2024-02-13T00:09:30.169 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-13T00:09:30.170 DEBUG:teuthology.run:Teuthology command: teuthology --description rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} --name lflores-2024-02-12_21:56:27-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi --verbose --archive /home/teuthworker/archive/lflores-2024-02-12_21:56:27-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7557134 --owner scheduled_lflores@teuthology -- /home/teuthworker/archive/lflores-2024-02-12_21:56:27-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7557134/orig.config.yaml 2024-02-13T00:09:30.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-13T00:09:30.295 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/lflores-2024-02-12_21:56:27-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7557134 branch: wip-yuri10-testing-2024-02-08-0854-pacific description: rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} email: null first_in_suite: false job_id: '7557134' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: lflores-2024-02-12_21:56:27-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri10-testing-2024-02-08-0854-pacific ceph: conf: client: debug ms: 1 global: mon election default strategy: 1 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd: debug ms: 1 debug osd: 20 osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(MON_DOWN\) - missing hit_sets - do not have an application enabled - application not enabled on pool - mons down sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 cephadm: cephadm_mode: cephadm-package install: ceph: flavor: default sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 extra_packages: - cephadm kernel: hwe: true workunit: branch: wip-tracker-64343-pacific sha1: 84e714279aa684636ac645daf0a1a85c2094cfb3 owner: scheduled_lflores@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a seed: 964 sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-tracker-64343-pacific suite_path: /home/teuthworker/src/github.com_ljflores_ceph_84e714279aa684636ac645daf0a1a85c2094cfb3/qa suite_relpath: qa suite_repo: https://github.com/ljflores/ceph.git suite_sha1: 84e714279aa684636ac645daf0a1a85c2094cfb3 targets: smithi080.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi106.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: d9fdb2209e15b39d9f061fd85399f352ce0f0894 timestamp: 2024-02-12_21:56:27 tube: smithi user: lflores verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-13T00:09:30.296 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ljflores_ceph_84e714279aa684636ac645daf0a1a85c2094cfb3/qa; will attempt to use it 2024-02-13T00:09:30.297 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ljflores_ceph_84e714279aa684636ac645daf0a1a85c2094cfb3/qa/tasks 2024-02-13T00:09:30.297 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-13T00:09:30.299 INFO:teuthology.task.internal:Checking packages... 2024-02-13T00:09:30.339 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '0e714d9a4bd2a821113e6318adb87bd06cf81ec1' 2024-02-13T00:09:30.339 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-13T00:09:30.339 INFO:teuthology.packaging:ref: None 2024-02-13T00:09:30.339 INFO:teuthology.packaging:tag: None 2024-02-13T00:09:30.339 INFO:teuthology.packaging:branch: wip-yuri10-testing-2024-02-08-0854-pacific 2024-02-13T00:09:30.340 INFO:teuthology.packaging:sha1: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-13T00:09:30.340 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri10-testing-2024-02-08-0854-pacific 2024-02-13T00:09:30.935 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-521-g0e714d9a-1focal 2024-02-13T00:09:30.937 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-13T00:09:30.943 INFO:teuthology.task.internal:no buildpackages task found 2024-02-13T00:09:30.943 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-13T00:09:31.039 INFO:teuthology.task.internal:Saving configuration 2024-02-13T00:09:31.051 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-13T00:09:31.057 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-13T00:09:31.083 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-02-12_21:56:27-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7557134', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-13 00:03:30.530224', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-02-13T00:09:31.106 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-02-12_21:56:27-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7557134', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-13 00:03:30.531748', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-02-13T00:09:31.107 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-13T00:09:31.114 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2024-02-13T00:09:31.114 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2024-02-13T00:09:31.114 INFO:teuthology.run_tasks:Running task console_log... 2024-02-13T00:09:31.185 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f12244e60d0>, signals=[15]) 2024-02-13T00:09:31.186 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-13T00:09:31.193 INFO:teuthology.task.internal:Opening connections... 2024-02-13T00:09:31.193 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi080.front.sepia.ceph.com 2024-02-13T00:09:31.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-13T00:09:31.296 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi106.front.sepia.ceph.com 2024-02-13T00:09:31.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-13T00:09:31.384 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-13T00:09:31.391 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-02-13T00:09:31.398 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-02-13T00:09:31.398 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-02-13T00:09:31.447 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="Ubuntu" 2024-02-13T00:09:31.447 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-02-13T00:09:31.447 INFO:teuthology.orchestra.run.smithi080.stdout:ID=ubuntu 2024-02-13T00:09:31.447 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE=debian 2024-02-13T00:09:31.447 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-02-13T00:09:31.447 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="20.04" 2024-02-13T00:09:31.448 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-13T00:09:31.448 INFO:teuthology.orchestra.run.smithi080.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-13T00:09:31.448 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-13T00:09:31.448 INFO:teuthology.orchestra.run.smithi080.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-13T00:09:31.448 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_CODENAME=focal 2024-02-13T00:09:31.448 INFO:teuthology.orchestra.run.smithi080.stdout:UBUNTU_CODENAME=focal 2024-02-13T00:09:31.449 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-02-13T00:09:31.472 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2024-02-13T00:09:31.479 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2024-02-13T00:09:31.479 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-02-13T00:09:31.532 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="Ubuntu" 2024-02-13T00:09:31.532 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-02-13T00:09:31.533 INFO:teuthology.orchestra.run.smithi106.stdout:ID=ubuntu 2024-02-13T00:09:31.533 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE=debian 2024-02-13T00:09:31.533 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-02-13T00:09:31.533 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="20.04" 2024-02-13T00:09:31.533 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-13T00:09:31.533 INFO:teuthology.orchestra.run.smithi106.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-13T00:09:31.533 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-13T00:09:31.533 INFO:teuthology.orchestra.run.smithi106.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-13T00:09:31.533 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_CODENAME=focal 2024-02-13T00:09:31.533 INFO:teuthology.orchestra.run.smithi106.stdout:UBUNTU_CODENAME=focal 2024-02-13T00:09:31.533 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-02-13T00:09:31.564 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-13T00:09:31.573 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-13T00:09:31.580 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-13T00:09:31.580 DEBUG:teuthology.orchestra.run.smithi080:> test '!' -e /home/ubuntu/cephtest 2024-02-13T00:09:31.582 DEBUG:teuthology.orchestra.run.smithi106:> test '!' -e /home/ubuntu/cephtest 2024-02-13T00:09:31.588 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-13T00:09:31.594 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-13T00:09:31.594 DEBUG:teuthology.orchestra.run.smithi080:> test -z $(ls -A /var/lib/ceph) 2024-02-13T00:09:31.596 DEBUG:teuthology.orchestra.run.smithi106:> test -z $(ls -A /var/lib/ceph) 2024-02-13T00:09:31.624 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-13T00:09:31.683 INFO:teuthology.run_tasks:Running task kernel... 2024-02-13T00:09:31.753 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-13T00:09:31.753 INFO:teuthology.task.kernel:normalize config orig: {'hwe': True} 2024-02-13T00:09:31.753 DEBUG:teuthology.task.kernel:normalized overrides {'mon.a': {'hwe': True}, 'mon.c': {'hwe': True}, 'mgr.y': {'hwe': True}, 'osd.0': {'hwe': True}, 'osd.1': {'hwe': True}, 'osd.2': {'hwe': True}, 'osd.3': {'hwe': True}, 'client.0': {'hwe': True}, 'ceph.rgw.foo.a': {'hwe': True}, 'node-exporter.a': {'hwe': True}, 'alertmanager.a': {'hwe': True}, 'mon.b': {'hwe': True}, 'mgr.x': {'hwe': True}, 'osd.4': {'hwe': True}, 'osd.5': {'hwe': True}, 'osd.6': {'hwe': True}, 'osd.7': {'hwe': True}, 'client.1': {'hwe': True}, 'prometheus.a': {'hwe': True}, 'grafana.a': {'hwe': True}, 'node-exporter.b': {'hwe': True}, 'ceph.iscsi.iscsi.a': {'hwe': True}} 2024-02-13T00:09:31.753 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro', 'hwe': True}, 'mon.b': {'kdb': True, 'sha1': 'distro', 'hwe': True}}, timeout 300 2024-02-13T00:09:31.753 DEBUG:teuthology.orchestra.run.smithi080:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-13T00:09:31.754 DEBUG:teuthology.orchestra.run.smithi106:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-13T00:09:31.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-13T00:09:31.760 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-02-13T00:09:31.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-13T00:09:31.761 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2024-02-13T00:09:31.767 INFO:teuthology.orchestra.run.smithi080.stdout:5.4.0-124-generic 2024-02-13T00:09:31.767 INFO:teuthology.task.kernel:Running kernel on smithi080: 5.4.0-124-generic 2024-02-13T00:09:31.767 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get clean 2024-02-13T00:09:31.768 INFO:teuthology.orchestra.run.smithi106.stdout:5.4.0-124-generic 2024-02-13T00:09:31.768 INFO:teuthology.task.kernel:Running kernel on smithi106: 5.4.0-124-generic 2024-02-13T00:09:31.768 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get clean 2024-02-13T00:09:31.864 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get update 2024-02-13T00:09:31.867 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get update 2024-02-13T00:09:32.084 INFO:teuthology.orchestra.run.smithi106.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-02-13T00:09:32.123 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-02-13T00:09:32.144 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-02-13T00:09:32.179 INFO:teuthology.orchestra.run.smithi080.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-02-13T00:09:32.184 INFO:teuthology.orchestra.run.smithi080.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-02-13T00:09:32.208 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-02-13T00:09:32.351 INFO:teuthology.orchestra.run.smithi080.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-02-13T00:09:32.542 INFO:teuthology.orchestra.run.smithi080.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,713 kB] 2024-02-13T00:09:32.549 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-02-13T00:09:32.583 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,713 kB] 2024-02-13T00:09:32.662 INFO:teuthology.orchestra.run.smithi080.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,094 kB] 2024-02-13T00:09:32.749 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,094 kB] 2024-02-13T00:09:33.059 INFO:teuthology.orchestra.run.smithi080.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [706 kB] 2024-02-13T00:09:33.068 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [706 kB] 2024-02-13T00:09:33.083 INFO:teuthology.orchestra.run.smithi080.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [413 kB] 2024-02-13T00:09:33.092 INFO:teuthology.orchestra.run.smithi080.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [932 kB] 2024-02-13T00:09:33.099 INFO:teuthology.orchestra.run.smithi080.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-02-13T00:09:33.099 INFO:teuthology.orchestra.run.smithi080.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [35.5 kB] 2024-02-13T00:09:33.101 INFO:teuthology.orchestra.run.smithi080.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,552 kB] 2024-02-13T00:09:33.170 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [413 kB] 2024-02-13T00:09:33.222 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [932 kB] 2024-02-13T00:09:33.239 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [496 kB] 2024-02-13T00:09:33.248 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-02-13T00:09:33.248 INFO:teuthology.orchestra.run.smithi106.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,669 kB] 2024-02-13T00:09:33.304 INFO:teuthology.orchestra.run.smithi080.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [496 kB] 2024-02-13T00:09:33.322 INFO:teuthology.orchestra.run.smithi106.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-02-13T00:09:33.323 INFO:teuthology.orchestra.run.smithi106.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [35.5 kB] 2024-02-13T00:09:33.324 INFO:teuthology.orchestra.run.smithi106.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,552 kB] 2024-02-13T00:09:33.328 INFO:teuthology.orchestra.run.smithi106.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [36.8 kB] 2024-02-13T00:09:33.328 INFO:teuthology.orchestra.run.smithi106.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [372 kB] 2024-02-13T00:09:33.335 INFO:teuthology.orchestra.run.smithi106.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-02-13T00:09:33.338 INFO:teuthology.orchestra.run.smithi080.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-02-13T00:09:33.339 INFO:teuthology.orchestra.run.smithi080.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [36.8 kB] 2024-02-13T00:09:33.340 INFO:teuthology.orchestra.run.smithi080.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,669 kB] 2024-02-13T00:09:33.372 INFO:teuthology.orchestra.run.smithi080.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [356 kB] 2024-02-13T00:09:33.390 INFO:teuthology.orchestra.run.smithi080.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-02-13T00:09:33.390 INFO:teuthology.orchestra.run.smithi080.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [645 kB] 2024-02-13T00:09:33.411 INFO:teuthology.orchestra.run.smithi080.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [937 kB] 2024-02-13T00:09:33.423 INFO:teuthology.orchestra.run.smithi106.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [356 kB] 2024-02-13T00:09:33.426 INFO:teuthology.orchestra.run.smithi106.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-02-13T00:09:33.426 INFO:teuthology.orchestra.run.smithi106.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [645 kB] 2024-02-13T00:09:33.443 INFO:teuthology.orchestra.run.smithi080.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [372 kB] 2024-02-13T00:09:33.498 INFO:teuthology.orchestra.run.smithi106.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [772 kB] 2024-02-13T00:09:33.507 INFO:teuthology.orchestra.run.smithi080.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [197 kB] 2024-02-13T00:09:33.510 INFO:teuthology.orchestra.run.smithi080.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-02-13T00:09:33.511 INFO:teuthology.orchestra.run.smithi080.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [772 kB] 2024-02-13T00:09:33.512 INFO:teuthology.orchestra.run.smithi080.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-02-13T00:09:33.512 INFO:teuthology.orchestra.run.smithi080.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.9 kB] 2024-02-13T00:09:33.513 INFO:teuthology.orchestra.run.smithi080.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,188 B] 2024-02-13T00:09:33.513 INFO:teuthology.orchestra.run.smithi080.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,796 B] 2024-02-13T00:09:33.513 INFO:teuthology.orchestra.run.smithi080.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-02-13T00:09:33.519 INFO:teuthology.orchestra.run.smithi106.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [937 kB] 2024-02-13T00:09:33.524 INFO:teuthology.orchestra.run.smithi080.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,163 kB] 2024-02-13T00:09:33.529 INFO:teuthology.orchestra.run.smithi106.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [197 kB] 2024-02-13T00:09:33.541 INFO:teuthology.orchestra.run.smithi106.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-02-13T00:09:33.543 INFO:teuthology.orchestra.run.smithi106.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.9 kB] 2024-02-13T00:09:33.545 INFO:teuthology.orchestra.run.smithi106.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,188 B] 2024-02-13T00:09:33.545 INFO:teuthology.orchestra.run.smithi106.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,796 B] 2024-02-13T00:09:33.545 INFO:teuthology.orchestra.run.smithi106.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-02-13T00:09:33.602 INFO:teuthology.orchestra.run.smithi080.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [279 kB] 2024-02-13T00:09:33.625 INFO:teuthology.orchestra.run.smithi080.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-02-13T00:09:33.630 INFO:teuthology.orchestra.run.smithi080.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.1 kB] 2024-02-13T00:09:33.632 INFO:teuthology.orchestra.run.smithi080.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2024-02-13T00:09:33.633 INFO:teuthology.orchestra.run.smithi080.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,768 B] 2024-02-13T00:09:33.633 INFO:teuthology.orchestra.run.smithi080.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-02-13T00:09:33.634 INFO:teuthology.orchestra.run.smithi080.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-02-13T00:09:33.636 INFO:teuthology.orchestra.run.smithi080.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-02-13T00:09:33.639 INFO:teuthology.orchestra.run.smithi080.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-02-13T00:09:33.646 INFO:teuthology.orchestra.run.smithi080.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-02-13T00:09:33.679 INFO:teuthology.orchestra.run.smithi080.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-02-13T00:09:33.680 INFO:teuthology.orchestra.run.smithi080.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-02-13T00:09:34.094 INFO:teuthology.orchestra.run.smithi106.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,163 kB] 2024-02-13T00:09:34.204 INFO:teuthology.orchestra.run.smithi106.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [279 kB] 2024-02-13T00:09:34.225 INFO:teuthology.orchestra.run.smithi106.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-02-13T00:09:34.227 INFO:teuthology.orchestra.run.smithi106.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.1 kB] 2024-02-13T00:09:34.228 INFO:teuthology.orchestra.run.smithi106.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2024-02-13T00:09:34.229 INFO:teuthology.orchestra.run.smithi106.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,768 B] 2024-02-13T00:09:34.229 INFO:teuthology.orchestra.run.smithi106.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-02-13T00:09:34.230 INFO:teuthology.orchestra.run.smithi106.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-02-13T00:09:34.232 INFO:teuthology.orchestra.run.smithi106.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-02-13T00:09:34.235 INFO:teuthology.orchestra.run.smithi106.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-02-13T00:09:34.399 INFO:teuthology.orchestra.run.smithi106.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-02-13T00:09:34.591 INFO:teuthology.orchestra.run.smithi106.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-02-13T00:09:34.614 INFO:teuthology.orchestra.run.smithi106.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-02-13T00:09:36.972 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 19.0 MB in 3s (5,928 kB/s) 2024-02-13T00:09:37.075 INFO:teuthology.orchestra.run.smithi080.stdout:Fetched 19.0 MB in 3s (5,985 kB/s) 2024-02-13T00:09:38.431 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-02-13T00:09:38.455 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic-hwe-20.04 2024-02-13T00:09:38.522 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-02-13T00:09:38.583 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-02-13T00:09:38.610 DEBUG:teuthology.orchestra.run.smithi080:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic-hwe-20.04 2024-02-13T00:09:38.683 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-02-13T00:09:38.728 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2024-02-13T00:09:38.728 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2024-02-13T00:09:38.888 INFO:teuthology.orchestra.run.smithi080.stdout:Building dependency tree... 2024-02-13T00:09:38.889 INFO:teuthology.orchestra.run.smithi080.stdout:Reading state information... 2024-02-13T00:09:38.909 INFO:teuthology.orchestra.run.smithi106.stdout:The following additional packages will be installed: 2024-02-13T00:09:38.909 INFO:teuthology.orchestra.run.smithi106.stdout: libdbus-glib-1-2 libevdev2 libimobiledevice6 libplist3 libupower-glib3 2024-02-13T00:09:38.909 INFO:teuthology.orchestra.run.smithi106.stdout: libusbmuxd6 linux-image-5.15.0-94-generic linux-modules-5.15.0-94-generic 2024-02-13T00:09:38.910 INFO:teuthology.orchestra.run.smithi106.stdout: linux-modules-extra-5.15.0-94-generic thermald upower usbmuxd 2024-02-13T00:09:38.911 INFO:teuthology.orchestra.run.smithi106.stdout:Suggested packages: 2024-02-13T00:09:38.911 INFO:teuthology.orchestra.run.smithi106.stdout: libusbmuxd-tools fdutils linux-doc | linux-hwe-5.15-source-5.15.0 2024-02-13T00:09:38.911 INFO:teuthology.orchestra.run.smithi106.stdout: linux-hwe-5.15-tools linux-headers-5.15.0-94-generic 2024-02-13T00:09:38.960 INFO:teuthology.orchestra.run.smithi106.stdout:The following NEW packages will be installed: 2024-02-13T00:09:38.961 INFO:teuthology.orchestra.run.smithi106.stdout: libdbus-glib-1-2 libevdev2 libimobiledevice6 libplist3 libupower-glib3 2024-02-13T00:09:38.961 INFO:teuthology.orchestra.run.smithi106.stdout: libusbmuxd6 linux-image-5.15.0-94-generic linux-image-generic-hwe-20.04 2024-02-13T00:09:38.961 INFO:teuthology.orchestra.run.smithi106.stdout: linux-modules-5.15.0-94-generic linux-modules-extra-5.15.0-94-generic 2024-02-13T00:09:38.961 INFO:teuthology.orchestra.run.smithi106.stdout: thermald upower usbmuxd 2024-02-13T00:09:39.066 INFO:teuthology.orchestra.run.smithi080.stdout:The following additional packages will be installed: 2024-02-13T00:09:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: libdbus-glib-1-2 libevdev2 libimobiledevice6 libplist3 libupower-glib3 2024-02-13T00:09:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: libusbmuxd6 linux-image-5.15.0-94-generic linux-modules-5.15.0-94-generic 2024-02-13T00:09:39.066 INFO:teuthology.orchestra.run.smithi080.stdout: linux-modules-extra-5.15.0-94-generic thermald upower usbmuxd 2024-02-13T00:09:39.067 INFO:teuthology.orchestra.run.smithi080.stdout:Suggested packages: 2024-02-13T00:09:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: libusbmuxd-tools fdutils linux-doc | linux-hwe-5.15-source-5.15.0 2024-02-13T00:09:39.068 INFO:teuthology.orchestra.run.smithi080.stdout: linux-hwe-5.15-tools linux-headers-5.15.0-94-generic 2024-02-13T00:09:39.073 INFO:teuthology.orchestra.run.smithi106.stdout:0 upgraded, 13 newly installed, 0 to remove and 288 not upgraded. 2024-02-13T00:09:39.074 INFO:teuthology.orchestra.run.smithi106.stdout:Need to get 90.9 MB of archives. 2024-02-13T00:09:39.074 INFO:teuthology.orchestra.run.smithi106.stdout:After this operation, 497 MB of additional disk space will be used. 2024-02-13T00:09:39.074 INFO:teuthology.orchestra.run.smithi106.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 libdbus-glib-1-2 amd64 0.110-5fakssync1 [59.1 kB] 2024-02-13T00:09:39.123 INFO:teuthology.orchestra.run.smithi080.stdout:The following NEW packages will be installed: 2024-02-13T00:09:39.124 INFO:teuthology.orchestra.run.smithi080.stdout: libdbus-glib-1-2 libevdev2 libimobiledevice6 libplist3 libupower-glib3 2024-02-13T00:09:39.124 INFO:teuthology.orchestra.run.smithi080.stdout: libusbmuxd6 linux-image-5.15.0-94-generic linux-image-generic-hwe-20.04 2024-02-13T00:09:39.124 INFO:teuthology.orchestra.run.smithi080.stdout: linux-modules-5.15.0-94-generic linux-modules-extra-5.15.0-94-generic 2024-02-13T00:09:39.125 INFO:teuthology.orchestra.run.smithi080.stdout: thermald upower usbmuxd 2024-02-13T00:09:39.239 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 libplist3 amd64 2.1.0-4build2 [31.6 kB] 2024-02-13T00:09:39.252 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 libusbmuxd6 amd64 2.0.1-2 [19.1 kB] 2024-02-13T00:09:39.254 INFO:teuthology.orchestra.run.smithi080.stdout:0 upgraded, 13 newly installed, 0 to remove and 288 not upgraded. 2024-02-13T00:09:39.254 INFO:teuthology.orchestra.run.smithi080.stdout:Need to get 90.9 MB of archives. 2024-02-13T00:09:39.255 INFO:teuthology.orchestra.run.smithi080.stdout:After this operation, 497 MB of additional disk space will be used. 2024-02-13T00:09:39.255 INFO:teuthology.orchestra.run.smithi080.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 libdbus-glib-1-2 amd64 0.110-5fakssync1 [59.1 kB] 2024-02-13T00:09:39.263 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 libimobiledevice6 amd64 1.2.1~git20191129.9f79242-1build1 [65.2 kB] 2024-02-13T00:09:39.364 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 libupower-glib3 amd64 0.99.11-1build2 [43.2 kB] 2024-02-13T00:09:39.368 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.15.0-94-generic amd64 5.15.0-94.104~20.04.1 [21.0 MB] 2024-02-13T00:09:39.408 INFO:teuthology.orchestra.run.smithi080.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 libplist3 amd64 2.1.0-4build2 [31.6 kB] 2024-02-13T00:09:39.425 INFO:teuthology.orchestra.run.smithi080.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 libusbmuxd6 amd64 2.0.1-2 [19.1 kB] 2024-02-13T00:09:39.436 INFO:teuthology.orchestra.run.smithi080.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 libimobiledevice6 amd64 1.2.1~git20191129.9f79242-1build1 [65.2 kB] 2024-02-13T00:09:39.481 INFO:teuthology.orchestra.run.smithi080.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 libupower-glib3 amd64 0.99.11-1build2 [43.2 kB] 2024-02-13T00:09:39.493 INFO:teuthology.orchestra.run.smithi080.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.15.0-94-generic amd64 5.15.0-94.104~20.04.1 [21.0 MB] 2024-02-13T00:09:40.478 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.15.0-94-generic amd64 5.15.0-94.104~20.04.1 [11.4 MB] 2024-02-13T00:09:40.911 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.15.0-94-generic amd64 5.15.0-94.104~20.04.1 [57.9 MB] 2024-02-13T00:09:41.009 INFO:teuthology.orchestra.run.smithi080.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.15.0-94-generic amd64 5.15.0-94.104~20.04.1 [11.4 MB] 2024-02-13T00:09:41.484 INFO:teuthology.orchestra.run.smithi080.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.15.0-94-generic amd64 5.15.0-94.104~20.04.1 [57.9 MB] 2024-02-13T00:09:42.932 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic-hwe-20.04 amd64 5.15.0.94.104~20.04.50 [2,596 B] 2024-02-13T00:09:43.006 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libevdev2 amd64 1.9.0+dfsg-1ubuntu0.2 [31.6 kB] 2024-02-13T00:09:43.007 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 thermald amd64 1.9.1-1ubuntu0.6 [233 kB] 2024-02-13T00:09:43.013 INFO:teuthology.orchestra.run.smithi106.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 upower amd64 0.99.11-1build2 [104 kB] 2024-02-13T00:09:43.015 INFO:teuthology.orchestra.run.smithi106.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 usbmuxd amd64 1.1.1~git20191130.9af2b12-1 [38.4 kB] 2024-02-13T00:09:43.670 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 90.9 MB in 4s (22.5 MB/s) 2024-02-13T00:09:43.883 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libdbus-glib-1-2:amd64. 2024-02-13T00:09:44.004 INFO:teuthology.orchestra.run.smithi080.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic-hwe-20.04 amd64 5.15.0.94.104~20.04.50 [2,596 B] 2024-02-13T00:09:44.004 INFO:teuthology.orchestra.run.smithi080.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libevdev2 amd64 1.9.0+dfsg-1ubuntu0.2 [31.6 kB] 2024-02-13T00:09:44.005 INFO:teuthology.orchestra.run.smithi080.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 thermald amd64 1.9.1-1ubuntu0.6 [233 kB] 2024-02-13T00:09:44.010 INFO:teuthology.orchestra.run.smithi080.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 upower amd64 0.99.11-1build2 [104 kB] 2024-02-13T00:09:44.177 INFO:teuthology.orchestra.run.smithi080.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 usbmuxd amd64 1.1.1~git20191130.9af2b12-1 [38.4 kB] 2024-02-13T00:09:44.978 INFO:teuthology.orchestra.run.smithi080.stdout:Fetched 90.9 MB in 5s (17.6 MB/s) 2024-02-13T00:09:45.200 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libdbus-glib-1-2:amd64. 2024-02-13T00:09:45.632 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-02-13T00:09:45.637 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../00-libdbus-glib-1-2_0.110-5fakssync1_amd64.deb ... 2024-02-13T00:09:45.764 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libdbus-glib-1-2:amd64 (0.110-5fakssync1) ... 2024-02-13T00:09:46.125 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libplist3:amd64. 2024-02-13T00:09:46.139 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../01-libplist3_2.1.0-4build2_amd64.deb ... 2024-02-13T00:09:46.183 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libplist3:amd64 (2.1.0-4build2) ... 2024-02-13T00:09:46.528 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libusbmuxd6:amd64. 2024-02-13T00:09:46.543 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../02-libusbmuxd6_2.0.1-2_amd64.deb ... 2024-02-13T00:09:46.586 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libusbmuxd6:amd64 (2.0.1-2) ... 2024-02-13T00:09:46.914 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libimobiledevice6:amd64. 2024-02-13T00:09:46.927 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../03-libimobiledevice6_1.2.1~git20191129.9f79242-1build1_amd64.deb ... 2024-02-13T00:09:46.964 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libimobiledevice6:amd64 (1.2.1~git20191129.9f79242-1build1) ... 2024-02-13T00:09:47.008 INFO:teuthology.orchestra.run.smithi080.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-02-13T00:09:47.013 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../00-libdbus-glib-1-2_0.110-5fakssync1_amd64.deb ... 2024-02-13T00:09:47.198 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libdbus-glib-1-2:amd64 (0.110-5fakssync1) ... 2024-02-13T00:09:47.309 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libupower-glib3:amd64. 2024-02-13T00:09:47.323 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../04-libupower-glib3_0.99.11-1build2_amd64.deb ... 2024-02-13T00:09:47.384 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libupower-glib3:amd64 (0.99.11-1build2) ... 2024-02-13T00:09:47.593 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libplist3:amd64. 2024-02-13T00:09:47.606 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../01-libplist3_2.1.0-4build2_amd64.deb ... 2024-02-13T00:09:47.643 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libplist3:amd64 (2.1.0-4build2) ... 2024-02-13T00:09:47.695 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-modules-5.15.0-94-generic. 2024-02-13T00:09:47.710 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../05-linux-modules-5.15.0-94-generic_5.15.0-94.104~20.04.1_amd64.deb ... 2024-02-13T00:09:47.753 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-modules-5.15.0-94-generic (5.15.0-94.104~20.04.1) ... 2024-02-13T00:09:48.005 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libusbmuxd6:amd64. 2024-02-13T00:09:48.018 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../02-libusbmuxd6_2.0.1-2_amd64.deb ... 2024-02-13T00:09:48.054 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libusbmuxd6:amd64 (2.0.1-2) ... 2024-02-13T00:09:48.408 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libimobiledevice6:amd64. 2024-02-13T00:09:48.422 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../03-libimobiledevice6_1.2.1~git20191129.9f79242-1build1_amd64.deb ... 2024-02-13T00:09:48.466 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libimobiledevice6:amd64 (1.2.1~git20191129.9f79242-1build1) ... 2024-02-13T00:09:48.770 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libupower-glib3:amd64. 2024-02-13T00:09:48.784 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../04-libupower-glib3_0.99.11-1build2_amd64.deb ... 2024-02-13T00:09:48.847 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libupower-glib3:amd64 (0.99.11-1build2) ... 2024-02-13T00:09:49.206 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-modules-5.15.0-94-generic. 2024-02-13T00:09:49.219 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../05-linux-modules-5.15.0-94-generic_5.15.0-94.104~20.04.1_amd64.deb ... 2024-02-13T00:09:49.256 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-modules-5.15.0-94-generic (5.15.0-94.104~20.04.1) ... 2024-02-13T00:09:50.263 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-image-5.15.0-94-generic. 2024-02-13T00:09:50.276 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../06-linux-image-5.15.0-94-generic_5.15.0-94.104~20.04.1_amd64.deb ... 2024-02-13T00:09:50.380 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-image-5.15.0-94-generic (5.15.0-94.104~20.04.1) ... 2024-02-13T00:09:50.907 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-94-generic. 2024-02-13T00:09:50.922 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../07-linux-modules-extra-5.15.0-94-generic_5.15.0-94.104~20.04.1_amd64.deb ... 2024-02-13T00:09:50.965 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-modules-extra-5.15.0-94-generic (5.15.0-94.104~20.04.1) ... 2024-02-13T00:09:51.975 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-image-5.15.0-94-generic. 2024-02-13T00:09:51.990 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../06-linux-image-5.15.0-94-generic_5.15.0-94.104~20.04.1_amd64.deb ... 2024-02-13T00:09:52.103 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-image-5.15.0-94-generic (5.15.0-94.104~20.04.1) ... 2024-02-13T00:09:52.629 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-94-generic. 2024-02-13T00:09:52.642 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../07-linux-modules-extra-5.15.0-94-generic_5.15.0-94.104~20.04.1_amd64.deb ... 2024-02-13T00:09:52.687 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-modules-extra-5.15.0-94-generic (5.15.0-94.104~20.04.1) ... 2024-02-13T00:09:58.118 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-image-generic-hwe-20.04. 2024-02-13T00:09:58.133 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../08-linux-image-generic-hwe-20.04_5.15.0.94.104~20.04.50_amd64.deb ... 2024-02-13T00:09:58.175 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-image-generic-hwe-20.04 (5.15.0.94.104~20.04.50) ... 2024-02-13T00:09:58.495 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libevdev2:amd64. 2024-02-13T00:09:58.510 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../09-libevdev2_1.9.0+dfsg-1ubuntu0.2_amd64.deb ... 2024-02-13T00:09:58.553 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libevdev2:amd64 (1.9.0+dfsg-1ubuntu0.2) ... 2024-02-13T00:09:58.973 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package thermald. 2024-02-13T00:09:58.987 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../10-thermald_1.9.1-1ubuntu0.6_amd64.deb ... 2024-02-13T00:09:59.031 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking thermald (1.9.1-1ubuntu0.6) ... 2024-02-13T00:09:59.544 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package upower. 2024-02-13T00:09:59.561 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../11-upower_0.99.11-1build2_amd64.deb ... 2024-02-13T00:09:59.616 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking upower (0.99.11-1build2) ... 2024-02-13T00:09:59.870 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package linux-image-generic-hwe-20.04. 2024-02-13T00:09:59.886 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../08-linux-image-generic-hwe-20.04_5.15.0.94.104~20.04.50_amd64.deb ... 2024-02-13T00:09:59.928 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking linux-image-generic-hwe-20.04 (5.15.0.94.104~20.04.50) ... 2024-02-13T00:10:00.040 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package usbmuxd. 2024-02-13T00:10:00.056 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../12-usbmuxd_1.1.1~git20191130.9af2b12-1_amd64.deb ... 2024-02-13T00:10:00.098 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking usbmuxd (1.1.1~git20191130.9af2b12-1) ... 2024-02-13T00:10:00.272 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libevdev2:amd64. 2024-02-13T00:10:00.286 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../09-libevdev2_1.9.0+dfsg-1ubuntu0.2_amd64.deb ... 2024-02-13T00:10:00.356 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libevdev2:amd64 (1.9.0+dfsg-1ubuntu0.2) ... 2024-02-13T00:10:00.396 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libplist3:amd64 (2.1.0-4build2) ... 2024-02-13T00:10:00.511 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libdbus-glib-1-2:amd64 (0.110-5fakssync1) ... 2024-02-13T00:10:00.637 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libusbmuxd6:amd64 (2.0.1-2) ... 2024-02-13T00:10:00.742 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package thermald. 2024-02-13T00:10:00.754 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libupower-glib3:amd64 (0.99.11-1build2) ... 2024-02-13T00:10:00.757 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../10-thermald_1.9.1-1ubuntu0.6_amd64.deb ... 2024-02-13T00:10:00.800 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking thermald (1.9.1-1ubuntu0.6) ... 2024-02-13T00:10:00.881 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libimobiledevice6:amd64 (1.2.1~git20191129.9f79242-1build1) ... 2024-02-13T00:10:01.032 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libevdev2:amd64 (1.9.0+dfsg-1ubuntu0.2) ... 2024-02-13T00:10:01.174 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up upower (0.99.11-1build2) ... 2024-02-13T00:10:01.372 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package upower. 2024-02-13T00:10:01.388 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../11-upower_0.99.11-1build2_amd64.deb ... 2024-02-13T00:10:01.444 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking upower (0.99.11-1build2) ... 2024-02-13T00:10:01.710 INFO:teuthology.orchestra.run.smithi106.stdout:upower.service is a disabled or a static unit, not starting it. 2024-02-13T00:10:01.761 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up usbmuxd (1.1.1~git20191130.9af2b12-1) ... 2024-02-13T00:10:01.859 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package usbmuxd. 2024-02-13T00:10:01.873 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../12-usbmuxd_1.1.1~git20191130.9af2b12-1_amd64.deb ... 2024-02-13T00:10:01.909 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking usbmuxd (1.1.1~git20191130.9af2b12-1) ... 2024-02-13T00:10:01.940 INFO:teuthology.orchestra.run.smithi106.stdout:Warning: The home dir /var/lib/usbmux you specified can't be accessed: No such file or directory 2024-02-13T00:10:01.947 INFO:teuthology.orchestra.run.smithi106.stdout:Adding system user `usbmux' (UID 114) ... 2024-02-13T00:10:01.947 INFO:teuthology.orchestra.run.smithi106.stdout:Adding new user `usbmux' (UID 114) with group `plugdev' ... 2024-02-13T00:10:02.224 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libplist3:amd64 (2.1.0-4build2) ... 2024-02-13T00:10:02.355 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libdbus-glib-1-2:amd64 (0.110-5fakssync1) ... 2024-02-13T00:10:02.445 INFO:teuthology.orchestra.run.smithi106.stdout:Not creating home directory `/var/lib/usbmux'. 2024-02-13T00:10:02.481 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libusbmuxd6:amd64 (2.0.1-2) ... 2024-02-13T00:10:02.641 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libupower-glib3:amd64 (0.99.11-1build2) ... 2024-02-13T00:10:02.656 INFO:teuthology.orchestra.run.smithi106.stdout:usbmuxd.service is a disabled or a static unit, not starting it. 2024-02-13T00:10:02.708 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up thermald (1.9.1-1ubuntu0.6) ... 2024-02-13T00:10:02.767 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libimobiledevice6:amd64 (1.2.1~git20191129.9f79242-1build1) ... 2024-02-13T00:10:02.893 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libevdev2:amd64 (1.9.0+dfsg-1ubuntu0.2) ... 2024-02-13T00:10:03.017 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.thermald.service -> /lib/systemd/system/thermald.service. 2024-02-13T00:10:03.018 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/thermald.service -> /lib/systemd/system/thermald.service. 2024-02-13T00:10:03.052 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up upower (0.99.11-1build2) ... 2024-02-13T00:10:03.480 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-image-5.15.0-94-generic (5.15.0-94.104~20.04.1) ... 2024-02-13T00:10:03.613 INFO:teuthology.orchestra.run.smithi080.stdout:upower.service is a disabled or a static unit, not starting it. 2024-02-13T00:10:03.665 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up usbmuxd (1.1.1~git20191130.9af2b12-1) ... 2024-02-13T00:10:03.840 INFO:teuthology.orchestra.run.smithi080.stdout:Warning: The home dir /var/lib/usbmux you specified can't be accessed: No such file or directory 2024-02-13T00:10:03.851 INFO:teuthology.orchestra.run.smithi080.stdout:Adding system user `usbmux' (UID 114) ... 2024-02-13T00:10:03.851 INFO:teuthology.orchestra.run.smithi080.stdout:Adding new user `usbmux' (UID 114) with group `plugdev' ... 2024-02-13T00:10:04.390 INFO:teuthology.orchestra.run.smithi080.stdout:Not creating home directory `/var/lib/usbmux'. 2024-02-13T00:10:04.607 INFO:teuthology.orchestra.run.smithi080.stdout:usbmuxd.service is a disabled or a static unit, not starting it. 2024-02-13T00:10:04.653 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up thermald (1.9.1-1ubuntu0.6) ... 2024-02-13T00:10:04.793 INFO:teuthology.orchestra.run.smithi106.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-94-generic 2024-02-13T00:10:04.793 INFO:teuthology.orchestra.run.smithi106.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-94-generic 2024-02-13T00:10:04.939 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-modules-extra-5.15.0-94-generic (5.15.0-94.104~20.04.1) ... 2024-02-13T00:10:04.970 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.thermald.service -> /lib/systemd/system/thermald.service. 2024-02-13T00:10:04.970 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/thermald.service -> /lib/systemd/system/thermald.service. 2024-02-13T00:10:06.117 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-image-5.15.0-94-generic (5.15.0-94.104~20.04.1) ... 2024-02-13T00:10:06.308 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-image-generic-hwe-20.04 (5.15.0.94.104~20.04.50) ... 2024-02-13T00:10:06.433 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-modules-5.15.0-94-generic (5.15.0-94.104~20.04.1) ... 2024-02-13T00:10:07.591 INFO:teuthology.orchestra.run.smithi080.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-94-generic 2024-02-13T00:10:07.591 INFO:teuthology.orchestra.run.smithi080.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-94-generic 2024-02-13T00:10:07.751 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-modules-extra-5.15.0-94-generic (5.15.0-94.104~20.04.1) ... 2024-02-13T00:10:07.818 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-02-13T00:10:08.107 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-02-13T00:10:08.860 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-02-13T00:10:08.968 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for linux-image-5.15.0-94-generic (5.15.0-94.104~20.04.1) ... 2024-02-13T00:10:09.035 INFO:teuthology.orchestra.run.smithi106.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-02-13T00:10:09.035 INFO:teuthology.orchestra.run.smithi106.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-94-generic 2024-02-13T00:10:09.178 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-image-generic-hwe-20.04 (5.15.0.94.104~20.04.50) ... 2024-02-13T00:10:09.304 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up linux-modules-5.15.0-94-generic (5.15.0-94.104~20.04.1) ... 2024-02-13T00:10:10.664 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-02-13T00:10:10.969 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-02-13T00:10:12.380 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-02-13T00:10:12.506 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for linux-image-5.15.0-94-generic (5.15.0-94.104~20.04.1) ... 2024-02-13T00:10:12.568 INFO:teuthology.orchestra.run.smithi080.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-02-13T00:10:12.568 INFO:teuthology.orchestra.run.smithi080.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-94-generic 2024-02-13T00:10:34.235 INFO:teuthology.orchestra.run.smithi106.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-02-13T00:10:34.236 INFO:teuthology.orchestra.run.smithi106.stdout:Sourcing file `/etc/default/grub' 2024-02-13T00:10:34.246 INFO:teuthology.orchestra.run.smithi106.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-13T00:10:34.262 INFO:teuthology.orchestra.run.smithi106.stdout:Generating grub configuration file ... 2024-02-13T00:10:34.557 INFO:teuthology.orchestra.run.smithi106.stdout:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-13T00:10:34.582 INFO:teuthology.orchestra.run.smithi106.stdout:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-13T00:10:34.982 INFO:teuthology.orchestra.run.smithi106.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-02-13T00:10:35.041 INFO:teuthology.orchestra.run.smithi106.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-02-13T00:10:37.435 INFO:teuthology.orchestra.run.smithi106.stdout:done 2024-02-13T00:10:37.869 DEBUG:teuthology.orchestra.run.smithi106:> dpkg -s linux-image-generic-hwe-20.04 2024-02-13T00:10:37.917 INFO:teuthology.orchestra.run.smithi106.stdout:Package: linux-image-generic-hwe-20.04 2024-02-13T00:10:37.917 INFO:teuthology.orchestra.run.smithi106.stdout:Status: install ok installed 2024-02-13T00:10:37.917 INFO:teuthology.orchestra.run.smithi106.stdout:Priority: optional 2024-02-13T00:10:37.917 INFO:teuthology.orchestra.run.smithi106.stdout:Section: kernel 2024-02-13T00:10:37.917 INFO:teuthology.orchestra.run.smithi106.stdout:Installed-Size: 20 2024-02-13T00:10:37.917 INFO:teuthology.orchestra.run.smithi106.stdout:Maintainer: Ubuntu Kernel Team 2024-02-13T00:10:37.917 INFO:teuthology.orchestra.run.smithi106.stdout:Architecture: amd64 2024-02-13T00:10:37.917 INFO:teuthology.orchestra.run.smithi106.stdout:Source: linux-meta-hwe-5.15 2024-02-13T00:10:37.917 INFO:teuthology.orchestra.run.smithi106.stdout:Version: 5.15.0.94.104~20.04.50 2024-02-13T00:10:37.917 INFO:teuthology.orchestra.run.smithi106.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-13T00:10:37.917 INFO:teuthology.orchestra.run.smithi106.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-13T00:10:37.917 INFO:teuthology.orchestra.run.smithi106.stdout:Recommends: thermald 2024-02-13T00:10:37.918 INFO:teuthology.orchestra.run.smithi106.stdout:Description: Generic Linux kernel image 2024-02-13T00:10:37.918 INFO:teuthology.orchestra.run.smithi106.stdout: This package will always depend on the latest generic kernel image 2024-02-13T00:10:37.918 INFO:teuthology.orchestra.run.smithi106.stdout: available. 2024-02-13T00:10:37.918 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.15.0-94-generic 2024-02-13T00:10:37.918 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-13T00:10:37.918 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-13T00:10:37.918 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-02-13T00:10:37.918 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi106.front.sepia.ceph.com, path=None, version=distro) 2024-02-13T00:10:37.919 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get clean 2024-02-13T00:10:37.987 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get update 2024-02-13T00:10:38.146 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-02-13T00:10:38.157 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-02-13T00:10:38.185 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-02-13T00:10:38.235 INFO:teuthology.orchestra.run.smithi080.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-02-13T00:10:38.235 INFO:teuthology.orchestra.run.smithi080.stdout:Sourcing file `/etc/default/grub' 2024-02-13T00:10:38.238 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-02-13T00:10:38.244 INFO:teuthology.orchestra.run.smithi080.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-13T00:10:38.269 INFO:teuthology.orchestra.run.smithi080.stdout:Generating grub configuration file ... 2024-02-13T00:10:38.615 INFO:teuthology.orchestra.run.smithi080.stdout:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-13T00:10:38.634 INFO:teuthology.orchestra.run.smithi080.stdout:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-13T00:10:39.051 INFO:teuthology.orchestra.run.smithi080.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-02-13T00:10:39.063 INFO:teuthology.orchestra.run.smithi080.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-02-13T00:10:39.944 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-02-13T00:10:39.970 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic-hwe-20.04 2024-02-13T00:10:40.036 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-02-13T00:10:40.239 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2024-02-13T00:10:40.240 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2024-02-13T00:10:40.457 INFO:teuthology.orchestra.run.smithi106.stdout:linux-image-generic-hwe-20.04 is already the newest version (5.15.0.94.104~20.04.50). 2024-02-13T00:10:40.457 INFO:teuthology.orchestra.run.smithi106.stdout:0 upgraded, 0 newly installed, 0 to remove and 288 not upgraded. 2024-02-13T00:10:40.459 DEBUG:teuthology.orchestra.run.smithi106:> dpkg -s linux-image-generic-hwe-20.04 2024-02-13T00:10:40.479 INFO:teuthology.orchestra.run.smithi106.stdout:Package: linux-image-generic-hwe-20.04 2024-02-13T00:10:40.479 INFO:teuthology.orchestra.run.smithi106.stdout:Status: install ok installed 2024-02-13T00:10:40.479 INFO:teuthology.orchestra.run.smithi106.stdout:Priority: optional 2024-02-13T00:10:40.479 INFO:teuthology.orchestra.run.smithi106.stdout:Section: kernel 2024-02-13T00:10:40.479 INFO:teuthology.orchestra.run.smithi106.stdout:Installed-Size: 20 2024-02-13T00:10:40.479 INFO:teuthology.orchestra.run.smithi106.stdout:Maintainer: Ubuntu Kernel Team 2024-02-13T00:10:40.479 INFO:teuthology.orchestra.run.smithi106.stdout:Architecture: amd64 2024-02-13T00:10:40.479 INFO:teuthology.orchestra.run.smithi106.stdout:Source: linux-meta-hwe-5.15 2024-02-13T00:10:40.479 INFO:teuthology.orchestra.run.smithi106.stdout:Version: 5.15.0.94.104~20.04.50 2024-02-13T00:10:40.480 INFO:teuthology.orchestra.run.smithi106.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-13T00:10:40.480 INFO:teuthology.orchestra.run.smithi106.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-13T00:10:40.480 INFO:teuthology.orchestra.run.smithi106.stdout:Recommends: thermald 2024-02-13T00:10:40.480 INFO:teuthology.orchestra.run.smithi106.stdout:Description: Generic Linux kernel image 2024-02-13T00:10:40.480 INFO:teuthology.orchestra.run.smithi106.stdout: This package will always depend on the latest generic kernel image 2024-02-13T00:10:40.480 INFO:teuthology.orchestra.run.smithi106.stdout: available. 2024-02-13T00:10:40.480 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-02-13T00:10:40.487 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.cxRqjYVFit 2024-02-13T00:10:40.487 DEBUG:teuthology.orchestra.run.smithi106:> sudo cp /boot/grub/grub.cfg /tmp/tmp.cxRqjYVFit 2024-02-13T00:10:40.544 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.cxRqjYVFit 2024-02-13T00:10:40.589 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.cxRqjYVFit is 9KB 2024-02-13T00:10:40.603 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.cxRqjYVFit 2024-02-13T00:10:40.610 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-02-13T00:10:40.665 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-02-13T00:10:40.665 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-02-13T00:10:40.665 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-02-13T00:10:40.693 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-94-generic 2024-02-13T00:10:40.693 DEBUG:teuthology.orchestra.run.smithi106:> sudo update-grub 2024-02-13T00:10:41.482 INFO:teuthology.orchestra.run.smithi080.stdout:done 2024-02-13T00:10:41.952 INFO:teuthology.orchestra.run.smithi106.stderr:Sourcing file `/etc/default/grub' 2024-02-13T00:10:41.962 INFO:teuthology.orchestra.run.smithi106.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-13T00:10:41.986 DEBUG:teuthology.orchestra.run.smithi080:> dpkg -s linux-image-generic-hwe-20.04 2024-02-13T00:10:42.006 INFO:teuthology.orchestra.run.smithi106.stderr:Generating grub configuration file ... 2024-02-13T00:10:42.043 INFO:teuthology.orchestra.run.smithi080.stdout:Package: linux-image-generic-hwe-20.04 2024-02-13T00:10:42.043 INFO:teuthology.orchestra.run.smithi080.stdout:Status: install ok installed 2024-02-13T00:10:42.044 INFO:teuthology.orchestra.run.smithi080.stdout:Priority: optional 2024-02-13T00:10:42.044 INFO:teuthology.orchestra.run.smithi080.stdout:Section: kernel 2024-02-13T00:10:42.044 INFO:teuthology.orchestra.run.smithi080.stdout:Installed-Size: 20 2024-02-13T00:10:42.044 INFO:teuthology.orchestra.run.smithi080.stdout:Maintainer: Ubuntu Kernel Team 2024-02-13T00:10:42.044 INFO:teuthology.orchestra.run.smithi080.stdout:Architecture: amd64 2024-02-13T00:10:42.044 INFO:teuthology.orchestra.run.smithi080.stdout:Source: linux-meta-hwe-5.15 2024-02-13T00:10:42.044 INFO:teuthology.orchestra.run.smithi080.stdout:Version: 5.15.0.94.104~20.04.50 2024-02-13T00:10:42.044 INFO:teuthology.orchestra.run.smithi080.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-13T00:10:42.044 INFO:teuthology.orchestra.run.smithi080.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-13T00:10:42.044 INFO:teuthology.orchestra.run.smithi080.stdout:Recommends: thermald 2024-02-13T00:10:42.044 INFO:teuthology.orchestra.run.smithi080.stdout:Description: Generic Linux kernel image 2024-02-13T00:10:42.044 INFO:teuthology.orchestra.run.smithi080.stdout: This package will always depend on the latest generic kernel image 2024-02-13T00:10:42.044 INFO:teuthology.orchestra.run.smithi080.stdout: available. 2024-02-13T00:10:42.045 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.15.0-94-generic 2024-02-13T00:10:42.045 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-13T00:10:42.045 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-13T00:10:42.045 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-02-13T00:10:42.045 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi080.front.sepia.ceph.com, path=None, version=distro) 2024-02-13T00:10:42.045 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get clean 2024-02-13T00:10:42.138 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get update 2024-02-13T00:10:42.304 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-13T00:10:42.315 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-13T00:10:42.318 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-02-13T00:10:42.318 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-02-13T00:10:42.352 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-02-13T00:10:42.398 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-02-13T00:10:42.669 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-02-13T00:10:42.681 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-02-13T00:10:44.059 INFO:teuthology.orchestra.run.smithi106.stderr:done 2024-02-13T00:10:44.061 DEBUG:teuthology.orchestra.run.smithi106:> sudo shutdown -r now 2024-02-13T00:10:44.076 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-02-13T00:10:44.099 DEBUG:teuthology.orchestra.run.smithi080:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic-hwe-20.04 2024-02-13T00:10:44.166 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-02-13T00:10:44.373 INFO:teuthology.orchestra.run.smithi080.stdout:Building dependency tree... 2024-02-13T00:10:44.374 INFO:teuthology.orchestra.run.smithi080.stdout:Reading state information... 2024-02-13T00:10:44.594 INFO:teuthology.orchestra.run.smithi080.stdout:linux-image-generic-hwe-20.04 is already the newest version (5.15.0.94.104~20.04.50). 2024-02-13T00:10:44.594 INFO:teuthology.orchestra.run.smithi080.stdout:0 upgraded, 0 newly installed, 0 to remove and 288 not upgraded. 2024-02-13T00:10:44.596 DEBUG:teuthology.orchestra.run.smithi080:> dpkg -s linux-image-generic-hwe-20.04 2024-02-13T00:10:44.613 INFO:teuthology.orchestra.run.smithi080.stdout:Package: linux-image-generic-hwe-20.04 2024-02-13T00:10:44.613 INFO:teuthology.orchestra.run.smithi080.stdout:Status: install ok installed 2024-02-13T00:10:44.613 INFO:teuthology.orchestra.run.smithi080.stdout:Priority: optional 2024-02-13T00:10:44.613 INFO:teuthology.orchestra.run.smithi080.stdout:Section: kernel 2024-02-13T00:10:44.613 INFO:teuthology.orchestra.run.smithi080.stdout:Installed-Size: 20 2024-02-13T00:10:44.613 INFO:teuthology.orchestra.run.smithi080.stdout:Maintainer: Ubuntu Kernel Team 2024-02-13T00:10:44.613 INFO:teuthology.orchestra.run.smithi080.stdout:Architecture: amd64 2024-02-13T00:10:44.614 INFO:teuthology.orchestra.run.smithi080.stdout:Source: linux-meta-hwe-5.15 2024-02-13T00:10:44.614 INFO:teuthology.orchestra.run.smithi080.stdout:Version: 5.15.0.94.104~20.04.50 2024-02-13T00:10:44.614 INFO:teuthology.orchestra.run.smithi080.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-13T00:10:44.614 INFO:teuthology.orchestra.run.smithi080.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-13T00:10:44.614 INFO:teuthology.orchestra.run.smithi080.stdout:Recommends: thermald 2024-02-13T00:10:44.614 INFO:teuthology.orchestra.run.smithi080.stdout:Description: Generic Linux kernel image 2024-02-13T00:10:44.614 INFO:teuthology.orchestra.run.smithi080.stdout: This package will always depend on the latest generic kernel image 2024-02-13T00:10:44.614 INFO:teuthology.orchestra.run.smithi080.stdout: available. 2024-02-13T00:10:44.614 DEBUG:teuthology.orchestra.run.smithi080:> mktemp 2024-02-13T00:10:44.663 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.SynUhX4oJI 2024-02-13T00:10:44.663 DEBUG:teuthology.orchestra.run.smithi080:> sudo cp /boot/grub/grub.cfg /tmp/tmp.SynUhX4oJI 2024-02-13T00:10:44.678 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.SynUhX4oJI 2024-02-13T00:10:44.758 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.SynUhX4oJI is 9KB 2024-02-13T00:10:44.772 DEBUG:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.SynUhX4oJI 2024-02-13T00:10:44.778 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-02-13T00:10:44.836 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-13T00:10:44.836 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-02-13T00:10:44.836 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-02-13T00:10:44.885 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-94-generic 2024-02-13T00:10:44.885 DEBUG:teuthology.orchestra.run.smithi080:> sudo update-grub 2024-02-13T00:10:46.231 INFO:teuthology.orchestra.run.smithi080.stderr:Sourcing file `/etc/default/grub' 2024-02-13T00:10:46.242 INFO:teuthology.orchestra.run.smithi080.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-13T00:10:46.259 INFO:teuthology.orchestra.run.smithi080.stderr:Generating grub configuration file ... 2024-02-13T00:10:46.557 INFO:teuthology.orchestra.run.smithi080.stderr:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-13T00:10:46.569 INFO:teuthology.orchestra.run.smithi080.stderr:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-13T00:10:46.939 INFO:teuthology.orchestra.run.smithi080.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-02-13T00:10:46.951 INFO:teuthology.orchestra.run.smithi080.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-02-13T00:10:48.376 INFO:teuthology.orchestra.run.smithi080.stderr:done 2024-02-13T00:10:48.379 DEBUG:teuthology.orchestra.run.smithi080:> sudo shutdown -r now 2024-02-13T00:11:14.089 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-02-13T00:11:14.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-02-13T00:11:14.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-13T00:11:18.384 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-02-13T00:11:18.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-13T00:11:18.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-13T00:11:32.540 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-02-13T00:11:36.892 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-02-13T00:11:41.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-02-13T00:11:41.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-13T00:11:44.604 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-02-13T00:11:45.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-13T00:11:45.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-13T00:11:48.956 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-02-13T00:11:56.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-02-13T00:11:56.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-13T00:12:00.960 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-13T00:12:00.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-13T00:12:15.036 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-02-13T00:12:30.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-02-13T00:12:30.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-13T00:12:30.298 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-02-13T00:12:30.827 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-02-13T00:12:30.827 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-94-generic"... 2024-02-13T00:12:30.827 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2024-02-13T00:12:30.876 INFO:teuthology.orchestra.run.smithi106.stdout:5.15.0-94-generic 2024-02-13T00:12:30.876 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-94-generic vs 5.15.0-94-generic 2024-02-13T00:12:30.876 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-13T00:12:30.876 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-02-13T00:12:31.877 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-02-13T00:12:31.877 DEBUG:teuthology.orchestra.run.smithi106:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-13T00:12:32.239 INFO:teuthology.orchestra.run.smithi106.stdout:ttyS1 2024-02-13T00:12:32.268 DEBUG:teuthology.parallel:result is None 2024-02-13T00:12:32.779 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-02-13T00:12:33.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-13T00:12:33.307 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-94-generic"... 2024-02-13T00:12:33.307 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-02-13T00:12:33.355 INFO:teuthology.orchestra.run.smithi080.stdout:5.15.0-94-generic 2024-02-13T00:12:33.355 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-94-generic vs 5.15.0-94-generic 2024-02-13T00:12:33.355 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-13T00:12:33.355 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-02-13T00:12:34.356 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-02-13T00:12:34.356 DEBUG:teuthology.orchestra.run.smithi080:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-13T00:12:34.742 INFO:teuthology.orchestra.run.smithi080.stdout:ttyS1 2024-02-13T00:12:34.783 DEBUG:teuthology.parallel:result is None 2024-02-13T00:12:34.784 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-13T00:12:34.794 INFO:teuthology.task.internal:Creating test directory... 2024-02-13T00:12:34.795 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-13T00:12:34.797 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-13T00:12:34.804 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-13T00:12:34.814 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-13T00:12:34.824 INFO:teuthology.task.internal:Creating archive directory... 2024-02-13T00:12:34.825 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-13T00:12:34.846 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-13T00:12:34.933 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-13T00:12:34.939 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-13T00:12:34.939 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-13T00:12:34.942 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-13T00:12:34.957 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-13T00:12:34.959 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-13T00:12:34.965 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-13T00:12:34.967 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-13T00:12:34.969 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-13T00:12:34.977 INFO:teuthology.task.internal:Configuring sudo... 2024-02-13T00:12:34.977 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-13T00:12:35.015 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-13T00:12:35.030 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-13T00:12:35.039 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-13T00:12:35.039 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-13T00:12:35.070 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-13T00:12:35.080 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-13T00:12:35.124 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-13T00:12:35.172 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-13T00:12:35.172 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-13T00:12:35.243 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-13T00:12:35.251 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-13T00:12:35.300 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-02-13T00:12:35.300 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-13T00:12:35.370 DEBUG:teuthology.orchestra.run.smithi080:> sudo service rsyslog restart 2024-02-13T00:12:35.372 DEBUG:teuthology.orchestra.run.smithi106:> sudo service rsyslog restart 2024-02-13T00:12:35.458 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-13T00:12:35.467 INFO:teuthology.task.internal:Starting timer... 2024-02-13T00:12:35.467 INFO:teuthology.run_tasks:Running task pcp... 2024-02-13T00:12:35.480 INFO:teuthology.run_tasks:Running task selinux... 2024-02-13T00:12:35.488 DEBUG:teuthology.task.selinux:Excluding smithi080: OS 'ubuntu' does not support SELinux 2024-02-13T00:12:35.488 DEBUG:teuthology.task.selinux:Excluding smithi106: OS 'ubuntu' does not support SELinux 2024-02-13T00:12:35.488 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-13T00:12:35.489 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-02-13T00:12:35.489 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-13T00:12:35.489 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-13T00:12:35.551 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-13T00:12:35.566 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-13T00:12:35.568 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi080.front.sepia.ceph.com,smithi106.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-13T00:18:08.272 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi080.front.sepia.ceph.com'), Remote(name='ubuntu@smithi106.front.sepia.ceph.com')] 2024-02-13T00:18:08.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-13T00:18:08.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-13T00:18:08.360 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-02-13T00:18:08.482 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-13T00:18:08.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-02-13T00:18:08.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-13T00:18:08.575 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-02-13T00:18:08.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-02-13T00:18:08.694 INFO:teuthology.run_tasks:Running task clock... 2024-02-13T00:18:08.704 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-13T00:18:08.704 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-13T00:18:08.705 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-13T00:18:08.707 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-13T00:18:08.707 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-13T00:18:08.742 INFO:teuthology.orchestra.run.smithi080.stdout:13 Feb 00:18:08 ntpd[12756]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-02-13T00:18:08.742 INFO:teuthology.orchestra.run.smithi080.stdout:13 Feb 00:18:08 ntpd[12756]: Command line: ntpd -gq 2024-02-13T00:18:08.742 INFO:teuthology.orchestra.run.smithi080.stdout:13 Feb 00:18:08 ntpd[12756]: proto: precision = 0.100 usec (-23) 2024-02-13T00:18:08.743 INFO:teuthology.orchestra.run.smithi080.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-13T00:18:08.744 INFO:teuthology.orchestra.run.smithi080.stdout:13 Feb 00:18:08 ntpd[12756]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-13T00:18:08.744 INFO:teuthology.orchestra.run.smithi080.stderr:restrict ::: KOD does nothing without LIMITED. 2024-02-13T00:18:08.745 INFO:teuthology.orchestra.run.smithi080.stdout:13 Feb 00:18:08 ntpd[12756]: restrict ::: KOD does nothing without LIMITED. 2024-02-13T00:18:08.745 INFO:teuthology.orchestra.run.smithi080.stdout:13 Feb 00:18:08 ntpd[12756]: Listen and drop on 0 v6wildcard [::]:123 2024-02-13T00:18:08.745 INFO:teuthology.orchestra.run.smithi080.stdout:13 Feb 00:18:08 ntpd[12756]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-02-13T00:18:08.745 INFO:teuthology.orchestra.run.smithi080.stdout:13 Feb 00:18:08 ntpd[12756]: Listen normally on 2 lo 127.0.0.1:123 2024-02-13T00:18:08.745 INFO:teuthology.orchestra.run.smithi080.stdout:13 Feb 00:18:08 ntpd[12756]: Listen normally on 3 enp3s0f1 172.21.15.80:123 2024-02-13T00:18:08.745 INFO:teuthology.orchestra.run.smithi080.stdout:13 Feb 00:18:08 ntpd[12756]: Listen normally on 4 lo [::1]:123 2024-02-13T00:18:08.746 INFO:teuthology.orchestra.run.smithi080.stdout:13 Feb 00:18:08 ntpd[12756]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cba9%5]:123 2024-02-13T00:18:08.746 INFO:teuthology.orchestra.run.smithi080.stdout:13 Feb 00:18:08 ntpd[12756]: Listening on routing socket on fd #22 for interface updates 2024-02-13T00:18:08.771 INFO:teuthology.orchestra.run.smithi106.stdout:13 Feb 00:18:08 ntpd[12748]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-02-13T00:18:08.772 INFO:teuthology.orchestra.run.smithi106.stdout:13 Feb 00:18:08 ntpd[12748]: Command line: ntpd -gq 2024-02-13T00:18:08.772 INFO:teuthology.orchestra.run.smithi106.stdout:13 Feb 00:18:08 ntpd[12748]: proto: precision = 0.095 usec (-23) 2024-02-13T00:18:08.772 INFO:teuthology.orchestra.run.smithi106.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-13T00:18:08.773 INFO:teuthology.orchestra.run.smithi106.stdout:13 Feb 00:18:08 ntpd[12748]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-13T00:18:08.773 INFO:teuthology.orchestra.run.smithi106.stderr:restrict ::: KOD does nothing without LIMITED. 2024-02-13T00:18:08.774 INFO:teuthology.orchestra.run.smithi106.stdout:13 Feb 00:18:08 ntpd[12748]: restrict ::: KOD does nothing without LIMITED. 2024-02-13T00:18:08.774 INFO:teuthology.orchestra.run.smithi106.stdout:13 Feb 00:18:08 ntpd[12748]: Listen and drop on 0 v6wildcard [::]:123 2024-02-13T00:18:08.774 INFO:teuthology.orchestra.run.smithi106.stdout:13 Feb 00:18:08 ntpd[12748]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-02-13T00:18:08.774 INFO:teuthology.orchestra.run.smithi106.stdout:13 Feb 00:18:08 ntpd[12748]: Listen normally on 2 lo 127.0.0.1:123 2024-02-13T00:18:08.774 INFO:teuthology.orchestra.run.smithi106.stdout:13 Feb 00:18:08 ntpd[12748]: Listen normally on 3 enp3s0f1 172.21.15.106:123 2024-02-13T00:18:08.774 INFO:teuthology.orchestra.run.smithi106.stdout:13 Feb 00:18:08 ntpd[12748]: Listen normally on 4 lo [::1]:123 2024-02-13T00:18:08.774 INFO:teuthology.orchestra.run.smithi106.stdout:13 Feb 00:18:08 ntpd[12748]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce6d%5]:123 2024-02-13T00:18:08.775 INFO:teuthology.orchestra.run.smithi106.stdout:13 Feb 00:18:08 ntpd[12748]: Listening on routing socket on fd #22 for interface updates 2024-02-13T00:18:09.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:09 ntpd[12756]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:09.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:09 ntpd[12756]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:09.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:09 ntpd[12756]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:09.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:09 ntpd[12756]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:09.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:09 ntpd[12756]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:09.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:09 ntpd[12756]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:09.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:09 ntpd[12756]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:09.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:09 ntpd[12756]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:09.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:09 ntpd[12756]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T00:18:09.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:09 ntpd[12756]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T00:18:09.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:09 ntpd[12756]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:09.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:09 ntpd[12756]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:09.745 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:09 ntpd[12756]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T00:18:09.745 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:09 ntpd[12756]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T00:18:09.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:09 ntpd[12748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:09.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:09 ntpd[12748]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:09.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:09 ntpd[12748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:09.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:09 ntpd[12748]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:09.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:09 ntpd[12748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:09.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:09 ntpd[12748]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:09.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:09 ntpd[12748]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T00:18:09.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:09 ntpd[12748]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T00:18:09.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:09 ntpd[12748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:09.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:09 ntpd[12748]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:09.774 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:09 ntpd[12748]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T00:18:09.774 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:09 ntpd[12748]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T00:18:10.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:10 ntpd[12756]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:10.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:10 ntpd[12756]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:10.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:10 ntpd[12756]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:10.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:10 ntpd[12756]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:10.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:10 ntpd[12756]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T00:18:10.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:10 ntpd[12756]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T00:18:10.772 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:10 ntpd[12748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:10.772 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:10 ntpd[12748]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:11.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:11 ntpd[12756]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:11.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:11 ntpd[12756]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:11.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:11 ntpd[12756]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:11.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:11 ntpd[12756]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:11.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:11 ntpd[12756]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:11.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:11 ntpd[12756]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:11.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:11 ntpd[12756]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T00:18:11.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:11 ntpd[12756]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T00:18:11.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:11 ntpd[12756]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:11.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:11 ntpd[12756]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:11.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:11 ntpd[12756]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T00:18:11.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:11 ntpd[12756]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T00:18:11.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:11 ntpd[12748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:11.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:11 ntpd[12748]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:11.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:11 ntpd[12748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:11.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:11 ntpd[12748]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:11.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:11 ntpd[12748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:11.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:11 ntpd[12748]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:11.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:11 ntpd[12748]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T00:18:11.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:11 ntpd[12748]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T00:18:11.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:11 ntpd[12748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:11.774 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:11 ntpd[12748]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:11.774 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:11 ntpd[12748]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T00:18:11.774 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:11 ntpd[12748]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T00:18:12.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:12 ntpd[12756]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:12.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:12 ntpd[12756]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:12.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:12 ntpd[12756]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:12.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:12 ntpd[12756]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:12.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:12 ntpd[12756]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T00:18:12.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:12 ntpd[12756]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T00:18:12.772 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:12 ntpd[12748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:12.772 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:12 ntpd[12748]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:12.772 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:12 ntpd[12748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:12.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:12 ntpd[12748]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:12.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:12 ntpd[12748]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T00:18:12.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:12 ntpd[12748]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T00:18:13.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:13 ntpd[12756]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:13.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:13 ntpd[12756]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:13.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:13 ntpd[12756]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:13.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:13 ntpd[12756]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:13.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:13 ntpd[12756]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:13.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:13 ntpd[12756]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:13.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:13 ntpd[12756]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T00:18:13.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:13 ntpd[12756]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T00:18:13.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:13 ntpd[12756]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:13.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:13 ntpd[12756]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:13.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:13 ntpd[12756]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T00:18:13.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:13 ntpd[12756]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T00:18:13.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:13 ntpd[12748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:13.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:13 ntpd[12748]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:13.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:13 ntpd[12748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:13.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:13 ntpd[12748]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:13.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:13 ntpd[12748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:13.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:13 ntpd[12748]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:13.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:13 ntpd[12748]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T00:18:13.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:13 ntpd[12748]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T00:18:13.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:13 ntpd[12748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:13.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:13 ntpd[12748]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:13.774 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:13 ntpd[12748]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T00:18:13.774 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:13 ntpd[12748]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T00:18:14.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:14 ntpd[12756]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:14.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:14 ntpd[12756]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:14.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:14 ntpd[12756]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:14.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:14 ntpd[12756]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:14.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:14 ntpd[12756]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T00:18:14.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:14 ntpd[12756]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T00:18:14.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:14 ntpd[12748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:14.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:14 ntpd[12748]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:14.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:14 ntpd[12748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:14.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:14 ntpd[12748]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:14.774 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:14 ntpd[12748]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T00:18:14.774 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:14 ntpd[12748]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T00:18:15.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:15 ntpd[12756]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:15.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:15 ntpd[12756]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:15.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:15 ntpd[12756]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:15.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:15 ntpd[12756]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:15.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:15 ntpd[12756]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:15.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:15 ntpd[12756]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:15.743 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:15 ntpd[12756]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T00:18:15.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:15 ntpd[12756]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T00:18:15.744 INFO:teuthology.orchestra.run.smithi080.stdout:13 Feb 00:18:15 ntpd[12756]: ntpd: time slew -0.002990 s 2024-02-13T00:18:15.744 INFO:teuthology.orchestra.run.smithi080.stdout:ntpd: time slew -0.002990s 2024-02-13T00:18:15.744 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:15 ntpd[12756]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-02-13T00:18:15.745 INFO:teuthology.orchestra.run.smithi080.stderr:13 Feb 00:18:15 ntpd[12756]: can't open /var/log/ntpstats/loopstats.20240213: Permission denied 2024-02-13T00:18:15.772 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:15 ntpd[12748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:15.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:15 ntpd[12748]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:15.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:15 ntpd[12748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:15.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:15 ntpd[12748]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:15.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:15 ntpd[12748]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T00:18:15.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:15 ntpd[12748]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T00:18:15.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:15 ntpd[12748]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T00:18:15.773 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:15 ntpd[12748]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T00:18:15.773 INFO:teuthology.orchestra.run.smithi106.stdout:13 Feb 00:18:15 ntpd[12748]: ntpd: time slew +0.003879 s 2024-02-13T00:18:15.773 INFO:teuthology.orchestra.run.smithi106.stdout:ntpd: time slew +0.003879s 2024-02-13T00:18:15.774 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:15 ntpd[12748]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-02-13T00:18:15.774 INFO:teuthology.orchestra.run.smithi106.stderr:13 Feb 00:18:15 ntpd[12748]: can't open /var/log/ntpstats/loopstats.20240213: Permission denied 2024-02-13T00:18:15.809 INFO:teuthology.orchestra.run.smithi080.stdout: remote refid st t when poll reach delay offset jitter 2024-02-13T00:18:15.809 INFO:teuthology.orchestra.run.smithi080.stdout:============================================================================== 2024-02-13T00:18:15.809 INFO:teuthology.orchestra.run.smithi080.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-02-13T00:18:15.809 INFO:teuthology.orchestra.run.smithi080.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-02-13T00:18:15.809 INFO:teuthology.orchestra.run.smithi080.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-02-13T00:18:15.809 INFO:teuthology.orchestra.run.smithi080.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-02-13T00:18:15.843 INFO:teuthology.orchestra.run.smithi106.stdout: remote refid st t when poll reach delay offset jitter 2024-02-13T00:18:15.843 INFO:teuthology.orchestra.run.smithi106.stdout:============================================================================== 2024-02-13T00:18:15.843 INFO:teuthology.orchestra.run.smithi106.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-02-13T00:18:15.843 INFO:teuthology.orchestra.run.smithi106.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-02-13T00:18:15.844 INFO:teuthology.orchestra.run.smithi106.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-02-13T00:18:15.844 INFO:teuthology.orchestra.run.smithi106.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-02-13T00:18:15.845 INFO:teuthology.run_tasks:Running task install... 2024-02-13T00:18:15.854 DEBUG:teuthology.task.install:project ceph 2024-02-13T00:18:15.855 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '0e714d9a4bd2a821113e6318adb87bd06cf81ec1'}, 'extra_packages': ['cephadm']} 2024-02-13T00:18:15.855 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '0e714d9a4bd2a821113e6318adb87bd06cf81ec1'} 2024-02-13T00:18:15.855 INFO:teuthology.task.install:Using flavor: default 2024-02-13T00:18:15.860 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-13T00:18:15.861 INFO:teuthology.task.install:extra packages: [] 2024-02-13T00:18:15.861 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-key list | grep Ceph 2024-02-13T00:18:15.861 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-key list | grep Ceph 2024-02-13T00:18:15.961 INFO:teuthology.orchestra.run.smithi080.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-02-13T00:18:15.984 INFO:teuthology.orchestra.run.smithi106.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-02-13T00:18:16.022 INFO:teuthology.orchestra.run.smithi080.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-02-13T00:18:16.022 INFO:teuthology.orchestra.run.smithi080.stdout:uid [ unknown] Ceph.com (release key) 2024-02-13T00:18:16.023 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-02-13T00:18:16.023 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-13T00:18:16.042 INFO:teuthology.orchestra.run.smithi106.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-02-13T00:18:16.042 INFO:teuthology.orchestra.run.smithi106.stdout:uid [ unknown] Ceph.com (release key) 2024-02-13T00:18:16.043 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-02-13T00:18:16.043 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-13T00:18:16.266 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default/ 2024-02-13T00:18:16.267 INFO:teuthology.task.install.deb:Package version is 16.2.14-521-g0e714d9a-1focal 2024-02-13T00:18:16.290 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default/ 2024-02-13T00:18:16.291 INFO:teuthology.task.install.deb:Package version is 16.2.14-521-g0e714d9a-1focal 2024-02-13T00:18:16.380 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-13T00:18:16.380 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-02-13T00:18:16.398 DEBUG:teuthology.orchestra.run.smithi080:> sudo apt-get update 2024-02-13T00:18:16.467 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-02-13T00:18:16.468 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-02-13T00:18:16.485 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get update 2024-02-13T00:18:16.590 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-02-13T00:18:16.591 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-02-13T00:18:16.602 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-02-13T00:18:16.623 INFO:teuthology.orchestra.run.smithi080.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-02-13T00:18:16.643 INFO:teuthology.orchestra.run.smithi080.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal InRelease 2024-02-13T00:18:16.666 INFO:teuthology.orchestra.run.smithi080.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal Release [7,680 B] 2024-02-13T00:18:16.681 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-02-13T00:18:16.689 INFO:teuthology.orchestra.run.smithi080.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal Release.gpg 2024-02-13T00:18:16.689 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-02-13T00:18:16.709 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-02-13T00:18:16.722 INFO:teuthology.orchestra.run.smithi080.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 Packages [17.2 kB] 2024-02-13T00:18:16.733 INFO:teuthology.orchestra.run.smithi106.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal InRelease 2024-02-13T00:18:16.756 INFO:teuthology.orchestra.run.smithi080.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main i386 Packages [3,096 B] 2024-02-13T00:18:16.758 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal Release [7,680 B] 2024-02-13T00:18:16.786 INFO:teuthology.orchestra.run.smithi106.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal Release.gpg 2024-02-13T00:18:16.794 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:7 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-02-13T00:18:16.807 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 Packages [17.2 kB] 2024-02-13T00:18:16.843 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main i386 Packages [3,096 B] 2024-02-13T00:18:17.217 INFO:teuthology.orchestra.run.smithi080.stdout:Fetched 28.0 kB in 1s (45.8 kB/s) 2024-02-13T00:18:17.315 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 28.0 kB in 1s (45.1 kB/s) 2024-02-13T00:18:18.309 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-02-13T00:18:18.336 DEBUG:teuthology.orchestra.run.smithi080:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.2.14-521-g0e714d9a-1focal cephadm=16.2.14-521-g0e714d9a-1focal ceph-mds=16.2.14-521-g0e714d9a-1focal ceph-mgr=16.2.14-521-g0e714d9a-1focal ceph-common=16.2.14-521-g0e714d9a-1focal ceph-fuse=16.2.14-521-g0e714d9a-1focal ceph-test=16.2.14-521-g0e714d9a-1focal radosgw=16.2.14-521-g0e714d9a-1focal python3-rados=16.2.14-521-g0e714d9a-1focal python3-rgw=16.2.14-521-g0e714d9a-1focal python3-cephfs=16.2.14-521-g0e714d9a-1focal python3-rbd=16.2.14-521-g0e714d9a-1focal libcephfs2=16.2.14-521-g0e714d9a-1focal libcephfs-dev=16.2.14-521-g0e714d9a-1focal librados2=16.2.14-521-g0e714d9a-1focal librbd1=16.2.14-521-g0e714d9a-1focal rbd-fuse=16.2.14-521-g0e714d9a-1focal 2024-02-13T00:18:18.399 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-02-13T00:18:18.412 INFO:teuthology.orchestra.run.smithi080.stdout:Reading package lists... 2024-02-13T00:18:18.426 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.2.14-521-g0e714d9a-1focal cephadm=16.2.14-521-g0e714d9a-1focal ceph-mds=16.2.14-521-g0e714d9a-1focal ceph-mgr=16.2.14-521-g0e714d9a-1focal ceph-common=16.2.14-521-g0e714d9a-1focal ceph-fuse=16.2.14-521-g0e714d9a-1focal ceph-test=16.2.14-521-g0e714d9a-1focal radosgw=16.2.14-521-g0e714d9a-1focal python3-rados=16.2.14-521-g0e714d9a-1focal python3-rgw=16.2.14-521-g0e714d9a-1focal python3-cephfs=16.2.14-521-g0e714d9a-1focal python3-rbd=16.2.14-521-g0e714d9a-1focal libcephfs2=16.2.14-521-g0e714d9a-1focal libcephfs-dev=16.2.14-521-g0e714d9a-1focal librados2=16.2.14-521-g0e714d9a-1focal librbd1=16.2.14-521-g0e714d9a-1focal rbd-fuse=16.2.14-521-g0e714d9a-1focal 2024-02-13T00:18:18.502 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-02-13T00:18:18.628 INFO:teuthology.orchestra.run.smithi080.stdout:Building dependency tree... 2024-02-13T00:18:18.628 INFO:teuthology.orchestra.run.smithi080.stdout:Reading state information... 2024-02-13T00:18:18.691 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2024-02-13T00:18:18.691 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2024-02-13T00:18:18.810 INFO:teuthology.orchestra.run.smithi080.stdout:The following packages were automatically installed and are no longer required: 2024-02-13T00:18:18.812 INFO:teuthology.orchestra.run.smithi080.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-02-13T00:18:18.812 INFO:teuthology.orchestra.run.smithi080.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-13T00:18:18.812 INFO:teuthology.orchestra.run.smithi080.stdout:The following additional packages will be installed: 2024-02-13T00:18:18.812 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-02-13T00:18:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq libjaeger 2024-02-13T00:18:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2024-02-13T00:18:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 2024-02-13T00:18:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph nvme-cli python-pastedeploy-tpl 2024-02-13T00:18:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-02-13T00:18:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2024-02-13T00:18:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-02-13T00:18:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-02-13T00:18:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-02-13T00:18:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2024-02-13T00:18:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-02-13T00:18:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-02-13T00:18:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2024-02-13T00:18:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2024-02-13T00:18:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-02-13T00:18:18.813 INFO:teuthology.orchestra.run.smithi080.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2024-02-13T00:18:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2024-02-13T00:18:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2024-02-13T00:18:18.814 INFO:teuthology.orchestra.run.smithi080.stdout:Suggested packages: 2024-02-13T00:18:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2024-02-13T00:18:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-02-13T00:18:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-02-13T00:18:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-02-13T00:18:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-02-13T00:18:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-02-13T00:18:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-02-13T00:18:18.814 INFO:teuthology.orchestra.run.smithi080.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-02-13T00:18:18.815 INFO:teuthology.orchestra.run.smithi080.stdout:Recommended packages: 2024-02-13T00:18:18.815 INFO:teuthology.orchestra.run.smithi080.stdout: btrfs-tools 2024-02-13T00:18:18.870 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages were automatically installed and are no longer required: 2024-02-13T00:18:18.872 INFO:teuthology.orchestra.run.smithi106.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-02-13T00:18:18.872 INFO:teuthology.orchestra.run.smithi106.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-13T00:18:18.872 INFO:teuthology.orchestra.run.smithi106.stdout:The following additional packages will be installed: 2024-02-13T00:18:18.872 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-02-13T00:18:18.872 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq libjaeger 2024-02-13T00:18:18.873 INFO:teuthology.orchestra.run.smithi106.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2024-02-13T00:18:18.873 INFO:teuthology.orchestra.run.smithi106.stdout: liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 2024-02-13T00:18:18.873 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph nvme-cli python-pastedeploy-tpl 2024-02-13T00:18:18.873 INFO:teuthology.orchestra.run.smithi106.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-02-13T00:18:18.873 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2024-02-13T00:18:18.873 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-02-13T00:18:18.873 INFO:teuthology.orchestra.run.smithi106.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-02-13T00:18:18.873 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-02-13T00:18:18.873 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2024-02-13T00:18:18.873 INFO:teuthology.orchestra.run.smithi106.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-02-13T00:18:18.873 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-02-13T00:18:18.873 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2024-02-13T00:18:18.873 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2024-02-13T00:18:18.873 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-02-13T00:18:18.873 INFO:teuthology.orchestra.run.smithi106.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2024-02-13T00:18:18.874 INFO:teuthology.orchestra.run.smithi106.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2024-02-13T00:18:18.874 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2024-02-13T00:18:18.874 INFO:teuthology.orchestra.run.smithi106.stdout:Suggested packages: 2024-02-13T00:18:18.874 INFO:teuthology.orchestra.run.smithi106.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2024-02-13T00:18:18.874 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-02-13T00:18:18.874 INFO:teuthology.orchestra.run.smithi106.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-02-13T00:18:18.874 INFO:teuthology.orchestra.run.smithi106.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-02-13T00:18:18.874 INFO:teuthology.orchestra.run.smithi106.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-02-13T00:18:18.874 INFO:teuthology.orchestra.run.smithi106.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-02-13T00:18:18.875 INFO:teuthology.orchestra.run.smithi106.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-02-13T00:18:18.875 INFO:teuthology.orchestra.run.smithi106.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-02-13T00:18:18.875 INFO:teuthology.orchestra.run.smithi106.stdout:Recommended packages: 2024-02-13T00:18:18.875 INFO:teuthology.orchestra.run.smithi106.stdout: btrfs-tools 2024-02-13T00:18:18.925 INFO:teuthology.orchestra.run.smithi080.stdout:The following NEW packages will be installed: 2024-02-13T00:18:18.926 INFO:teuthology.orchestra.run.smithi080.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-02-13T00:18:18.926 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-02-13T00:18:18.926 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test cephadm jq libcephfs-dev 2024-02-13T00:18:18.926 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2 libjaeger libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2024-02-13T00:18:18.926 INFO:teuthology.orchestra.run.smithi080.stdout: libleveldb1d liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 2024-02-13T00:18:18.926 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph nvme-cli 2024-02-13T00:18:18.926 INFO:teuthology.orchestra.run.smithi080.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2024-02-13T00:18:18.926 INFO:teuthology.orchestra.run.smithi080.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-02-13T00:18:18.926 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cryptography 2024-02-13T00:18:18.927 INFO:teuthology.orchestra.run.smithi080.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2024-02-13T00:18:18.927 INFO:teuthology.orchestra.run.smithi080.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2024-02-13T00:18:18.927 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2024-02-13T00:18:18.927 INFO:teuthology.orchestra.run.smithi080.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-02-13T00:18:18.927 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-02-13T00:18:18.927 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-02-13T00:18:18.927 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-02-13T00:18:18.927 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-02-13T00:18:18.927 INFO:teuthology.orchestra.run.smithi080.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-02-13T00:18:18.928 INFO:teuthology.orchestra.run.smithi080.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-02-13T00:18:18.928 INFO:teuthology.orchestra.run.smithi080.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-02-13T00:18:18.928 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2024-02-13T00:18:18.929 INFO:teuthology.orchestra.run.smithi080.stdout:The following packages will be upgraded: 2024-02-13T00:18:18.929 INFO:teuthology.orchestra.run.smithi080.stdout: librados2 librbd1 2024-02-13T00:18:18.990 INFO:teuthology.orchestra.run.smithi106.stdout:The following NEW packages will be installed: 2024-02-13T00:18:18.990 INFO:teuthology.orchestra.run.smithi106.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-02-13T00:18:18.991 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-02-13T00:18:18.991 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test cephadm jq libcephfs-dev 2024-02-13T00:18:18.991 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs2 libjaeger libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2024-02-13T00:18:18.991 INFO:teuthology.orchestra.run.smithi106.stdout: libleveldb1d liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 2024-02-13T00:18:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph nvme-cli 2024-02-13T00:18:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2024-02-13T00:18:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-02-13T00:18:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cryptography 2024-02-13T00:18:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2024-02-13T00:18:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2024-02-13T00:18:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2024-02-13T00:18:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-02-13T00:18:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-02-13T00:18:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-02-13T00:18:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-02-13T00:18:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-02-13T00:18:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-02-13T00:18:18.993 INFO:teuthology.orchestra.run.smithi106.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-02-13T00:18:18.993 INFO:teuthology.orchestra.run.smithi106.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-02-13T00:18:18.993 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2024-02-13T00:18:18.993 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages will be upgraded: 2024-02-13T00:18:18.993 INFO:teuthology.orchestra.run.smithi106.stdout: librados2 librbd1 2024-02-13T00:18:19.064 INFO:teuthology.orchestra.run.smithi080.stdout:2 upgraded, 98 newly installed, 0 to remove and 267 not upgraded. 2024-02-13T00:18:19.064 INFO:teuthology.orchestra.run.smithi080.stdout:Need to get 160 MB of archives. 2024-02-13T00:18:19.064 INFO:teuthology.orchestra.run.smithi080.stdout:After this operation, 701 MB of additional disk space will be used. 2024-02-13T00:18:19.064 INFO:teuthology.orchestra.run.smithi080.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 16.2.14-521-g0e714d9a-1focal [3,960 B] 2024-02-13T00:18:19.065 INFO:teuthology.orchestra.run.smithi106.stdout:2 upgraded, 98 newly installed, 0 to remove and 267 not upgraded. 2024-02-13T00:18:19.065 INFO:teuthology.orchestra.run.smithi106.stdout:Need to get 160 MB of archives. 2024-02-13T00:18:19.065 INFO:teuthology.orchestra.run.smithi106.stdout:After this operation, 701 MB of additional disk space will be used. 2024-02-13T00:18:19.065 INFO:teuthology.orchestra.run.smithi106.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-02-13T00:18:19.109 INFO:teuthology.orchestra.run.smithi080.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 16.2.14-521-g0e714d9a-1focal [3,394 kB] 2024-02-13T00:18:19.121 INFO:teuthology.orchestra.run.smithi080.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-02-13T00:18:19.164 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-02-13T00:18:19.165 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-02-13T00:18:19.176 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-02-13T00:18:19.182 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 16.2.14-521-g0e714d9a-1focal [3,960 B] 2024-02-13T00:18:19.184 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-02-13T00:18:19.213 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2024-02-13T00:18:19.219 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-02-13T00:18:19.220 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.2 [211 kB] 2024-02-13T00:18:19.229 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-02-13T00:18:19.230 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-02-13T00:18:19.230 INFO:teuthology.orchestra.run.smithi106.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-02-13T00:18:19.235 INFO:teuthology.orchestra.run.smithi106.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-02-13T00:18:19.235 INFO:teuthology.orchestra.run.smithi106.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-02-13T00:18:19.236 INFO:teuthology.orchestra.run.smithi106.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-02-13T00:18:19.250 INFO:teuthology.orchestra.run.smithi106.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-02-13T00:18:19.252 INFO:teuthology.orchestra.run.smithi106.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-02-13T00:18:19.253 INFO:teuthology.orchestra.run.smithi106.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-02-13T00:18:19.253 INFO:teuthology.orchestra.run.smithi106.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-02-13T00:18:19.270 INFO:teuthology.orchestra.run.smithi106.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-02-13T00:18:19.272 INFO:teuthology.orchestra.run.smithi106.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-02-13T00:18:19.274 INFO:teuthology.orchestra.run.smithi106.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-02-13T00:18:19.276 INFO:teuthology.orchestra.run.smithi106.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 16.2.14-521-g0e714d9a-1focal [3,394 kB] 2024-02-13T00:18:19.277 INFO:teuthology.orchestra.run.smithi106.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-02-13T00:18:19.277 INFO:teuthology.orchestra.run.smithi106.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-02-13T00:18:19.282 INFO:teuthology.orchestra.run.smithi106.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-02-13T00:18:19.291 INFO:teuthology.orchestra.run.smithi106.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-02-13T00:18:19.291 INFO:teuthology.orchestra.run.smithi106.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-02-13T00:18:19.292 INFO:teuthology.orchestra.run.smithi106.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-02-13T00:18:19.292 INFO:teuthology.orchestra.run.smithi106.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-02-13T00:18:19.298 INFO:teuthology.orchestra.run.smithi080.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 16.2.14-521-g0e714d9a-1focal [3,395 kB] 2024-02-13T00:18:19.311 INFO:teuthology.orchestra.run.smithi106.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-02-13T00:18:19.314 INFO:teuthology.orchestra.run.smithi106.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-02-13T00:18:19.315 INFO:teuthology.orchestra.run.smithi106.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-02-13T00:18:19.317 INFO:teuthology.orchestra.run.smithi106.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-02-13T00:18:19.318 INFO:teuthology.orchestra.run.smithi106.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-02-13T00:18:19.319 INFO:teuthology.orchestra.run.smithi106.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-02-13T00:18:19.332 INFO:teuthology.orchestra.run.smithi106.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-02-13T00:18:19.332 INFO:teuthology.orchestra.run.smithi106.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-02-13T00:18:19.410 INFO:teuthology.orchestra.run.smithi080.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 16.2.14-521-g0e714d9a-1focal [730 kB] 2024-02-13T00:18:19.437 INFO:teuthology.orchestra.run.smithi080.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 16.2.14-521-g0e714d9a-1focal [414 kB] 2024-02-13T00:18:19.450 INFO:teuthology.orchestra.run.smithi080.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 16.2.14-521-g0e714d9a-1focal [22.2 kB] 2024-02-13T00:18:19.451 INFO:teuthology.orchestra.run.smithi080.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 16.2.14-521-g0e714d9a-1focal [212 kB] 2024-02-13T00:18:19.458 INFO:teuthology.orchestra.run.smithi080.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 16.2.14-521-g0e714d9a-1focal [38.4 kB] 2024-02-13T00:18:19.458 INFO:teuthology.orchestra.run.smithi080.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 16.2.14-521-g0e714d9a-1focal [385 kB] 2024-02-13T00:18:19.471 INFO:teuthology.orchestra.run.smithi080.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 16.2.14-521-g0e714d9a-1focal [3,707 kB] 2024-02-13T00:18:19.481 INFO:teuthology.orchestra.run.smithi106.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-02-13T00:18:19.496 INFO:teuthology.orchestra.run.smithi106.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-02-13T00:18:19.497 INFO:teuthology.orchestra.run.smithi106.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-02-13T00:18:19.515 INFO:teuthology.orchestra.run.smithi106.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-02-13T00:18:19.515 INFO:teuthology.orchestra.run.smithi106.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-02-13T00:18:19.516 INFO:teuthology.orchestra.run.smithi106.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-02-13T00:18:19.516 INFO:teuthology.orchestra.run.smithi106.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-02-13T00:18:19.517 INFO:teuthology.orchestra.run.smithi106.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-02-13T00:18:19.517 INFO:teuthology.orchestra.run.smithi106.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-02-13T00:18:19.517 INFO:teuthology.orchestra.run.smithi106.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-02-13T00:18:19.524 INFO:teuthology.orchestra.run.smithi080.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-02-13T00:18:19.529 INFO:teuthology.orchestra.run.smithi106.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-02-13T00:18:19.529 INFO:teuthology.orchestra.run.smithi106.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-02-13T00:18:19.532 INFO:teuthology.orchestra.run.smithi080.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-02-13T00:18:19.549 INFO:teuthology.orchestra.run.smithi106.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-02-13T00:18:19.555 INFO:teuthology.orchestra.run.smithi106.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-02-13T00:18:19.559 INFO:teuthology.orchestra.run.smithi106.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-02-13T00:18:19.561 INFO:teuthology.orchestra.run.smithi106.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-02-13T00:18:19.562 INFO:teuthology.orchestra.run.smithi106.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-02-13T00:18:19.565 INFO:teuthology.orchestra.run.smithi106.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-02-13T00:18:19.566 INFO:teuthology.orchestra.run.smithi106.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-02-13T00:18:19.569 INFO:teuthology.orchestra.run.smithi106.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-02-13T00:18:19.569 INFO:teuthology.orchestra.run.smithi106.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-02-13T00:18:19.569 INFO:teuthology.orchestra.run.smithi106.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-02-13T00:18:19.574 INFO:teuthology.orchestra.run.smithi080.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-02-13T00:18:19.590 INFO:teuthology.orchestra.run.smithi106.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-02-13T00:18:19.592 INFO:teuthology.orchestra.run.smithi106.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-02-13T00:18:19.606 INFO:teuthology.orchestra.run.smithi080.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-02-13T00:18:19.610 INFO:teuthology.orchestra.run.smithi106.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-02-13T00:18:19.610 INFO:teuthology.orchestra.run.smithi106.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-02-13T00:18:19.611 INFO:teuthology.orchestra.run.smithi106.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-02-13T00:18:19.611 INFO:teuthology.orchestra.run.smithi106.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-02-13T00:18:19.613 INFO:teuthology.orchestra.run.smithi106.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-02-13T00:18:19.615 INFO:teuthology.orchestra.run.smithi106.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-02-13T00:18:19.615 INFO:teuthology.orchestra.run.smithi106.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-02-13T00:18:19.615 INFO:teuthology.orchestra.run.smithi106.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-02-13T00:18:19.616 INFO:teuthology.orchestra.run.smithi080.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 16.2.14-521-g0e714d9a-1focal [116 kB] 2024-02-13T00:18:19.621 INFO:teuthology.orchestra.run.smithi080.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 16.2.14-521-g0e714d9a-1focal [448 kB] 2024-02-13T00:18:19.631 INFO:teuthology.orchestra.run.smithi106.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-02-13T00:18:19.652 INFO:teuthology.orchestra.run.smithi080.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 16.2.14-521-g0e714d9a-1focal [21.8 MB] 2024-02-13T00:18:19.716 INFO:teuthology.orchestra.run.smithi080.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2024-02-13T00:18:19.738 INFO:teuthology.orchestra.run.smithi080.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-02-13T00:18:19.745 INFO:teuthology.orchestra.run.smithi080.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.2 [211 kB] 2024-02-13T00:18:19.776 INFO:teuthology.orchestra.run.smithi080.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-02-13T00:18:19.781 INFO:teuthology.orchestra.run.smithi080.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-02-13T00:18:19.783 INFO:teuthology.orchestra.run.smithi080.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-02-13T00:18:19.962 INFO:teuthology.orchestra.run.smithi080.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-02-13T00:18:20.129 INFO:teuthology.orchestra.run.smithi080.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-02-13T00:18:20.158 INFO:teuthology.orchestra.run.smithi080.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-02-13T00:18:20.183 INFO:teuthology.orchestra.run.smithi080.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-02-13T00:18:20.299 INFO:teuthology.orchestra.run.smithi080.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-02-13T00:18:20.311 INFO:teuthology.orchestra.run.smithi080.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-02-13T00:18:20.316 INFO:teuthology.orchestra.run.smithi080.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-02-13T00:18:20.382 INFO:teuthology.orchestra.run.smithi080.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-02-13T00:18:20.399 INFO:teuthology.orchestra.run.smithi080.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-02-13T00:18:20.433 INFO:teuthology.orchestra.run.smithi080.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-02-13T00:18:20.463 INFO:teuthology.orchestra.run.smithi080.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-02-13T00:18:20.609 INFO:teuthology.orchestra.run.smithi080.stdout:Get:36 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 16.2.14-521-g0e714d9a-1focal [4,731 kB] 2024-02-13T00:18:20.628 INFO:teuthology.orchestra.run.smithi080.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-02-13T00:18:20.648 INFO:teuthology.orchestra.run.smithi080.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 16.2.14-521-g0e714d9a-1focal [204 kB] 2024-02-13T00:18:20.654 INFO:teuthology.orchestra.run.smithi080.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 16.2.14-521-g0e714d9a-1focal [126 kB] 2024-02-13T00:18:20.670 INFO:teuthology.orchestra.run.smithi080.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 16.2.14-521-g0e714d9a-1focal [1,551 kB] 2024-02-13T00:18:20.734 INFO:teuthology.orchestra.run.smithi080.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 16.2.14-521-g0e714d9a-1focal [4,015 kB] 2024-02-13T00:18:20.877 INFO:teuthology.orchestra.run.smithi080.stdout:Get:42 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 16.2.14-521-g0e714d9a-1focal [21.2 MB] 2024-02-13T00:18:21.164 INFO:teuthology.orchestra.run.smithi080.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-02-13T00:18:21.164 INFO:teuthology.orchestra.run.smithi080.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-02-13T00:18:21.167 INFO:teuthology.orchestra.run.smithi080.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-02-13T00:18:21.171 INFO:teuthology.orchestra.run.smithi080.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-02-13T00:18:21.182 INFO:teuthology.orchestra.run.smithi080.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-02-13T00:18:21.206 INFO:teuthology.orchestra.run.smithi080.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-02-13T00:18:21.217 INFO:teuthology.orchestra.run.smithi080.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-02-13T00:18:21.219 INFO:teuthology.orchestra.run.smithi080.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-02-13T00:18:21.254 INFO:teuthology.orchestra.run.smithi080.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-02-13T00:18:21.266 INFO:teuthology.orchestra.run.smithi080.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-02-13T00:18:21.442 INFO:teuthology.orchestra.run.smithi080.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-02-13T00:18:21.525 INFO:teuthology.orchestra.run.smithi080.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-02-13T00:18:21.646 INFO:teuthology.orchestra.run.smithi080.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-02-13T00:18:21.691 INFO:teuthology.orchestra.run.smithi080.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 16.2.14-521-g0e714d9a-1focal [4,052 B] 2024-02-13T00:18:21.692 INFO:teuthology.orchestra.run.smithi080.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 16.2.14-521-g0e714d9a-1focal [836 kB] 2024-02-13T00:18:21.698 INFO:teuthology.orchestra.run.smithi080.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 16.2.14-521-g0e714d9a-1focal [2,363 kB] 2024-02-13T00:18:21.715 INFO:teuthology.orchestra.run.smithi080.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 16.2.14-521-g0e714d9a-1focal [77.4 kB] 2024-02-13T00:18:21.716 INFO:teuthology.orchestra.run.smithi080.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 16.2.14-521-g0e714d9a-1focal [100 kB] 2024-02-13T00:18:21.716 INFO:teuthology.orchestra.run.smithi080.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 16.2.14-521-g0e714d9a-1focal [2,824 kB] 2024-02-13T00:18:21.803 INFO:teuthology.orchestra.run.smithi080.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 16.2.14-521-g0e714d9a-1focal [7,874 kB] 2024-02-13T00:18:22.069 INFO:teuthology.orchestra.run.smithi080.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 16.2.14-521-g0e714d9a-1focal [4,168 B] 2024-02-13T00:18:22.069 INFO:teuthology.orchestra.run.smithi080.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 16.2.14-521-g0e714d9a-1focal [45.8 MB] 2024-02-13T00:18:22.398 INFO:teuthology.orchestra.run.smithi080.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-02-13T00:18:22.433 INFO:teuthology.orchestra.run.smithi080.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-02-13T00:18:22.435 INFO:teuthology.orchestra.run.smithi080.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-02-13T00:18:22.515 INFO:teuthology.orchestra.run.smithi080.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-02-13T00:18:22.515 INFO:teuthology.orchestra.run.smithi080.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-02-13T00:18:22.515 INFO:teuthology.orchestra.run.smithi080.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-02-13T00:18:22.517 INFO:teuthology.orchestra.run.smithi080.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-02-13T00:18:22.517 INFO:teuthology.orchestra.run.smithi080.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-02-13T00:18:22.680 INFO:teuthology.orchestra.run.smithi080.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-02-13T00:18:22.845 INFO:teuthology.orchestra.run.smithi080.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-02-13T00:18:23.030 INFO:teuthology.orchestra.run.smithi080.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-02-13T00:18:23.045 INFO:teuthology.orchestra.run.smithi080.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-02-13T00:18:23.078 INFO:teuthology.orchestra.run.smithi080.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-02-13T00:18:23.211 INFO:teuthology.orchestra.run.smithi080.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-02-13T00:18:23.244 INFO:teuthology.orchestra.run.smithi080.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-02-13T00:18:23.267 INFO:teuthology.orchestra.run.smithi080.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-02-13T00:18:23.275 INFO:teuthology.orchestra.run.smithi080.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-02-13T00:18:23.319 INFO:teuthology.orchestra.run.smithi080.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-02-13T00:18:23.345 INFO:teuthology.orchestra.run.smithi080.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-02-13T00:18:23.358 INFO:teuthology.orchestra.run.smithi106.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 16.2.14-521-g0e714d9a-1focal [3,395 kB] 2024-02-13T00:18:23.531 INFO:teuthology.orchestra.run.smithi080.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-02-13T00:18:23.614 INFO:teuthology.orchestra.run.smithi080.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-02-13T00:18:23.788 INFO:teuthology.orchestra.run.smithi080.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-02-13T00:18:23.788 INFO:teuthology.orchestra.run.smithi080.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-02-13T00:18:23.859 INFO:teuthology.orchestra.run.smithi080.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 16.2.14-521-g0e714d9a-1focal [21.5 kB] 2024-02-13T00:18:23.860 INFO:teuthology.orchestra.run.smithi080.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 16.2.14-521-g0e714d9a-1focal [11.3 MB] 2024-02-13T00:18:23.879 INFO:teuthology.orchestra.run.smithi080.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-02-13T00:18:24.173 INFO:teuthology.orchestra.run.smithi080.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 16.2.14-521-g0e714d9a-1focal [78.1 kB] 2024-02-13T00:18:24.173 INFO:teuthology.orchestra.run.smithi080.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-02-13T00:18:24.173 INFO:teuthology.orchestra.run.smithi080.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-02-13T00:18:24.174 INFO:teuthology.orchestra.run.smithi080.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-02-13T00:18:24.174 INFO:teuthology.orchestra.run.smithi080.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-02-13T00:18:24.184 INFO:teuthology.orchestra.run.smithi080.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-02-13T00:18:24.188 INFO:teuthology.orchestra.run.smithi080.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-02-13T00:18:24.353 INFO:teuthology.orchestra.run.smithi080.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-02-13T00:18:24.521 INFO:teuthology.orchestra.run.smithi080.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-02-13T00:18:24.773 INFO:teuthology.orchestra.run.smithi080.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-02-13T00:18:25.453 INFO:teuthology.orchestra.run.smithi080.stdout:Fetched 160 MB in 6s (27.3 MB/s) 2024-02-13T00:18:25.548 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libjaeger. 2024-02-13T00:18:25.594 INFO:teuthology.orchestra.run.smithi080.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 112645 files and directories currently installed.) 2024-02-13T00:18:25.598 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../00-libjaeger_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:25.655 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libjaeger (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:25.700 INFO:teuthology.orchestra.run.smithi106.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 16.2.14-521-g0e714d9a-1focal [730 kB] 2024-02-13T00:18:26.000 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-02-13T00:18:26.014 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../01-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-02-13T00:18:26.100 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-02-13T00:18:26.232 INFO:teuthology.orchestra.run.smithi106.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 16.2.14-521-g0e714d9a-1focal [414 kB] 2024-02-13T00:18:26.450 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../02-librbd1_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:26.544 INFO:teuthology.orchestra.run.smithi106.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 16.2.14-521-g0e714d9a-1focal [22.2 kB] 2024-02-13T00:18:26.545 INFO:teuthology.orchestra.run.smithi106.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 16.2.14-521-g0e714d9a-1focal [212 kB] 2024-02-13T00:18:26.571 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking librbd1 (16.2.14-521-g0e714d9a-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-02-13T00:18:26.705 INFO:teuthology.orchestra.run.smithi106.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 16.2.14-521-g0e714d9a-1focal [38.4 kB] 2024-02-13T00:18:26.706 INFO:teuthology.orchestra.run.smithi106.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 16.2.14-521-g0e714d9a-1focal [385 kB] 2024-02-13T00:18:26.951 INFO:teuthology.orchestra.run.smithi106.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 16.2.14-521-g0e714d9a-1focal [3,707 kB] 2024-02-13T00:18:27.265 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../03-librados2_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:27.391 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking librados2 (16.2.14-521-g0e714d9a-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-02-13T00:18:28.054 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libcephfs2. 2024-02-13T00:18:28.067 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../04-libcephfs2_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:28.112 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libcephfs2 (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:28.448 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-rados. 2024-02-13T00:18:28.462 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../05-python3-rados_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:28.506 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-rados (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:28.842 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-02-13T00:18:28.858 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../06-python3-ceph-argparse_16.2.14-521-g0e714d9a-1focal_all.deb ... 2024-02-13T00:18:28.900 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-ceph-argparse (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:29.203 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-cephfs. 2024-02-13T00:18:29.216 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../07-python3-cephfs_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:29.245 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-cephfs (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:29.361 INFO:teuthology.orchestra.run.smithi106.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 16.2.14-521-g0e714d9a-1focal [116 kB] 2024-02-13T00:18:29.395 INFO:teuthology.orchestra.run.smithi106.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 16.2.14-521-g0e714d9a-1focal [448 kB] 2024-02-13T00:18:29.501 INFO:teuthology.orchestra.run.smithi106.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 16.2.14-521-g0e714d9a-1focal [21.8 MB] 2024-02-13T00:18:29.573 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-ceph-common. 2024-02-13T00:18:29.589 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../08-python3-ceph-common_16.2.14-521-g0e714d9a-1focal_all.deb ... 2024-02-13T00:18:29.648 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-ceph-common (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:29.943 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-prettytable. 2024-02-13T00:18:29.957 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../09-python3-prettytable_0.7.2-5_all.deb ... 2024-02-13T00:18:30.001 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-02-13T00:18:30.253 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-rbd. 2024-02-13T00:18:30.268 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../10-python3-rbd_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:30.312 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-rbd (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:30.681 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-02-13T00:18:30.694 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../11-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-02-13T00:18:30.731 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-02-13T00:18:31.075 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-02-13T00:18:31.090 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../12-librabbitmq4_0.10.0-1_amd64.deb ... 2024-02-13T00:18:31.134 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-02-13T00:18:31.479 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-02-13T00:18:31.493 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../13-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-02-13T00:18:31.537 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-02-13T00:18:31.881 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package librgw2. 2024-02-13T00:18:31.894 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../14-librgw2_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:31.931 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking librgw2 (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:32.542 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-rgw. 2024-02-13T00:18:32.557 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../15-python3-rgw_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:32.600 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-rgw (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:32.727 INFO:teuthology.orchestra.run.smithi106.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 16.2.14-521-g0e714d9a-1focal [4,731 kB] 2024-02-13T00:18:32.911 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libleveldb1d:amd64. 2024-02-13T00:18:32.924 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../16-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2024-02-13T00:18:32.969 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2024-02-13T00:18:33.055 INFO:teuthology.orchestra.run.smithi106.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 16.2.14-521-g0e714d9a-1focal [204 kB] 2024-02-13T00:18:33.085 INFO:teuthology.orchestra.run.smithi106.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 16.2.14-521-g0e714d9a-1focal [126 kB] 2024-02-13T00:18:33.088 INFO:teuthology.orchestra.run.smithi106.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 16.2.14-521-g0e714d9a-1focal [1,551 kB] 2024-02-13T00:18:33.198 INFO:teuthology.orchestra.run.smithi106.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 16.2.14-521-g0e714d9a-1focal [4,015 kB] 2024-02-13T00:18:33.322 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package liboath0. 2024-02-13T00:18:33.336 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../17-liboath0_2.6.1-1.3_amd64.deb ... 2024-02-13T00:18:33.380 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-02-13T00:18:33.485 INFO:teuthology.orchestra.run.smithi106.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 16.2.14-521-g0e714d9a-1focal [21.2 MB] 2024-02-13T00:18:33.770 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libradosstriper1. 2024-02-13T00:18:33.782 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../18-libradosstriper1_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:33.833 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libradosstriper1 (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:34.286 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-common. 2024-02-13T00:18:34.301 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../19-ceph-common_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:34.356 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-common (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:34.807 INFO:teuthology.orchestra.run.smithi106.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 16.2.14-521-g0e714d9a-1focal [4,052 B] 2024-02-13T00:18:34.807 INFO:teuthology.orchestra.run.smithi106.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 16.2.14-521-g0e714d9a-1focal [836 kB] 2024-02-13T00:18:34.813 INFO:teuthology.orchestra.run.smithi106.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 16.2.14-521-g0e714d9a-1focal [2,363 kB] 2024-02-13T00:18:34.916 INFO:teuthology.orchestra.run.smithi106.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 16.2.14-521-g0e714d9a-1focal [77.4 kB] 2024-02-13T00:18:34.916 INFO:teuthology.orchestra.run.smithi106.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 16.2.14-521-g0e714d9a-1focal [100 kB] 2024-02-13T00:18:34.917 INFO:teuthology.orchestra.run.smithi106.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 16.2.14-521-g0e714d9a-1focal [2,824 kB] 2024-02-13T00:18:35.062 INFO:teuthology.orchestra.run.smithi106.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 16.2.14-521-g0e714d9a-1focal [7,874 kB] 2024-02-13T00:18:35.452 INFO:teuthology.orchestra.run.smithi106.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 16.2.14-521-g0e714d9a-1focal [4,168 B] 2024-02-13T00:18:35.453 INFO:teuthology.orchestra.run.smithi106.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 16.2.14-521-g0e714d9a-1focal [45.8 MB] 2024-02-13T00:18:36.475 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-base. 2024-02-13T00:18:36.488 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../20-ceph-base_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:36.615 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-base (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:37.401 INFO:teuthology.orchestra.run.smithi106.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 16.2.14-521-g0e714d9a-1focal [21.5 kB] 2024-02-13T00:18:37.401 INFO:teuthology.orchestra.run.smithi106.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 16.2.14-521-g0e714d9a-1focal [11.3 MB] 2024-02-13T00:18:37.555 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-cryptography. 2024-02-13T00:18:37.569 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../21-python3-cryptography_2.8-3ubuntu0.2_amd64.deb ... 2024-02-13T00:18:37.613 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.2) ... 2024-02-13T00:18:37.669 INFO:teuthology.orchestra.run.smithi106.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-02-08-0854-pacific/0e714d9a4bd2a821113e6318adb87bd06cf81ec1/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 16.2.14-521-g0e714d9a-1focal [78.1 kB] 2024-02-13T00:18:37.983 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-openssl. 2024-02-13T00:18:37.997 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../22-python3-openssl_19.0.0-1build1_all.deb ... 2024-02-13T00:18:38.041 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-02-13T00:18:38.294 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-02-13T00:18:38.309 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../23-ceph-mgr-modules-core_16.2.14-521-g0e714d9a-1focal_all.deb ... 2024-02-13T00:18:38.322 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 160 MB in 19s (8,574 kB/s) 2024-02-13T00:18:38.352 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr-modules-core (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:38.414 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjaeger. 2024-02-13T00:18:38.460 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 112645 files and directories currently installed.) 2024-02-13T00:18:38.464 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../00-libjaeger_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:38.504 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjaeger (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:38.665 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-bcrypt. 2024-02-13T00:18:38.679 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../24-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-02-13T00:18:38.715 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-02-13T00:18:38.849 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-02-13T00:18:38.863 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../01-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-02-13T00:18:38.949 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-02-13T00:18:39.018 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-cherrypy3. 2024-02-13T00:18:39.031 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../25-python3-cherrypy3_8.9.1-6_all.deb ... 2024-02-13T00:18:39.076 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-02-13T00:18:39.291 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../02-librbd1_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:39.396 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-jwt. 2024-02-13T00:18:39.410 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../26-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-02-13T00:18:39.419 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librbd1 (16.2.14-521-g0e714d9a-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-02-13T00:18:39.454 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-02-13T00:18:39.699 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-logutils. 2024-02-13T00:18:39.713 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../27-python3-logutils_0.3.3-7_all.deb ... 2024-02-13T00:18:39.757 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-02-13T00:18:40.043 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-markupsafe. 2024-02-13T00:18:40.058 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../28-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-02-13T00:18:40.071 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../03-librados2_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:40.101 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-02-13T00:18:40.198 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librados2 (16.2.14-521-g0e714d9a-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-02-13T00:18:40.412 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-mako. 2024-02-13T00:18:40.426 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../29-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-02-13T00:18:40.471 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-02-13T00:18:40.799 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-simplegeneric. 2024-02-13T00:18:40.812 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../30-python3-simplegeneric_0.8.1-3_all.deb ... 2024-02-13T00:18:40.844 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libcephfs2. 2024-02-13T00:18:40.857 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-02-13T00:18:40.859 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../04-libcephfs2_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:40.902 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libcephfs2 (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:41.143 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-singledispatch. 2024-02-13T00:18:41.152 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../31-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-02-13T00:18:41.193 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-02-13T00:18:41.229 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rados. 2024-02-13T00:18:41.242 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../05-python3-rados_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:41.279 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rados (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:41.471 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-webob. 2024-02-13T00:18:41.486 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../32-python3-webob_1%3a1.8.5-2_all.deb ... 2024-02-13T00:18:41.529 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-02-13T00:18:41.666 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-02-13T00:18:41.674 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../06-python3-ceph-argparse_16.2.14-521-g0e714d9a-1focal_all.deb ... 2024-02-13T00:18:41.715 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-ceph-argparse (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:41.840 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-soupsieve. 2024-02-13T00:18:41.854 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../33-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-02-13T00:18:41.898 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-02-13T00:18:42.018 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cephfs. 2024-02-13T00:18:42.034 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../07-python3-cephfs_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:42.077 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cephfs (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:42.184 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-bs4. 2024-02-13T00:18:42.198 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../34-python3-bs4_4.8.2-1_all.deb ... 2024-02-13T00:18:42.234 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-02-13T00:18:42.379 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-ceph-common. 2024-02-13T00:18:42.394 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../08-python3-ceph-common_16.2.14-521-g0e714d9a-1focal_all.deb ... 2024-02-13T00:18:42.429 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-ceph-common (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:42.588 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-waitress. 2024-02-13T00:18:42.602 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../35-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-02-13T00:18:42.648 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-02-13T00:18:42.732 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-prettytable. 2024-02-13T00:18:42.747 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../09-python3-prettytable_0.7.2-5_all.deb ... 2024-02-13T00:18:42.791 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-02-13T00:18:42.965 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-tempita. 2024-02-13T00:18:42.981 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../36-python3-tempita_0.5.2-6_all.deb ... 2024-02-13T00:18:43.023 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-02-13T00:18:43.043 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rbd. 2024-02-13T00:18:43.058 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../10-python3-rbd_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:43.101 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rbd (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:43.326 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-paste. 2024-02-13T00:18:43.339 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../37-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-02-13T00:18:43.376 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-02-13T00:18:43.454 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-02-13T00:18:43.468 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../11-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-02-13T00:18:43.512 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-02-13T00:18:43.696 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-02-13T00:18:43.710 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../38-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-02-13T00:18:43.754 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-02-13T00:18:43.807 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-02-13T00:18:43.820 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../12-librabbitmq4_0.10.0-1_amd64.deb ... 2024-02-13T00:18:43.857 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-02-13T00:18:44.057 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pastedeploy. 2024-02-13T00:18:44.070 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../39-python3-pastedeploy_2.1.0-1_all.deb ... 2024-02-13T00:18:44.107 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-02-13T00:18:44.185 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-02-13T00:18:44.198 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../13-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-02-13T00:18:44.235 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-02-13T00:18:44.410 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-webtest. 2024-02-13T00:18:44.423 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../40-python3-webtest_2.0.32-2_all.deb ... 2024-02-13T00:18:44.468 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-02-13T00:18:44.579 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librgw2. 2024-02-13T00:18:44.595 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../14-librgw2_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:44.637 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librgw2 (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:44.788 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pecan. 2024-02-13T00:18:44.802 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../41-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-02-13T00:18:44.847 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-02-13T00:18:45.217 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-werkzeug. 2024-02-13T00:18:45.223 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rgw. 2024-02-13T00:18:45.233 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../42-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-02-13T00:18:45.238 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../15-python3-rgw_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:45.273 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rgw (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:45.275 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-02-13T00:18:45.592 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libleveldb1d:amd64. 2024-02-13T00:18:45.607 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../16-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2024-02-13T00:18:45.620 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-02-13T00:18:45.634 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../43-libsqlite3-mod-ceph_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:45.651 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2024-02-13T00:18:45.679 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libsqlite3-mod-ceph (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:46.020 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liboath0. 2024-02-13T00:18:46.032 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr. 2024-02-13T00:18:46.033 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../17-liboath0_2.6.1-1.3_amd64.deb ... 2024-02-13T00:18:46.046 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../44-ceph-mgr_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:46.070 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-02-13T00:18:46.090 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:46.448 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libradosstriper1. 2024-02-13T00:18:46.463 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../18-libradosstriper1_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:46.506 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libradosstriper1 (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:46.568 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mon. 2024-02-13T00:18:46.582 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../45-ceph-mon_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:46.626 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mon (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:46.968 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-common. 2024-02-13T00:18:46.981 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../19-ceph-common_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:47.026 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-common (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:47.455 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-osd. 2024-02-13T00:18:47.470 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../46-ceph-osd_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:47.504 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-osd (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:49.156 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-base. 2024-02-13T00:18:49.169 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../20-ceph-base_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:49.216 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-base (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:49.543 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph. 2024-02-13T00:18:49.558 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../47-ceph_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:49.601 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:49.924 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-fuse. 2024-02-13T00:18:49.934 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../48-ceph-fuse_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:49.971 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-fuse (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:50.036 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cryptography. 2024-02-13T00:18:50.050 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../21-python3-cryptography_2.8-3ubuntu0.2_amd64.deb ... 2024-02-13T00:18:50.094 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.2) ... 2024-02-13T00:18:50.399 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mds. 2024-02-13T00:18:50.412 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../49-ceph-mds_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:50.457 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mds (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:50.464 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-openssl. 2024-02-13T00:18:50.479 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../22-python3-openssl_19.0.0-1build1_all.deb ... 2024-02-13T00:18:50.522 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-02-13T00:18:50.792 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-02-13T00:18:50.805 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../23-ceph-mgr-modules-core_16.2.14-521-g0e714d9a-1focal_all.deb ... 2024-02-13T00:18:50.858 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-modules-core (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:51.002 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package cephadm. 2024-02-13T00:18:51.017 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../50-cephadm_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:51.060 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking cephadm (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:51.229 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-bcrypt. 2024-02-13T00:18:51.242 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../24-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-02-13T00:18:51.287 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-02-13T00:18:51.371 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-jinja2. 2024-02-13T00:18:51.385 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../51-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-02-13T00:18:51.430 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-02-13T00:18:51.590 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cherrypy3. 2024-02-13T00:18:51.599 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../25-python3-cherrypy3_8.9.1-6_all.deb ... 2024-02-13T00:18:51.640 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-02-13T00:18:51.757 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-02-13T00:18:51.773 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../52-ceph-mgr-cephadm_16.2.14-521-g0e714d9a-1focal_all.deb ... 2024-02-13T00:18:51.815 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr-cephadm (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:51.977 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jwt. 2024-02-13T00:18:51.991 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../26-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-02-13T00:18:52.035 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-02-13T00:18:52.555 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-logutils. 2024-02-13T00:18:52.563 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../27-python3-logutils_0.3.3-7_all.deb ... 2024-02-13T00:18:52.694 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-repoze.lru. 2024-02-13T00:18:52.709 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../53-python3-repoze.lru_0.7-2_all.deb ... 2024-02-13T00:18:52.960 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-02-13T00:18:53.096 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-02-13T00:18:53.221 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libjs-underscore. 2024-02-13T00:18:53.237 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../54-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-02-13T00:18:53.279 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-02-13T00:18:53.417 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-markupsafe. 2024-02-13T00:18:53.431 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../28-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-02-13T00:18:53.474 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-02-13T00:18:53.540 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-02-13T00:18:53.553 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../55-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-02-13T00:18:53.600 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-02-13T00:18:53.777 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-mako. 2024-02-13T00:18:53.791 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../29-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-02-13T00:18:53.835 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-02-13T00:18:53.909 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-routes. 2024-02-13T00:18:53.925 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../56-python3-routes_2.4.1-2_all.deb ... 2024-02-13T00:18:53.967 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-02-13T00:18:54.171 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-simplegeneric. 2024-02-13T00:18:54.185 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../30-python3-simplegeneric_0.8.1-3_all.deb ... 2024-02-13T00:18:54.230 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-02-13T00:18:54.304 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-02-13T00:18:54.317 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../57-ceph-mgr-dashboard_16.2.14-521-g0e714d9a-1focal_all.deb ... 2024-02-13T00:18:54.362 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr-dashboard (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:54.524 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-singledispatch. 2024-02-13T00:18:54.538 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../31-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-02-13T00:18:54.582 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-02-13T00:18:54.877 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webob. 2024-02-13T00:18:54.890 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../32-python3-webob_1%3a1.8.5-2_all.deb ... 2024-02-13T00:18:54.935 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-02-13T00:18:55.254 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-soupsieve. 2024-02-13T00:18:55.263 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../33-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-02-13T00:18:55.304 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-02-13T00:18:55.378 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-decorator. 2024-02-13T00:18:55.394 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../58-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-02-13T00:18:55.436 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-02-13T00:18:55.616 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-bs4. 2024-02-13T00:18:55.629 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../34-python3-bs4_4.8.2-1_all.deb ... 2024-02-13T00:18:55.674 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-02-13T00:18:55.747 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-02-13T00:18:55.762 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../59-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-02-13T00:18:55.805 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-02-13T00:18:56.043 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-waitress. 2024-02-13T00:18:56.057 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../35-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-02-13T00:18:56.105 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-02-13T00:18:56.116 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-scipy. 2024-02-13T00:18:56.130 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../60-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-02-13T00:18:56.174 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-02-13T00:18:56.430 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-tempita. 2024-02-13T00:18:56.443 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../36-python3-tempita_0.5.2-6_all.deb ... 2024-02-13T00:18:56.488 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-02-13T00:18:56.791 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-paste. 2024-02-13T00:18:56.807 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../37-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-02-13T00:18:56.849 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-02-13T00:18:57.185 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-02-13T00:18:57.199 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../38-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-02-13T00:18:57.243 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-02-13T00:18:57.484 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-02-13T00:18:57.497 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../61-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-02-13T00:18:57.541 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-02-13T00:18:57.546 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pastedeploy. 2024-02-13T00:18:57.559 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../39-python3-pastedeploy_2.1.0-1_all.deb ... 2024-02-13T00:18:57.596 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-02-13T00:18:57.874 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webtest. 2024-02-13T00:18:58.033 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../40-python3-webtest_2.0.32-2_all.deb ... 2024-02-13T00:18:58.033 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-02-13T00:18:58.120 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-joblib. 2024-02-13T00:18:58.143 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../62-python3-joblib_0.14.0-3_all.deb ... 2024-02-13T00:18:58.172 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pecan. 2024-02-13T00:18:58.178 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-02-13T00:18:58.183 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../41-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-02-13T00:18:58.229 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-02-13T00:18:58.532 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-sklearn. 2024-02-13T00:18:58.546 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../63-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-02-13T00:18:58.573 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-werkzeug. 2024-02-13T00:18:58.587 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../42-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-02-13T00:18:58.589 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-02-13T00:18:58.631 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-02-13T00:18:58.985 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-02-13T00:18:58.999 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../43-libsqlite3-mod-ceph_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:59.042 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libsqlite3-mod-ceph (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:59.297 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-02-13T00:18:59.313 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../64-ceph-mgr-diskprediction-local_16.2.14-521-g0e714d9a-1focal_all.deb ... 2024-02-13T00:18:59.364 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr-diskprediction-local (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:59.395 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr. 2024-02-13T00:18:59.409 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../44-ceph-mgr_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:59.445 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:18:59.931 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mon. 2024-02-13T00:18:59.945 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../45-ceph-mon_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:18:59.989 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mon (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:00.508 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-cachetools. 2024-02-13T00:19:00.522 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../65-python3-cachetools_4.0.0-1_all.deb ... 2024-02-13T00:19:00.566 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-02-13T00:19:00.735 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-osd. 2024-02-13T00:19:00.750 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../46-ceph-osd_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:19:00.793 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-osd (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:00.886 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pyasn1. 2024-02-13T00:19:00.901 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../66-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-02-13T00:19:00.944 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-02-13T00:19:01.264 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-02-13T00:19:01.278 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../67-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-02-13T00:19:01.322 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-02-13T00:19:01.645 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-rsa. 2024-02-13T00:19:01.661 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../68-python3-rsa_4.0-3_all.deb ... 2024-02-13T00:19:01.704 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-rsa (4.0-3) ... 2024-02-13T00:19:02.007 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-google-auth. 2024-02-13T00:19:02.021 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../69-python3-google-auth_1.5.1-2_all.deb ... 2024-02-13T00:19:02.065 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-02-13T00:19:02.367 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-blinker. 2024-02-13T00:19:02.382 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../70-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-02-13T00:19:02.425 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-02-13T00:19:02.728 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-oauthlib. 2024-02-13T00:19:02.742 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../71-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-02-13T00:19:02.786 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-02-13T00:19:02.798 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph. 2024-02-13T00:19:02.812 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../47-ceph_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:19:02.856 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:03.136 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-02-13T00:19:03.151 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../72-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-02-13T00:19:03.198 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-02-13T00:19:03.201 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-fuse. 2024-02-13T00:19:03.214 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../48-ceph-fuse_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:19:03.242 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-fuse (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:03.492 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-websocket. 2024-02-13T00:19:03.506 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../73-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-02-13T00:19:03.550 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-02-13T00:19:03.654 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mds. 2024-02-13T00:19:03.667 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../49-ceph-mds_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:19:03.704 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mds (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:03.871 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-kubernetes. 2024-02-13T00:19:03.886 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../74-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-02-13T00:19:03.929 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-02-13T00:19:04.215 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package cephadm. 2024-02-13T00:19:04.228 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../50-cephadm_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:19:04.273 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking cephadm (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:04.483 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-02-13T00:19:04.498 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../75-ceph-mgr-k8sevents_16.2.14-521-g0e714d9a-1focal_all.deb ... 2024-02-13T00:19:04.541 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-mgr-k8sevents (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:04.584 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jinja2. 2024-02-13T00:19:04.599 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../51-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-02-13T00:19:04.643 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-02-13T00:19:04.861 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libonig5:amd64. 2024-02-13T00:19:04.875 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../76-libonig5_6.9.4-1_amd64.deb ... 2024-02-13T00:19:04.919 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-02-13T00:19:04.970 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-02-13T00:19:04.986 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../52-ceph-mgr-cephadm_16.2.14-521-g0e714d9a-1focal_all.deb ... 2024-02-13T00:19:05.028 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-cephadm (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:05.272 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libjq1:amd64. 2024-02-13T00:19:05.286 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../77-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-02-13T00:19:05.330 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-02-13T00:19:05.382 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-repoze.lru. 2024-02-13T00:19:05.395 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../53-python3-repoze.lru_0.7-2_all.deb ... 2024-02-13T00:19:05.440 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-02-13T00:19:05.591 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package jq. 2024-02-13T00:19:05.606 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../78-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-02-13T00:19:05.649 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-02-13T00:19:05.709 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjs-underscore. 2024-02-13T00:19:05.723 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../54-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-02-13T00:19:05.767 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-02-13T00:19:05.902 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package socat. 2024-02-13T00:19:05.917 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../79-socat_1.7.3.3-2_amd64.deb ... 2024-02-13T00:19:05.960 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking socat (1.7.3.3-2) ... 2024-02-13T00:19:06.028 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-02-13T00:19:06.043 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../55-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-02-13T00:19:06.086 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-02-13T00:19:06.296 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package xmlstarlet. 2024-02-13T00:19:06.310 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../80-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-02-13T00:19:06.354 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-02-13T00:19:06.413 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-routes. 2024-02-13T00:19:06.427 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../56-python3-routes_2.4.1-2_all.deb ... 2024-02-13T00:19:06.472 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-02-13T00:19:06.778 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package ceph-test. 2024-02-13T00:19:06.794 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../81-ceph-test_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:19:06.825 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-02-13T00:19:06.836 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking ceph-test (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:06.838 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../57-ceph-mgr-dashboard_16.2.14-521-g0e714d9a-1focal_all.deb ... 2024-02-13T00:19:06.883 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-dashboard (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:07.840 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-decorator. 2024-02-13T00:19:07.854 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../58-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-02-13T00:19:07.898 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-02-13T00:19:08.209 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-02-13T00:19:08.224 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../59-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-02-13T00:19:08.267 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-02-13T00:19:08.929 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-scipy. 2024-02-13T00:19:08.943 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../60-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-02-13T00:19:08.987 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-02-13T00:19:10.278 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-02-13T00:19:10.292 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../61-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-02-13T00:19:10.335 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-02-13T00:19:10.623 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package libcephfs-dev. 2024-02-13T00:19:10.637 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../82-libcephfs-dev_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:19:10.681 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking libcephfs-dev (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:10.839 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-joblib. 2024-02-13T00:19:10.856 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../62-python3-joblib_0.14.0-3_all.deb ... 2024-02-13T00:19:10.897 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-02-13T00:19:11.076 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package nvme-cli. 2024-02-13T00:19:11.090 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../83-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-02-13T00:19:11.142 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-02-13T00:19:11.259 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-sklearn. 2024-02-13T00:19:11.275 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../63-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-02-13T00:19:11.317 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-02-13T00:19:11.509 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-atomicwrites. 2024-02-13T00:19:11.523 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../84-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-02-13T00:19:11.567 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-02-13T00:19:11.887 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-attr. 2024-02-13T00:19:11.901 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../85-python3-attr_19.3.0-2_all.deb ... 2024-02-13T00:19:11.945 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-02-13T00:19:12.025 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-02-13T00:19:12.040 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../64-ceph-mgr-diskprediction-local_16.2.14-521-g0e714d9a-1focal_all.deb ... 2024-02-13T00:19:12.083 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-diskprediction-local (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:12.298 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-webencodings. 2024-02-13T00:19:12.312 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../86-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-02-13T00:19:12.356 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-02-13T00:19:12.650 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-html5lib. 2024-02-13T00:19:12.659 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../87-python3-html5lib_1.0.1-2_all.deb ... 2024-02-13T00:19:12.700 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-02-13T00:19:13.053 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-02-13T00:19:13.062 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../88-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-02-13T00:19:13.102 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-02-13T00:19:13.211 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cachetools. 2024-02-13T00:19:13.225 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../65-python3-cachetools_4.0.0-1_all.deb ... 2024-02-13T00:19:13.269 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-02-13T00:19:13.555 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyasn1. 2024-02-13T00:19:13.556 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-packaging. 2024-02-13T00:19:13.565 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../89-python3-packaging_20.3-1_all.deb ... 2024-02-13T00:19:13.571 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../66-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-02-13T00:19:13.605 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-packaging (20.3-1) ... 2024-02-13T00:19:13.613 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-02-13T00:19:13.908 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pastescript. 2024-02-13T00:19:13.922 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../90-python3-pastescript_2.0.2-4_all.deb ... 2024-02-13T00:19:13.954 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-02-13T00:19:13.966 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-02-13T00:19:13.968 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../67-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-02-13T00:19:14.012 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-02-13T00:19:14.287 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pluggy. 2024-02-13T00:19:14.300 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../91-python3-pluggy_0.13.0-2_all.deb ... 2024-02-13T00:19:14.323 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rsa. 2024-02-13T00:19:14.338 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../68-python3-rsa_4.0-3_all.deb ... 2024-02-13T00:19:14.344 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-02-13T00:19:14.381 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rsa (4.0-3) ... 2024-02-13T00:19:14.639 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-psutil. 2024-02-13T00:19:14.655 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../92-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-02-13T00:19:14.666 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-google-auth. 2024-02-13T00:19:14.680 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../69-python3-google-auth_1.5.1-2_all.deb ... 2024-02-13T00:19:14.697 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-02-13T00:19:14.724 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-02-13T00:19:15.034 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-py. 2024-02-13T00:19:15.050 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../93-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-02-13T00:19:15.068 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-blinker. 2024-02-13T00:19:15.082 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../70-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-02-13T00:19:15.092 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-02-13T00:19:15.127 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-02-13T00:19:15.411 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pyinotify. 2024-02-13T00:19:15.426 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../94-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-02-13T00:19:15.446 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-oauthlib. 2024-02-13T00:19:15.461 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../71-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-02-13T00:19:15.469 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-02-13T00:19:15.504 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-02-13T00:19:15.797 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-wcwidth. 2024-02-13T00:19:15.813 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../95-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-02-13T00:19:15.824 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-02-13T00:19:15.838 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../72-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-02-13T00:19:15.855 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-02-13T00:19:15.882 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-02-13T00:19:16.158 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-pytest. 2024-02-13T00:19:16.174 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../96-python3-pytest_4.6.9-1_all.deb ... 2024-02-13T00:19:16.186 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-websocket. 2024-02-13T00:19:16.199 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../73-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-02-13T00:19:16.216 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-02-13T00:19:16.244 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-02-13T00:19:16.539 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-kubernetes. 2024-02-13T00:19:16.553 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../74-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-02-13T00:19:16.553 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package python3-simplejson. 2024-02-13T00:19:16.567 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../97-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-02-13T00:19:16.596 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-02-13T00:19:16.620 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-02-13T00:19:17.049 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package radosgw. 2024-02-13T00:19:17.063 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../98-radosgw_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:19:17.101 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-02-13T00:19:17.107 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking radosgw (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:17.115 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../75-ceph-mgr-k8sevents_16.2.14-521-g0e714d9a-1focal_all.deb ... 2024-02-13T00:19:17.159 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-k8sevents (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:17.462 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libonig5:amd64. 2024-02-13T00:19:17.476 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../76-libonig5_6.9.4-1_amd64.deb ... 2024-02-13T00:19:17.520 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-02-13T00:19:17.873 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjq1:amd64. 2024-02-13T00:19:17.887 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../77-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-02-13T00:19:17.931 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-02-13T00:19:18.209 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package jq. 2024-02-13T00:19:18.223 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../78-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-02-13T00:19:18.266 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-02-13T00:19:18.268 INFO:teuthology.orchestra.run.smithi080.stdout:Selecting previously unselected package rbd-fuse. 2024-02-13T00:19:18.282 INFO:teuthology.orchestra.run.smithi080.stdout:Preparing to unpack .../99-rbd-fuse_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:19:18.326 INFO:teuthology.orchestra.run.smithi080.stdout:Unpacking rbd-fuse (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:18.544 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package socat. 2024-02-13T00:19:18.559 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../79-socat_1.7.3.3-2_amd64.deb ... 2024-02-13T00:19:18.602 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking socat (1.7.3.3-2) ... 2024-02-13T00:19:18.629 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-attr (19.3.0-2) ... 2024-02-13T00:19:18.905 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package xmlstarlet. 2024-02-13T00:19:18.919 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../80-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-02-13T00:19:18.923 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2024-02-13T00:19:18.963 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-02-13T00:19:19.049 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-02-13T00:19:19.175 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-02-13T00:19:19.393 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up cephadm (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:19.394 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-test. 2024-02-13T00:19:19.408 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../81-ceph-test_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:19:19.452 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-test (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:19.938 INFO:teuthology.orchestra.run.smithi080.stdout:Adding system user cephadm....done 2024-02-13T00:19:20.095 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-02-13T00:19:20.446 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-02-13T00:19:20.730 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-02-13T00:19:20.856 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-02-13T00:19:21.183 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-02-13T00:19:21.584 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-02-13T00:19:21.869 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-02-13T00:19:22.145 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-02-13T00:19:22.421 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-02-13T00:19:22.714 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-ceph-argparse (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:23.007 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-02-13T00:19:23.133 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-02-13T00:19:23.181 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libcephfs-dev. 2024-02-13T00:19:23.196 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../82-libcephfs-dev_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:19:23.239 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libcephfs-dev (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:23.417 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-02-13T00:19:23.636 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package nvme-cli. 2024-02-13T00:19:23.649 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../83-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-02-13T00:19:23.704 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-02-13T00:19:23.709 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-02-13T00:19:24.061 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-02-13T00:19:24.067 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-atomicwrites. 2024-02-13T00:19:24.081 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../84-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-02-13T00:19:24.117 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-02-13T00:19:24.345 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-02-13T00:19:24.419 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-attr. 2024-02-13T00:19:24.433 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../85-python3-attr_19.3.0-2_all.deb ... 2024-02-13T00:19:24.477 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-02-13T00:19:24.684 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-02-13T00:19:24.864 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webencodings. 2024-02-13T00:19:24.877 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../86-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-02-13T00:19:24.922 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-02-13T00:19:24.976 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libjaeger (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:25.102 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-02-13T00:19:25.224 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-html5lib. 2024-02-13T00:19:25.233 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../87-python3-html5lib_1.0.1-2_all.deb ... 2024-02-13T00:19:25.274 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-02-13T00:19:25.437 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-02-13T00:19:25.594 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-02-13T00:19:25.608 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../88-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-02-13T00:19:25.652 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-02-13T00:19:25.730 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-packaging (20.3-1) ... 2024-02-13T00:19:26.023 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-02-13T00:19:26.130 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-packaging. 2024-02-13T00:19:26.144 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../89-python3-packaging_20.3-1_all.deb ... 2024-02-13T00:19:26.150 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-02-13T00:19:26.188 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-packaging (20.3-1) ... 2024-02-13T00:19:26.433 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-02-13T00:19:26.491 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pastescript. 2024-02-13T00:19:26.505 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../90-python3-pastescript_2.0.2-4_all.deb ... 2024-02-13T00:19:26.549 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-02-13T00:19:26.828 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-02-13T00:19:26.886 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pluggy. 2024-02-13T00:19:26.900 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../91-python3-pluggy_0.13.0-2_all.deb ... 2024-02-13T00:19:26.944 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-02-13T00:19:27.180 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-cryptography (2.8-3ubuntu0.2) ... 2024-02-13T00:19:27.255 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-psutil. 2024-02-13T00:19:27.264 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../92-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-02-13T00:19:27.305 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-02-13T00:19:27.565 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up socat (1.7.3.3-2) ... 2024-02-13T00:19:27.691 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-ceph-common (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:27.708 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-py. 2024-02-13T00:19:27.717 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../93-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-02-13T00:19:27.766 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-02-13T00:19:28.017 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-02-13T00:19:28.119 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyinotify. 2024-02-13T00:19:28.135 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../94-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-02-13T00:19:28.177 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-02-13T00:19:28.360 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-02-13T00:19:28.486 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-02-13T00:19:28.522 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-wcwidth. 2024-02-13T00:19:28.522 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../95-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-02-13T00:19:28.555 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-02-13T00:19:28.613 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-02-13T00:19:28.850 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pytest. 2024-02-13T00:19:28.865 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../96-python3-pytest_4.6.9-1_all.deb ... 2024-02-13T00:19:28.908 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-02-13T00:19:28.914 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-02-13T00:19:29.220 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-simplejson. 2024-02-13T00:19:29.235 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../97-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-02-13T00:19:29.256 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-02-13T00:19:29.278 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-02-13T00:19:29.382 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-02-13T00:19:29.698 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package radosgw. 2024-02-13T00:19:29.709 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-02-13T00:19:29.712 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../98-radosgw_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:19:29.756 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking radosgw (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:29.985 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-02-13T00:19:30.277 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-02-13T00:19:30.403 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-02-13T00:19:30.688 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-02-13T00:19:30.951 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package rbd-fuse. 2024-02-13T00:19:30.967 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../99-rbd-fuse_16.2.14-521-g0e714d9a-1focal_amd64.deb ... 2024-02-13T00:19:30.980 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-02-13T00:19:31.009 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking rbd-fuse (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:31.282 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-02-13T00:19:31.334 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-attr (19.3.0-2) ... 2024-02-13T00:19:31.622 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2024-02-13T00:19:31.686 INFO:teuthology.orchestra.run.smithi080.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-02-13T00:19:31.748 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-02-13T00:19:31.874 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-02-13T00:19:31.926 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-02-13T00:19:32.052 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-02-13T00:19:32.059 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up cephadm (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:32.370 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-02-13T00:19:32.632 INFO:teuthology.orchestra.run.smithi106.stdout:Adding system user cephadm....done 2024-02-13T00:19:32.722 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-02-13T00:19:32.785 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-02-13T00:19:32.848 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-02-13T00:19:32.976 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-02-13T00:19:33.128 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-02-13T00:19:33.302 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-02-13T00:19:33.429 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-02-13T00:19:33.555 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-02-13T00:19:33.595 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up librados2 (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:33.737 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-02-13T00:19:33.865 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-02-13T00:19:34.267 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-02-13T00:19:34.542 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-02-13T00:19:34.844 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-02-13T00:19:35.128 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-02-13T00:19:35.263 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up librgw2 (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:35.392 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libsqlite3-mod-ceph (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:35.446 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-ceph-argparse (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:35.507 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-02-13T00:19:35.633 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-02-13T00:19:35.722 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-02-13T00:19:35.848 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-02-13T00:19:36.018 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-02-13T00:19:36.124 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-02-13T00:19:36.310 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-02-13T00:19:36.412 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-02-13T00:19:36.599 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-02-13T00:19:36.780 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-02-13T00:19:36.942 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libcephfs2 (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:37.064 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-02-13T00:19:37.076 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-02-13T00:19:37.395 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libradosstriper1 (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:37.398 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-02-13T00:19:37.521 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-02-13T00:19:37.683 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjaeger (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:37.809 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-02-13T00:19:37.847 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-02-13T00:19:38.152 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-02-13T00:19:38.438 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-packaging (20.3-1) ... 2024-02-13T00:19:38.737 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-02-13T00:19:38.863 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-02-13T00:19:38.920 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up librbd1 (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:39.046 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-02-13T00:19:39.141 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-02-13T00:19:39.172 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-02-13T00:19:39.448 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-rsa (4.0-3) ... 2024-02-13T00:19:39.749 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-02-13T00:19:39.959 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-02-13T00:19:40.042 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr-modules-core (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:40.168 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-fuse (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:40.352 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cryptography (2.8-3ubuntu0.2) ... 2024-02-13T00:19:40.392 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-13T00:19:40.392 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-13T00:19:40.704 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up socat (1.7.3.3-2) ... 2024-02-13T00:19:40.822 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-ceph-common (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:40.869 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up libcephfs-dev (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:40.996 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-02-13T00:19:41.132 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-02-13T00:19:41.305 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-02-13T00:19:41.491 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-02-13T00:19:41.607 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-02-13T00:19:41.617 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-02-13T00:19:41.743 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-02-13T00:19:41.967 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-rados (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:42.027 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-02-13T00:19:42.093 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-rbd (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:42.219 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up rbd-fuse (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:42.337 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-02-13T00:19:42.345 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-routes (2.4.1-2) ... 2024-02-13T00:19:42.463 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-02-13T00:19:42.647 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-02-13T00:19:42.798 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-02-13T00:19:43.026 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-rgw (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:43.074 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-02-13T00:19:43.152 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-cephfs (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:43.366 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-02-13T00:19:43.453 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-02-13T00:19:43.492 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-02-13T00:19:43.793 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-02-13T00:19:44.078 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-02-13T00:19:44.374 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-common (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:44.378 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-02-13T00:19:44.742 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-02-13T00:19:44.975 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-02-13T00:19:45.101 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-02-13T00:19:45.258 INFO:teuthology.orchestra.run.smithi080.stdout:Adding group ceph....done 2024-02-13T00:19:45.403 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-02-13T00:19:45.670 INFO:teuthology.orchestra.run.smithi080.stdout:Adding system user ceph....done 2024-02-13T00:19:45.764 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-02-13T00:19:45.846 INFO:teuthology.orchestra.run.smithi080.stdout:Setting system user ceph properties....done 2024-02-13T00:19:45.864 INFO:teuthology.orchestra.run.smithi080.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-02-13T00:19:45.891 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-02-13T00:19:46.005 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-02-13T00:19:46.017 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-02-13T00:19:46.343 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-02-13T00:19:46.360 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-02-13T00:19:46.636 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librados2 (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:46.762 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-02-13T00:19:46.825 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-test (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:46.951 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up radosgw (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:47.214 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-13T00:19:47.214 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-13T00:19:47.887 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-base (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:48.254 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librgw2 (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:48.258 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-02-13T00:19:48.380 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libsqlite3-mod-ceph (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:48.506 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-02-13T00:19:48.648 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-02-13T00:19:48.722 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mds (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:48.946 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-13T00:19:48.946 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-13T00:19:49.017 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-02-13T00:19:49.311 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-02-13T00:19:49.415 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:49.596 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-02-13T00:19:49.646 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-13T00:19:49.647 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-13T00:19:49.922 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libcephfs2 (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:50.048 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-02-13T00:19:50.133 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-osd (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:50.383 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libradosstriper1 (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:50.509 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-02-13T00:19:50.653 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-13T00:19:50.654 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-13T00:19:50.852 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-02-13T00:19:51.118 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr-k8sevents (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:51.244 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr-diskprediction-local (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:51.387 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mon (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:51.613 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-13T00:19:51.613 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-13T00:19:51.915 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librbd1 (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:52.042 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-02-13T00:19:52.097 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr-cephadm (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:52.167 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-02-13T00:19:52.240 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:52.310 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rsa (4.0-3) ... 2024-02-13T00:19:52.366 INFO:teuthology.orchestra.run.smithi080.stdout:Setting up ceph-mgr-dashboard (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:52.526 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-02-13T00:19:52.595 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-02-13T00:19:52.820 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-02-13T00:19:52.904 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-modules-core (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:53.030 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-fuse (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:53.247 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-13T00:19:53.248 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-13T00:19:53.748 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libcephfs-dev (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:53.883 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-02-13T00:19:54.192 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-02-13T00:19:54.510 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-02-13T00:19:54.871 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rados (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:55.022 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rbd (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:55.173 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up rbd-fuse (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:55.366 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-routes (2.4.1-2) ... 2024-02-13T00:19:55.658 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-02-13T00:19:55.831 INFO:teuthology.orchestra.run.smithi080.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-02-13T00:19:56.045 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rgw (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:56.171 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cephfs (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:56.285 INFO:teuthology.orchestra.run.smithi080.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-02-13T00:19:56.293 DEBUG:teuthology.parallel:result is None 2024-02-13T00:19:56.455 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-02-13T00:19:57.393 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-common (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:57.962 INFO:teuthology.orchestra.run.smithi106.stdout:Adding group ceph....done 2024-02-13T00:19:58.371 INFO:teuthology.orchestra.run.smithi106.stdout:Adding system user ceph....done 2024-02-13T00:19:58.565 INFO:teuthology.orchestra.run.smithi106.stdout:Setting system user ceph properties....done 2024-02-13T00:19:58.585 INFO:teuthology.orchestra.run.smithi106.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-02-13T00:19:58.731 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-02-13T00:19:59.060 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-02-13T00:19:59.519 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-test (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:59.645 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up radosgw (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:19:59.919 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-13T00:19:59.919 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-13T00:20:00.572 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-base (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:20:00.960 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-02-13T00:20:01.416 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mds (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:20:01.654 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-13T00:20:01.654 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-13T00:20:02.117 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:20:02.339 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-13T00:20:02.339 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-13T00:20:02.810 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-osd (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:20:03.307 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-13T00:20:03.307 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-13T00:20:03.786 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-k8sevents (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:20:03.937 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-diskprediction-local (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:20:04.097 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mon (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:20:04.326 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-13T00:20:04.326 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-13T00:20:04.773 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-cephadm (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:20:04.916 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:20:05.033 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-dashboard (16.2.14-521-g0e714d9a-1focal) ... 2024-02-13T00:20:05.177 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-02-13T00:20:05.486 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-02-13T00:20:08.457 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-02-13T00:20:08.919 INFO:teuthology.orchestra.run.smithi106.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-02-13T00:20:08.923 DEBUG:teuthology.parallel:result is None 2024-02-13T00:20:08.924 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-13T00:20:09.068 DEBUG:teuthology.orchestra.run.smithi080:> dpkg-query -W -f '${Version}' ceph 2024-02-13T00:20:09.090 INFO:teuthology.orchestra.run.smithi080.stdout:16.2.14-521-g0e714d9a-1focal 2024-02-13T00:20:09.091 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-521-g0e714d9a-1focal 2024-02-13T00:20:09.091 INFO:teuthology.task.install:The correct ceph version 16.2.14-521-g0e714d9a-1focal is installed. 2024-02-13T00:20:09.093 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-13T00:20:09.234 DEBUG:teuthology.orchestra.run.smithi106:> dpkg-query -W -f '${Version}' ceph 2024-02-13T00:20:09.256 INFO:teuthology.orchestra.run.smithi106.stdout:16.2.14-521-g0e714d9a-1focal 2024-02-13T00:20:09.257 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-521-g0e714d9a-1focal 2024-02-13T00:20:09.257 INFO:teuthology.task.install:The correct ceph version 16.2.14-521-g0e714d9a-1focal is installed. 2024-02-13T00:20:09.258 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-13T00:20:09.259 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-13T00:20:09.259 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-13T00:20:09.276 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-02-13T00:20:09.276 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-13T00:20:09.313 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-13T00:20:09.314 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-13T00:20:09.314 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/daemon-helper 2024-02-13T00:20:09.336 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-13T00:20:09.390 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-02-13T00:20:09.390 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/daemon-helper 2024-02-13T00:20:09.405 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-13T00:20:09.465 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-13T00:20:09.465 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-13T00:20:09.465 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-13T00:20:09.479 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-13T00:20:09.536 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-02-13T00:20:09.536 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-13T00:20:09.553 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-13T00:20:09.613 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-13T00:20:09.613 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-13T00:20:09.613 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/stdin-killer 2024-02-13T00:20:09.629 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-13T00:20:09.686 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-02-13T00:20:09.686 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/stdin-killer 2024-02-13T00:20:09.701 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-13T00:20:09.759 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-13T00:20:09.838 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client': {'debug ms': 1}, 'global': {'mon election default strategy': 1, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(MON_DOWN\\)', 'missing hit_sets', 'do not have an application enabled', 'application not enabled on pool', 'mons down'], 'sha1': '0e714d9a4bd2a821113e6318adb87bd06cf81ec1', 'cephadm_mode': 'cephadm-package'} 2024-02-13T00:20:09.838 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-13T00:20:09.838 INFO:tasks.cephadm:Cluster fsid is a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:20:09.838 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-13T00:20:09.838 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.80', 'mon.c': '[v2:172.21.15.80:3301,v1:172.21.15.80:6790]', 'mon.b': '172.21.15.106'} 2024-02-13T00:20:09.839 INFO:tasks.cephadm:First mon is mon.a on smithi080 2024-02-13T00:20:09.839 INFO:tasks.cephadm:First mgr is y 2024-02-13T00:20:09.839 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-13T00:20:09.839 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname $(hostname -s) 2024-02-13T00:20:09.856 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname $(hostname -s) 2024-02-13T00:20:09.883 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /etc/ceph 2024-02-13T00:20:09.916 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph 2024-02-13T00:20:09.931 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 777 /etc/ceph 2024-02-13T00:20:09.976 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 777 /etc/ceph 2024-02-13T00:20:09.991 INFO:tasks.cephadm:Writing seed config... 2024-02-13T00:20:09.992 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-13T00:20:09.992 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-13T00:20:09.992 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-02-13T00:20:09.992 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2024-02-13T00:20:09.992 INFO:tasks.cephadm: override: [global] ms type = async 2024-02-13T00:20:09.992 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-13T00:20:09.992 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-13T00:20:09.992 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-13T00:20:09.992 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-02-13T00:20:09.992 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-13T00:20:09.992 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-13T00:20:09.992 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-02-13T00:20:09.993 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-13T00:20:09.993 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-13T00:20:10.027 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = a5ae7724-ca05-11ee-95b9-87774f69a715 mon election default strategy = 1 ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug ms = 1 2024-02-13T00:20:10.027 DEBUG:teuthology.orchestra.run.smithi080:mon.a> sudo journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@mon.a.service 2024-02-13T00:20:10.070 DEBUG:teuthology.orchestra.run.smithi080:mgr.y> sudo journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@mgr.y.service 2024-02-13T00:20:10.117 INFO:tasks.cephadm:Bootstrapping... 2024-02-13T00:20:10.118 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -v bootstrap --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.80 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-13T00:20:10.520 INFO:journalctl@ceph.mgr.y.smithi080.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-13T00:20:10.592 INFO:teuthology.orchestra.run.smithi080.stderr:-------------------------------------------------------------------------------- 2024-02-13T00:20:10.592 INFO:teuthology.orchestra.run.smithi080.stderr:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1', '-v', 'bootstrap', '--fsid', 'a5ae7724-ca05-11ee-95b9-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.80', '--skip-admin-label'] 2024-02-13T00:20:10.592 INFO:teuthology.orchestra.run.smithi080.stderr:Verifying podman|docker is present... 2024-02-13T00:20:10.592 INFO:teuthology.orchestra.run.smithi080.stderr:Verifying lvm2 is present... 2024-02-13T00:20:10.592 INFO:teuthology.orchestra.run.smithi080.stderr:Verifying time synchronization is in place... 2024-02-13T00:20:10.598 INFO:journalctl@ceph.mon.a.smithi080.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-13T00:20:10.599 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-02-13T00:20:10.604 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: inactive 2024-02-13T00:20:10.610 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Failed to get unit file state for chronyd.service: No such file or directory 2024-02-13T00:20:10.617 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: inactive 2024-02-13T00:20:10.622 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: masked 2024-02-13T00:20:10.629 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: inactive 2024-02-13T00:20:10.636 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Failed to get unit file state for ntpd.service: No such file or directory 2024-02-13T00:20:10.643 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: inactive 2024-02-13T00:20:10.651 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: enabled 2024-02-13T00:20:10.658 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: active 2024-02-13T00:20:10.660 INFO:teuthology.orchestra.run.smithi080.stderr:Unit ntp.service is enabled and running 2024-02-13T00:20:10.660 INFO:teuthology.orchestra.run.smithi080.stderr:Repeating the final host check... 2024-02-13T00:20:10.660 INFO:teuthology.orchestra.run.smithi080.stderr:docker (/usr/bin/docker) is present 2024-02-13T00:20:10.660 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl is present 2024-02-13T00:20:10.660 INFO:teuthology.orchestra.run.smithi080.stderr:lvcreate is present 2024-02-13T00:20:10.667 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-02-13T00:20:10.672 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: inactive 2024-02-13T00:20:10.678 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Failed to get unit file state for chronyd.service: No such file or directory 2024-02-13T00:20:10.684 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: inactive 2024-02-13T00:20:10.691 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: masked 2024-02-13T00:20:10.699 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: inactive 2024-02-13T00:20:10.709 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Failed to get unit file state for ntpd.service: No such file or directory 2024-02-13T00:20:10.716 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: inactive 2024-02-13T00:20:10.724 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: enabled 2024-02-13T00:20:10.732 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: active 2024-02-13T00:20:10.733 INFO:teuthology.orchestra.run.smithi080.stderr:Unit ntp.service is enabled and running 2024-02-13T00:20:10.733 INFO:teuthology.orchestra.run.smithi080.stderr:Host looks OK 2024-02-13T00:20:10.733 INFO:teuthology.orchestra.run.smithi080.stderr:Cluster fsid: a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:20:10.733 INFO:teuthology.orchestra.run.smithi080.stderr:Acquiring lock 139866605132528 on /run/cephadm/a5ae7724-ca05-11ee-95b9-87774f69a715.lock 2024-02-13T00:20:10.733 INFO:teuthology.orchestra.run.smithi080.stderr:Lock 139866605132528 acquired on /run/cephadm/a5ae7724-ca05-11ee-95b9-87774f69a715.lock 2024-02-13T00:20:10.734 INFO:teuthology.orchestra.run.smithi080.stderr:Verifying IP 172.21.15.80 port 3300 ... 2024-02-13T00:20:10.734 INFO:teuthology.orchestra.run.smithi080.stderr:Verifying IP 172.21.15.80 port 6789 ... 2024-02-13T00:20:10.734 INFO:teuthology.orchestra.run.smithi080.stderr:Base mon IP(s) is [172.21.15.80:3300, 172.21.15.80:6789], mon addrv is [v2:172.21.15.80:3300,v1:172.21.15.80:6789] 2024-02-13T00:20:10.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/sbin/ip: default via 172.21.15.254 dev enp3s0f1 2024-02-13T00:20:10.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/sbin/ip: default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.80 metric 100 2024-02-13T00:20:10.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/sbin/ip: 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2024-02-13T00:20:10.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/sbin/ip: 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.80 2024-02-13T00:20:10.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/sbin/ip: 172.21.15.254 dev enp3s0f1 proto dhcp scope link src 172.21.15.80 metric 100 2024-02-13T00:20:10.742 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2024-02-13T00:20:10.743 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/sbin/ip: fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-02-13T00:20:10.743 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 expires 1787sec pref medium 2024-02-13T00:20:10.745 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-02-13T00:20:10.745 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/sbin/ip: inet6 ::1/128 scope host 2024-02-13T00:20:10.745 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/sbin/ip: valid_lft forever preferred_lft forever 2024-02-13T00:20:10.745 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/sbin/ip: 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-02-13T00:20:10.745 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/sbin/ip: inet6 fe80::ec4:7aff:fe8f:cba9/64 scope link 2024-02-13T00:20:10.745 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/sbin/ip: valid_lft forever preferred_lft forever 2024-02-13T00:20:10.747 INFO:teuthology.orchestra.run.smithi080.stderr:Mon IP `172.21.15.80` is in CIDR network `172.21.0.0/20` 2024-02-13T00:20:10.747 INFO:teuthology.orchestra.run.smithi080.stderr:Mon IP `172.21.15.80` is in CIDR network `172.21.0.0/20` 2024-02-13T00:20:10.747 INFO:teuthology.orchestra.run.smithi080.stderr:Mon IP `172.21.15.80` is in CIDR network `172.21.15.254/32` 2024-02-13T00:20:10.747 INFO:teuthology.orchestra.run.smithi080.stderr:Mon IP `172.21.15.80` is in CIDR network `172.21.15.254/32` 2024-02-13T00:20:10.747 INFO:teuthology.orchestra.run.smithi080.stderr:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20', '172.21.15.254/32', '172.21.15.254/32'] 2024-02-13T00:20:10.747 INFO:teuthology.orchestra.run.smithi080.stderr:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-02-13T00:20:10.748 INFO:teuthology.orchestra.run.smithi080.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1... 2024-02-13T00:20:11.358 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/docker: 0e714d9a4bd2a821113e6318adb87bd06cf81ec1: Pulling from ceph-ci/ceph 2024-02-13T00:20:11.365 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/docker: 58df4e03ba06: Pulling fs layer 2024-02-13T00:20:11.365 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/docker: 955bfa9dba4a: Pulling fs layer 2024-02-13T00:20:18.989 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/docker: 58df4e03ba06: Verifying Checksum 2024-02-13T00:20:18.989 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/docker: 58df4e03ba06: Download complete 2024-02-13T00:20:22.615 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/docker: 58df4e03ba06: Pull complete 2024-02-13T00:20:31.958 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/docker: 955bfa9dba4a: Verifying Checksum 2024-02-13T00:20:31.958 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/docker: 955bfa9dba4a: Download complete 2024-02-13T00:20:44.018 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/docker: 955bfa9dba4a: Pull complete 2024-02-13T00:20:44.159 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/docker: Digest: sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc 2024-02-13T00:20:44.211 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/docker: Status: Downloaded newer image for quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-13T00:20:44.250 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/docker: quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 2024-02-13T00:20:56.256 INFO:teuthology.orchestra.run.smithi080.stderr:ceph: ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable) 2024-02-13T00:20:56.877 INFO:teuthology.orchestra.run.smithi080.stderr:Ceph version: ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable) 2024-02-13T00:20:56.877 INFO:teuthology.orchestra.run.smithi080.stderr:Extracting ceph user uid/gid from container image... 2024-02-13T00:20:57.694 INFO:teuthology.orchestra.run.smithi080.stderr:stat: 167 167 2024-02-13T00:20:58.273 INFO:teuthology.orchestra.run.smithi080.stderr:Creating initial keys... 2024-02-13T00:20:59.096 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-authtool: AQDrtcplUqhnBRAAbrLWJPqWihymmhubIQsoAA== 2024-02-13T00:21:00.506 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-authtool: AQDstcpl01LeHRAAcDCcyT3XXxTZbZQF41tWQg== 2024-02-13T00:21:01.866 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-authtool: AQDttcplWYJSMxAAJppzeNP/2R8u0k0C8jVK/g== 2024-02-13T00:21:02.446 INFO:teuthology.orchestra.run.smithi080.stderr:Creating initial monmap... 2024-02-13T00:21:03.269 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-13T00:21:03.269 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:21:03.269 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-13T00:21:03.880 INFO:teuthology.orchestra.run.smithi080.stderr:monmaptool for a [v2:172.21.15.80:3300,v1:172.21.15.80:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-13T00:21:03.880 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/monmaptool: set fsid to a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:21:03.880 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-13T00:21:03.881 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-13T00:21:03.881 INFO:teuthology.orchestra.run.smithi080.stderr:Creating mon... 2024-02-13T00:21:04.705 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.693+0000 7f91382fc880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-13T00:21:04.705 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.693+0000 7f91382fc880 1 imported monmap: 2024-02-13T00:21:04.705 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: epoch 0 2024-02-13T00:21:04.734 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: fsid a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:21:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: last_changed 2024-02-13T00:21:03.263470+0000 2024-02-13T00:21:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: created 2024-02-13T00:21:03.263470+0000 2024-02-13T00:21:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2024-02-13T00:21:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: election_strategy: 1 2024-02-13T00:21:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon.a 2024-02-13T00:21:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-13T00:21:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.693+0000 7f91382fc880 0 /usr/bin/ceph-mon: set fsid to a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:21:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: RocksDB version: 6.8.1 2024-02-13T00:21:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-13T00:21:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-13T00:21:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Compile date Feb 8 2024 2024-02-13T00:21:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: DB SUMMARY 2024-02-13T00:21:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-13T00:21:04.735 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-02-13T00:21:04.736 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-13T00:21:04.736 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-02-13T00:21:04.736 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-13T00:21:04.736 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.error_if_exists: 0 2024-02-13T00:21:04.736 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.create_if_missing: 1 2024-02-13T00:21:04.736 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.paranoid_checks: 1 2024-02-13T00:21:04.736 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.env: 0x55896a826080 2024-02-13T00:21:04.736 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.fs: Posix File System 2024-02-13T00:21:04.736 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.info_log: 0x55896c095a80 2024-02-13T00:21:04.736 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-13T00:21:04.736 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.statistics: (nil) 2024-02-13T00:21:04.736 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.use_fsync: 0 2024-02-13T00:21:04.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_log_file_size: 0 2024-02-13T00:21:04.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-13T00:21:04.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-13T00:21:04.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-13T00:21:04.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-13T00:21:04.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.allow_fallocate: 1 2024-02-13T00:21:04.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-13T00:21:04.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-13T00:21:04.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.use_direct_reads: 0 2024-02-13T00:21:04.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-13T00:21:04.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-13T00:21:04.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.db_log_dir: 2024-02-13T00:21:04.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-02-13T00:21:04.737 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-13T00:21:04.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_subcompactions: 1 2024-02-13T00:21:04.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_background_flushes: -1 2024-02-13T00:21:04.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-13T00:21:04.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-13T00:21:04.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-13T00:21:04.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-13T00:21:04.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-13T00:21:04.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-13T00:21:04.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-13T00:21:04.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.write_buffer_manager: 0x55896c09b950 2024-02-13T00:21:04.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-13T00:21:04.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-13T00:21:04.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-13T00:21:04.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-13T00:21:04.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-13T00:21:04.738 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-13T00:21:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-13T00:21:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-13T00:21:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-13T00:21:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.unordered_write: 0 2024-02-13T00:21:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-13T00:21:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-13T00:21:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-13T00:21:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-13T00:21:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.row_cache: None 2024-02-13T00:21:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.wal_filter: None 2024-02-13T00:21:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-13T00:21:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-13T00:21:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.preserve_deletes: 0 2024-02-13T00:21:04.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.two_write_queues: 0 2024-02-13T00:21:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-13T00:21:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.atomic_flush: 0 2024-02-13T00:21:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-13T00:21:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-13T00:21:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-13T00:21:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.log_readahead_size: 0 2024-02-13T00:21:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-13T00:21:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_background_jobs: 2 2024-02-13T00:21:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_background_compactions: -1 2024-02-13T00:21:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-13T00:21:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-13T00:21:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-13T00:21:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-13T00:21:04.740 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-13T00:21:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-13T00:21:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-13T00:21:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-13T00:21:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_open_files: -1 2024-02-13T00:21:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-13T00:21:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-13T00:21:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-13T00:21:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-13T00:21:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Compression algorithms supported: 2024-02-13T00:21:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-13T00:21:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: kZSTD supported: 0 2024-02-13T00:21:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: kXpressCompression supported: 0 2024-02-13T00:21:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-13T00:21:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: kLZ4Compression supported: 1 2024-02-13T00:21:04.741 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: kBZip2Compression supported: 0 2024-02-13T00:21:04.742 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: kZlibCompression supported: 1 2024-02-13T00:21:04.742 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: kSnappyCompression supported: 1 2024-02-13T00:21:04.742 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-13T00:21:04.742 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2024-02-13T00:21:04.742 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-13T00:21:04.742 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-02-13T00:21:04.742 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-13T00:21:04.742 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-13T00:21:04.742 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-13T00:21:04.742 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-13T00:21:04.742 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.merge_operator: 2024-02-13T00:21:04.742 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.compaction_filter: None 2024-02-13T00:21:04.742 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-13T00:21:04.742 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-13T00:21:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-13T00:21:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55896bfa9d30) 2024-02-13T00:21:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2024-02-13T00:21:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-13T00:21:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-13T00:21:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2024-02-13T00:21:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: index_type: 0 2024-02-13T00:21:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2024-02-13T00:21:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: index_shortening: 1 2024-02-13T00:21:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2024-02-13T00:21:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2024-02-13T00:21:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: checksum: 1 2024-02-13T00:21:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2024-02-13T00:21:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: block_cache: 0x55896bfe0d10 2024-02-13T00:21:04.743 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2024-02-13T00:21:04.744 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: block_cache_options: 2024-02-13T00:21:04.744 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: capacity : 536870912 2024-02-13T00:21:04.744 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2024-02-13T00:21:04.744 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2024-02-13T00:21:04.744 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2024-02-13T00:21:04.744 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2024-02-13T00:21:04.744 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2024-02-13T00:21:04.744 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: block_size: 4096 2024-02-13T00:21:04.744 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2024-02-13T00:21:04.744 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2024-02-13T00:21:04.744 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2024-02-13T00:21:04.744 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2024-02-13T00:21:04.744 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: partition_filters: 0 2024-02-13T00:21:04.744 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2024-02-13T00:21:04.745 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-13T00:21:04.745 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2024-02-13T00:21:04.745 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: verify_compression: 0 2024-02-13T00:21:04.745 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2024-02-13T00:21:04.745 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: format_version: 2 2024-02-13T00:21:04.745 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2024-02-13T00:21:04.745 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: block_align: 0 2024-02-13T00:21:04.745 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-13T00:21:04.745 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-13T00:21:04.745 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-13T00:21:04.745 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.compression: NoCompression 2024-02-13T00:21:04.745 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-13T00:21:04.745 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-13T00:21:04.745 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-13T00:21:04.745 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.num_levels: 7 2024-02-13T00:21:04.746 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-13T00:21:04.746 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-13T00:21:04.746 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-13T00:21:04.746 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-13T00:21:04.746 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-13T00:21:04.747 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-13T00:21:04.747 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-13T00:21:04.747 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-13T00:21:04.747 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-13T00:21:04.747 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-13T00:21:04.747 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-13T00:21:04.747 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-13T00:21:04.747 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-13T00:21:04.747 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-13T00:21:04.747 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-13T00:21:04.747 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-13T00:21:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-13T00:21:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-13T00:21:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-13T00:21:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-13T00:21:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-13T00:21:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-13T00:21:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-13T00:21:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-13T00:21:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-13T00:21:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-13T00:21:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-13T00:21:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-13T00:21:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-13T00:21:04.748 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-13T00:21:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-13T00:21:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-13T00:21:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-13T00:21:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-13T00:21:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-13T00:21:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-13T00:21:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-13T00:21:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-13T00:21:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-13T00:21:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-13T00:21:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-13T00:21:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-13T00:21:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-13T00:21:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-13T00:21:04.749 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-13T00:21:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-13T00:21:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-13T00:21:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.table_properties_collectors: 2024-02-13T00:21:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.inplace_update_support: 0 2024-02-13T00:21:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-13T00:21:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-13T00:21:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-13T00:21:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-13T00:21:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.bloom_locality: 0 2024-02-13T00:21:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.max_successive_merges: 0 2024-02-13T00:21:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-13T00:21:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-13T00:21:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-13T00:21:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-13T00:21:04.750 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.ttl: 2592000 2024-02-13T00:21:04.751 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.697+0000 7f91382fc880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-13T00:21:04.751 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.701+0000 7f91382fc880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-13T00:21:04.751 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-13T00:21:04.751 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.701+0000 7f91382fc880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2024-02-13T00:21:04.751 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-13T00:21:04.751 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.701+0000 7f91382fc880 4 rocksdb: DB pointer 0x55896c0a9800 2024-02-13T00:21:04.751 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.701+0000 7f912116e700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-13T00:21:04.751 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.701+0000 7f912116e700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-13T00:21:04.751 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2024-02-13T00:21:04.751 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-02-13T00:21:04.751 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-13T00:21:04.751 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-13T00:21:04.751 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-13T00:21:04.751 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-13T00:21:04.752 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-13T00:21:04.752 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-13T00:21:04.752 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-13T00:21:04.752 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-13T00:21:04.752 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-13T00:21:04.752 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-13T00:21:04.752 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-13T00:21:04.752 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-13T00:21:04.752 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-13T00:21:04.752 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-13T00:21:04.752 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-13T00:21:04.752 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-13T00:21:04.752 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-02-13T00:21:04.752 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2024-02-13T00:21:04.752 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-13T00:21:04.753 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2024-02-13T00:21:04.753 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2024-02-13T00:21:04.753 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2024-02-13T00:21:04.753 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-13T00:21:04.753 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-13T00:21:04.753 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-13T00:21:04.753 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-13T00:21:04.753 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2024-02-13T00:21:04.753 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-13T00:21:04.753 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-13T00:21:04.753 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-13T00:21:04.753 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-13T00:21:04.753 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-13T00:21:04.753 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-13T00:21:04.753 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-13T00:21:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-13T00:21:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-13T00:21:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-13T00:21:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-02-13T00:21:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2024-02-13T00:21:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-13T00:21:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2024-02-13T00:21:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2024-02-13T00:21:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2024-02-13T00:21:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-13T00:21:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-13T00:21:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-13T00:21:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-13T00:21:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2024-02-13T00:21:04.754 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: 2024-02-13T00:21:04.755 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.701+0000 7f91382fc880 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2024-02-13T00:21:04.755 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.701+0000 7f91382fc880 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2024-02-13T00:21:04.755 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph-mon: debug 2024-02-13T00:21:04.701+0000 7f91382fc880 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-02-13T00:21:05.255 INFO:teuthology.orchestra.run.smithi080.stderr:create mon.a on 2024-02-13T00:21:05.282 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-02-13T00:21:05.487 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2024-02-13T00:21:05.694 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-a5ae7724-ca05-11ee-95b9-87774f69a715.target -> /etc/systemd/system/ceph-a5ae7724-ca05-11ee-95b9-87774f69a715.target. 2024-02-13T00:21:05.694 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-a5ae7724-ca05-11ee-95b9-87774f69a715.target -> /etc/systemd/system/ceph-a5ae7724-ca05-11ee-95b9-87774f69a715.target. 2024-02-13T00:21:06.132 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Failed to reset failed state of unit ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@mon.a.service: Unit ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@mon.a.service not loaded. 2024-02-13T00:21:06.141 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Created symlink /etc/systemd/system/ceph-a5ae7724-ca05-11ee-95b9-87774f69a715.target.wants/ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@mon.a.service -> /etc/systemd/system/ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@.service. 2024-02-13T00:21:06.350 INFO:teuthology.orchestra.run.smithi080.stderr:firewalld does not appear to be present 2024-02-13T00:21:06.350 INFO:teuthology.orchestra.run.smithi080.stderr:Not possible to enable service . firewalld.service is not available 2024-02-13T00:21:06.350 INFO:teuthology.orchestra.run.smithi080.stderr:Waiting for mon to start... 2024-02-13T00:21:06.351 INFO:teuthology.orchestra.run.smithi080.stderr:Waiting for mon... 2024-02-13T00:21:06.371 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:06 smithi080 systemd[1]: Started Ceph mon.a for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:21:07.856 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.845+0000 7f1096410700 1 Processor -- start 2024-02-13T00:21:07.856 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.845+0000 7f1096410700 1 -- start start 2024-02-13T00:21:07.856 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.845+0000 7f1096410700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10900fd8d0 0x7f10900fdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:07.856 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.845+0000 7f1096410700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10900fe270 con 0x7f10900fd8d0 2024-02-13T00:21:07.856 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.845+0000 7f108ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10900fd8d0 0x7f10900fdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:07.857 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.845+0000 7f108ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10900fd8d0 0x7f10900fdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35716/0 (socket says 172.21.15.80:35716) 2024-02-13T00:21:07.857 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.845+0000 7f108ffff700 1 -- 172.21.15.80:0/559506836 learned_addr learned my addr 172.21.15.80:0/559506836 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:07.858 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.845+0000 7f108ffff700 1 -- 172.21.15.80:0/559506836 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10900fe3b0 con 0x7f10900fd8d0 2024-02-13T00:21:07.858 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.849+0000 7f108ffff700 1 --2- 172.21.15.80:0/559506836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10900fd8d0 0x7f10900fdcf0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f1080009730 tx=0x7f10800090f0).ready entity=mon.0 client_cookie=bbc6fdab9b572586 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:07.858 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.849+0000 7f108effd700 1 -- 172.21.15.80:0/559506836 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f108000b580 con 0x7f10900fd8d0 2024-02-13T00:21:07.858 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.849+0000 7f108effd700 1 -- 172.21.15.80:0/559506836 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108000b6e0 con 0x7f10900fd8d0 2024-02-13T00:21:07.859 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.849+0000 7f108effd700 1 -- 172.21.15.80:0/559506836 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f108000b990 con 0x7f10900fd8d0 2024-02-13T00:21:07.859 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.849+0000 7f1096410700 1 -- 172.21.15.80:0/559506836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10900fd8d0 msgr2=0x7f10900fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:07.859 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.849+0000 7f1096410700 1 --2- 172.21.15.80:0/559506836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10900fd8d0 0x7f10900fdcf0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f1080009730 tx=0x7f10800090f0).stop 2024-02-13T00:21:07.859 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.849+0000 7f1096410700 1 -- 172.21.15.80:0/559506836 shutdown_connections 2024-02-13T00:21:07.859 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.849+0000 7f1096410700 1 --2- 172.21.15.80:0/559506836 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10900fd8d0 0x7f10900fdcf0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:07.859 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.849+0000 7f1096410700 1 -- 172.21.15.80:0/559506836 >> 172.21.15.80:0/559506836 conn(0x7f1090070e40 msgr2=0x7f1090071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:07.859 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.849+0000 7f1096410700 1 -- 172.21.15.80:0/559506836 shutdown_connections 2024-02-13T00:21:07.859 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.849+0000 7f1096410700 1 -- 172.21.15.80:0/559506836 wait complete. 2024-02-13T00:21:07.860 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.849+0000 7f1096410700 1 Processor -- start 2024-02-13T00:21:07.860 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.849+0000 7f1096410700 1 -- start start 2024-02-13T00:21:07.860 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.849+0000 7f1096410700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10900fd8d0 0x7f109010be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:07.860 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.849+0000 7f1096410700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109010c330 con 0x7f10900fd8d0 2024-02-13T00:21:07.861 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.849+0000 7f108ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10900fd8d0 0x7f109010be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:07.861 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.849+0000 7f108ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10900fd8d0 0x7f109010be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:35730/0 (socket says 172.21.15.80:35730) 2024-02-13T00:21:07.861 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.849+0000 7f108ffff700 1 -- 172.21.15.80:0/613440989 learned_addr learned my addr 172.21.15.80:0/613440989 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:07.861 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.853+0000 7f108ffff700 1 -- 172.21.15.80:0/613440989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1080009370 con 0x7f10900fd8d0 2024-02-13T00:21:07.861 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.853+0000 7f108ffff700 1 --2- 172.21.15.80:0/613440989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10900fd8d0 0x7f109010be40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f1080011000 tx=0x7f1080017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:07.862 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.853+0000 7f108d7fa700 1 -- 172.21.15.80:0/613440989 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1080011cd0 con 0x7f10900fd8d0 2024-02-13T00:21:07.862 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.853+0000 7f108d7fa700 1 -- 172.21.15.80:0/613440989 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1080011e30 con 0x7f10900fd8d0 2024-02-13T00:21:07.863 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.853+0000 7f1096410700 1 -- 172.21.15.80:0/613440989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109010c530 con 0x7f10900fd8d0 2024-02-13T00:21:07.863 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.853+0000 7f108d7fa700 1 -- 172.21.15.80:0/613440989 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f108001d590 con 0x7f10900fd8d0 2024-02-13T00:21:07.863 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.853+0000 7f1096410700 1 -- 172.21.15.80:0/613440989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f109010d140 con 0x7f10900fd8d0 2024-02-13T00:21:07.863 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.853+0000 7f108d7fa700 1 -- 172.21.15.80:0/613440989 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f108001da60 con 0x7f10900fd8d0 2024-02-13T00:21:07.863 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.853+0000 7f108d7fa700 1 -- 172.21.15.80:0/613440989 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f10800266c0 con 0x7f10900fd8d0 2024-02-13T00:21:07.864 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.853+0000 7f1096410700 1 -- 172.21.15.80:0/613440989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109010c9c0 con 0x7f10900fd8d0 2024-02-13T00:21:07.867 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.857+0000 7f108d7fa700 1 -- 172.21.15.80:0/613440989 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f109010c9c0 con 0x7f10900fd8d0 2024-02-13T00:21:08.001 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.993+0000 7f1096410700 1 -- 172.21.15.80:0/613440989 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f10900fecf0 con 0x7f10900fd8d0 2024-02-13T00:21:08.002 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.993+0000 7f108d7fa700 1 -- 172.21.15.80:0/613440989 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f1080021030 con 0x7f10900fd8d0 2024-02-13T00:21:08.003 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: cluster: 2024-02-13T00:21:08.003 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: id: a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:21:08.003 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: health: HEALTH_OK 2024-02-13T00:21:08.004 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:08.004 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: services: 2024-02-13T00:21:08.004 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: mon: 1 daemons, quorum a (age 0.282578s) 2024-02-13T00:21:08.004 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: mgr: no daemons active 2024-02-13T00:21:08.005 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2024-02-13T00:21:08.005 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:08.005 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: data: 2024-02-13T00:21:08.005 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2024-02-13T00:21:08.005 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2024-02-13T00:21:08.005 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2024-02-13T00:21:08.005 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: pgs: 2024-02-13T00:21:08.006 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:08.006 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.993+0000 7f1096410700 1 -- 172.21.15.80:0/613440989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10900fd8d0 msgr2=0x7f109010be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:08.007 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.993+0000 7f1096410700 1 --2- 172.21.15.80:0/613440989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10900fd8d0 0x7f109010be40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f1080011000 tx=0x7f1080017000).stop 2024-02-13T00:21:08.007 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.993+0000 7f1096410700 1 -- 172.21.15.80:0/613440989 shutdown_connections 2024-02-13T00:21:08.007 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.993+0000 7f1096410700 1 --2- 172.21.15.80:0/613440989 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f10900fd8d0 0x7f109010be40 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:08.007 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.993+0000 7f1096410700 1 -- 172.21.15.80:0/613440989 >> 172.21.15.80:0/613440989 conn(0x7f1090070e40 msgr2=0x7f10901005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:08.007 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.993+0000 7f1096410700 1 -- 172.21.15.80:0/613440989 shutdown_connections 2024-02-13T00:21:08.007 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:07.993+0000 7f1096410700 1 -- 172.21.15.80:0/613440989 wait complete. 2024-02-13T00:21:08.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:07 smithi080 bash[16866]: cluster 2024-02-13T00:21:07.716293+0000 mon.a (mon.0) 0 : [INF] mkfs a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:21:08.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:07 smithi080 bash[16866]: cluster 2024-02-13T00:21:07.708911+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-02-13T00:21:08.655 INFO:teuthology.orchestra.run.smithi080.stderr:mon is available 2024-02-13T00:21:08.655 INFO:teuthology.orchestra.run.smithi080.stderr:Assimilating anything we can from ceph.conf... 2024-02-13T00:21:09.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:08 smithi080 bash[16866]: cluster 2024-02-13T00:21:07.714715+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-02-13T00:21:09.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:08 smithi080 bash[16866]: cluster 2024-02-13T00:21:07.715040+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0]} removed_ranks: {} 2024-02-13T00:21:09.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:08 smithi080 bash[16866]: cluster 2024-02-13T00:21:07.718336+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2024-02-13T00:21:09.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:08 smithi080 bash[16866]: cluster 2024-02-13T00:21:07.722412+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-02-13T00:21:09.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:08 smithi080 bash[16866]: cluster 2024-02-13T00:21:07.722928+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2024-02-13T00:21:09.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:08 smithi080 bash[16866]: audit 2024-02-13T00:21:07.997191+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.80:0/613440989' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-13T00:21:09.576 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.565+0000 7fb4fdcd8700 1 Processor -- start 2024-02-13T00:21:09.576 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.565+0000 7fb4fdcd8700 1 -- start start 2024-02-13T00:21:09.576 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.565+0000 7fb4fdcd8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f80fd8d0 0x7fb4f80fdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.565+0000 7fb4fdcd8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f80fe270 con 0x7fb4f80fd8d0 2024-02-13T00:21:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.565+0000 7fb4f77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f80fd8d0 0x7fb4f80fdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.565+0000 7fb4f77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f80fd8d0 0x7fb4f80fdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45686/0 (socket says 172.21.15.80:45686) 2024-02-13T00:21:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.565+0000 7fb4f77fe700 1 -- 172.21.15.80:0/791954569 learned_addr learned my addr 172.21.15.80:0/791954569 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.565+0000 7fb4f77fe700 1 -- 172.21.15.80:0/791954569 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f80fe3b0 con 0x7fb4f80fd8d0 2024-02-13T00:21:09.577 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.569+0000 7fb4f77fe700 1 --2- 172.21.15.80:0/791954569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f80fd8d0 0x7fb4f80fdcf0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7fb4e8009730 tx=0x7fb4e80090f0).ready entity=mon.0 client_cookie=fdba5b93b4bf0b2e server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:09.578 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.569+0000 7fb4f67fc700 1 -- 172.21.15.80:0/791954569 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4e800b580 con 0x7fb4f80fd8d0 2024-02-13T00:21:09.578 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.569+0000 7fb4f67fc700 1 -- 172.21.15.80:0/791954569 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e800b6e0 con 0x7fb4f80fd8d0 2024-02-13T00:21:09.578 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.569+0000 7fb4f67fc700 1 -- 172.21.15.80:0/791954569 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4e800b990 con 0x7fb4f80fd8d0 2024-02-13T00:21:09.579 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.569+0000 7fb4fdcd8700 1 -- 172.21.15.80:0/791954569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f80fd8d0 msgr2=0x7fb4f80fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:09.579 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.569+0000 7fb4fdcd8700 1 --2- 172.21.15.80:0/791954569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f80fd8d0 0x7fb4f80fdcf0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7fb4e8009730 tx=0x7fb4e80090f0).stop 2024-02-13T00:21:09.580 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.569+0000 7fb4fdcd8700 1 -- 172.21.15.80:0/791954569 shutdown_connections 2024-02-13T00:21:09.580 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.569+0000 7fb4fdcd8700 1 --2- 172.21.15.80:0/791954569 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f80fd8d0 0x7fb4f80fdcf0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:09.580 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.569+0000 7fb4fdcd8700 1 -- 172.21.15.80:0/791954569 >> 172.21.15.80:0/791954569 conn(0x7fb4f8070e40 msgr2=0x7fb4f8071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:09.580 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.569+0000 7fb4fdcd8700 1 -- 172.21.15.80:0/791954569 shutdown_connections 2024-02-13T00:21:09.580 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.569+0000 7fb4fdcd8700 1 -- 172.21.15.80:0/791954569 wait complete. 2024-02-13T00:21:09.581 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.569+0000 7fb4fdcd8700 1 Processor -- start 2024-02-13T00:21:09.581 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.569+0000 7fb4fdcd8700 1 -- start start 2024-02-13T00:21:09.581 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.573+0000 7fb4fdcd8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f80fd8d0 0x7fb4f810be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:09.581 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.573+0000 7fb4fdcd8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f810c330 con 0x7fb4f80fd8d0 2024-02-13T00:21:09.582 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.573+0000 7fb4f77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f80fd8d0 0x7fb4f810be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:09.582 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.573+0000 7fb4f77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f80fd8d0 0x7fb4f810be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45694/0 (socket says 172.21.15.80:45694) 2024-02-13T00:21:09.582 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.573+0000 7fb4f77fe700 1 -- 172.21.15.80:0/4260256282 learned_addr learned my addr 172.21.15.80:0/4260256282 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:09.582 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.573+0000 7fb4f77fe700 1 -- 172.21.15.80:0/4260256282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e8009370 con 0x7fb4f80fd8d0 2024-02-13T00:21:09.582 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.573+0000 7fb4f77fe700 1 --2- 172.21.15.80:0/4260256282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f80fd8d0 0x7fb4f810be40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7fb4e8009130 tx=0x7fb4e8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:09.583 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.573+0000 7fb4f4ff9700 1 -- 172.21.15.80:0/4260256282 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4e8011cd0 con 0x7fb4f80fd8d0 2024-02-13T00:21:09.583 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.573+0000 7fb4f4ff9700 1 -- 172.21.15.80:0/4260256282 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e8011e30 con 0x7fb4f80fd8d0 2024-02-13T00:21:09.583 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.573+0000 7fb4f4ff9700 1 -- 172.21.15.80:0/4260256282 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4e801d570 con 0x7fb4f80fd8d0 2024-02-13T00:21:09.583 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.573+0000 7fb4fdcd8700 1 -- 172.21.15.80:0/4260256282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f810c530 con 0x7fb4f80fd8d0 2024-02-13T00:21:09.583 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.573+0000 7fb4fdcd8700 1 -- 172.21.15.80:0/4260256282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f810d140 con 0x7fb4f80fd8d0 2024-02-13T00:21:09.583 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.573+0000 7fb4f4ff9700 1 -- 172.21.15.80:0/4260256282 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fb4e801da00 con 0x7fb4f80fd8d0 2024-02-13T00:21:09.584 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.573+0000 7fb4f4ff9700 1 -- 172.21.15.80:0/4260256282 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fb4e8026710 con 0x7fb4f80fd8d0 2024-02-13T00:21:09.584 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.573+0000 7fb4fdcd8700 1 -- 172.21.15.80:0/4260256282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f810c9c0 con 0x7fb4f80fd8d0 2024-02-13T00:21:09.587 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.577+0000 7fb4f4ff9700 1 -- 172.21.15.80:0/4260256282 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fb4e8021030 con 0x7fb4f80fd8d0 2024-02-13T00:21:09.715 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.705+0000 7fb4fdcd8700 1 -- 172.21.15.80:0/4260256282 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fb4f805a3b0 con 0x7fb4f80fd8d0 2024-02-13T00:21:09.720 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.709+0000 7fb4f4ff9700 1 -- 172.21.15.80:0/4260256282 <== mon.0 v2:172.21.15.80:3300/0 7 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fb4e801de90 con 0x7fb4f80fd8d0 2024-02-13T00:21:09.721 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.709+0000 7fb4f4ff9700 1 -- 172.21.15.80:0/4260256282 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+363 (secure 0 0 0) 0x7fb4e8034030 con 0x7fb4f80fd8d0 2024-02-13T00:21:09.721 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.721 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: [global] 2024-02-13T00:21:09.721 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: fsid = a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:21:09.721 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: log_to_journald = false 2024-02-13T00:21:09.721 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.80:3300,v1:172.21.15.80:6789] 2024-02-13T00:21:09.721 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-02-13T00:21:09.721 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-02-13T00:21:09.721 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-02-13T00:21:09.721 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-02-13T00:21:09.721 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.721 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: [mgr] 2024-02-13T00:21:09.722 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-02-13T00:21:09.722 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.722 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: [osd] 2024-02-13T00:21:09.722 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-02-13T00:21:09.722 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-02-13T00:21:09.722 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.709+0000 7fb4fdcd8700 1 -- 172.21.15.80:0/4260256282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f80fd8d0 msgr2=0x7fb4f810be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:09.722 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.709+0000 7fb4fdcd8700 1 --2- 172.21.15.80:0/4260256282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f80fd8d0 0x7fb4f810be40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7fb4e8009130 tx=0x7fb4e8017000).stop 2024-02-13T00:21:09.722 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.709+0000 7fb4fdcd8700 1 -- 172.21.15.80:0/4260256282 shutdown_connections 2024-02-13T00:21:09.722 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.709+0000 7fb4fdcd8700 1 --2- 172.21.15.80:0/4260256282 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb4f80fd8d0 0x7fb4f810be40 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:09.722 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.709+0000 7fb4fdcd8700 1 -- 172.21.15.80:0/4260256282 >> 172.21.15.80:0/4260256282 conn(0x7fb4f8070e40 msgr2=0x7fb4f81005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:09.722 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.709+0000 7fb4fdcd8700 1 -- 172.21.15.80:0/4260256282 shutdown_connections 2024-02-13T00:21:09.723 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:09.709+0000 7fb4fdcd8700 1 -- 172.21.15.80:0/4260256282 wait complete. 2024-02-13T00:21:10.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:09 smithi080 bash[16866]: audit 2024-02-13T00:21:09.710508+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.15.80:0/4260256282' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-13T00:21:10.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:09 smithi080 bash[16866]: audit 2024-02-13T00:21:09.713308+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.15.80:0/4260256282' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-13T00:21:10.377 INFO:teuthology.orchestra.run.smithi080.stderr:Generating new minimal ceph.conf... 2024-02-13T00:21:11.338 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.325+0000 7fca78264700 1 Processor -- start 2024-02-13T00:21:11.338 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.325+0000 7fca78264700 1 -- start start 2024-02-13T00:21:11.338 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.325+0000 7fca78264700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca700fb6c0 0x7fca700fbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:11.339 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.325+0000 7fca78264700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca700fbfd0 con 0x7fca700fb6c0 2024-02-13T00:21:11.339 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.325+0000 7fca76000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca700fb6c0 0x7fca700fbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:11.339 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.325+0000 7fca76000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca700fb6c0 0x7fca700fbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45708/0 (socket says 172.21.15.80:45708) 2024-02-13T00:21:11.339 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.325+0000 7fca76000700 1 -- 172.21.15.80:0/2494266190 learned_addr learned my addr 172.21.15.80:0/2494266190 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:11.339 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.329+0000 7fca76000700 1 -- 172.21.15.80:0/2494266190 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca700fc110 con 0x7fca700fb6c0 2024-02-13T00:21:11.339 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.329+0000 7fca76000700 1 --2- 172.21.15.80:0/2494266190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca700fb6c0 0x7fca700fbae0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fca6c009730 tx=0x7fca6c0090f0).ready entity=mon.0 client_cookie=385e7dc8a5b2081 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:11.339 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.329+0000 7fca74ffe700 1 -- 172.21.15.80:0/2494266190 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca6c00b580 con 0x7fca700fb6c0 2024-02-13T00:21:11.339 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.329+0000 7fca74ffe700 1 -- 172.21.15.80:0/2494266190 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fca6c00bb50 con 0x7fca700fb6c0 2024-02-13T00:21:11.339 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.329+0000 7fca74ffe700 1 -- 172.21.15.80:0/2494266190 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca6c011a70 con 0x7fca700fb6c0 2024-02-13T00:21:11.341 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.329+0000 7fca78264700 1 -- 172.21.15.80:0/2494266190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca700fb6c0 msgr2=0x7fca700fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:11.341 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.329+0000 7fca78264700 1 --2- 172.21.15.80:0/2494266190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca700fb6c0 0x7fca700fbae0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fca6c009730 tx=0x7fca6c0090f0).stop 2024-02-13T00:21:11.341 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.329+0000 7fca78264700 1 -- 172.21.15.80:0/2494266190 shutdown_connections 2024-02-13T00:21:11.341 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.329+0000 7fca78264700 1 --2- 172.21.15.80:0/2494266190 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca700fb6c0 0x7fca700fbae0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:11.341 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.329+0000 7fca78264700 1 -- 172.21.15.80:0/2494266190 >> 172.21.15.80:0/2494266190 conn(0x7fca700f6ec0 msgr2=0x7fca700f92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:11.341 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.329+0000 7fca78264700 1 -- 172.21.15.80:0/2494266190 shutdown_connections 2024-02-13T00:21:11.341 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.329+0000 7fca78264700 1 -- 172.21.15.80:0/2494266190 wait complete. 2024-02-13T00:21:11.341 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.333+0000 7fca78264700 1 Processor -- start 2024-02-13T00:21:11.341 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.333+0000 7fca78264700 1 -- start start 2024-02-13T00:21:11.343 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.333+0000 7fca78264700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca700fb6c0 0x7fca7010a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:11.343 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.333+0000 7fca78264700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7010a7e0 con 0x7fca700fb6c0 2024-02-13T00:21:11.343 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.333+0000 7fca76000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca700fb6c0 0x7fca7010a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:11.343 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.333+0000 7fca76000700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca700fb6c0 0x7fca7010a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45714/0 (socket says 172.21.15.80:45714) 2024-02-13T00:21:11.343 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.333+0000 7fca76000700 1 -- 172.21.15.80:0/3060954959 learned_addr learned my addr 172.21.15.80:0/3060954959 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:11.343 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.333+0000 7fca76000700 1 -- 172.21.15.80:0/3060954959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6c009370 con 0x7fca700fb6c0 2024-02-13T00:21:11.343 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.333+0000 7fca76000700 1 --2- 172.21.15.80:0/3060954959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca700fb6c0 0x7fca7010a2f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fca6c009f00 tx=0x7fca6c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:11.344 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.333+0000 7fca66ffd700 1 -- 172.21.15.80:0/3060954959 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca6c01a760 con 0x7fca700fb6c0 2024-02-13T00:21:11.344 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.333+0000 7fca66ffd700 1 -- 172.21.15.80:0/3060954959 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fca6c01ad30 con 0x7fca700fb6c0 2024-02-13T00:21:11.344 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.333+0000 7fca66ffd700 1 -- 172.21.15.80:0/3060954959 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca6c023bd0 con 0x7fca700fb6c0 2024-02-13T00:21:11.344 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.333+0000 7fca78264700 1 -- 172.21.15.80:0/3060954959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca7010a9e0 con 0x7fca700fb6c0 2024-02-13T00:21:11.345 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.333+0000 7fca78264700 1 -- 172.21.15.80:0/3060954959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7010ae70 con 0x7fca700fb6c0 2024-02-13T00:21:11.345 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.333+0000 7fca66ffd700 1 -- 172.21.15.80:0/3060954959 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fca6c022620 con 0x7fca700fb6c0 2024-02-13T00:21:11.345 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.333+0000 7fca66ffd700 1 -- 172.21.15.80:0/3060954959 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fca6c022c40 con 0x7fca700fb6c0 2024-02-13T00:21:11.345 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.337+0000 7fca78264700 1 -- 172.21.15.80:0/3060954959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca70046d80 con 0x7fca700fb6c0 2024-02-13T00:21:11.349 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.341+0000 7fca66ffd700 1 -- 172.21.15.80:0/3060954959 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fca6c01e030 con 0x7fca700fb6c0 2024-02-13T00:21:11.478 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.469+0000 7fca78264700 1 -- 172.21.15.80:0/3060954959 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fca70103e90 con 0x7fca700fb6c0 2024-02-13T00:21:11.478 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.469+0000 7fca66ffd700 1 -- 172.21.15.80:0/3060954959 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fca6c023410 con 0x7fca700fb6c0 2024-02-13T00:21:11.480 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.469+0000 7fca78264700 1 -- 172.21.15.80:0/3060954959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca700fb6c0 msgr2=0x7fca7010a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:11.480 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.469+0000 7fca78264700 1 --2- 172.21.15.80:0/3060954959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca700fb6c0 0x7fca7010a2f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fca6c009f00 tx=0x7fca6c0090f0).stop 2024-02-13T00:21:11.480 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.469+0000 7fca78264700 1 -- 172.21.15.80:0/3060954959 shutdown_connections 2024-02-13T00:21:11.480 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.469+0000 7fca78264700 1 --2- 172.21.15.80:0/3060954959 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fca700fb6c0 0x7fca7010a2f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:11.481 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.469+0000 7fca78264700 1 -- 172.21.15.80:0/3060954959 >> 172.21.15.80:0/3060954959 conn(0x7fca700f6ec0 msgr2=0x7fca700f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:11.481 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.469+0000 7fca78264700 1 -- 172.21.15.80:0/3060954959 shutdown_connections 2024-02-13T00:21:11.481 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:11.469+0000 7fca78264700 1 -- 172.21.15.80:0/3060954959 wait complete. 2024-02-13T00:21:11.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:11 smithi080 bash[16866]: audit 2024-02-13T00:21:11.473382+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.80:0/3060954959' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:21:12.097 INFO:teuthology.orchestra.run.smithi080.stderr:Restarting the monitor... 2024-02-13T00:21:12.449 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:12 smithi080 systemd[1]: Stopping Ceph mon.a for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:21:12.449 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:12 smithi080 bash[17251]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-mon.a 2024-02-13T00:21:12.449 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:12 smithi080 bash[16866]: debug 2024-02-13T00:21:12.265+0000 7fed90bbb700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-13T00:21:12.449 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:12 smithi080 bash[16866]: debug 2024-02-13T00:21:12.265+0000 7fed90bbb700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-02-13T00:21:12.952 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:12 smithi080 bash[17285]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-mon-a 2024-02-13T00:21:12.966 INFO:teuthology.orchestra.run.smithi080.stderr:Setting public_network to 172.21.15.254/32,172.21.0.0/20 in mon config section 2024-02-13T00:21:13.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:12 smithi080 bash[17346]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-mon-a 2024-02-13T00:21:13.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:12 smithi080 systemd[1]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@mon.a.service: Succeeded. 2024-02-13T00:21:13.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:12 smithi080 systemd[1]: Stopped Ceph mon.a for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:21:13.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:12 smithi080 systemd[1]: Started Ceph mon.a for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:21:14.297 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.285+0000 7f0c11e1b700 1 Processor -- start 2024-02-13T00:21:14.297 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.285+0000 7f0c11e1b700 1 -- start start 2024-02-13T00:21:14.298 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.289+0000 7f0c11e1b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c0c0f9d60 0x7f0c0c0fa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:14.298 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.289+0000 7f0c11e1b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c0fa670 con 0x7f0c0c0f9d60 2024-02-13T00:21:14.298 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.289+0000 7f0c0b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c0c0f9d60 0x7f0c0c0fa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:14.298 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.289+0000 7f0c0b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c0c0f9d60 0x7f0c0c0fa180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45718/0 (socket says 172.21.15.80:45718) 2024-02-13T00:21:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.289+0000 7f0c0b7fe700 1 -- 172.21.15.80:0/1021012694 learned_addr learned my addr 172.21.15.80:0/1021012694 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.289+0000 7f0c0b7fe700 1 -- 172.21.15.80:0/1021012694 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0c0fa7b0 con 0x7f0c0c0f9d60 2024-02-13T00:21:14.299 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.289+0000 7f0c0b7fe700 1 --2- 172.21.15.80:0/1021012694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c0c0f9d60 0x7f0c0c0fa180 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f0c0000b9f0 tx=0x7f0c0000b370).ready entity=mon.0 client_cookie=1ae4a107c47e018d server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:14.300 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.289+0000 7f0c0a7fc700 1 -- 172.21.15.80:0/1021012694 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c0000db70 con 0x7f0c0c0f9d60 2024-02-13T00:21:14.300 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.289+0000 7f0c0a7fc700 1 -- 172.21.15.80:0/1021012694 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f0c0000dcd0 con 0x7f0c0c0f9d60 2024-02-13T00:21:14.300 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.289+0000 7f0c0a7fc700 1 -- 172.21.15.80:0/1021012694 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c00014370 con 0x7f0c0c0f9d60 2024-02-13T00:21:14.301 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.289+0000 7f0c11e1b700 1 -- 172.21.15.80:0/1021012694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c0c0f9d60 msgr2=0x7f0c0c0fa180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:14.301 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.289+0000 7f0c11e1b700 1 --2- 172.21.15.80:0/1021012694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c0c0f9d60 0x7f0c0c0fa180 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f0c0000b9f0 tx=0x7f0c0000b370).stop 2024-02-13T00:21:14.301 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.289+0000 7f0c11e1b700 1 -- 172.21.15.80:0/1021012694 shutdown_connections 2024-02-13T00:21:14.301 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.289+0000 7f0c11e1b700 1 --2- 172.21.15.80:0/1021012694 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c0c0f9d60 0x7f0c0c0fa180 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:14.302 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.289+0000 7f0c11e1b700 1 -- 172.21.15.80:0/1021012694 >> 172.21.15.80:0/1021012694 conn(0x7f0c0c0f5460 msgr2=0x7f0c0c0f78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:14.302 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.293+0000 7f0c11e1b700 1 -- 172.21.15.80:0/1021012694 shutdown_connections 2024-02-13T00:21:14.302 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.293+0000 7f0c11e1b700 1 -- 172.21.15.80:0/1021012694 wait complete. 2024-02-13T00:21:14.302 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.293+0000 7f0c11e1b700 1 Processor -- start 2024-02-13T00:21:14.302 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.293+0000 7f0c11e1b700 1 -- start start 2024-02-13T00:21:14.303 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.293+0000 7f0c11e1b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c0c0f9d60 0x7f0c0c10c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:14.303 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.293+0000 7f0c11e1b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c10c9b0 con 0x7f0c0c0f9d60 2024-02-13T00:21:14.303 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.293+0000 7f0c0b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c0c0f9d60 0x7f0c0c10c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:14.303 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.293+0000 7f0c0b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c0c0f9d60 0x7f0c0c10c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45726/0 (socket says 172.21.15.80:45726) 2024-02-13T00:21:14.303 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.293+0000 7f0c0b7fe700 1 -- 172.21.15.80:0/3993210512 learned_addr learned my addr 172.21.15.80:0/3993210512 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:14.304 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.293+0000 7f0c0b7fe700 1 -- 172.21.15.80:0/3993210512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0000b6a0 con 0x7f0c0c0f9d60 2024-02-13T00:21:14.305 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.293+0000 7f0c0b7fe700 1 --2- 172.21.15.80:0/3993210512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c0c0f9d60 0x7f0c0c10c4c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f0c00018040 tx=0x7f0c0000b370).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:14.305 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.293+0000 7f0c08ff9700 1 -- 172.21.15.80:0/3993210512 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c00009040 con 0x7f0c0c0f9d60 2024-02-13T00:21:14.305 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.293+0000 7f0c11e1b700 1 -- 172.21.15.80:0/3993210512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c0c10cbb0 con 0x7f0c0c0f9d60 2024-02-13T00:21:14.305 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.293+0000 7f0c08ff9700 1 -- 172.21.15.80:0/3993210512 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f0c00014eb0 con 0x7f0c0c0f9d60 2024-02-13T00:21:14.305 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.293+0000 7f0c11e1b700 1 -- 172.21.15.80:0/3993210512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0c10d040 con 0x7f0c0c0f9d60 2024-02-13T00:21:14.305 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.293+0000 7f0c08ff9700 1 -- 172.21.15.80:0/3993210512 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c00013b10 con 0x7f0c0c0f9d60 2024-02-13T00:21:14.305 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.293+0000 7f0c08ff9700 1 -- 172.21.15.80:0/3993210512 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f0c0001e450 con 0x7f0c0c0f9d60 2024-02-13T00:21:14.305 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.293+0000 7f0c08ff9700 1 -- 172.21.15.80:0/3993210512 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f0c00027760 con 0x7f0c0c0f9d60 2024-02-13T00:21:14.305 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.297+0000 7f0c11e1b700 1 -- 172.21.15.80:0/3993210512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf8004f50 con 0x7f0c0c0f9d60 2024-02-13T00:21:14.309 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.301+0000 7f0c08ff9700 1 -- 172.21.15.80:0/3993210512 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f0c00023070 con 0x7f0c0c0f9d60 2024-02-13T00:21:14.439 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.429+0000 7f0c11e1b700 1 -- 172.21.15.80:0/3993210512 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f0bf8005200 con 0x7f0c0c0f9d60 2024-02-13T00:21:14.445 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.433+0000 7f0c08ff9700 1 -- 172.21.15.80:0/3993210512 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0c0001a070 con 0x7f0c0c0f9d60 2024-02-13T00:21:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.437+0000 7f0c11e1b700 1 -- 172.21.15.80:0/3993210512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c0c0f9d60 msgr2=0x7f0c0c10c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.437+0000 7f0c11e1b700 1 --2- 172.21.15.80:0/3993210512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c0c0f9d60 0x7f0c0c10c4c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f0c00018040 tx=0x7f0c0000b370).stop 2024-02-13T00:21:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.437+0000 7f0c11e1b700 1 -- 172.21.15.80:0/3993210512 shutdown_connections 2024-02-13T00:21:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.437+0000 7f0c11e1b700 1 --2- 172.21.15.80:0/3993210512 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0c0c0f9d60 0x7f0c0c10c4c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:14.447 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.437+0000 7f0c11e1b700 1 -- 172.21.15.80:0/3993210512 >> 172.21.15.80:0/3993210512 conn(0x7f0c0c0f5460 msgr2=0x7f0c0c100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.437+0000 7f0c11e1b700 1 -- 172.21.15.80:0/3993210512 shutdown_connections 2024-02-13T00:21:14.448 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:14.437+0000 7f0c11e1b700 1 -- 172.21.15.80:0/3993210512 wait complete. 2024-02-13T00:21:14.500 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.145+0000 7f9bb3c1f880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-13T00:21:14.500 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.145+0000 7f9bb3c1f880 0 ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable), process ceph-mon, pid 7 2024-02-13T00:21:14.500 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.145+0000 7f9bb3c1f880 0 pidfile_write: ignore empty --pid-file 2024-02-13T00:21:14.500 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.149+0000 7f9bb3c1f880 0 load: jerasure load: lrc load: isa 2024-02-13T00:21:14.500 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: RocksDB version: 6.8.1 2024-02-13T00:21:14.500 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-13T00:21:14.501 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Compile date Feb 8 2024 2024-02-13T00:21:14.501 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: DB SUMMARY 2024-02-13T00:21:14.501 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: CURRENT file: CURRENT 2024-02-13T00:21:14.501 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-13T00:21:14.502 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2024-02-13T00:21:14.502 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2024-02-13T00:21:14.502 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 87985 ; 2024-02-13T00:21:14.502 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.error_if_exists: 0 2024-02-13T00:21:14.502 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.create_if_missing: 0 2024-02-13T00:21:14.502 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.paranoid_checks: 1 2024-02-13T00:21:14.503 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.env: 0x55b107626080 2024-02-13T00:21:14.503 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.fs: Posix File System 2024-02-13T00:21:14.503 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.info_log: 0x55b109834220 2024-02-13T00:21:14.503 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-13T00:21:14.503 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.statistics: (nil) 2024-02-13T00:21:14.503 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.use_fsync: 0 2024-02-13T00:21:14.503 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_log_file_size: 0 2024-02-13T00:21:14.503 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-13T00:21:14.503 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-13T00:21:14.503 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-13T00:21:14.503 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-13T00:21:14.503 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.allow_fallocate: 1 2024-02-13T00:21:14.503 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-13T00:21:14.503 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-13T00:21:14.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.use_direct_reads: 0 2024-02-13T00:21:14.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-13T00:21:14.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-13T00:21:14.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.db_log_dir: 2024-02-13T00:21:14.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-02-13T00:21:14.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-13T00:21:14.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_subcompactions: 1 2024-02-13T00:21:14.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_background_flushes: -1 2024-02-13T00:21:14.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-13T00:21:14.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-13T00:21:14.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-13T00:21:14.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-13T00:21:14.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-13T00:21:14.504 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-13T00:21:14.505 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-13T00:21:14.505 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.write_buffer_manager: 0x55b10a5283f0 2024-02-13T00:21:14.505 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-13T00:21:14.505 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-13T00:21:14.505 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-13T00:21:14.505 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-13T00:21:14.505 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-13T00:21:14.505 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-13T00:21:14.505 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-13T00:21:14.505 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-13T00:21:14.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-13T00:21:14.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.unordered_write: 0 2024-02-13T00:21:14.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-13T00:21:14.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-13T00:21:14.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-13T00:21:14.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-13T00:21:14.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.row_cache: None 2024-02-13T00:21:14.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.wal_filter: None 2024-02-13T00:21:14.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-13T00:21:14.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-13T00:21:14.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.preserve_deletes: 0 2024-02-13T00:21:14.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.two_write_queues: 0 2024-02-13T00:21:14.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-13T00:21:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.atomic_flush: 0 2024-02-13T00:21:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-13T00:21:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-13T00:21:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-13T00:21:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.log_readahead_size: 0 2024-02-13T00:21:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-13T00:21:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_background_jobs: 2 2024-02-13T00:21:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_background_compactions: -1 2024-02-13T00:21:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-13T00:21:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-13T00:21:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-13T00:21:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-13T00:21:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-13T00:21:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-13T00:21:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-13T00:21:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-13T00:21:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_open_files: -1 2024-02-13T00:21:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-13T00:21:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-13T00:21:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-13T00:21:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-13T00:21:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Compression algorithms supported: 2024-02-13T00:21:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-13T00:21:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: kZSTD supported: 0 2024-02-13T00:21:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: kXpressCompression supported: 0 2024-02-13T00:21:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-13T00:21:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: kLZ4Compression supported: 1 2024-02-13T00:21:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: kBZip2Compression supported: 0 2024-02-13T00:21:14.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: kZlibCompression supported: 1 2024-02-13T00:21:14.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: kSnappyCompression supported: 1 2024-02-13T00:21:14.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-13T00:21:14.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2024-02-13T00:21:14.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-13T00:21:14.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-13T00:21:14.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.merge_operator: 2024-02-13T00:21:14.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.compaction_filter: None 2024-02-13T00:21:14.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-13T00:21:14.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-13T00:21:14.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-13T00:21:14.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b1097d7d28) 2024-02-13T00:21:14.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: cache_index_and_filter_blocks: 1 2024-02-13T00:21:14.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-13T00:21:14.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-13T00:21:14.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: pin_top_level_index_and_filter: 1 2024-02-13T00:21:14.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: index_type: 0 2024-02-13T00:21:14.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: data_block_index_type: 0 2024-02-13T00:21:14.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: index_shortening: 1 2024-02-13T00:21:14.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: data_block_hash_table_util_ratio: 0.750000 2024-02-13T00:21:14.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: hash_index_allow_collision: 1 2024-02-13T00:21:14.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: checksum: 1 2024-02-13T00:21:14.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: no_block_cache: 0 2024-02-13T00:21:14.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: block_cache: 0x55b10980ef10 2024-02-13T00:21:14.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: block_cache_name: BinnedLRUCache 2024-02-13T00:21:14.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: block_cache_options: 2024-02-13T00:21:14.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: capacity : 536870912 2024-02-13T00:21:14.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: num_shard_bits : 4 2024-02-13T00:21:14.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: strict_capacity_limit : 0 2024-02-13T00:21:14.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: high_pri_pool_ratio: 0.000 2024-02-13T00:21:14.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: block_cache_compressed: (nil) 2024-02-13T00:21:14.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: persistent_cache: (nil) 2024-02-13T00:21:14.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: block_size: 4096 2024-02-13T00:21:14.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: block_size_deviation: 10 2024-02-13T00:21:14.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: block_restart_interval: 16 2024-02-13T00:21:14.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: index_block_restart_interval: 1 2024-02-13T00:21:14.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: metadata_block_size: 4096 2024-02-13T00:21:14.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: partition_filters: 0 2024-02-13T00:21:14.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: use_delta_encoding: 1 2024-02-13T00:21:14.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-13T00:21:14.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: whole_key_filtering: 1 2024-02-13T00:21:14.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: verify_compression: 0 2024-02-13T00:21:14.513 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: read_amp_bytes_per_bit: 0 2024-02-13T00:21:14.513 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: format_version: 2 2024-02-13T00:21:14.513 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: enable_index_compression: 1 2024-02-13T00:21:14.513 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: block_align: 0 2024-02-13T00:21:14.513 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-13T00:21:14.513 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-13T00:21:14.513 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.compression: NoCompression 2024-02-13T00:21:14.513 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-13T00:21:14.513 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-13T00:21:14.513 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-13T00:21:14.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.num_levels: 7 2024-02-13T00:21:14.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-13T00:21:14.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-13T00:21:14.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-13T00:21:14.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-13T00:21:14.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-13T00:21:14.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-13T00:21:14.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-13T00:21:14.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-13T00:21:14.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-13T00:21:14.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-13T00:21:14.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-13T00:21:14.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-13T00:21:14.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-13T00:21:14.515 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-13T00:21:14.515 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-13T00:21:14.515 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-13T00:21:14.515 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-13T00:21:14.515 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-13T00:21:14.515 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-13T00:21:14.515 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-13T00:21:14.515 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-13T00:21:14.515 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-13T00:21:14.515 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-13T00:21:14.515 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-13T00:21:14.515 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-13T00:21:14.515 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-13T00:21:14.515 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-13T00:21:14.516 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-13T00:21:14.516 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-13T00:21:14.516 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-13T00:21:14.516 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-13T00:21:14.516 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-13T00:21:14.516 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-13T00:21:14.516 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-13T00:21:14.516 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-13T00:21:14.516 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-13T00:21:14.516 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-13T00:21:14.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-13T00:21:14.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-13T00:21:14.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-13T00:21:14.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-13T00:21:14.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-13T00:21:14.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-13T00:21:14.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-13T00:21:14.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-13T00:21:14.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-13T00:21:14.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-13T00:21:14.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.table_properties_collectors: 2024-02-13T00:21:14.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.inplace_update_support: 0 2024-02-13T00:21:14.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-13T00:21:14.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-13T00:21:14.517 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-13T00:21:14.518 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-13T00:21:14.518 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.bloom_locality: 0 2024-02-13T00:21:14.518 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.max_successive_merges: 0 2024-02-13T00:21:14.518 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-13T00:21:14.518 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-13T00:21:14.518 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-13T00:21:14.518 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-13T00:21:14.518 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.ttl: 2592000 2024-02-13T00:21:14.518 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-13T00:21:14.518 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-13T00:21:14.518 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2024-02-13T00:21:14.518 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707783674158541, "job": 1, "event": "recovery_started", "log_files": [6]} 2024-02-13T00:21:14.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2024-02-13T00:21:14.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-13T00:21:14.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707783674159809, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 84510, "table_properties": {"data_size": 82783, "index_size": 332, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 581, "raw_key_size": 9930, "raw_average_key_size": 47, "raw_value_size": 77088, "raw_average_value_size": 370, "num_data_blocks": 11, "num_entries": 208, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1707783674, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-13T00:21:14.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.153+0000 7f9bb3c1f880 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2024-02-13T00:21:14.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.157+0000 7f9bb3c1f880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707783674160712, "job": 1, "event": "recovery_finished"} 2024-02-13T00:21:14.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.157+0000 7f9bb3c1f880 4 rocksdb: DB pointer 0x55b1098d7800 2024-02-13T00:21:14.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.157+0000 7f9b9aa10700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-13T00:21:14.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.157+0000 7f9b9aa10700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-13T00:21:14.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: ** DB Stats ** 2024-02-13T00:21:14.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-13T00:21:14.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-13T00:21:14.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-13T00:21:14.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-13T00:21:14.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-13T00:21:14.519 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-13T00:21:14.520 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-13T00:21:14.520 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: ** Compaction Stats [default] ** 2024-02-13T00:21:14.520 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-13T00:21:14.520 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-13T00:21:14.520 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: L0 2/0 84.18 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 86.1 0.00 0.00 1 0.001 0 0 2024-02-13T00:21:14.520 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Sum 2/0 84.18 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 86.1 0.00 0.00 1 0.001 0 0 2024-02-13T00:21:14.520 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 86.1 0.00 0.00 1 0.001 0 0 2024-02-13T00:21:14.520 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: ** Compaction Stats [default] ** 2024-02-13T00:21:14.520 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-13T00:21:14.520 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-13T00:21:14.520 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 86.1 0.00 0.00 1 0.001 0 0 2024-02-13T00:21:14.520 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-13T00:21:14.520 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-13T00:21:14.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-13T00:21:14.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: AddFile(Total Files): cumulative 0, interval 0 2024-02-13T00:21:14.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-13T00:21:14.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: AddFile(Keys): cumulative 0, interval 0 2024-02-13T00:21:14.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Cumulative compaction: 0.00 GB write, 13.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-13T00:21:14.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Interval compaction: 0.00 GB write, 13.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-13T00:21:14.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-13T00:21:14.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: ** File Read Latency Histogram By Level [default] ** 2024-02-13T00:21:14.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: ** Compaction Stats [default] ** 2024-02-13T00:21:14.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-13T00:21:14.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-13T00:21:14.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: L0 2/0 84.18 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 86.1 0.00 0.00 1 0.001 0 0 2024-02-13T00:21:14.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Sum 2/0 84.18 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 86.1 0.00 0.00 1 0.001 0 0 2024-02-13T00:21:14.521 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-13T00:21:14.522 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: ** Compaction Stats [default] ** 2024-02-13T00:21:14.522 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-13T00:21:14.522 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-13T00:21:14.522 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 86.1 0.00 0.00 1 0.001 0 0 2024-02-13T00:21:14.522 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-13T00:21:14.522 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-13T00:21:14.522 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-13T00:21:14.522 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: AddFile(Total Files): cumulative 0, interval 0 2024-02-13T00:21:14.522 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-13T00:21:14.522 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: AddFile(Keys): cumulative 0, interval 0 2024-02-13T00:21:14.522 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Cumulative compaction: 0.00 GB write, 13.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-13T00:21:14.522 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-13T00:21:14.522 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-13T00:21:14.522 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: ** File Read Latency Histogram By Level [default] ** 2024-02-13T00:21:14.522 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.161+0000 7f9bb3c1f880 0 starting mon.a rank 0 at public addrs [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] at bind addrs [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:21:14.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.161+0000 7f9bb3c1f880 1 mon.a@-1(???) e1 preinit fsid a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:21:14.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.161+0000 7f9bb3c1f880 0 mon.a@-1(???).mds e1 new map 2024-02-13T00:21:14.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.161+0000 7f9bb3c1f880 0 mon.a@-1(???).mds e1 print_map 2024-02-13T00:21:14.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: e1 2024-02-13T00:21:14.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: enable_multiple, ever_enabled_multiple: 1,1 2024-02-13T00:21:14.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-13T00:21:14.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: legacy client fscid: -1 2024-02-13T00:21:14.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: 2024-02-13T00:21:14.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: No filesystems configured 2024-02-13T00:21:14.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.161+0000 7f9bb3c1f880 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-13T00:21:14.523 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.161+0000 7f9bb3c1f880 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-13T00:21:14.524 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.161+0000 7f9bb3c1f880 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-13T00:21:14.524 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.161+0000 7f9bb3c1f880 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-13T00:21:14.524 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: audit 2024-02-13T00:21:11.473382+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.80:0/3060954959' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:21:14.524 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: debug 2024-02-13T00:21:14.161+0000 7f9bb3c1f880 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-13T00:21:14.524 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: cluster 2024-02-13T00:21:14.188733+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-02-13T00:21:14.524 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: cluster 2024-02-13T00:21:14.188792+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0]} removed_ranks: {} 2024-02-13T00:21:14.524 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: cluster 2024-02-13T00:21:14.189249+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2024-02-13T00:21:14.524 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: cluster 2024-02-13T00:21:14.189280+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-02-13T00:21:14.524 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:14 smithi080 bash[17386]: cluster 2024-02-13T00:21:14.189690+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2024-02-13T00:21:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:Wrote config to /etc/ceph/ceph.conf 2024-02-13T00:21:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-13T00:21:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:Creating mgr... 2024-02-13T00:21:15.142 INFO:teuthology.orchestra.run.smithi080.stderr:Verifying port 9283 ... 2024-02-13T00:21:15.387 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Failed to reset failed state of unit ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@mgr.y.service: Unit ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@mgr.y.service not loaded. 2024-02-13T00:21:15.393 INFO:teuthology.orchestra.run.smithi080.stderr:systemctl: Created symlink /etc/systemd/system/ceph-a5ae7724-ca05-11ee-95b9-87774f69a715.target.wants/ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@mgr.y.service -> /etc/systemd/system/ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@.service. 2024-02-13T00:21:15.613 INFO:teuthology.orchestra.run.smithi080.stderr:firewalld does not appear to be present 2024-02-13T00:21:15.613 INFO:teuthology.orchestra.run.smithi080.stderr:Not possible to enable service . firewalld.service is not available 2024-02-13T00:21:15.613 INFO:teuthology.orchestra.run.smithi080.stderr:firewalld does not appear to be present 2024-02-13T00:21:15.613 INFO:teuthology.orchestra.run.smithi080.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2024-02-13T00:21:15.613 INFO:teuthology.orchestra.run.smithi080.stderr:Waiting for mgr to start... 2024-02-13T00:21:15.613 INFO:teuthology.orchestra.run.smithi080.stderr:Waiting for mgr... 2024-02-13T00:21:15.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:15 smithi080 bash[17386]: audit 2024-02-13T00:21:14.439528+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.15.80:0/3993210512' entity='client.admin' 2024-02-13T00:21:16.894 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd964e0f700 1 Processor -- start 2024-02-13T00:21:16.894 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd964e0f700 1 -- start start 2024-02-13T00:21:16.895 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd964e0f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9600fb6b0 0x7fd9600fbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:16.895 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd964e0f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9600fbfc0 con 0x7fd9600fb6b0 2024-02-13T00:21:16.895 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd95e59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9600fb6b0 0x7fd9600fbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:16.895 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd95e59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9600fb6b0 0x7fd9600fbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45744/0 (socket says 172.21.15.80:45744) 2024-02-13T00:21:16.895 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd95e59c700 1 -- 172.21.15.80:0/668008148 learned_addr learned my addr 172.21.15.80:0/668008148 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:16.895 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd95e59c700 1 -- 172.21.15.80:0/668008148 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9600fc100 con 0x7fd9600fb6b0 2024-02-13T00:21:16.895 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd95e59c700 1 --2- 172.21.15.80:0/668008148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9600fb6b0 0x7fd9600fbad0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7fd950009730 tx=0x7fd9500090f0).ready entity=mon.0 client_cookie=784e6d42e897ea5 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:16.897 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd95d59a700 1 -- 172.21.15.80:0/668008148 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd95000b580 con 0x7fd9600fb6b0 2024-02-13T00:21:16.897 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd95d59a700 1 -- 172.21.15.80:0/668008148 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fd95000bb50 con 0x7fd9600fb6b0 2024-02-13T00:21:16.897 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd95d59a700 1 -- 172.21.15.80:0/668008148 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd950011a70 con 0x7fd9600fb6b0 2024-02-13T00:21:16.897 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd964e0f700 1 -- 172.21.15.80:0/668008148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9600fb6b0 msgr2=0x7fd9600fbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:16.897 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd964e0f700 1 --2- 172.21.15.80:0/668008148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9600fb6b0 0x7fd9600fbad0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7fd950009730 tx=0x7fd9500090f0).stop 2024-02-13T00:21:16.897 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd964e0f700 1 -- 172.21.15.80:0/668008148 shutdown_connections 2024-02-13T00:21:16.897 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd964e0f700 1 --2- 172.21.15.80:0/668008148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9600fb6b0 0x7fd9600fbad0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:16.897 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd964e0f700 1 -- 172.21.15.80:0/668008148 >> 172.21.15.80:0/668008148 conn(0x7fd9600f6eb0 msgr2=0x7fd9600f92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:16.897 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd964e0f700 1 -- 172.21.15.80:0/668008148 shutdown_connections 2024-02-13T00:21:16.897 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd964e0f700 1 -- 172.21.15.80:0/668008148 wait complete. 2024-02-13T00:21:16.898 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd964e0f700 1 Processor -- start 2024-02-13T00:21:16.898 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd964e0f700 1 -- start start 2024-02-13T00:21:16.898 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd964e0f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9600fb6b0 0x7fd960071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:16.898 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd964e0f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd960070200 con 0x7fd9600fb6b0 2024-02-13T00:21:16.898 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.885+0000 7fd95e59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9600fb6b0 0x7fd960071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:16.898 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.889+0000 7fd95e59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9600fb6b0 0x7fd960071d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45776/0 (socket says 172.21.15.80:45776) 2024-02-13T00:21:16.898 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.889+0000 7fd95e59c700 1 -- 172.21.15.80:0/3249668897 learned_addr learned my addr 172.21.15.80:0/3249668897 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:16.898 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.889+0000 7fd95e59c700 1 -- 172.21.15.80:0/3249668897 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd950009370 con 0x7fd9600fb6b0 2024-02-13T00:21:16.899 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.889+0000 7fd95e59c700 1 --2- 172.21.15.80:0/3249668897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9600fb6b0 0x7fd960071d80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fd950009f00 tx=0x7fd9500090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:16.899 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.889+0000 7fd94f7fe700 1 -- 172.21.15.80:0/3249668897 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd95001a760 con 0x7fd9600fb6b0 2024-02-13T00:21:16.899 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.889+0000 7fd964e0f700 1 -- 172.21.15.80:0/3249668897 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9600703a0 con 0x7fd9600fb6b0 2024-02-13T00:21:16.899 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.889+0000 7fd94f7fe700 1 -- 172.21.15.80:0/3249668897 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fd95001ad30 con 0x7fd9600fb6b0 2024-02-13T00:21:16.900 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.889+0000 7fd94f7fe700 1 -- 172.21.15.80:0/3249668897 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd950023bd0 con 0x7fd9600fb6b0 2024-02-13T00:21:16.900 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.889+0000 7fd964e0f700 1 -- 172.21.15.80:0/3249668897 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd960070830 con 0x7fd9600fb6b0 2024-02-13T00:21:16.900 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.889+0000 7fd94f7fe700 1 -- 172.21.15.80:0/3249668897 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fd95002c650 con 0x7fd9600fb6b0 2024-02-13T00:21:16.900 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.889+0000 7fd94f7fe700 1 -- 172.21.15.80:0/3249668897 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fd950022730 con 0x7fd9600fb6b0 2024-02-13T00:21:16.900 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.889+0000 7fd964e0f700 1 -- 172.21.15.80:0/3249668897 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96005a3b0 con 0x7fd9600fb6b0 2024-02-13T00:21:16.902 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:16.893+0000 7fd94f7fe700 1 -- 172.21.15.80:0/3249668897 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fd95001e030 con 0x7fd9600fb6b0 2024-02-13T00:21:17.036 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:17.025+0000 7fd964e0f700 1 -- 172.21.15.80:0/3249668897 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fd9601042e0 con 0x7fd9600fb6b0 2024-02-13T00:21:17.039 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:17.025+0000 7fd94f7fe700 1 -- 172.21.15.80:0/3249668897 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1241 (secure 0 0 0) 0x7fd9500234d0 con 0x7fd9600fb6b0 2024-02-13T00:21:17.039 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:17.039 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: { 2024-02-13T00:21:17.039 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "fsid": "a5ae7724-ca05-11ee-95b9-87774f69a715", 2024-02-13T00:21:17.039 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "health": { 2024-02-13T00:21:17.039 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-02-13T00:21:17.039 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "checks": {}, 2024-02-13T00:21:17.039 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "mutes": [] 2024-02-13T00:21:17.039 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-13T00:21:17.040 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-02-13T00:21:17.040 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "quorum": [ 2024-02-13T00:21:17.040 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 0 2024-02-13T00:21:17.040 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: ], 2024-02-13T00:21:17.040 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "quorum_names": [ 2024-02-13T00:21:17.040 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "a" 2024-02-13T00:21:17.040 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: ], 2024-02-13T00:21:17.040 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "quorum_age": 2, 2024-02-13T00:21:17.040 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "monmap": { 2024-02-13T00:21:17.040 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-13T00:21:17.040 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-02-13T00:21:17.040 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_mons": 1 2024-02-13T00:21:17.040 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-13T00:21:17.040 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "osdmap": { 2024-02-13T00:21:17.041 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-13T00:21:17.041 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_osds": 0, 2024-02-13T00:21:17.041 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-02-13T00:21:17.045 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-02-13T00:21:17.045 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-02-13T00:21:17.045 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-02-13T00:21:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-02-13T00:21:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-13T00:21:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "pgmap": { 2024-02-13T00:21:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-02-13T00:21:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-02-13T00:21:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_pools": 0, 2024-02-13T00:21:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_objects": 0, 2024-02-13T00:21:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-02-13T00:21:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-02-13T00:21:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-02-13T00:21:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "bytes_total": 0 2024-02-13T00:21:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-13T00:21:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "fsmap": { 2024-02-13T00:21:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-13T00:21:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "by_rank": [], 2024-02-13T00:21:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "up:standby": 0 2024-02-13T00:21:17.046 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-13T00:21:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "mgrmap": { 2024-02-13T00:21:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "available": false, 2024-02-13T00:21:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-02-13T00:21:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "modules": [ 2024-02-13T00:21:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "iostat", 2024-02-13T00:21:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "nfs", 2024-02-13T00:21:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "restful" 2024-02-13T00:21:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: ], 2024-02-13T00:21:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "services": {} 2024-02-13T00:21:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-13T00:21:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "servicemap": { 2024-02-13T00:21:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-13T00:21:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "modified": "2024-02-13T00:21:07.716720+0000", 2024-02-13T00:21:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "services": {} 2024-02-13T00:21:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-13T00:21:17.047 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "progress_events": {} 2024-02-13T00:21:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: } 2024-02-13T00:21:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:17.029+0000 7fd964e0f700 1 -- 172.21.15.80:0/3249668897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9600fb6b0 msgr2=0x7fd960071d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:17.029+0000 7fd964e0f700 1 --2- 172.21.15.80:0/3249668897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9600fb6b0 0x7fd960071d80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fd950009f00 tx=0x7fd9500090f0).stop 2024-02-13T00:21:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:17.029+0000 7fd964e0f700 1 -- 172.21.15.80:0/3249668897 shutdown_connections 2024-02-13T00:21:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:17.029+0000 7fd964e0f700 1 --2- 172.21.15.80:0/3249668897 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd9600fb6b0 0x7fd960071d80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:17.029+0000 7fd964e0f700 1 -- 172.21.15.80:0/3249668897 >> 172.21.15.80:0/3249668897 conn(0x7fd9600f6eb0 msgr2=0x7fd9600f8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:17.029+0000 7fd964e0f700 1 -- 172.21.15.80:0/3249668897 shutdown_connections 2024-02-13T00:21:17.048 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:17.029+0000 7fd964e0f700 1 -- 172.21.15.80:0/3249668897 wait complete. 2024-02-13T00:21:17.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:17 smithi080 bash[17386]: audit 2024-02-13T00:21:17.031602+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.80:0/3249668897' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-13T00:21:17.510 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:17 smithi080 bash[17652]: debug 2024-02-13T00:21:17.153+0000 7f5873c3a680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-13T00:21:17.681 INFO:teuthology.orchestra.run.smithi080.stderr:mgr not available, waiting (1/15)... 2024-02-13T00:21:18.010 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:17 smithi080 bash[17652]: debug 2024-02-13T00:21:17.645+0000 7f5873c3a680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-13T00:21:18.944 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:18 smithi080 bash[17652]: debug 2024-02-13T00:21:18.601+0000 7f5873c3a680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-13T00:21:18.945 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:18 smithi080 bash[17652]: debug 2024-02-13T00:21:18.689+0000 7f5873c3a680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-13T00:21:19.260 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:18 smithi080 bash[17652]: debug 2024-02-13T00:21:18.933+0000 7f5873c3a680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-13T00:21:20.346 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:20 smithi080 bash[17652]: debug 2024-02-13T00:21:20.073+0000 7f5873c3a680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-13T00:21:20.346 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:20 smithi080 bash[17652]: debug 2024-02-13T00:21:20.241+0000 7f5873c3a680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-13T00:21:20.346 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:20 smithi080 bash[17652]: debug 2024-02-13T00:21:20.337+0000 7f5873c3a680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-13T00:21:20.611 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.601+0000 7f445a6da700 1 Processor -- start 2024-02-13T00:21:20.612 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.601+0000 7f445a6da700 1 -- start start 2024-02-13T00:21:20.612 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.601+0000 7f445a6da700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44540fb6b0 0x7f44540fbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:20.612 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.601+0000 7f445a6da700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44540fbfc0 con 0x7f44540fb6b0 2024-02-13T00:21:20.612 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.601+0000 7f4453fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44540fb6b0 0x7f44540fbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:20.612 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.601+0000 7f4453fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44540fb6b0 0x7f44540fbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47448/0 (socket says 172.21.15.80:47448) 2024-02-13T00:21:20.612 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.601+0000 7f4453fff700 1 -- 172.21.15.80:0/1199784627 learned_addr learned my addr 172.21.15.80:0/1199784627 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:20.613 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.601+0000 7f4453fff700 1 -- 172.21.15.80:0/1199784627 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44540fc100 con 0x7f44540fb6b0 2024-02-13T00:21:20.613 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.601+0000 7f4453fff700 1 --2- 172.21.15.80:0/1199784627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44540fb6b0 0x7f44540fbad0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f443c009730 tx=0x7f443c0090f0).ready entity=mon.0 client_cookie=c043839d1fe0b816 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:20.614 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.601+0000 7f44537fe700 1 -- 172.21.15.80:0/1199784627 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f443c00b580 con 0x7f44540fb6b0 2024-02-13T00:21:20.614 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.601+0000 7f44537fe700 1 -- 172.21.15.80:0/1199784627 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f443c00bb50 con 0x7f44540fb6b0 2024-02-13T00:21:20.614 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.601+0000 7f44537fe700 1 -- 172.21.15.80:0/1199784627 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f443c011a70 con 0x7f44540fb6b0 2024-02-13T00:21:20.614 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.605+0000 7f445a6da700 1 -- 172.21.15.80:0/1199784627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44540fb6b0 msgr2=0x7f44540fbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:20.614 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.605+0000 7f445a6da700 1 --2- 172.21.15.80:0/1199784627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44540fb6b0 0x7f44540fbad0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f443c009730 tx=0x7f443c0090f0).stop 2024-02-13T00:21:20.614 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.605+0000 7f445a6da700 1 -- 172.21.15.80:0/1199784627 shutdown_connections 2024-02-13T00:21:20.614 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.605+0000 7f445a6da700 1 --2- 172.21.15.80:0/1199784627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f44540fb6b0 0x7f44540fbad0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:20.614 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.605+0000 7f445a6da700 1 -- 172.21.15.80:0/1199784627 >> 172.21.15.80:0/1199784627 conn(0x7f44540f6eb0 msgr2=0x7f44540f92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:20.614 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.605+0000 7f445a6da700 1 -- 172.21.15.80:0/1199784627 shutdown_connections 2024-02-13T00:21:20.614 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.605+0000 7f445a6da700 1 -- 172.21.15.80:0/1199784627 wait complete. 2024-02-13T00:21:20.615 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.605+0000 7f445a6da700 1 Processor -- start 2024-02-13T00:21:20.615 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.605+0000 7f445a6da700 1 -- start start 2024-02-13T00:21:20.615 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.605+0000 7f445a6da700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f445410a3b0 0x7f445410a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:20.616 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.605+0000 7f445a6da700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445410acc0 con 0x7f445410a3b0 2024-02-13T00:21:20.616 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.605+0000 7f4453fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f445410a3b0 0x7f445410a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:20.616 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.605+0000 7f4453fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f445410a3b0 0x7f445410a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47456/0 (socket says 172.21.15.80:47456) 2024-02-13T00:21:20.616 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.605+0000 7f4453fff700 1 -- 172.21.15.80:0/2871881902 learned_addr learned my addr 172.21.15.80:0/2871881902 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:20.616 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.605+0000 7f4453fff700 1 -- 172.21.15.80:0/2871881902 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c009370 con 0x7f445410a3b0 2024-02-13T00:21:20.616 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.605+0000 7f4453fff700 1 --2- 172.21.15.80:0/2871881902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f445410a3b0 0x7f445410a7d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f443c009f00 tx=0x7f443c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:20.616 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.605+0000 7f4451ffb700 1 -- 172.21.15.80:0/2871881902 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f443c0118b0 con 0x7f445410a3b0 2024-02-13T00:21:20.616 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.605+0000 7f445a6da700 1 -- 172.21.15.80:0/2871881902 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f445410aec0 con 0x7f445410a3b0 2024-02-13T00:21:20.616 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.605+0000 7f4451ffb700 1 -- 172.21.15.80:0/2871881902 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f443c010d20 con 0x7f445410a3b0 2024-02-13T00:21:20.617 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.605+0000 7f445a6da700 1 -- 172.21.15.80:0/2871881902 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f445410ba10 con 0x7f445410a3b0 2024-02-13T00:21:20.617 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.605+0000 7f4451ffb700 1 -- 172.21.15.80:0/2871881902 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f443c01bcb0 con 0x7f445410a3b0 2024-02-13T00:21:20.617 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.609+0000 7f445a6da700 1 -- 172.21.15.80:0/2871881902 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445405a3b0 con 0x7f445410a3b0 2024-02-13T00:21:20.617 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.609+0000 7f4451ffb700 1 -- 172.21.15.80:0/2871881902 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f443c024400 con 0x7f445410a3b0 2024-02-13T00:21:20.617 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.609+0000 7f4451ffb700 1 -- 172.21.15.80:0/2871881902 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f443c01b4d0 con 0x7f445410a3b0 2024-02-13T00:21:20.621 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.613+0000 7f4451ffb700 1 -- 172.21.15.80:0/2871881902 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f443c042e50 con 0x7f445410a3b0 2024-02-13T00:21:20.694 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:20 smithi080 bash[17652]: debug 2024-02-13T00:21:20.453+0000 7f5873c3a680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-13T00:21:20.758 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.749+0000 7f445a6da700 1 -- 172.21.15.80:0/2871881902 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f4454046d80 con 0x7f445410a3b0 2024-02-13T00:21:20.758 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.749+0000 7f4451ffb700 1 -- 172.21.15.80:0/2871881902 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1241 (secure 0 0 0) 0x7f443c031020 con 0x7f445410a3b0 2024-02-13T00:21:20.758 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.759 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: { 2024-02-13T00:21:20.759 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "fsid": "a5ae7724-ca05-11ee-95b9-87774f69a715", 2024-02-13T00:21:20.759 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "health": { 2024-02-13T00:21:20.759 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-02-13T00:21:20.760 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "checks": {}, 2024-02-13T00:21:20.760 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "mutes": [] 2024-02-13T00:21:20.761 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-13T00:21:20.761 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-02-13T00:21:20.761 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "quorum": [ 2024-02-13T00:21:20.761 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 0 2024-02-13T00:21:20.761 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: ], 2024-02-13T00:21:20.761 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "quorum_names": [ 2024-02-13T00:21:20.761 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "a" 2024-02-13T00:21:20.762 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: ], 2024-02-13T00:21:20.762 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "quorum_age": 6, 2024-02-13T00:21:20.762 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "monmap": { 2024-02-13T00:21:20.762 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-13T00:21:20.762 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-02-13T00:21:20.762 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_mons": 1 2024-02-13T00:21:20.763 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-13T00:21:20.763 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "osdmap": { 2024-02-13T00:21:20.763 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-13T00:21:20.764 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_osds": 0, 2024-02-13T00:21:20.764 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-02-13T00:21:20.764 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-02-13T00:21:20.764 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-02-13T00:21:20.764 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-02-13T00:21:20.764 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-02-13T00:21:20.764 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-13T00:21:20.764 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "pgmap": { 2024-02-13T00:21:20.766 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-02-13T00:21:20.766 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-02-13T00:21:20.766 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_pools": 0, 2024-02-13T00:21:20.766 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_objects": 0, 2024-02-13T00:21:20.766 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-02-13T00:21:20.766 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-02-13T00:21:20.766 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-02-13T00:21:20.766 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "bytes_total": 0 2024-02-13T00:21:20.766 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-13T00:21:20.766 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "fsmap": { 2024-02-13T00:21:20.766 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-13T00:21:20.768 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "by_rank": [], 2024-02-13T00:21:20.768 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "up:standby": 0 2024-02-13T00:21:20.768 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-13T00:21:20.768 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "mgrmap": { 2024-02-13T00:21:20.768 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "available": false, 2024-02-13T00:21:20.768 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-02-13T00:21:20.768 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "modules": [ 2024-02-13T00:21:20.768 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "iostat", 2024-02-13T00:21:20.768 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "nfs", 2024-02-13T00:21:20.770 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "restful" 2024-02-13T00:21:20.770 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: ], 2024-02-13T00:21:20.770 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "services": {} 2024-02-13T00:21:20.770 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-13T00:21:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "servicemap": { 2024-02-13T00:21:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-13T00:21:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "modified": "2024-02-13T00:21:07.716720+0000", 2024-02-13T00:21:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "services": {} 2024-02-13T00:21:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-13T00:21:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "progress_events": {} 2024-02-13T00:21:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: } 2024-02-13T00:21:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.753+0000 7f445a6da700 1 -- 172.21.15.80:0/2871881902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f445410a3b0 msgr2=0x7f445410a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.753+0000 7f445a6da700 1 --2- 172.21.15.80:0/2871881902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f445410a3b0 0x7f445410a7d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f443c009f00 tx=0x7f443c0090f0).stop 2024-02-13T00:21:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.753+0000 7f445a6da700 1 -- 172.21.15.80:0/2871881902 shutdown_connections 2024-02-13T00:21:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.753+0000 7f445a6da700 1 --2- 172.21.15.80:0/2871881902 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f445410a3b0 0x7f445410a7d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.753+0000 7f445a6da700 1 -- 172.21.15.80:0/2871881902 >> 172.21.15.80:0/2871881902 conn(0x7f44540f6eb0 msgr2=0x7f44540f87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.753+0000 7f445a6da700 1 -- 172.21.15.80:0/2871881902 shutdown_connections 2024-02-13T00:21:20.771 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:20.753+0000 7f445a6da700 1 -- 172.21.15.80:0/2871881902 wait complete. 2024-02-13T00:21:21.008 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:20 smithi080 bash[17652]: debug 2024-02-13T00:21:20.685+0000 7f5873c3a680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-13T00:21:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:20 smithi080 bash[17386]: audit 2024-02-13T00:21:20.753150+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.15.80:0/2871881902' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-13T00:21:21.260 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:21 smithi080 bash[17652]: debug 2024-02-13T00:21:21.053+0000 7f5873c3a680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-13T00:21:21.260 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:21 smithi080 bash[17652]: debug 2024-02-13T00:21:21.169+0000 7f5873c3a680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-13T00:21:21.439 INFO:teuthology.orchestra.run.smithi080.stderr:mgr not available, waiting (2/15)... 2024-02-13T00:21:22.482 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:22 smithi080 bash[17652]: debug 2024-02-13T00:21:22.041+0000 7f5873c3a680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-13T00:21:22.482 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:22 smithi080 bash[17652]: debug 2024-02-13T00:21:22.141+0000 7f5873c3a680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-13T00:21:22.482 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:22 smithi080 bash[17652]: debug 2024-02-13T00:21:22.257+0000 7f5873c3a680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-13T00:21:23.096 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:22 smithi080 bash[17652]: debug 2024-02-13T00:21:22.469+0000 7f5873c3a680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-13T00:21:23.096 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:22 smithi080 bash[17652]: debug 2024-02-13T00:21:22.757+0000 7f5873c3a680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-13T00:21:23.096 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:22 smithi080 bash[17652]: debug 2024-02-13T00:21:22.921+0000 7f5873c3a680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-13T00:21:23.414 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:23 smithi080 bash[17652]: debug 2024-02-13T00:21:23.085+0000 7f5873c3a680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-13T00:21:23.414 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:23 smithi080 bash[17652]: debug 2024-02-13T00:21:23.297+0000 7f5873c3a680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-13T00:21:23.760 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:23 smithi080 bash[17652]: debug 2024-02-13T00:21:23.405+0000 7f5873c3a680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-13T00:21:23.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:23 smithi080 bash[17386]: cluster 2024-02-13T00:21:23.430851+0000 mon.a (mon.0) 9 : cluster [INF] Activating manager daemon y 2024-02-13T00:21:23.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:23 smithi080 bash[17386]: cluster 2024-02-13T00:21:23.437136+0000 mon.a (mon.0) 10 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00646117s) 2024-02-13T00:21:23.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:23 smithi080 bash[17386]: audit 2024-02-13T00:21:23.438716+0000 mon.a (mon.0) 11 : audit [DBG] from='mgr.14101 172.21.15.80:0/4153155005' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-13T00:21:23.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:23 smithi080 bash[17386]: audit 2024-02-13T00:21:23.439018+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14101 172.21.15.80:0/4153155005' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-13T00:21:23.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:23 smithi080 bash[17386]: audit 2024-02-13T00:21:23.439297+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14101 172.21.15.80:0/4153155005' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-13T00:21:23.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:23 smithi080 bash[17386]: audit 2024-02-13T00:21:23.439547+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14101 172.21.15.80:0/4153155005' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T00:21:23.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:23 smithi080 bash[17386]: audit 2024-02-13T00:21:23.439895+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14101 172.21.15.80:0/4153155005' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-13T00:21:23.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:23 smithi080 bash[17386]: cluster 2024-02-13T00:21:23.463536+0000 mon.a (mon.0) 16 : cluster [INF] Manager daemon y is now available 2024-02-13T00:21:23.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:23 smithi080 bash[17386]: audit 2024-02-13T00:21:23.480335+0000 mon.a (mon.0) 17 : audit [INF] from='mgr.14101 172.21.15.80:0/4153155005' entity='mgr.y' 2024-02-13T00:21:24.513 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.501+0000 7f3a91885700 1 Processor -- start 2024-02-13T00:21:24.513 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.501+0000 7f3a91885700 1 -- start start 2024-02-13T00:21:24.514 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.501+0000 7f3a91885700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a8c0fd8d0 0x7f3a8c0fdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:24.514 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.501+0000 7f3a91885700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c0fe270 con 0x7f3a8c0fd8d0 2024-02-13T00:21:24.514 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.501+0000 7f3a8affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a8c0fd8d0 0x7f3a8c0fdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:24.514 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.501+0000 7f3a8affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a8c0fd8d0 0x7f3a8c0fdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47510/0 (socket says 172.21.15.80:47510) 2024-02-13T00:21:24.514 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.501+0000 7f3a8affd700 1 -- 172.21.15.80:0/24872838 learned_addr learned my addr 172.21.15.80:0/24872838 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:24.515 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.505+0000 7f3a8affd700 1 -- 172.21.15.80:0/24872838 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8c0fe3b0 con 0x7f3a8c0fd8d0 2024-02-13T00:21:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.505+0000 7f3a8affd700 1 --2- 172.21.15.80:0/24872838 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a8c0fd8d0 0x7f3a8c0fdcf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f3a7c009e50 tx=0x7f3a7c009840).ready entity=mon.0 client_cookie=acb8a43c696d2d59 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.505+0000 7f3a89ffb700 1 -- 172.21.15.80:0/24872838 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a7c00e070 con 0x7f3a8c0fd8d0 2024-02-13T00:21:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.505+0000 7f3a89ffb700 1 -- 172.21.15.80:0/24872838 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f3a7c00be90 con 0x7f3a8c0fd8d0 2024-02-13T00:21:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.505+0000 7f3a89ffb700 1 -- 172.21.15.80:0/24872838 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a7c013d40 con 0x7f3a8c0fd8d0 2024-02-13T00:21:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.505+0000 7f3a91885700 1 -- 172.21.15.80:0/24872838 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a8c0fd8d0 msgr2=0x7f3a8c0fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.505+0000 7f3a91885700 1 --2- 172.21.15.80:0/24872838 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a8c0fd8d0 0x7f3a8c0fdcf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f3a7c009e50 tx=0x7f3a7c009840).stop 2024-02-13T00:21:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.505+0000 7f3a91885700 1 -- 172.21.15.80:0/24872838 shutdown_connections 2024-02-13T00:21:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.505+0000 7f3a91885700 1 --2- 172.21.15.80:0/24872838 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a8c0fd8d0 0x7f3a8c0fdcf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.505+0000 7f3a91885700 1 -- 172.21.15.80:0/24872838 >> 172.21.15.80:0/24872838 conn(0x7f3a8c070e40 msgr2=0x7f3a8c071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.505+0000 7f3a91885700 1 -- 172.21.15.80:0/24872838 shutdown_connections 2024-02-13T00:21:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.505+0000 7f3a91885700 1 -- 172.21.15.80:0/24872838 wait complete. 2024-02-13T00:21:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.505+0000 7f3a91885700 1 Processor -- start 2024-02-13T00:21:24.516 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.505+0000 7f3a91885700 1 -- start start 2024-02-13T00:21:24.518 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.505+0000 7f3a91885700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a8c0fd8d0 0x7f3a8c10c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:24.518 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.505+0000 7f3a91885700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8c10c9b0 con 0x7f3a8c0fd8d0 2024-02-13T00:21:24.518 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.505+0000 7f3a8affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a8c0fd8d0 0x7f3a8c10c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:24.518 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.505+0000 7f3a8affd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a8c0fd8d0 0x7f3a8c10c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47516/0 (socket says 172.21.15.80:47516) 2024-02-13T00:21:24.518 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.505+0000 7f3a8affd700 1 -- 172.21.15.80:0/2035869642 learned_addr learned my addr 172.21.15.80:0/2035869642 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:24.518 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.509+0000 7f3a8affd700 1 -- 172.21.15.80:0/2035869642 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c009ae0 con 0x7f3a8c0fd8d0 2024-02-13T00:21:24.518 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.509+0000 7f3a8affd700 1 --2- 172.21.15.80:0/2035869642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a8c0fd8d0 0x7f3a8c10c4c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f3a7c014f60 tx=0x7f3a7c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:24.519 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.509+0000 7f3a83fff700 1 -- 172.21.15.80:0/2035869642 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a7c00e040 con 0x7f3a8c0fd8d0 2024-02-13T00:21:24.519 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.509+0000 7f3a83fff700 1 -- 172.21.15.80:0/2035869642 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f3a7c012900 con 0x7f3a8c0fd8d0 2024-02-13T00:21:24.519 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.509+0000 7f3a83fff700 1 -- 172.21.15.80:0/2035869642 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a7c0076b0 con 0x7f3a8c0fd8d0 2024-02-13T00:21:24.519 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.509+0000 7f3a91885700 1 -- 172.21.15.80:0/2035869642 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8c10cbb0 con 0x7f3a8c0fd8d0 2024-02-13T00:21:24.519 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.509+0000 7f3a91885700 1 -- 172.21.15.80:0/2035869642 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a8c10d040 con 0x7f3a8c0fd8d0 2024-02-13T00:21:24.519 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.509+0000 7f3a83fff700 1 -- 172.21.15.80:0/2035869642 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 3) v1 ==== 38500+0+0 (secure 0 0 0) 0x7f3a7c003040 con 0x7f3a8c0fd8d0 2024-02-13T00:21:24.519 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.509+0000 7f3a83fff700 1 --2- 172.21.15.80:0/2035869642 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f3a780324c0 0x7f3a78034980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:24.520 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.509+0000 7f3a83fff700 1 -- 172.21.15.80:0/2035869642 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f3a7c0441b0 con 0x7f3a8c0fd8d0 2024-02-13T00:21:24.520 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.509+0000 7f3a8a7fc700 1 --2- 172.21.15.80:0/2035869642 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f3a780324c0 0x7f3a78034980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:24.520 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.509+0000 7f3a91885700 1 -- 172.21.15.80:0/2035869642 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8c05a3b0 con 0x7f3a8c0fd8d0 2024-02-13T00:21:24.521 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.509+0000 7f3a8a7fc700 1 --2- 172.21.15.80:0/2035869642 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f3a780324c0 0x7f3a78034980 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f3a74009780 tx=0x7f3a74006cc0).ready entity=mgr.14101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:24.527 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.517+0000 7f3a83fff700 1 -- 172.21.15.80:0/2035869642 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3a7c011960 con 0x7f3a8c0fd8d0 2024-02-13T00:21:24.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:24 smithi080 bash[17386]: audit 2024-02-13T00:21:23.486869+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14101 172.21.15.80:0/4153155005' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-13T00:21:24.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:24 smithi080 bash[17386]: audit 2024-02-13T00:21:23.490725+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14101 172.21.15.80:0/4153155005' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-13T00:21:24.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:24 smithi080 bash[17386]: audit 2024-02-13T00:21:23.493591+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.14101 172.21.15.80:0/4153155005' entity='mgr.y' 2024-02-13T00:21:24.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:24 smithi080 bash[17386]: audit 2024-02-13T00:21:23.495574+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14101 172.21.15.80:0/4153155005' entity='mgr.y' 2024-02-13T00:21:24.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:24 smithi080 bash[17386]: cluster 2024-02-13T00:21:24.440737+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e3: y(active, since 1.01008s) 2024-02-13T00:21:24.973 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.961+0000 7f3a91885700 1 -- 172.21.15.80:0/2035869642 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f3a8c046d80 con 0x7f3a8c0fd8d0 2024-02-13T00:21:24.975 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.965+0000 7f3a83fff700 1 -- 172.21.15.80:0/2035869642 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1241 (secure 0 0 0) 0x7f3a7c019250 con 0x7f3a8c0fd8d0 2024-02-13T00:21:24.975 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.975 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: { 2024-02-13T00:21:24.975 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "fsid": "a5ae7724-ca05-11ee-95b9-87774f69a715", 2024-02-13T00:21:24.975 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "health": { 2024-02-13T00:21:24.975 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-02-13T00:21:24.975 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "checks": {}, 2024-02-13T00:21:24.975 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "mutes": [] 2024-02-13T00:21:24.975 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-13T00:21:24.975 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-02-13T00:21:24.976 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "quorum": [ 2024-02-13T00:21:24.976 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 0 2024-02-13T00:21:24.976 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: ], 2024-02-13T00:21:24.976 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "quorum_names": [ 2024-02-13T00:21:24.976 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "a" 2024-02-13T00:21:24.976 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: ], 2024-02-13T00:21:24.976 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "quorum_age": 10, 2024-02-13T00:21:24.976 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "monmap": { 2024-02-13T00:21:24.981 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-13T00:21:24.982 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-02-13T00:21:24.982 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_mons": 1 2024-02-13T00:21:24.982 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-13T00:21:24.982 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "osdmap": { 2024-02-13T00:21:24.982 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-13T00:21:24.982 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_osds": 0, 2024-02-13T00:21:24.982 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-02-13T00:21:24.982 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-02-13T00:21:24.982 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-02-13T00:21:24.982 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-02-13T00:21:24.982 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-02-13T00:21:24.982 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-13T00:21:24.982 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "pgmap": { 2024-02-13T00:21:24.983 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-02-13T00:21:24.983 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-02-13T00:21:24.983 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_pools": 0, 2024-02-13T00:21:24.983 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_objects": 0, 2024-02-13T00:21:24.983 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-02-13T00:21:24.983 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-02-13T00:21:24.983 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-02-13T00:21:24.983 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "bytes_total": 0 2024-02-13T00:21:24.983 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-13T00:21:24.983 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "fsmap": { 2024-02-13T00:21:24.983 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-13T00:21:24.983 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "by_rank": [], 2024-02-13T00:21:24.983 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "up:standby": 0 2024-02-13T00:21:24.983 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-13T00:21:24.983 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "mgrmap": { 2024-02-13T00:21:24.984 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "available": true, 2024-02-13T00:21:24.984 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-02-13T00:21:24.984 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "modules": [ 2024-02-13T00:21:24.984 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "iostat", 2024-02-13T00:21:24.984 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "nfs", 2024-02-13T00:21:24.984 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "restful" 2024-02-13T00:21:24.984 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: ], 2024-02-13T00:21:24.984 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "services": {} 2024-02-13T00:21:24.984 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-13T00:21:24.984 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "servicemap": { 2024-02-13T00:21:24.984 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-13T00:21:24.984 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "modified": "2024-02-13T00:21:07.716720+0000", 2024-02-13T00:21:24.984 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "services": {} 2024-02-13T00:21:24.984 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: }, 2024-02-13T00:21:24.984 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "progress_events": {} 2024-02-13T00:21:24.984 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: } 2024-02-13T00:21:24.985 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.965+0000 7f3a91885700 1 -- 172.21.15.80:0/2035869642 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f3a780324c0 msgr2=0x7f3a78034980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:24.985 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.965+0000 7f3a91885700 1 --2- 172.21.15.80:0/2035869642 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f3a780324c0 0x7f3a78034980 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f3a74009780 tx=0x7f3a74006cc0).stop 2024-02-13T00:21:24.985 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.965+0000 7f3a91885700 1 -- 172.21.15.80:0/2035869642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a8c0fd8d0 msgr2=0x7f3a8c10c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:24.985 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.965+0000 7f3a91885700 1 --2- 172.21.15.80:0/2035869642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a8c0fd8d0 0x7f3a8c10c4c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f3a7c014f60 tx=0x7f3a7c009840).stop 2024-02-13T00:21:24.985 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.965+0000 7f3a91885700 1 -- 172.21.15.80:0/2035869642 shutdown_connections 2024-02-13T00:21:24.985 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.965+0000 7f3a91885700 1 --2- 172.21.15.80:0/2035869642 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f3a780324c0 0x7f3a78034980 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:24.985 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.965+0000 7f3a91885700 1 --2- 172.21.15.80:0/2035869642 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3a8c0fd8d0 0x7f3a8c10c4c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:24.985 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.965+0000 7f3a91885700 1 -- 172.21.15.80:0/2035869642 >> 172.21.15.80:0/2035869642 conn(0x7f3a8c070e40 msgr2=0x7f3a8c0fc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:24.985 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.965+0000 7f3a91885700 1 -- 172.21.15.80:0/2035869642 shutdown_connections 2024-02-13T00:21:24.985 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:24.965+0000 7f3a91885700 1 -- 172.21.15.80:0/2035869642 wait complete. 2024-02-13T00:21:25.670 INFO:teuthology.orchestra.run.smithi080.stderr:mgr is available 2024-02-13T00:21:25.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:25 smithi080 bash[17386]: audit 2024-02-13T00:21:24.968062+0000 mon.a (mon.0) 23 : audit [DBG] from='client.? 172.21.15.80:0/2035869642' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-13T00:21:26.652 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.641+0000 7ff2f4580700 1 Processor -- start 2024-02-13T00:21:26.652 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.641+0000 7ff2f4580700 1 -- start start 2024-02-13T00:21:26.652 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.641+0000 7ff2f4580700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2ec0756b0 0x7ff2ec075ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:26.653 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.641+0000 7ff2f4580700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec076050 con 0x7ff2ec0756b0 2024-02-13T00:21:26.653 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.641+0000 7ff2f231c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2ec0756b0 0x7ff2ec075ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:26.653 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.641+0000 7ff2f231c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2ec0756b0 0x7ff2ec075ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47524/0 (socket says 172.21.15.80:47524) 2024-02-13T00:21:26.653 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.641+0000 7ff2f231c700 1 -- 172.21.15.80:0/3211266234 learned_addr learned my addr 172.21.15.80:0/3211266234 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:26.654 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.641+0000 7ff2f231c700 1 -- 172.21.15.80:0/3211266234 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec076190 con 0x7ff2ec0756b0 2024-02-13T00:21:26.654 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.641+0000 7ff2f231c700 1 --2- 172.21.15.80:0/3211266234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2ec0756b0 0x7ff2ec075ad0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7ff2e8009730 tx=0x7ff2e80090f0).ready entity=mon.0 client_cookie=64b2b41f0dd59d7f server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:26.654 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.645+0000 7ff2f131a700 1 -- 172.21.15.80:0/3211266234 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2e800b580 con 0x7ff2ec0756b0 2024-02-13T00:21:26.654 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.645+0000 7ff2f131a700 1 -- 172.21.15.80:0/3211266234 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7ff2e800bb50 con 0x7ff2ec0756b0 2024-02-13T00:21:26.654 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.645+0000 7ff2f131a700 1 -- 172.21.15.80:0/3211266234 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2e8011a70 con 0x7ff2ec0756b0 2024-02-13T00:21:26.656 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.645+0000 7ff2f4580700 1 -- 172.21.15.80:0/3211266234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2ec0756b0 msgr2=0x7ff2ec075ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:26.656 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.645+0000 7ff2f4580700 1 --2- 172.21.15.80:0/3211266234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2ec0756b0 0x7ff2ec075ad0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7ff2e8009730 tx=0x7ff2e80090f0).stop 2024-02-13T00:21:26.656 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.645+0000 7ff2f4580700 1 -- 172.21.15.80:0/3211266234 shutdown_connections 2024-02-13T00:21:26.656 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.645+0000 7ff2f4580700 1 --2- 172.21.15.80:0/3211266234 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2ec0756b0 0x7ff2ec075ad0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:26.656 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.645+0000 7ff2f4580700 1 -- 172.21.15.80:0/3211266234 >> 172.21.15.80:0/3211266234 conn(0x7ff2ec070e40 msgr2=0x7ff2ec073280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:26.656 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.645+0000 7ff2f4580700 1 -- 172.21.15.80:0/3211266234 shutdown_connections 2024-02-13T00:21:26.656 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.645+0000 7ff2f4580700 1 -- 172.21.15.80:0/3211266234 wait complete. 2024-02-13T00:21:26.656 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.645+0000 7ff2f4580700 1 Processor -- start 2024-02-13T00:21:26.656 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.645+0000 7ff2f4580700 1 -- start start 2024-02-13T00:21:26.656 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.645+0000 7ff2f4580700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2ec0756b0 0x7ff2ec1108e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:26.656 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.645+0000 7ff2f4580700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec110dd0 con 0x7ff2ec0756b0 2024-02-13T00:21:26.657 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.645+0000 7ff2f231c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2ec0756b0 0x7ff2ec1108e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:26.657 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.645+0000 7ff2f231c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2ec0756b0 0x7ff2ec1108e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47528/0 (socket says 172.21.15.80:47528) 2024-02-13T00:21:26.657 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.645+0000 7ff2f231c700 1 -- 172.21.15.80:0/3902249361 learned_addr learned my addr 172.21.15.80:0/3902249361 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:26.657 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.645+0000 7ff2f231c700 1 -- 172.21.15.80:0/3902249361 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e8009370 con 0x7ff2ec0756b0 2024-02-13T00:21:26.658 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.649+0000 7ff2f231c700 1 --2- 172.21.15.80:0/3902249361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2ec0756b0 0x7ff2ec1108e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7ff2e800bfa0 tx=0x7ff2e80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:26.658 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.649+0000 7ff2e37fe700 1 -- 172.21.15.80:0/3902249361 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2e801a640 con 0x7ff2ec0756b0 2024-02-13T00:21:26.658 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.649+0000 7ff2e37fe700 1 -- 172.21.15.80:0/3902249361 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7ff2e801ac10 con 0x7ff2ec0756b0 2024-02-13T00:21:26.658 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.649+0000 7ff2f4580700 1 -- 172.21.15.80:0/3902249361 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2ec110fd0 con 0x7ff2ec0756b0 2024-02-13T00:21:26.658 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.649+0000 7ff2e37fe700 1 -- 172.21.15.80:0/3902249361 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2e8023b70 con 0x7ff2ec0756b0 2024-02-13T00:21:26.658 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.649+0000 7ff2f4580700 1 -- 172.21.15.80:0/3902249361 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ec111460 con 0x7ff2ec0756b0 2024-02-13T00:21:26.659 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.649+0000 7ff2e37fe700 1 -- 172.21.15.80:0/3902249361 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 4) v1 ==== 38606+0+0 (secure 0 0 0) 0x7ff2e8023cd0 con 0x7ff2ec0756b0 2024-02-13T00:21:26.660 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.649+0000 7ff2e37fe700 1 --2- 172.21.15.80:0/3902249361 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7ff2d80325e0 0x7ff2d8034aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:26.660 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.649+0000 7ff2e37fe700 1 -- 172.21.15.80:0/3902249361 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7ff2e8044b70 con 0x7ff2ec0756b0 2024-02-13T00:21:26.660 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.649+0000 7ff2f1b1b700 1 --2- 172.21.15.80:0/3902249361 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7ff2d80325e0 0x7ff2d8034aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:26.660 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.649+0000 7ff2f4580700 1 -- 172.21.15.80:0/3902249361 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2ec05a3b0 con 0x7ff2ec0756b0 2024-02-13T00:21:26.661 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.649+0000 7ff2f1b1b700 1 --2- 172.21.15.80:0/3902249361 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7ff2d80325e0 0x7ff2d8034aa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7ff2dc009780 tx=0x7ff2dc006cc0).ready entity=mgr.14101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:26.667 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.657+0000 7ff2e37fe700 1 -- 172.21.15.80:0/3902249361 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff2e801e080 con 0x7ff2ec0756b0 2024-02-13T00:21:26.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:26 smithi080 bash[17386]: cluster 2024-02-13T00:21:25.488992+0000 mon.a (mon.0) 24 : cluster [DBG] mgrmap e4: y(active, since 2s) 2024-02-13T00:21:26.996 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.985+0000 7ff2f4580700 1 -- 172.21.15.80:0/3902249361 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7ff2ec046d80 con 0x7ff2ec0756b0 2024-02-13T00:21:26.999 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.989+0000 7ff2e37fe700 1 -- 172.21.15.80:0/3902249361 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+307 (secure 0 0 0) 0x7ff2e802bd20 con 0x7ff2ec0756b0 2024-02-13T00:21:26.999 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.999 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: [global] 2024-02-13T00:21:26.999 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: fsid = a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:21:26.999 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: log_to_journald = false 2024-02-13T00:21:27.000 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-02-13T00:21:27.000 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-02-13T00:21:27.000 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-02-13T00:21:27.000 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-02-13T00:21:27.000 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:27.000 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: [mgr] 2024-02-13T00:21:27.000 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-02-13T00:21:27.000 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:27.000 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: [osd] 2024-02-13T00:21:27.000 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-02-13T00:21:27.000 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-02-13T00:21:27.003 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.993+0000 7ff2f4580700 1 -- 172.21.15.80:0/3902249361 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7ff2d80325e0 msgr2=0x7ff2d8034aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:27.003 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.993+0000 7ff2f4580700 1 --2- 172.21.15.80:0/3902249361 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7ff2d80325e0 0x7ff2d8034aa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7ff2dc009780 tx=0x7ff2dc006cc0).stop 2024-02-13T00:21:27.003 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.993+0000 7ff2f4580700 1 -- 172.21.15.80:0/3902249361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2ec0756b0 msgr2=0x7ff2ec1108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:27.003 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.993+0000 7ff2f4580700 1 --2- 172.21.15.80:0/3902249361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2ec0756b0 0x7ff2ec1108e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7ff2e800bfa0 tx=0x7ff2e80090f0).stop 2024-02-13T00:21:27.003 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.993+0000 7ff2f4580700 1 -- 172.21.15.80:0/3902249361 shutdown_connections 2024-02-13T00:21:27.003 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.993+0000 7ff2f4580700 1 --2- 172.21.15.80:0/3902249361 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7ff2d80325e0 0x7ff2d8034aa0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:27.003 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.993+0000 7ff2f4580700 1 --2- 172.21.15.80:0/3902249361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff2ec0756b0 0x7ff2ec1108e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:27.003 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.993+0000 7ff2f4580700 1 -- 172.21.15.80:0/3902249361 >> 172.21.15.80:0/3902249361 conn(0x7ff2ec070e40 msgr2=0x7ff2ec073270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:27.004 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.993+0000 7ff2f4580700 1 -- 172.21.15.80:0/3902249361 shutdown_connections 2024-02-13T00:21:27.004 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:26.993+0000 7ff2f4580700 1 -- 172.21.15.80:0/3902249361 wait complete. 2024-02-13T00:21:27.634 INFO:teuthology.orchestra.run.smithi080.stderr:Enabling cephadm module... 2024-02-13T00:21:27.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:27 smithi080 bash[17386]: audit 2024-02-13T00:21:26.991837+0000 mon.a (mon.0) 25 : audit [INF] from='client.? 172.21.15.80:0/3902249361' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-13T00:21:28.628 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.617+0000 7f46f9661700 1 Processor -- start 2024-02-13T00:21:28.628 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.617+0000 7f46f9661700 1 -- start start 2024-02-13T00:21:28.628 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.617+0000 7f46f9661700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46f40fb6c0 0x7f46f40fbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:28.628 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.617+0000 7f46f9661700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f40fbfd0 con 0x7f46f40fb6c0 2024-02-13T00:21:28.628 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.617+0000 7f46f2ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46f40fb6c0 0x7f46f40fbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:28.628 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.617+0000 7f46f2ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46f40fb6c0 0x7f46f40fbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47540/0 (socket says 172.21.15.80:47540) 2024-02-13T00:21:28.628 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.617+0000 7f46f2ffd700 1 -- 172.21.15.80:0/3676467145 learned_addr learned my addr 172.21.15.80:0/3676467145 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:28.629 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.617+0000 7f46f2ffd700 1 -- 172.21.15.80:0/3676467145 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f40fc110 con 0x7f46f40fb6c0 2024-02-13T00:21:28.629 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.617+0000 7f46f2ffd700 1 --2- 172.21.15.80:0/3676467145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46f40fb6c0 0x7f46f40fbae0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f46e4009e50 tx=0x7f46e4009840).ready entity=mon.0 client_cookie=35b94a48d8938e82 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:28.629 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.617+0000 7f46f1ffb700 1 -- 172.21.15.80:0/3676467145 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46e400e070 con 0x7f46f40fb6c0 2024-02-13T00:21:28.629 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.617+0000 7f46f1ffb700 1 -- 172.21.15.80:0/3676467145 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f46e400be90 con 0x7f46f40fb6c0 2024-02-13T00:21:28.629 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.617+0000 7f46f1ffb700 1 -- 172.21.15.80:0/3676467145 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46e4013d40 con 0x7f46f40fb6c0 2024-02-13T00:21:28.630 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.621+0000 7f46f9661700 1 -- 172.21.15.80:0/3676467145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46f40fb6c0 msgr2=0x7f46f40fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:28.630 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.621+0000 7f46f9661700 1 --2- 172.21.15.80:0/3676467145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46f40fb6c0 0x7f46f40fbae0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f46e4009e50 tx=0x7f46e4009840).stop 2024-02-13T00:21:28.631 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.621+0000 7f46f9661700 1 -- 172.21.15.80:0/3676467145 shutdown_connections 2024-02-13T00:21:28.631 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.621+0000 7f46f9661700 1 --2- 172.21.15.80:0/3676467145 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46f40fb6c0 0x7f46f40fbae0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:28.631 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.621+0000 7f46f9661700 1 -- 172.21.15.80:0/3676467145 >> 172.21.15.80:0/3676467145 conn(0x7f46f40f6ec0 msgr2=0x7f46f40f92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:28.631 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.621+0000 7f46f9661700 1 -- 172.21.15.80:0/3676467145 shutdown_connections 2024-02-13T00:21:28.631 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.621+0000 7f46f9661700 1 -- 172.21.15.80:0/3676467145 wait complete. 2024-02-13T00:21:28.631 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.621+0000 7f46f9661700 1 Processor -- start 2024-02-13T00:21:28.632 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.621+0000 7f46f9661700 1 -- start start 2024-02-13T00:21:28.632 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.621+0000 7f46f9661700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46f40fb6c0 0x7f46f4071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:28.632 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.621+0000 7f46f9661700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f4070200 con 0x7f46f40fb6c0 2024-02-13T00:21:28.632 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.621+0000 7f46f2ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46f40fb6c0 0x7f46f4071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:28.632 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.621+0000 7f46f2ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46f40fb6c0 0x7f46f4071d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:47552/0 (socket says 172.21.15.80:47552) 2024-02-13T00:21:28.632 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.621+0000 7f46f2ffd700 1 -- 172.21.15.80:0/2942832095 learned_addr learned my addr 172.21.15.80:0/2942832095 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:28.634 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.621+0000 7f46f2ffd700 1 -- 172.21.15.80:0/2942832095 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e4009ae0 con 0x7f46f40fb6c0 2024-02-13T00:21:28.634 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.621+0000 7f46f2ffd700 1 --2- 172.21.15.80:0/2942832095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46f40fb6c0 0x7f46f4071d80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f46e40072f0 tx=0x7f46e4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:28.634 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.621+0000 7f46dbfff700 1 -- 172.21.15.80:0/2942832095 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46e400e040 con 0x7f46f40fb6c0 2024-02-13T00:21:28.634 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.621+0000 7f46dbfff700 1 -- 172.21.15.80:0/2942832095 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f46e4012980 con 0x7f46f40fb6c0 2024-02-13T00:21:28.634 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.621+0000 7f46f9661700 1 -- 172.21.15.80:0/2942832095 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f40703a0 con 0x7f46f40fb6c0 2024-02-13T00:21:28.634 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.621+0000 7f46dbfff700 1 -- 172.21.15.80:0/2942832095 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46e4007880 con 0x7f46f40fb6c0 2024-02-13T00:21:28.634 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.621+0000 7f46f9661700 1 -- 172.21.15.80:0/2942832095 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f4070830 con 0x7f46f40fb6c0 2024-02-13T00:21:28.634 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.625+0000 7f46dbfff700 1 -- 172.21.15.80:0/2942832095 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 4) v1 ==== 38606+0+0 (secure 0 0 0) 0x7f46e4003040 con 0x7f46f40fb6c0 2024-02-13T00:21:28.635 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.625+0000 7f46f9661700 1 -- 172.21.15.80:0/2942832095 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f405a3b0 con 0x7f46f40fb6c0 2024-02-13T00:21:28.635 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.625+0000 7f46dbfff700 1 --2- 172.21.15.80:0/2942832095 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f46dc032610 0x7f46dc034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:28.635 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.625+0000 7f46dbfff700 1 -- 172.21.15.80:0/2942832095 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f46e4044440 con 0x7f46f40fb6c0 2024-02-13T00:21:28.635 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.625+0000 7f46f27fc700 1 --2- 172.21.15.80:0/2942832095 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f46dc032610 0x7f46dc034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:28.635 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.625+0000 7f46f27fc700 1 --2- 172.21.15.80:0/2942832095 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f46dc032610 0x7f46dc034ad0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f46e8009780 tx=0x7f46e8006cb0).ready entity=mgr.14101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:28.640 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:28.629+0000 7f46dbfff700 1 -- 172.21.15.80:0/2942832095 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f46e4023300 con 0x7f46f40fb6c0 2024-02-13T00:21:29.048 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:29.037+0000 7f46f9661700 1 -- 172.21.15.80:0/2942832095 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f46f40fd3e0 con 0x7f46f40fb6c0 2024-02-13T00:21:29.104 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:29.093+0000 7f46dbfff700 1 -- 172.21.15.80:0/2942832095 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 5) v1 ==== 38617+0+0 (secure 0 0 0) 0x7f46e4025780 con 0x7f46f40fb6c0 2024-02-13T00:21:29.106 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:29.097+0000 7f46dbfff700 1 -- 172.21.15.80:0/2942832095 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f46e4019640 con 0x7f46f40fb6c0 2024-02-13T00:21:29.111 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:29.101+0000 7f46f9661700 1 -- 172.21.15.80:0/2942832095 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f46dc032610 msgr2=0x7f46dc034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:29.111 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:29.101+0000 7f46f9661700 1 --2- 172.21.15.80:0/2942832095 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f46dc032610 0x7f46dc034ad0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f46e8009780 tx=0x7f46e8006cb0).stop 2024-02-13T00:21:29.111 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:29.101+0000 7f46f9661700 1 -- 172.21.15.80:0/2942832095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46f40fb6c0 msgr2=0x7f46f4071d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:29.111 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:29.101+0000 7f46f9661700 1 --2- 172.21.15.80:0/2942832095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46f40fb6c0 0x7f46f4071d80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f46e40072f0 tx=0x7f46e4009840).stop 2024-02-13T00:21:29.112 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:29.101+0000 7f46f9661700 1 -- 172.21.15.80:0/2942832095 shutdown_connections 2024-02-13T00:21:29.112 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:29.101+0000 7f46f9661700 1 --2- 172.21.15.80:0/2942832095 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f46dc032610 0x7f46dc034ad0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:29.112 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:29.101+0000 7f46f9661700 1 --2- 172.21.15.80:0/2942832095 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46f40fb6c0 0x7f46f4071d80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:29.112 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:29.101+0000 7f46f9661700 1 -- 172.21.15.80:0/2942832095 >> 172.21.15.80:0/2942832095 conn(0x7f46f40f6ec0 msgr2=0x7f46f40f8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:29.112 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:29.101+0000 7f46f9661700 1 -- 172.21.15.80:0/2942832095 shutdown_connections 2024-02-13T00:21:29.112 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:29.101+0000 7f46f9661700 1 -- 172.21.15.80:0/2942832095 wait complete. 2024-02-13T00:21:29.414 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:29 smithi080 bash[17386]: audit 2024-02-13T00:21:29.043481+0000 mon.a (mon.0) 26 : audit [INF] from='client.? 172.21.15.80:0/2942832095' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-13T00:21:29.414 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:29 smithi080 bash[17652]: ignoring --setuser ceph since I am not root 2024-02-13T00:21:29.414 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:29 smithi080 bash[17652]: ignoring --setgroup ceph since I am not root 2024-02-13T00:21:29.414 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:29 smithi080 bash[17652]: debug 2024-02-13T00:21:29.301+0000 7fdcfdf19680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-13T00:21:29.414 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:29 smithi080 bash[17652]: debug 2024-02-13T00:21:29.405+0000 7fdcfdf19680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-13T00:21:30.109 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:29 smithi080 bash[17652]: debug 2024-02-13T00:21:29.853+0000 7fdcfdf19680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-13T00:21:30.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:30 smithi080 bash[17386]: audit 2024-02-13T00:21:29.100704+0000 mon.a (mon.0) 27 : audit [INF] from='client.? 172.21.15.80:0/2942832095' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-13T00:21:30.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:30 smithi080 bash[17386]: cluster 2024-02-13T00:21:29.100820+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e5: y(active, since 5s) 2024-02-13T00:21:30.885 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.873+0000 7f8b411cb700 1 Processor -- start 2024-02-13T00:21:30.885 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.873+0000 7f8b411cb700 1 -- start start 2024-02-13T00:21:30.885 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.873+0000 7f8b411cb700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b3c0f9a40 0x7f8b3c0f9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:30.885 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.873+0000 7f8b411cb700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c0fa3e0 con 0x7f8b3c0f9a40 2024-02-13T00:21:30.885 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.873+0000 7f8b3ad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b3c0f9a40 0x7f8b3c0f9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:30.885 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.873+0000 7f8b3ad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b3c0f9a40 0x7f8b3c0f9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41538/0 (socket says 172.21.15.80:41538) 2024-02-13T00:21:30.885 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.877+0000 7f8b3ad9d700 1 -- 172.21.15.80:0/3558848741 learned_addr learned my addr 172.21.15.80:0/3558848741 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:30.886 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.877+0000 7f8b3ad9d700 1 -- 172.21.15.80:0/3558848741 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c0fa520 con 0x7f8b3c0f9a40 2024-02-13T00:21:30.886 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.877+0000 7f8b3ad9d700 1 --2- 172.21.15.80:0/3558848741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b3c0f9a40 0x7f8b3c0f9e60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8b24009730 tx=0x7f8b240090f0).ready entity=mon.0 client_cookie=1dc481bc2932e02 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:30.887 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.877+0000 7f8b39d9b700 1 -- 172.21.15.80:0/3558848741 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b2400b580 con 0x7f8b3c0f9a40 2024-02-13T00:21:30.887 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.877+0000 7f8b39d9b700 1 -- 172.21.15.80:0/3558848741 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f8b2400bb50 con 0x7f8b3c0f9a40 2024-02-13T00:21:30.887 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.877+0000 7f8b39d9b700 1 -- 172.21.15.80:0/3558848741 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b24011a70 con 0x7f8b3c0f9a40 2024-02-13T00:21:30.888 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.877+0000 7f8b411cb700 1 -- 172.21.15.80:0/3558848741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b3c0f9a40 msgr2=0x7f8b3c0f9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:30.888 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.877+0000 7f8b411cb700 1 --2- 172.21.15.80:0/3558848741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b3c0f9a40 0x7f8b3c0f9e60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8b24009730 tx=0x7f8b240090f0).stop 2024-02-13T00:21:30.888 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.877+0000 7f8b411cb700 1 -- 172.21.15.80:0/3558848741 shutdown_connections 2024-02-13T00:21:30.888 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.877+0000 7f8b411cb700 1 --2- 172.21.15.80:0/3558848741 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b3c0f9a40 0x7f8b3c0f9e60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:30.888 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.877+0000 7f8b411cb700 1 -- 172.21.15.80:0/3558848741 >> 172.21.15.80:0/3558848741 conn(0x7f8b3c0f5460 msgr2=0x7f8b3c0f78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:30.889 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.877+0000 7f8b411cb700 1 -- 172.21.15.80:0/3558848741 shutdown_connections 2024-02-13T00:21:30.889 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.877+0000 7f8b411cb700 1 -- 172.21.15.80:0/3558848741 wait complete. 2024-02-13T00:21:30.889 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.881+0000 7f8b411cb700 1 Processor -- start 2024-02-13T00:21:30.890 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.881+0000 7f8b411cb700 1 -- start start 2024-02-13T00:21:30.890 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.881+0000 7f8b411cb700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b3c0f9a40 0x7f8b3c10a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:30.891 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.881+0000 7f8b411cb700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c10a9d0 con 0x7f8b3c0f9a40 2024-02-13T00:21:30.891 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.881+0000 7f8b3ad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b3c0f9a40 0x7f8b3c10a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:30.891 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.881+0000 7f8b3ad9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b3c0f9a40 0x7f8b3c10a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41540/0 (socket says 172.21.15.80:41540) 2024-02-13T00:21:30.891 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.881+0000 7f8b3ad9d700 1 -- 172.21.15.80:0/2834415115 learned_addr learned my addr 172.21.15.80:0/2834415115 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:30.891 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.881+0000 7f8b3ad9d700 1 -- 172.21.15.80:0/2834415115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b24009370 con 0x7f8b3c0f9a40 2024-02-13T00:21:30.891 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.881+0000 7f8b3ad9d700 1 --2- 172.21.15.80:0/2834415115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b3c0f9a40 0x7f8b3c10a4e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f8b24006940 tx=0x7f8b240090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.881+0000 7f8b33fff700 1 -- 172.21.15.80:0/2834415115 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b2401a640 con 0x7f8b3c0f9a40 2024-02-13T00:21:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.881+0000 7f8b33fff700 1 -- 172.21.15.80:0/2834415115 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f8b2401ac10 con 0x7f8b3c0f9a40 2024-02-13T00:21:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.881+0000 7f8b33fff700 1 -- 172.21.15.80:0/2834415115 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b24023b90 con 0x7f8b3c0f9a40 2024-02-13T00:21:30.892 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.881+0000 7f8b411cb700 1 -- 172.21.15.80:0/2834415115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3c10abd0 con 0x7f8b3c0f9a40 2024-02-13T00:21:30.893 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.881+0000 7f8b411cb700 1 -- 172.21.15.80:0/2834415115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3c10b060 con 0x7f8b3c0f9a40 2024-02-13T00:21:30.894 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.885+0000 7f8b411cb700 1 -- 172.21.15.80:0/2834415115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3c046d80 con 0x7f8b3c0f9a40 2024-02-13T00:21:30.895 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.885+0000 7f8b33fff700 1 -- 172.21.15.80:0/2834415115 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 38617+0+0 (secure 0 0 0) 0x7f8b2401a7a0 con 0x7f8b3c0f9a40 2024-02-13T00:21:30.895 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.885+0000 7f8b33fff700 1 --2- 172.21.15.80:0/2834415115 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f8b1c0325c0 0x7f8b1c034a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:30.895 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.885+0000 7f8b33fff700 1 -- 172.21.15.80:0/2834415115 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f8b24044fe0 con 0x7f8b3c0f9a40 2024-02-13T00:21:30.895 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.885+0000 7f8b3a59c700 1 -- 172.21.15.80:0/2834415115 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f8b1c0325c0 msgr2=0x7f8b1c034a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/3082938701 2024-02-13T00:21:30.895 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.885+0000 7f8b3a59c700 1 --2- 172.21.15.80:0/2834415115 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f8b1c0325c0 0x7f8b1c034a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-02-13T00:21:30.901 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:30.893+0000 7f8b33fff700 1 -- 172.21.15.80:0/2834415115 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f8b240188b0 con 0x7f8b3c0f9a40 2024-02-13T00:21:30.925 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:30 smithi080 bash[17652]: debug 2024-02-13T00:21:30.813+0000 7fdcfdf19680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-13T00:21:31.097 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:31.089+0000 7f8b3a59c700 1 -- 172.21.15.80:0/2834415115 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f8b1c0325c0 msgr2=0x7f8b1c034a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/3082938701 2024-02-13T00:21:31.098 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:31.089+0000 7f8b3a59c700 1 --2- 172.21.15.80:0/2834415115 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f8b1c0325c0 0x7f8b1c034a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-02-13T00:21:31.177 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:30 smithi080 bash[17652]: debug 2024-02-13T00:21:30.913+0000 7fdcfdf19680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-13T00:21:31.304 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:31.293+0000 7f8b411cb700 1 -- 172.21.15.80:0/2834415115 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f8b3c0621e0 con 0x7f8b3c0f9a40 2024-02-13T00:21:31.304 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:31.293+0000 7f8b33fff700 1 -- 172.21.15.80:0/2834415115 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f8b2401e070 con 0x7f8b3c0f9a40 2024-02-13T00:21:31.304 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: { 2024-02-13T00:21:31.304 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 5, 2024-02-13T00:21:31.304 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "available": true, 2024-02-13T00:21:31.304 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "active_name": "y", 2024-02-13T00:21:31.304 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_standby": 0 2024-02-13T00:21:31.304 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: } 2024-02-13T00:21:31.307 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:31.297+0000 7f8b411cb700 1 -- 172.21.15.80:0/2834415115 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f8b1c0325c0 msgr2=0x7f8b1c034a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-13T00:21:31.307 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:31.297+0000 7f8b411cb700 1 --2- 172.21.15.80:0/2834415115 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f8b1c0325c0 0x7f8b1c034a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-13T00:21:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:31.297+0000 7f8b411cb700 1 -- 172.21.15.80:0/2834415115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b3c0f9a40 msgr2=0x7f8b3c10a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:31.297+0000 7f8b411cb700 1 --2- 172.21.15.80:0/2834415115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b3c0f9a40 0x7f8b3c10a4e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f8b24006940 tx=0x7f8b240090f0).stop 2024-02-13T00:21:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:31.297+0000 7f8b411cb700 1 -- 172.21.15.80:0/2834415115 shutdown_connections 2024-02-13T00:21:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:31.297+0000 7f8b411cb700 1 --2- 172.21.15.80:0/2834415115 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f8b1c0325c0 0x7f8b1c034a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-13T00:21:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:31.297+0000 7f8b411cb700 1 --2- 172.21.15.80:0/2834415115 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b3c0f9a40 0x7f8b3c10a4e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:31.297+0000 7f8b411cb700 1 -- 172.21.15.80:0/2834415115 >> 172.21.15.80:0/2834415115 conn(0x7f8b3c0f5460 msgr2=0x7f8b3c0f6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:31.297+0000 7f8b411cb700 1 -- 172.21.15.80:0/2834415115 shutdown_connections 2024-02-13T00:21:31.308 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:31.297+0000 7f8b411cb700 1 -- 172.21.15.80:0/2834415115 wait complete. 2024-02-13T00:21:31.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:31 smithi080 bash[17386]: audit 2024-02-13T00:21:31.298339+0000 mon.a (mon.0) 29 : audit [DBG] from='client.? 172.21.15.80:0/2834415115' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-13T00:21:31.510 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:31 smithi080 bash[17652]: debug 2024-02-13T00:21:31.169+0000 7fdcfdf19680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-13T00:21:31.961 INFO:teuthology.orchestra.run.smithi080.stderr:Waiting for the mgr to restart... 2024-02-13T00:21:31.962 INFO:teuthology.orchestra.run.smithi080.stderr:Waiting for mgr epoch 5... 2024-02-13T00:21:32.575 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:32 smithi080 bash[17652]: debug 2024-02-13T00:21:32.309+0000 7fdcfdf19680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-13T00:21:32.575 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:32 smithi080 bash[17652]: debug 2024-02-13T00:21:32.465+0000 7fdcfdf19680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-13T00:21:32.576 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:32 smithi080 bash[17652]: debug 2024-02-13T00:21:32.565+0000 7fdcfdf19680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-13T00:21:32.875 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.865+0000 7f0fef111700 1 Processor -- start 2024-02-13T00:21:32.876 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.865+0000 7f0fef111700 1 -- start start 2024-02-13T00:21:32.876 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.865+0000 7f0fef111700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fe80fb6b0 0x7f0fe80fbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:32.877 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.865+0000 7f0fef111700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe80fbfc0 con 0x7f0fe80fb6b0 2024-02-13T00:21:32.877 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.865+0000 7f0fecead700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fe80fb6b0 0x7f0fe80fbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:32.877 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.865+0000 7f0fecead700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fe80fb6b0 0x7f0fe80fbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41554/0 (socket says 172.21.15.80:41554) 2024-02-13T00:21:32.877 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.865+0000 7f0fecead700 1 -- 172.21.15.80:0/2866652315 learned_addr learned my addr 172.21.15.80:0/2866652315 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:32.877 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.865+0000 7f0fecead700 1 -- 172.21.15.80:0/2866652315 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe80fc100 con 0x7f0fe80fb6b0 2024-02-13T00:21:32.877 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.865+0000 7f0fecead700 1 --2- 172.21.15.80:0/2866652315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fe80fb6b0 0x7f0fe80fbad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f0fdc009730 tx=0x7f0fdc0090f0).ready entity=mon.0 client_cookie=939e99e7549c5662 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.865+0000 7f0fe77fe700 1 -- 172.21.15.80:0/2866652315 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fdc00b580 con 0x7f0fe80fb6b0 2024-02-13T00:21:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.869+0000 7f0fe77fe700 1 -- 172.21.15.80:0/2866652315 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f0fdc00bb50 con 0x7f0fe80fb6b0 2024-02-13T00:21:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.869+0000 7f0fe77fe700 1 -- 172.21.15.80:0/2866652315 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fdc011a70 con 0x7f0fe80fb6b0 2024-02-13T00:21:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.869+0000 7f0fef111700 1 -- 172.21.15.80:0/2866652315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fe80fb6b0 msgr2=0x7f0fe80fbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:32.878 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.869+0000 7f0fef111700 1 --2- 172.21.15.80:0/2866652315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fe80fb6b0 0x7f0fe80fbad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f0fdc009730 tx=0x7f0fdc0090f0).stop 2024-02-13T00:21:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.869+0000 7f0fef111700 1 -- 172.21.15.80:0/2866652315 shutdown_connections 2024-02-13T00:21:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.869+0000 7f0fef111700 1 --2- 172.21.15.80:0/2866652315 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fe80fb6b0 0x7f0fe80fbad0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:32.879 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.869+0000 7f0fef111700 1 -- 172.21.15.80:0/2866652315 >> 172.21.15.80:0/2866652315 conn(0x7f0fe80f6eb0 msgr2=0x7f0fe80f92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.869+0000 7f0fef111700 1 -- 172.21.15.80:0/2866652315 shutdown_connections 2024-02-13T00:21:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.869+0000 7f0fef111700 1 -- 172.21.15.80:0/2866652315 wait complete. 2024-02-13T00:21:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.869+0000 7f0fef111700 1 Processor -- start 2024-02-13T00:21:32.880 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.869+0000 7f0fef111700 1 -- start start 2024-02-13T00:21:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.869+0000 7f0fef111700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fe80fb6b0 0x7f0fe810a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.869+0000 7f0fef111700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe810a7d0 con 0x7f0fe80fb6b0 2024-02-13T00:21:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.869+0000 7f0fecead700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fe80fb6b0 0x7f0fe810a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.873+0000 7f0fecead700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fe80fb6b0 0x7f0fe810a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41558/0 (socket says 172.21.15.80:41558) 2024-02-13T00:21:32.881 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.873+0000 7f0fecead700 1 -- 172.21.15.80:0/1637742016 learned_addr learned my addr 172.21.15.80:0/1637742016 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.873+0000 7f0fecead700 1 -- 172.21.15.80:0/1637742016 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc009370 con 0x7f0fe80fb6b0 2024-02-13T00:21:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.873+0000 7f0fecead700 1 --2- 172.21.15.80:0/1637742016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fe80fb6b0 0x7f0fe810a2e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0fdc006940 tx=0x7f0fdc0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:32.882 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.873+0000 7f0fe5ffb700 1 -- 172.21.15.80:0/1637742016 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fdc01a640 con 0x7f0fe80fb6b0 2024-02-13T00:21:32.883 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.873+0000 7f0fe5ffb700 1 -- 172.21.15.80:0/1637742016 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f0fdc01ac10 con 0x7f0fe80fb6b0 2024-02-13T00:21:32.883 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.873+0000 7f0fef111700 1 -- 172.21.15.80:0/1637742016 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe810a9d0 con 0x7f0fe80fb6b0 2024-02-13T00:21:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.873+0000 7f0fe5ffb700 1 -- 172.21.15.80:0/1637742016 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fdc023b90 con 0x7f0fe80fb6b0 2024-02-13T00:21:32.884 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.873+0000 7f0fef111700 1 -- 172.21.15.80:0/1637742016 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe810ae60 con 0x7f0fe80fb6b0 2024-02-13T00:21:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.873+0000 7f0fe5ffb700 1 -- 172.21.15.80:0/1637742016 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 5) v1 ==== 38617+0+0 (secure 0 0 0) 0x7f0fdc02c3f0 con 0x7f0fe80fb6b0 2024-02-13T00:21:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.873+0000 7f0fe5ffb700 1 --2- 172.21.15.80:0/1637742016 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f0fd80325c0 0x7f0fd8034a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.873+0000 7f0fe5ffb700 1 -- 172.21.15.80:0/1637742016 --> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0fd8035140 con 0x7f0fd80325c0 2024-02-13T00:21:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.873+0000 7f0fe5ffb700 1 -- 172.21.15.80:0/1637742016 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f0fdc044e30 con 0x7f0fe80fb6b0 2024-02-13T00:21:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.873+0000 7f0fe7fff700 1 -- 172.21.15.80:0/1637742016 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f0fd80325c0 msgr2=0x7f0fd8034a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/3082938701 2024-02-13T00:21:32.885 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:32.873+0000 7f0fe7fff700 1 --2- 172.21.15.80:0/1637742016 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f0fd80325c0 0x7f0fd8034a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-02-13T00:21:32.932 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:32 smithi080 bash[17652]: debug 2024-02-13T00:21:32.689+0000 7fdcfdf19680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-13T00:21:33.086 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:33.077+0000 7f0fe7fff700 1 -- 172.21.15.80:0/1637742016 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f0fd80325c0 msgr2=0x7f0fd8034a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/3082938701 2024-02-13T00:21:33.086 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:33.077+0000 7f0fe7fff700 1 --2- 172.21.15.80:0/1637742016 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f0fd80325c0 0x7f0fd8034a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-02-13T00:21:33.260 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:32 smithi080 bash[17652]: debug 2024-02-13T00:21:32.921+0000 7fdcfdf19680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-13T00:21:33.490 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:33.481+0000 7f0fe7fff700 1 -- 172.21.15.80:0/1637742016 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f0fd80325c0 msgr2=0x7f0fd8034a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/3082938701 2024-02-13T00:21:33.490 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:33.481+0000 7f0fe7fff700 1 --2- 172.21.15.80:0/1637742016 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f0fd80325c0 0x7f0fd8034a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-02-13T00:21:33.761 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:33 smithi080 bash[17652]: debug 2024-02-13T00:21:33.285+0000 7fdcfdf19680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-13T00:21:33.761 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:33 smithi080 bash[17652]: debug 2024-02-13T00:21:33.405+0000 7fdcfdf19680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-13T00:21:34.293 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:34.285+0000 7f0fe7fff700 1 -- 172.21.15.80:0/1637742016 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f0fd80325c0 msgr2=0x7f0fd8034a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/3082938701 2024-02-13T00:21:34.294 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:34.285+0000 7f0fe7fff700 1 --2- 172.21.15.80:0/1637742016 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f0fd80325c0 0x7f0fd8034a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-02-13T00:21:34.709 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:34 smithi080 bash[17652]: debug 2024-02-13T00:21:34.269+0000 7fdcfdf19680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-13T00:21:34.710 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:34 smithi080 bash[17652]: debug 2024-02-13T00:21:34.373+0000 7fdcfdf19680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-13T00:21:34.710 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:34 smithi080 bash[17652]: debug 2024-02-13T00:21:34.485+0000 7fdcfdf19680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-13T00:21:35.260 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:34 smithi080 bash[17652]: debug 2024-02-13T00:21:34.701+0000 7fdcfdf19680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-13T00:21:35.260 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:34 smithi080 bash[17652]: debug 2024-02-13T00:21:34.989+0000 7fdcfdf19680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-13T00:21:35.260 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:35 smithi080 bash[17652]: debug 2024-02-13T00:21:35.149+0000 7fdcfdf19680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-13T00:21:35.647 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:35 smithi080 bash[17652]: debug 2024-02-13T00:21:35.321+0000 7fdcfdf19680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-13T00:21:35.648 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:35 smithi080 bash[17652]: debug 2024-02-13T00:21:35.533+0000 7fdcfdf19680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-13T00:21:35.672 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:35.661+0000 7f0fe5ffb700 1 -- 172.21.15.80:0/1637742016 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mgrmap(e 6) v1 ==== 38441+0+0 (secure 0 0 0) 0x7f0fdc029d00 con 0x7f0fe80fb6b0 2024-02-13T00:21:35.672 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:35.661+0000 7f0fe5ffb700 1 -- 172.21.15.80:0/1637742016 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f0fd80325c0 msgr2=0x7f0fd8034a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-13T00:21:35.672 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:35.661+0000 7f0fe5ffb700 1 --2- 172.21.15.80:0/1637742016 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f0fd80325c0 0x7f0fd8034a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-13T00:21:36.010 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:35 smithi080 bash[17652]: debug 2024-02-13T00:21:35.637+0000 7fdcfdf19680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-13T00:21:36.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:35 smithi080 bash[17386]: cluster 2024-02-13T00:21:35.662337+0000 mon.a (mon.0) 30 : cluster [INF] Active manager daemon y restarted 2024-02-13T00:21:36.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:35 smithi080 bash[17386]: cluster 2024-02-13T00:21:35.662772+0000 mon.a (mon.0) 31 : cluster [INF] Activating manager daemon y 2024-02-13T00:21:36.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:35 smithi080 bash[17386]: cluster 2024-02-13T00:21:35.668831+0000 mon.a (mon.0) 32 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-02-13T00:21:36.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:35 smithi080 bash[17386]: cluster 2024-02-13T00:21:35.668981+0000 mon.a (mon.0) 33 : cluster [DBG] mgrmap e6: y(active, starting, since 0.00637039s) 2024-02-13T00:21:36.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:35 smithi080 bash[17386]: audit 2024-02-13T00:21:35.670095+0000 mon.a (mon.0) 34 : audit [DBG] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T00:21:36.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:35 smithi080 bash[17386]: audit 2024-02-13T00:21:35.671286+0000 mon.a (mon.0) 35 : audit [DBG] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-13T00:21:36.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:35 smithi080 bash[17386]: audit 2024-02-13T00:21:35.672519+0000 mon.a (mon.0) 36 : audit [DBG] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-13T00:21:36.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:35 smithi080 bash[17386]: audit 2024-02-13T00:21:35.672717+0000 mon.a (mon.0) 37 : audit [DBG] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-13T00:21:36.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:35 smithi080 bash[17386]: audit 2024-02-13T00:21:35.672898+0000 mon.a (mon.0) 38 : audit [DBG] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-13T00:21:36.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:35 smithi080 bash[17386]: cluster 2024-02-13T00:21:35.700236+0000 mon.a (mon.0) 39 : cluster [INF] Manager daemon y is now available 2024-02-13T00:21:36.674 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:36.665+0000 7f0fe5ffb700 1 -- 172.21.15.80:0/1637742016 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 7) v1 ==== 38511+0+0 (secure 0 0 0) 0x7f0fdc01fcd0 con 0x7f0fe80fb6b0 2024-02-13T00:21:36.675 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:36.665+0000 7f0fe5ffb700 1 --2- 172.21.15.80:0/1637742016 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f0fd8035ff0 0x7f0fd80383e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:36.675 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:36.665+0000 7f0fe5ffb700 1 -- 172.21.15.80:0/1637742016 --> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0fd8035140 con 0x7f0fd8035ff0 2024-02-13T00:21:36.676 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:36.665+0000 7f0fe7fff700 1 --2- 172.21.15.80:0/1637742016 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f0fd8035ff0 0x7f0fd80383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:36.676 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:36.665+0000 7f0fe7fff700 1 --2- 172.21.15.80:0/1637742016 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f0fd8035ff0 0x7f0fd80383e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f0fd4003850 tx=0x7f0fd4006e20).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:36.678 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:36.669+0000 7f0fe5ffb700 1 -- 172.21.15.80:0/1637742016 <== mgr.14116 v2:172.21.15.80:6800/3429634547 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7f0fd8035140 con 0x7f0fd8035ff0 2024-02-13T00:21:36.691 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:36.681+0000 7f0fef111700 1 -- 172.21.15.80:0/1637742016 --> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f0fe805a3b0 con 0x7f0fd8035ff0 2024-02-13T00:21:36.692 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:36.681+0000 7f0fe5ffb700 1 -- 172.21.15.80:0/1637742016 <== mgr.14116 v2:172.21.15.80:6800/3429634547 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f0fe805a3b0 con 0x7f0fd8035ff0 2024-02-13T00:21:36.692 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: { 2024-02-13T00:21:36.693 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2024-02-13T00:21:36.693 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "initialized": true 2024-02-13T00:21:36.693 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: } 2024-02-13T00:21:36.694 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:36.681+0000 7f0fef111700 1 -- 172.21.15.80:0/1637742016 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f0fd8035ff0 msgr2=0x7f0fd80383e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:36.694 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:36.681+0000 7f0fef111700 1 --2- 172.21.15.80:0/1637742016 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f0fd8035ff0 0x7f0fd80383e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f0fd4003850 tx=0x7f0fd4006e20).stop 2024-02-13T00:21:36.694 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:36.681+0000 7f0fef111700 1 -- 172.21.15.80:0/1637742016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fe80fb6b0 msgr2=0x7f0fe810a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:36.695 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:36.681+0000 7f0fef111700 1 --2- 172.21.15.80:0/1637742016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fe80fb6b0 0x7f0fe810a2e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0fdc006940 tx=0x7f0fdc0090f0).stop 2024-02-13T00:21:36.695 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:36.685+0000 7f0fef111700 1 -- 172.21.15.80:0/1637742016 shutdown_connections 2024-02-13T00:21:36.695 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:36.685+0000 7f0fef111700 1 --2- 172.21.15.80:0/1637742016 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f0fd8035ff0 0x7f0fd80383e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:36.695 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:36.685+0000 7f0fef111700 1 --2- 172.21.15.80:0/1637742016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0fe80fb6b0 0x7f0fe810a2e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:36.695 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:36.685+0000 7f0fef111700 1 --2- 172.21.15.80:0/1637742016 >> [v2:172.21.15.80:6800/3082938701,v1:172.21.15.80:6801/3082938701] conn(0x7f0fd80325c0 0x7f0fd8034a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-13T00:21:36.695 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:36.685+0000 7f0fef111700 1 -- 172.21.15.80:0/1637742016 >> 172.21.15.80:0/1637742016 conn(0x7f0fe80f6eb0 msgr2=0x7f0fe80f8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:36.695 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:36.685+0000 7f0fef111700 1 -- 172.21.15.80:0/1637742016 shutdown_connections 2024-02-13T00:21:36.695 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:36.685+0000 7f0fef111700 1 -- 172.21.15.80:0/1637742016 wait complete. 2024-02-13T00:21:37.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:36 smithi080 bash[17386]: cephadm 2024-02-13T00:21:35.717424+0000 mgr.y (mgr.14116) 1 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-02-13T00:21:37.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:36 smithi080 bash[17386]: audit 2024-02-13T00:21:35.722534+0000 mon.a (mon.0) 40 : audit [INF] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' 2024-02-13T00:21:37.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:36 smithi080 bash[17386]: audit 2024-02-13T00:21:35.850639+0000 mon.a (mon.0) 41 : audit [INF] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' 2024-02-13T00:21:37.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:36 smithi080 bash[17386]: audit 2024-02-13T00:21:35.852977+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:21:37.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:36 smithi080 bash[17386]: audit 2024-02-13T00:21:35.855898+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:21:37.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:36 smithi080 bash[17386]: audit 2024-02-13T00:21:35.858803+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:21:37.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:36 smithi080 bash[17386]: audit 2024-02-13T00:21:35.885909+0000 mon.a (mon.0) 45 : audit [INF] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-13T00:21:37.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:36 smithi080 bash[17386]: audit 2024-02-13T00:21:35.890126+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-13T00:21:37.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:36 smithi080 bash[17386]: cluster 2024-02-13T00:21:36.673498+0000 mon.a (mon.0) 47 : cluster [DBG] mgrmap e7: y(active, since 1.01088s) 2024-02-13T00:21:37.366 INFO:teuthology.orchestra.run.smithi080.stderr:mgr epoch 5 is available 2024-02-13T00:21:37.366 INFO:teuthology.orchestra.run.smithi080.stderr:Setting orchestrator backend to cephadm... 2024-02-13T00:21:38.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:37 smithi080 bash[17386]: audit 2024-02-13T00:21:36.672441+0000 mgr.y (mgr.14116) 2 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-13T00:21:38.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:37 smithi080 bash[17386]: audit 2024-02-13T00:21:36.687319+0000 mgr.y (mgr.14116) 3 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-13T00:21:38.328 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.317+0000 7f8d2f1a4700 1 Processor -- start 2024-02-13T00:21:38.329 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.317+0000 7f8d2f1a4700 1 -- start start 2024-02-13T00:21:38.329 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.317+0000 7f8d2f1a4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d280f99d0 0x7f8d280f9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:38.329 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.317+0000 7f8d2f1a4700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d280fa370 con 0x7f8d280f99d0 2024-02-13T00:21:38.329 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.317+0000 7f8d2cf40700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d280f99d0 0x7f8d280f9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:38.330 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.317+0000 7f8d2cf40700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d280f99d0 0x7f8d280f9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41604/0 (socket says 172.21.15.80:41604) 2024-02-13T00:21:38.330 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.317+0000 7f8d2cf40700 1 -- 172.21.15.80:0/462045857 learned_addr learned my addr 172.21.15.80:0/462045857 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:38.330 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.321+0000 7f8d2cf40700 1 -- 172.21.15.80:0/462045857 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d280fa4b0 con 0x7f8d280f99d0 2024-02-13T00:21:38.331 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.321+0000 7f8d2cf40700 1 --2- 172.21.15.80:0/462045857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d280f99d0 0x7f8d280f9df0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f8d18009730 tx=0x7f8d180090f0).ready entity=mon.0 client_cookie=6d5123689e946e15 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:38.331 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.321+0000 7f8d277fe700 1 -- 172.21.15.80:0/462045857 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d1800b580 con 0x7f8d280f99d0 2024-02-13T00:21:38.331 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.321+0000 7f8d277fe700 1 -- 172.21.15.80:0/462045857 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f8d1800bb50 con 0x7f8d280f99d0 2024-02-13T00:21:38.331 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.321+0000 7f8d277fe700 1 -- 172.21.15.80:0/462045857 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d18011a70 con 0x7f8d280f99d0 2024-02-13T00:21:38.332 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.321+0000 7f8d2f1a4700 1 -- 172.21.15.80:0/462045857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d280f99d0 msgr2=0x7f8d280f9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:38.332 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.321+0000 7f8d2f1a4700 1 --2- 172.21.15.80:0/462045857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d280f99d0 0x7f8d280f9df0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f8d18009730 tx=0x7f8d180090f0).stop 2024-02-13T00:21:38.332 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.321+0000 7f8d2f1a4700 1 -- 172.21.15.80:0/462045857 shutdown_connections 2024-02-13T00:21:38.332 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.321+0000 7f8d2f1a4700 1 --2- 172.21.15.80:0/462045857 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d280f99d0 0x7f8d280f9df0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:38.332 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.321+0000 7f8d2f1a4700 1 -- 172.21.15.80:0/462045857 >> 172.21.15.80:0/462045857 conn(0x7f8d280f5460 msgr2=0x7f8d280f78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:38.333 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.321+0000 7f8d2f1a4700 1 -- 172.21.15.80:0/462045857 shutdown_connections 2024-02-13T00:21:38.333 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.321+0000 7f8d2f1a4700 1 -- 172.21.15.80:0/462045857 wait complete. 2024-02-13T00:21:38.333 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.321+0000 7f8d2f1a4700 1 Processor -- start 2024-02-13T00:21:38.333 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.321+0000 7f8d2f1a4700 1 -- start start 2024-02-13T00:21:38.334 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.325+0000 7f8d2f1a4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d280f99d0 0x7f8d2810a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:38.335 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.325+0000 7f8d2f1a4700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2810a7b0 con 0x7f8d280f99d0 2024-02-13T00:21:38.335 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.325+0000 7f8d2cf40700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d280f99d0 0x7f8d2810a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:38.335 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.325+0000 7f8d2cf40700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d280f99d0 0x7f8d2810a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:41620/0 (socket says 172.21.15.80:41620) 2024-02-13T00:21:38.335 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.325+0000 7f8d2cf40700 1 -- 172.21.15.80:0/2439873440 learned_addr learned my addr 172.21.15.80:0/2439873440 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:38.335 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.325+0000 7f8d2cf40700 1 -- 172.21.15.80:0/2439873440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d18009370 con 0x7f8d280f99d0 2024-02-13T00:21:38.335 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.325+0000 7f8d2cf40700 1 --2- 172.21.15.80:0/2439873440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d280f99d0 0x7f8d2810a2c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f8d18009f00 tx=0x7f8d180090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:38.335 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.325+0000 7f8d25ffb700 1 -- 172.21.15.80:0/2439873440 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d1801a640 con 0x7f8d280f99d0 2024-02-13T00:21:38.335 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.325+0000 7f8d25ffb700 1 -- 172.21.15.80:0/2439873440 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f8d1801ac10 con 0x7f8d280f99d0 2024-02-13T00:21:38.335 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.325+0000 7f8d2f1a4700 1 -- 172.21.15.80:0/2439873440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d2810a9b0 con 0x7f8d280f99d0 2024-02-13T00:21:38.335 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.325+0000 7f8d25ffb700 1 -- 172.21.15.80:0/2439873440 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d18023b10 con 0x7f8d280f99d0 2024-02-13T00:21:38.335 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.325+0000 7f8d2f1a4700 1 -- 172.21.15.80:0/2439873440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2810ae40 con 0x7f8d280f99d0 2024-02-13T00:21:38.336 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.325+0000 7f8d25ffb700 1 -- 172.21.15.80:0/2439873440 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) v1 ==== 38617+0+0 (secure 0 0 0) 0x7f8d1801a7a0 con 0x7f8d280f99d0 2024-02-13T00:21:38.337 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.325+0000 7f8d2f1a4700 1 -- 172.21.15.80:0/2439873440 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d28046d80 con 0x7f8d280f99d0 2024-02-13T00:21:38.337 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.325+0000 7f8d25ffb700 1 --2- 172.21.15.80:0/2439873440 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f8d100325e0 0x7f8d10034aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:38.337 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.329+0000 7f8d25ffb700 1 -- 172.21.15.80:0/2439873440 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f8d18044e10 con 0x7f8d280f99d0 2024-02-13T00:21:38.337 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.329+0000 7f8d27fff700 1 --2- 172.21.15.80:0/2439873440 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f8d100325e0 0x7f8d10034aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:38.338 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.329+0000 7f8d27fff700 1 --2- 172.21.15.80:0/2439873440 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f8d100325e0 0x7f8d10034aa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f8d1c009780 tx=0x7f8d1c006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:38.343 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.333+0000 7f8d25ffb700 1 -- 172.21.15.80:0/2439873440 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f8d180292a0 con 0x7f8d280f99d0 2024-02-13T00:21:38.693 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.681+0000 7f8d2f1a4700 1 -- 172.21.15.80:0/2439873440 --> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d2810b700 con 0x7f8d100325e0 2024-02-13T00:21:38.703 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.693+0000 7f8d25ffb700 1 -- 172.21.15.80:0/2439873440 <== mgr.14116 v2:172.21.15.80:6800/3429634547 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8d2810b700 con 0x7f8d100325e0 2024-02-13T00:21:38.706 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.697+0000 7f8d2f1a4700 1 -- 172.21.15.80:0/2439873440 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f8d100325e0 msgr2=0x7f8d10034aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:38.707 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.697+0000 7f8d2f1a4700 1 --2- 172.21.15.80:0/2439873440 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f8d100325e0 0x7f8d10034aa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f8d1c009780 tx=0x7f8d1c006cc0).stop 2024-02-13T00:21:38.707 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.697+0000 7f8d2f1a4700 1 -- 172.21.15.80:0/2439873440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d280f99d0 msgr2=0x7f8d2810a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:38.707 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.697+0000 7f8d2f1a4700 1 --2- 172.21.15.80:0/2439873440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d280f99d0 0x7f8d2810a2c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f8d18009f00 tx=0x7f8d180090f0).stop 2024-02-13T00:21:38.708 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.697+0000 7f8d2f1a4700 1 -- 172.21.15.80:0/2439873440 shutdown_connections 2024-02-13T00:21:38.708 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.697+0000 7f8d2f1a4700 1 --2- 172.21.15.80:0/2439873440 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f8d100325e0 0x7f8d10034aa0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:38.708 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.697+0000 7f8d2f1a4700 1 --2- 172.21.15.80:0/2439873440 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8d280f99d0 0x7f8d2810a2c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:38.708 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.697+0000 7f8d2f1a4700 1 -- 172.21.15.80:0/2439873440 >> 172.21.15.80:0/2439873440 conn(0x7f8d280f5460 msgr2=0x7f8d280f6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:38.708 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.697+0000 7f8d2f1a4700 1 -- 172.21.15.80:0/2439873440 shutdown_connections 2024-02-13T00:21:38.708 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:38.697+0000 7f8d2f1a4700 1 -- 172.21.15.80:0/2439873440 wait complete. 2024-02-13T00:21:39.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:38 smithi080 bash[17386]: cluster 2024-02-13T00:21:37.726926+0000 mon.a (mon.0) 48 : cluster [DBG] mgrmap e8: y(active, since 2s) 2024-02-13T00:21:39.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:38 smithi080 bash[17386]: audit 2024-02-13T00:21:38.697819+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' 2024-02-13T00:21:40.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:39 smithi080 bash[17386]: audit 2024-02-13T00:21:38.688665+0000 mgr.y (mgr.14116) 4 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:21:40.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:39 smithi080 bash[17386]: audit 2024-02-13T00:21:38.743211+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:21:40.309 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.297+0000 7f95e5790700 1 Processor -- start 2024-02-13T00:21:40.309 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.297+0000 7f95e5790700 1 -- start start 2024-02-13T00:21:40.310 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.301+0000 7f95e5790700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e00fd8d0 0x7f95e00fdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:40.310 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.301+0000 7f95e5790700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e00fe270 con 0x7f95e00fd8d0 2024-02-13T00:21:40.310 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.301+0000 7f95deffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e00fd8d0 0x7f95e00fdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:40.310 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.301+0000 7f95deffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e00fd8d0 0x7f95e00fdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38026/0 (socket says 172.21.15.80:38026) 2024-02-13T00:21:40.310 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.301+0000 7f95deffd700 1 -- 172.21.15.80:0/2855927124 learned_addr learned my addr 172.21.15.80:0/2855927124 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:40.311 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.301+0000 7f95deffd700 1 -- 172.21.15.80:0/2855927124 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e00fe3b0 con 0x7f95e00fd8d0 2024-02-13T00:21:40.311 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.301+0000 7f95deffd700 1 --2- 172.21.15.80:0/2855927124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e00fd8d0 0x7f95e00fdcf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f95d0009730 tx=0x7f95d00090f0).ready entity=mon.0 client_cookie=4473831fe57e526a server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:40.311 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.301+0000 7f95de7fc700 1 -- 172.21.15.80:0/2855927124 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95d000b580 con 0x7f95e00fd8d0 2024-02-13T00:21:40.311 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.301+0000 7f95de7fc700 1 -- 172.21.15.80:0/2855927124 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f95d000bb50 con 0x7f95e00fd8d0 2024-02-13T00:21:40.311 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.301+0000 7f95de7fc700 1 -- 172.21.15.80:0/2855927124 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95d0011a70 con 0x7f95e00fd8d0 2024-02-13T00:21:40.312 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.301+0000 7f95e5790700 1 -- 172.21.15.80:0/2855927124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e00fd8d0 msgr2=0x7f95e00fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:40.312 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.301+0000 7f95e5790700 1 --2- 172.21.15.80:0/2855927124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e00fd8d0 0x7f95e00fdcf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f95d0009730 tx=0x7f95d00090f0).stop 2024-02-13T00:21:40.312 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.301+0000 7f95e5790700 1 -- 172.21.15.80:0/2855927124 shutdown_connections 2024-02-13T00:21:40.313 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.301+0000 7f95e5790700 1 --2- 172.21.15.80:0/2855927124 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e00fd8d0 0x7f95e00fdcf0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:40.313 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.301+0000 7f95e5790700 1 -- 172.21.15.80:0/2855927124 >> 172.21.15.80:0/2855927124 conn(0x7f95e0070e40 msgr2=0x7f95e0071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:40.313 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.301+0000 7f95e5790700 1 -- 172.21.15.80:0/2855927124 shutdown_connections 2024-02-13T00:21:40.313 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.301+0000 7f95e5790700 1 -- 172.21.15.80:0/2855927124 wait complete. 2024-02-13T00:21:40.314 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.305+0000 7f95e5790700 1 Processor -- start 2024-02-13T00:21:40.314 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.305+0000 7f95e5790700 1 -- start start 2024-02-13T00:21:40.315 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.305+0000 7f95e5790700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e00fd8d0 0x7f95e010c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:40.315 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.305+0000 7f95e5790700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e010c9e0 con 0x7f95e00fd8d0 2024-02-13T00:21:40.315 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.305+0000 7f95deffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e00fd8d0 0x7f95e010c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:40.315 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.305+0000 7f95deffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e00fd8d0 0x7f95e010c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38036/0 (socket says 172.21.15.80:38036) 2024-02-13T00:21:40.316 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.305+0000 7f95deffd700 1 -- 172.21.15.80:0/824410542 learned_addr learned my addr 172.21.15.80:0/824410542 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:40.316 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.305+0000 7f95deffd700 1 -- 172.21.15.80:0/824410542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d0009370 con 0x7f95e00fd8d0 2024-02-13T00:21:40.316 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.305+0000 7f95deffd700 1 --2- 172.21.15.80:0/824410542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e00fd8d0 0x7f95e010c4f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f95d0009f00 tx=0x7f95d00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:40.316 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.305+0000 7f95dcff9700 1 -- 172.21.15.80:0/824410542 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95d001a640 con 0x7f95e00fd8d0 2024-02-13T00:21:40.317 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.305+0000 7f95dcff9700 1 -- 172.21.15.80:0/824410542 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f95d001ac10 con 0x7f95e00fd8d0 2024-02-13T00:21:40.317 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.305+0000 7f95e5790700 1 -- 172.21.15.80:0/824410542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e010cbe0 con 0x7f95e00fd8d0 2024-02-13T00:21:40.317 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.305+0000 7f95dcff9700 1 -- 172.21.15.80:0/824410542 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95d0023b10 con 0x7f95e00fd8d0 2024-02-13T00:21:40.317 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.305+0000 7f95e5790700 1 -- 172.21.15.80:0/824410542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e010d070 con 0x7f95e00fd8d0 2024-02-13T00:21:40.317 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.309+0000 7f95dcff9700 1 -- 172.21.15.80:0/824410542 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) v1 ==== 38617+0+0 (secure 0 0 0) 0x7f95d001a7a0 con 0x7f95e00fd8d0 2024-02-13T00:21:40.318 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.309+0000 7f95dcff9700 1 --2- 172.21.15.80:0/824410542 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f95cc032630 0x7f95cc034af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:40.318 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.309+0000 7f95dcff9700 1 -- 172.21.15.80:0/824410542 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f95d0044c80 con 0x7f95e00fd8d0 2024-02-13T00:21:40.318 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.309+0000 7f95e5790700 1 -- 172.21.15.80:0/824410542 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e005a3b0 con 0x7f95e00fd8d0 2024-02-13T00:21:40.318 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.309+0000 7f95d67fc700 1 --2- 172.21.15.80:0/824410542 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f95cc032630 0x7f95cc034af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:40.319 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.309+0000 7f95d67fc700 1 --2- 172.21.15.80:0/824410542 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f95cc032630 0x7f95cc034af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f95c8009780 tx=0x7f95c8006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:40.326 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.317+0000 7f95dcff9700 1 -- 172.21.15.80:0/824410542 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f95d001e020 con 0x7f95e00fd8d0 2024-02-13T00:21:40.656 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.645+0000 7f95e5790700 1 -- 172.21.15.80:0/824410542 --> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f95e010d8d0 con 0x7f95cc032630 2024-02-13T00:21:40.657 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.645+0000 7f95dcff9700 1 -- 172.21.15.80:0/824410542 <== mgr.14116 v2:172.21.15.80:6800/3429634547 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f95e010d8d0 con 0x7f95cc032630 2024-02-13T00:21:40.657 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: value unchanged 2024-02-13T00:21:40.660 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.649+0000 7f95e5790700 1 -- 172.21.15.80:0/824410542 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f95cc032630 msgr2=0x7f95cc034af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:40.660 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.649+0000 7f95e5790700 1 --2- 172.21.15.80:0/824410542 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f95cc032630 0x7f95cc034af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f95c8009780 tx=0x7f95c8006cc0).stop 2024-02-13T00:21:40.660 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.649+0000 7f95e5790700 1 -- 172.21.15.80:0/824410542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e00fd8d0 msgr2=0x7f95e010c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:40.660 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.649+0000 7f95e5790700 1 --2- 172.21.15.80:0/824410542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e00fd8d0 0x7f95e010c4f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f95d0009f00 tx=0x7f95d00090f0).stop 2024-02-13T00:21:40.660 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.649+0000 7f95e5790700 1 -- 172.21.15.80:0/824410542 shutdown_connections 2024-02-13T00:21:40.660 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.649+0000 7f95e5790700 1 --2- 172.21.15.80:0/824410542 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f95cc032630 0x7f95cc034af0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:40.660 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.649+0000 7f95e5790700 1 --2- 172.21.15.80:0/824410542 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95e00fd8d0 0x7f95e010c4f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:40.660 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.649+0000 7f95e5790700 1 -- 172.21.15.80:0/824410542 >> 172.21.15.80:0/824410542 conn(0x7f95e0070e40 msgr2=0x7f95e00fc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:40.660 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.649+0000 7f95e5790700 1 -- 172.21.15.80:0/824410542 shutdown_connections 2024-02-13T00:21:40.660 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:40.649+0000 7f95e5790700 1 -- 172.21.15.80:0/824410542 wait complete. 2024-02-13T00:21:41.310 INFO:teuthology.orchestra.run.smithi080.stderr:Generating ssh key... 2024-02-13T00:21:41.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:41 smithi080 bash[17386]: audit 2024-02-13T00:21:40.651761+0000 mgr.y (mgr.14116) 5 : audit [DBG] from='client.14128 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:21:42.278 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.265+0000 7fbe0176a700 1 Processor -- start 2024-02-13T00:21:42.278 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.265+0000 7fbe0176a700 1 -- start start 2024-02-13T00:21:42.278 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.269+0000 7fbe0176a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdfc0756b0 0x7fbdfc075ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:42.279 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.269+0000 7fbe0176a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc076050 con 0x7fbdfc0756b0 2024-02-13T00:21:42.279 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.269+0000 7fbdfaffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdfc0756b0 0x7fbdfc075ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:42.279 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.269+0000 7fbdfaffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdfc0756b0 0x7fbdfc075ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38046/0 (socket says 172.21.15.80:38046) 2024-02-13T00:21:42.279 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.269+0000 7fbdfaffd700 1 -- 172.21.15.80:0/1316818202 learned_addr learned my addr 172.21.15.80:0/1316818202 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:42.279 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.269+0000 7fbdfaffd700 1 -- 172.21.15.80:0/1316818202 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc076190 con 0x7fbdfc0756b0 2024-02-13T00:21:42.280 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.269+0000 7fbdfaffd700 1 --2- 172.21.15.80:0/1316818202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdfc0756b0 0x7fbdfc075ad0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fbdf0009730 tx=0x7fbdf00090f0).ready entity=mon.0 client_cookie=fe2cf13cf873c97d server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:42.280 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.269+0000 7fbdf9ffb700 1 -- 172.21.15.80:0/1316818202 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdf000b580 con 0x7fbdfc0756b0 2024-02-13T00:21:42.280 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.269+0000 7fbdf9ffb700 1 -- 172.21.15.80:0/1316818202 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fbdf000bb50 con 0x7fbdfc0756b0 2024-02-13T00:21:42.280 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.269+0000 7fbdf9ffb700 1 -- 172.21.15.80:0/1316818202 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdf0011a70 con 0x7fbdfc0756b0 2024-02-13T00:21:42.281 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.269+0000 7fbe0176a700 1 -- 172.21.15.80:0/1316818202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdfc0756b0 msgr2=0x7fbdfc075ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:42.281 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.269+0000 7fbe0176a700 1 --2- 172.21.15.80:0/1316818202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdfc0756b0 0x7fbdfc075ad0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fbdf0009730 tx=0x7fbdf00090f0).stop 2024-02-13T00:21:42.281 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.269+0000 7fbe0176a700 1 -- 172.21.15.80:0/1316818202 shutdown_connections 2024-02-13T00:21:42.281 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.269+0000 7fbe0176a700 1 --2- 172.21.15.80:0/1316818202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdfc0756b0 0x7fbdfc075ad0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:42.281 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.269+0000 7fbe0176a700 1 -- 172.21.15.80:0/1316818202 >> 172.21.15.80:0/1316818202 conn(0x7fbdfc070e40 msgr2=0x7fbdfc073280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:42.281 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.269+0000 7fbe0176a700 1 -- 172.21.15.80:0/1316818202 shutdown_connections 2024-02-13T00:21:42.281 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.269+0000 7fbe0176a700 1 -- 172.21.15.80:0/1316818202 wait complete. 2024-02-13T00:21:42.282 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.273+0000 7fbe0176a700 1 Processor -- start 2024-02-13T00:21:42.282 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.273+0000 7fbe0176a700 1 -- start start 2024-02-13T00:21:42.282 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.273+0000 7fbe0176a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdfc0756b0 0x7fbdfc1108e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:42.282 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.273+0000 7fbe0176a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc110dd0 con 0x7fbdfc0756b0 2024-02-13T00:21:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.273+0000 7fbdfaffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdfc0756b0 0x7fbdfc1108e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.273+0000 7fbdfaffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdfc0756b0 0x7fbdfc1108e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38056/0 (socket says 172.21.15.80:38056) 2024-02-13T00:21:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.273+0000 7fbdfaffd700 1 -- 172.21.15.80:0/3136216302 learned_addr learned my addr 172.21.15.80:0/3136216302 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.273+0000 7fbdfaffd700 1 -- 172.21.15.80:0/3136216302 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf0009370 con 0x7fbdfc0756b0 2024-02-13T00:21:42.283 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.273+0000 7fbdfaffd700 1 --2- 172.21.15.80:0/3136216302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdfc0756b0 0x7fbdfc1108e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fbdf000b7b0 tx=0x7fbdf00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:42.284 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.273+0000 7fbde3fff700 1 -- 172.21.15.80:0/3136216302 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdf0011b90 con 0x7fbdfc0756b0 2024-02-13T00:21:42.284 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.273+0000 7fbde3fff700 1 -- 172.21.15.80:0/3136216302 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fbdf0011cf0 con 0x7fbdfc0756b0 2024-02-13T00:21:42.284 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.273+0000 7fbe0176a700 1 -- 172.21.15.80:0/3136216302 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdfc110fd0 con 0x7fbdfc0756b0 2024-02-13T00:21:42.284 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.273+0000 7fbde3fff700 1 -- 172.21.15.80:0/3136216302 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdf001a5c0 con 0x7fbdfc0756b0 2024-02-13T00:21:42.284 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.273+0000 7fbe0176a700 1 -- 172.21.15.80:0/3136216302 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdfc111460 con 0x7fbdfc0756b0 2024-02-13T00:21:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.277+0000 7fbde3fff700 1 -- 172.21.15.80:0/3136216302 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) v1 ==== 38617+0+0 (secure 0 0 0) 0x7fbdf0012030 con 0x7fbdfc0756b0 2024-02-13T00:21:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.277+0000 7fbe0176a700 1 -- 172.21.15.80:0/3136216302 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdfc046d80 con 0x7fbdfc0756b0 2024-02-13T00:21:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.277+0000 7fbde3fff700 1 --2- 172.21.15.80:0/3136216302 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7fbde40325c0 0x7fbde4034a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.277+0000 7fbde3fff700 1 -- 172.21.15.80:0/3136216302 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7fbdf0044940 con 0x7fbdfc0756b0 2024-02-13T00:21:42.286 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.277+0000 7fbdfa7fc700 1 --2- 172.21.15.80:0/3136216302 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7fbde40325c0 0x7fbde4034a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:42.287 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.277+0000 7fbdfa7fc700 1 --2- 172.21.15.80:0/3136216302 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7fbde40325c0 0x7fbde4034a80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fbdec009780 tx=0x7fbdec006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:42.292 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.281+0000 7fbde3fff700 1 -- 172.21.15.80:0/3136216302 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fbdf0019570 con 0x7fbdfc0756b0 2024-02-13T00:21:42.615 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:42.605+0000 7fbe0176a700 1 -- 172.21.15.80:0/3136216302 --> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdfc0725e0 con 0x7fbde40325c0 2024-02-13T00:21:43.188 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:43.177+0000 7fbde3fff700 1 -- 172.21.15.80:0/3136216302 <== mgr.14116 v2:172.21.15.80:6800/3429634547 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fbdfc0725e0 con 0x7fbde40325c0 2024-02-13T00:21:43.189 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:43.181+0000 7fbe0176a700 1 -- 172.21.15.80:0/3136216302 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7fbde40325c0 msgr2=0x7fbde4034a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:43.189 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:43.181+0000 7fbe0176a700 1 --2- 172.21.15.80:0/3136216302 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7fbde40325c0 0x7fbde4034a80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fbdec009780 tx=0x7fbdec006cc0).stop 2024-02-13T00:21:43.190 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:43.181+0000 7fbe0176a700 1 -- 172.21.15.80:0/3136216302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdfc0756b0 msgr2=0x7fbdfc1108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:43.190 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:43.181+0000 7fbe0176a700 1 --2- 172.21.15.80:0/3136216302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdfc0756b0 0x7fbdfc1108e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fbdf000b7b0 tx=0x7fbdf00090f0).stop 2024-02-13T00:21:43.192 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:43.181+0000 7fbe0176a700 1 -- 172.21.15.80:0/3136216302 shutdown_connections 2024-02-13T00:21:43.192 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:43.181+0000 7fbe0176a700 1 --2- 172.21.15.80:0/3136216302 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7fbde40325c0 0x7fbde4034a80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:43.192 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:43.181+0000 7fbe0176a700 1 --2- 172.21.15.80:0/3136216302 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbdfc0756b0 0x7fbdfc1108e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:43.192 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:43.181+0000 7fbe0176a700 1 -- 172.21.15.80:0/3136216302 >> 172.21.15.80:0/3136216302 conn(0x7fbdfc070e40 msgr2=0x7fbdfc073270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:43.192 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:43.181+0000 7fbe0176a700 1 -- 172.21.15.80:0/3136216302 shutdown_connections 2024-02-13T00:21:43.192 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:43.181+0000 7fbe0176a700 1 -- 172.21.15.80:0/3136216302 wait complete. 2024-02-13T00:21:43.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:43 smithi080 bash[17386]: audit 2024-02-13T00:21:42.610327+0000 mgr.y (mgr.14116) 6 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:21:43.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:43 smithi080 bash[17386]: cephadm 2024-02-13T00:21:42.610706+0000 mgr.y (mgr.14116) 7 : cephadm [INF] Generating ssh key... 2024-02-13T00:21:43.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:43 smithi080 bash[17386]: audit 2024-02-13T00:21:43.177593+0000 mon.a (mon.0) 51 : audit [INF] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' 2024-02-13T00:21:43.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:43 smithi080 bash[17386]: audit 2024-02-13T00:21:43.179973+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' 2024-02-13T00:21:43.511 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:43 smithi080 bash[17652]: Generating public/private rsa key pair. 2024-02-13T00:21:43.511 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:43 smithi080 bash[17652]: Your identification has been saved in /tmp/tmp09v28b02/key. 2024-02-13T00:21:43.511 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:43 smithi080 bash[17652]: Your public key has been saved in /tmp/tmp09v28b02/key.pub. 2024-02-13T00:21:43.511 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:43 smithi080 bash[17652]: The key fingerprint is: 2024-02-13T00:21:43.511 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:43 smithi080 bash[17652]: SHA256:j3tiD7rmitWDWcrR8DvtYJLzHX+a9kB7zvFmBzuQDRE ceph-a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:21:43.511 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:43 smithi080 bash[17652]: The key's randomart image is: 2024-02-13T00:21:43.511 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:43 smithi080 bash[17652]: +---[RSA 3072]----+ 2024-02-13T00:21:43.512 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:43 smithi080 bash[17652]: | E. | 2024-02-13T00:21:43.512 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:43 smithi080 bash[17652]: | . | 2024-02-13T00:21:43.512 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:43 smithi080 bash[17652]: | . . | 2024-02-13T00:21:43.512 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:43 smithi080 bash[17652]: | + . | 2024-02-13T00:21:43.512 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:43 smithi080 bash[17652]: | . + S . + | 2024-02-13T00:21:43.512 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:43 smithi080 bash[17652]: | . O o + .o o | 2024-02-13T00:21:43.512 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:43 smithi080 bash[17652]: | X B = + o. o | 2024-02-13T00:21:43.512 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:43 smithi080 bash[17652]: | o =.Bo=o*.o= .| 2024-02-13T00:21:43.512 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:43 smithi080 bash[17652]: | . .+=o+==++o.o | 2024-02-13T00:21:43.512 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:43 smithi080 bash[17652]: +----[SHA256]-----+ 2024-02-13T00:21:44.797 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.785+0000 7fa567876700 1 Processor -- start 2024-02-13T00:21:44.797 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.785+0000 7fa567876700 1 -- start start 2024-02-13T00:21:44.797 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.785+0000 7fa567876700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5600fbb50 0x7fa5600fbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:44.797 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.785+0000 7fa567876700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5600fc4f0 con 0x7fa5600fbb50 2024-02-13T00:21:44.797 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.785+0000 7fa565612700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5600fbb50 0x7fa5600fbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:44.797 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.785+0000 7fa565612700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5600fbb50 0x7fa5600fbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38064/0 (socket says 172.21.15.80:38064) 2024-02-13T00:21:44.797 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.785+0000 7fa565612700 1 -- 172.21.15.80:0/2945093627 learned_addr learned my addr 172.21.15.80:0/2945093627 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:44.797 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.785+0000 7fa565612700 1 -- 172.21.15.80:0/2945093627 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5600fc630 con 0x7fa5600fbb50 2024-02-13T00:21:44.797 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.789+0000 7fa565612700 1 --2- 172.21.15.80:0/2945093627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5600fbb50 0x7fa5600fbf70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fa55c009730 tx=0x7fa55c0090f0).ready entity=mon.0 client_cookie=88ac755b41e9d50a server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:44.798 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.789+0000 7fa557fff700 1 -- 172.21.15.80:0/2945093627 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa55c00b580 con 0x7fa5600fbb50 2024-02-13T00:21:44.798 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.789+0000 7fa557fff700 1 -- 172.21.15.80:0/2945093627 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fa55c00bb50 con 0x7fa5600fbb50 2024-02-13T00:21:44.798 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.789+0000 7fa557fff700 1 -- 172.21.15.80:0/2945093627 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa55c011a70 con 0x7fa5600fbb50 2024-02-13T00:21:44.799 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.789+0000 7fa567876700 1 -- 172.21.15.80:0/2945093627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5600fbb50 msgr2=0x7fa5600fbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:44.799 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.789+0000 7fa567876700 1 --2- 172.21.15.80:0/2945093627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5600fbb50 0x7fa5600fbf70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fa55c009730 tx=0x7fa55c0090f0).stop 2024-02-13T00:21:44.799 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.789+0000 7fa567876700 1 -- 172.21.15.80:0/2945093627 shutdown_connections 2024-02-13T00:21:44.799 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.789+0000 7fa567876700 1 --2- 172.21.15.80:0/2945093627 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5600fbb50 0x7fa5600fbf70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:44.800 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.789+0000 7fa567876700 1 -- 172.21.15.80:0/2945093627 >> 172.21.15.80:0/2945093627 conn(0x7fa5600f5460 msgr2=0x7fa5600f78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:44.800 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.789+0000 7fa567876700 1 -- 172.21.15.80:0/2945093627 shutdown_connections 2024-02-13T00:21:44.800 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.789+0000 7fa567876700 1 -- 172.21.15.80:0/2945093627 wait complete. 2024-02-13T00:21:44.802 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.793+0000 7fa567876700 1 Processor -- start 2024-02-13T00:21:44.803 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.793+0000 7fa567876700 1 -- start start 2024-02-13T00:21:44.803 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.793+0000 7fa567876700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5600fbb50 0x7fa56010cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:44.803 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.793+0000 7fa567876700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5600fa510 con 0x7fa5600fbb50 2024-02-13T00:21:44.803 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.793+0000 7fa565612700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5600fbb50 0x7fa56010cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:44.803 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.793+0000 7fa565612700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5600fbb50 0x7fa56010cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38070/0 (socket says 172.21.15.80:38070) 2024-02-13T00:21:44.803 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.793+0000 7fa565612700 1 -- 172.21.15.80:0/741739778 learned_addr learned my addr 172.21.15.80:0/741739778 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:44.803 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.793+0000 7fa565612700 1 -- 172.21.15.80:0/741739778 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c009370 con 0x7fa5600fbb50 2024-02-13T00:21:44.806 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.793+0000 7fa565612700 1 --2- 172.21.15.80:0/741739778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5600fbb50 0x7fa56010cfa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa55c009f00 tx=0x7fa55c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:44.806 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.793+0000 7fa5567fc700 1 -- 172.21.15.80:0/741739778 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa55c01a640 con 0x7fa5600fbb50 2024-02-13T00:21:44.806 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.793+0000 7fa5567fc700 1 -- 172.21.15.80:0/741739778 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7fa55c01ac10 con 0x7fa5600fbb50 2024-02-13T00:21:44.806 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.793+0000 7fa5567fc700 1 -- 172.21.15.80:0/741739778 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa55c023b10 con 0x7fa5600fbb50 2024-02-13T00:21:44.806 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.793+0000 7fa567876700 1 -- 172.21.15.80:0/741739778 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5600fa710 con 0x7fa5600fbb50 2024-02-13T00:21:44.806 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.793+0000 7fa567876700 1 -- 172.21.15.80:0/741739778 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56010d6d0 con 0x7fa5600fbb50 2024-02-13T00:21:44.806 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.793+0000 7fa5567fc700 1 -- 172.21.15.80:0/741739778 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) v1 ==== 38617+0+0 (secure 0 0 0) 0x7fa55c023cb0 con 0x7fa5600fbb50 2024-02-13T00:21:44.806 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.793+0000 7fa5567fc700 1 --2- 172.21.15.80:0/741739778 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7fa54c0325e0 0x7fa54c034aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:44.806 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.793+0000 7fa5567fc700 1 -- 172.21.15.80:0/741739778 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7fa55c045b40 con 0x7fa5600fbb50 2024-02-13T00:21:44.806 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.797+0000 7fa564e11700 1 --2- 172.21.15.80:0/741739778 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7fa54c0325e0 0x7fa54c034aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:44.806 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.797+0000 7fa567876700 1 -- 172.21.15.80:0/741739778 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56005a3b0 con 0x7fa5600fbb50 2024-02-13T00:21:44.807 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.797+0000 7fa564e11700 1 --2- 172.21.15.80:0/741739778 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7fa54c0325e0 0x7fa54c034aa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fa550009780 tx=0x7fa550006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:44.812 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:44.801+0000 7fa5567fc700 1 -- 172.21.15.80:0/741739778 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa55c01e070 con 0x7fa5600fbb50 2024-02-13T00:21:45.143 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:45.133+0000 7fa567876700 1 -- 172.21.15.80:0/741739778 --> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5600591c0 con 0x7fa54c0325e0 2024-02-13T00:21:45.144 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:45.133+0000 7fa5567fc700 1 -- 172.21.15.80:0/741739778 <== mgr.14116 v2:172.21.15.80:6800/3429634547 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fa5600591c0 con 0x7fa54c0325e0 2024-02-13T00:21:45.145 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDX89ABC6tXcWMPnMOomMDdU15fcrca4P/u8B0X0h0mz7Qb006nT6aYOzse05GkTARl2pOHBnWqzrg71ZK2UfgLrLMqSVTqWTccd9U5KZ67YMfZoh5MWf94iRqOhuG6PKcLQYyajb/DBF7LHRfZe9Yy4OlJ0TxKGfwXifVsO6aVxWS5OHhGLkQWk/zW3Y0bZVUJHCkFs8TWomIqKy7gipKr0HDOtC2bTL/V2L1RyNbS4NkN2dhi0pNpb3sAeM34Uehz4SR3s8P9/9aRClJ3MjBri0WnMLca9MkMP+5brC9s+QRMUxmMhogektWgnmXGMS1PPRWc4cct1ARtc85iXEaa2IuxCYnEdNded8hP7q/EiCGS2QLPGIPo20peuCNVJK7xcTgmVMwnV1WyaI3wmFCDr1SgHEml4Z5RCydOveQklnW9/pVwy4vLd6oflJnKcEt6fUYtSOJ++T5iW2e+hR2sCfCKD3Z3sSNHiMx6GoTIyHHAk2YV6YZnRn0cCzcM9eM= ceph-a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:21:45.147 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:45.137+0000 7fa567876700 1 -- 172.21.15.80:0/741739778 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7fa54c0325e0 msgr2=0x7fa54c034aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:45.147 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:45.137+0000 7fa567876700 1 --2- 172.21.15.80:0/741739778 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7fa54c0325e0 0x7fa54c034aa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fa550009780 tx=0x7fa550006cc0).stop 2024-02-13T00:21:45.147 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:45.137+0000 7fa567876700 1 -- 172.21.15.80:0/741739778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5600fbb50 msgr2=0x7fa56010cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:45.147 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:45.137+0000 7fa567876700 1 --2- 172.21.15.80:0/741739778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5600fbb50 0x7fa56010cfa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa55c009f00 tx=0x7fa55c0090f0).stop 2024-02-13T00:21:45.148 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:45.137+0000 7fa567876700 1 -- 172.21.15.80:0/741739778 shutdown_connections 2024-02-13T00:21:45.148 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:45.137+0000 7fa567876700 1 --2- 172.21.15.80:0/741739778 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7fa54c0325e0 0x7fa54c034aa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:45.148 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:45.137+0000 7fa567876700 1 --2- 172.21.15.80:0/741739778 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa5600fbb50 0x7fa56010cfa0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:45.148 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:45.137+0000 7fa567876700 1 -- 172.21.15.80:0/741739778 >> 172.21.15.80:0/741739778 conn(0x7fa5600f5460 msgr2=0x7fa5600f6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:45.149 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:45.137+0000 7fa567876700 1 -- 172.21.15.80:0/741739778 shutdown_connections 2024-02-13T00:21:45.149 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:45.137+0000 7fa567876700 1 -- 172.21.15.80:0/741739778 wait complete. 2024-02-13T00:21:45.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:45 smithi080 bash[17386]: audit 2024-02-13T00:21:45.139070+0000 mgr.y (mgr.14116) 8 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:21:45.805 INFO:teuthology.orchestra.run.smithi080.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-02-13T00:21:45.805 INFO:teuthology.orchestra.run.smithi080.stderr:Adding key to root@localhost authorized_keys... 2024-02-13T00:21:45.805 INFO:teuthology.orchestra.run.smithi080.stderr:Adding host smithi080... 2024-02-13T00:21:46.724 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.712+0000 7f02c0a06700 1 Processor -- start 2024-02-13T00:21:46.724 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.712+0000 7f02c0a06700 1 -- start start 2024-02-13T00:21:46.724 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.712+0000 7f02c0a06700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02bc071ca0 0x7f02bc070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:46.724 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.712+0000 7f02c0a06700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0720c0 con 0x7f02bc071ca0 2024-02-13T00:21:46.724 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.712+0000 7f02ba59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02bc071ca0 0x7f02bc070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:46.724 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.712+0000 7f02ba59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02bc071ca0 0x7f02bc070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38086/0 (socket says 172.21.15.80:38086) 2024-02-13T00:21:46.724 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.712+0000 7f02ba59c700 1 -- 172.21.15.80:0/3113529173 learned_addr learned my addr 172.21.15.80:0/3113529173 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:46.725 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.712+0000 7f02ba59c700 1 -- 172.21.15.80:0/3113529173 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc070730 con 0x7f02bc071ca0 2024-02-13T00:21:46.725 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.712+0000 7f02ba59c700 1 --2- 172.21.15.80:0/3113529173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02bc071ca0 0x7f02bc070240 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f02ac009730 tx=0x7f02ac0090f0).ready entity=mon.0 client_cookie=40e189192a5ab560 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:46.726 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.712+0000 7f02b959a700 1 -- 172.21.15.80:0/3113529173 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02ac00b580 con 0x7f02bc071ca0 2024-02-13T00:21:46.726 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.712+0000 7f02b959a700 1 -- 172.21.15.80:0/3113529173 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f02ac00bb50 con 0x7f02bc071ca0 2024-02-13T00:21:46.726 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.712+0000 7f02b959a700 1 -- 172.21.15.80:0/3113529173 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02ac011a70 con 0x7f02bc071ca0 2024-02-13T00:21:46.727 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.716+0000 7f02c0a06700 1 -- 172.21.15.80:0/3113529173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02bc071ca0 msgr2=0x7f02bc070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:46.727 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.716+0000 7f02c0a06700 1 --2- 172.21.15.80:0/3113529173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02bc071ca0 0x7f02bc070240 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f02ac009730 tx=0x7f02ac0090f0).stop 2024-02-13T00:21:46.727 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.716+0000 7f02c0a06700 1 -- 172.21.15.80:0/3113529173 shutdown_connections 2024-02-13T00:21:46.727 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.716+0000 7f02c0a06700 1 --2- 172.21.15.80:0/3113529173 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02bc071ca0 0x7f02bc070240 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:46.727 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.716+0000 7f02c0a06700 1 -- 172.21.15.80:0/3113529173 >> 172.21.15.80:0/3113529173 conn(0x7f02bc0f6eb0 msgr2=0x7f02bc0f92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:46.727 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.716+0000 7f02c0a06700 1 -- 172.21.15.80:0/3113529173 shutdown_connections 2024-02-13T00:21:46.727 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.716+0000 7f02c0a06700 1 -- 172.21.15.80:0/3113529173 wait complete. 2024-02-13T00:21:46.729 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.716+0000 7f02c0a06700 1 Processor -- start 2024-02-13T00:21:46.729 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.716+0000 7f02c0a06700 1 -- start start 2024-02-13T00:21:46.729 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.716+0000 7f02c0a06700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02bc071ca0 0x7f02bc10c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:46.729 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.716+0000 7f02c0a06700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc10c9f0 con 0x7f02bc071ca0 2024-02-13T00:21:46.729 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.716+0000 7f02ba59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02bc071ca0 0x7f02bc10c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:46.729 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.716+0000 7f02ba59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02bc071ca0 0x7f02bc10c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:38092/0 (socket says 172.21.15.80:38092) 2024-02-13T00:21:46.729 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.716+0000 7f02ba59c700 1 -- 172.21.15.80:0/1372377545 learned_addr learned my addr 172.21.15.80:0/1372377545 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:46.729 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.720+0000 7f02ba59c700 1 -- 172.21.15.80:0/1372377545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ac009370 con 0x7f02bc071ca0 2024-02-13T00:21:46.729 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.720+0000 7f02ba59c700 1 --2- 172.21.15.80:0/1372377545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02bc071ca0 0x7f02bc10c500 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f02ac00bef0 tx=0x7f02ac0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:46.730 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.720+0000 7f02b37fe700 1 -- 172.21.15.80:0/1372377545 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02ac01a640 con 0x7f02bc071ca0 2024-02-13T00:21:46.730 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.720+0000 7f02b37fe700 1 -- 172.21.15.80:0/1372377545 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f02ac01ac10 con 0x7f02bc071ca0 2024-02-13T00:21:46.730 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.720+0000 7f02c0a06700 1 -- 172.21.15.80:0/1372377545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02bc10cbf0 con 0x7f02bc071ca0 2024-02-13T00:21:46.730 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.720+0000 7f02b37fe700 1 -- 172.21.15.80:0/1372377545 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02ac023b20 con 0x7f02bc071ca0 2024-02-13T00:21:46.730 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.720+0000 7f02c0a06700 1 -- 172.21.15.80:0/1372377545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02bc10d080 con 0x7f02bc071ca0 2024-02-13T00:21:46.731 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.720+0000 7f02b37fe700 1 -- 172.21.15.80:0/1372377545 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) v1 ==== 38617+0+0 (secure 0 0 0) 0x7f02ac023410 con 0x7f02bc071ca0 2024-02-13T00:21:46.731 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.720+0000 7f02b37fe700 1 --2- 172.21.15.80:0/1372377545 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f02a0032630 0x7f02a0034af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:46.731 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.720+0000 7f02b37fe700 1 -- 172.21.15.80:0/1372377545 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f02ac044f00 con 0x7f02bc071ca0 2024-02-13T00:21:46.732 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.720+0000 7f02b17fa700 1 -- 172.21.15.80:0/1372377545 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0298004f20 con 0x7f02bc071ca0 2024-02-13T00:21:46.732 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.720+0000 7f02b9d9b700 1 --2- 172.21.15.80:0/1372377545 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f02a0032630 0x7f02a0034af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:46.733 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.720+0000 7f02b9d9b700 1 --2- 172.21.15.80:0/1372377545 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f02a0032630 0x7f02a0034af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f02a8009780 tx=0x7f02a8006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:46.739 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:46.728+0000 7f02b37fe700 1 -- 172.21.15.80:0/1372377545 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f02ac01e020 con 0x7f02bc071ca0 2024-02-13T00:21:47.070 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:47.060+0000 7f02b17fa700 1 -- 172.21.15.80:0/1372377545 --> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi080", "addr": "172.21.15.80", "target": ["mon-mgr", ""]}) v1 -- 0x7f0298000b90 con 0x7f02a0032630 2024-02-13T00:21:47.510 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:21:47 smithi080 bash[17652]: Warning: Permanently added '172.21.15.80' (ECDSA) to the list of known hosts. 2024-02-13T00:21:47.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:47 smithi080 bash[17386]: audit 2024-02-13T00:21:47.065461+0000 mgr.y (mgr.14116) 9 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi080", "addr": "172.21.15.80", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:21:47.890 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:47.880+0000 7f02b37fe700 1 -- 172.21.15.80:0/1372377545 <== mgr.14116 v2:172.21.15.80:6800/3429634547 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f0298000b90 con 0x7f02a0032630 2024-02-13T00:21:47.890 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: Added host 'smithi080' with addr '172.21.15.80' 2024-02-13T00:21:47.892 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:47.880+0000 7f02b17fa700 1 -- 172.21.15.80:0/1372377545 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f02a0032630 msgr2=0x7f02a0034af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:47.893 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:47.880+0000 7f02b17fa700 1 --2- 172.21.15.80:0/1372377545 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f02a0032630 0x7f02a0034af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f02a8009780 tx=0x7f02a8006cc0).stop 2024-02-13T00:21:47.893 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:47.880+0000 7f02b17fa700 1 -- 172.21.15.80:0/1372377545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02bc071ca0 msgr2=0x7f02bc10c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:47.894 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:47.880+0000 7f02b17fa700 1 --2- 172.21.15.80:0/1372377545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02bc071ca0 0x7f02bc10c500 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f02ac00bef0 tx=0x7f02ac0090f0).stop 2024-02-13T00:21:47.894 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:47.880+0000 7f02b17fa700 1 -- 172.21.15.80:0/1372377545 shutdown_connections 2024-02-13T00:21:47.894 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:47.880+0000 7f02b17fa700 1 --2- 172.21.15.80:0/1372377545 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f02a0032630 0x7f02a0034af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:47.894 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:47.880+0000 7f02b17fa700 1 --2- 172.21.15.80:0/1372377545 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02bc071ca0 0x7f02bc10c500 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:47.894 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:47.880+0000 7f02b17fa700 1 -- 172.21.15.80:0/1372377545 >> 172.21.15.80:0/1372377545 conn(0x7f02bc0f6eb0 msgr2=0x7f02bc0f8730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:47.894 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:47.880+0000 7f02b17fa700 1 -- 172.21.15.80:0/1372377545 shutdown_connections 2024-02-13T00:21:47.894 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:47.884+0000 7f02b17fa700 1 -- 172.21.15.80:0/1372377545 wait complete. 2024-02-13T00:21:48.796 INFO:teuthology.orchestra.run.smithi080.stderr:Deploying unmanaged mon service... 2024-02-13T00:21:49.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:48 smithi080 bash[17386]: audit 2024-02-13T00:21:47.884180+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' 2024-02-13T00:21:49.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:48 smithi080 bash[17386]: cephadm 2024-02-13T00:21:47.884791+0000 mgr.y (mgr.14116) 10 : cephadm [INF] Added host smithi080 2024-02-13T00:21:49.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:48 smithi080 bash[17386]: audit 2024-02-13T00:21:47.887475+0000 mon.a (mon.0) 54 : audit [DBG] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:21:50.233 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.220+0000 7f7865fea700 1 Processor -- start 2024-02-13T00:21:50.234 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.220+0000 7f7865fea700 1 -- start start 2024-02-13T00:21:50.234 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.220+0000 7f7865fea700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78600fd8d0 0x7f78600fdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:50.234 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.220+0000 7f7865fea700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78600fe270 con 0x7f78600fd8d0 2024-02-13T00:21:50.234 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.220+0000 7f785f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78600fd8d0 0x7f78600fdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:50.234 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.220+0000 7f785f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78600fd8d0 0x7f78600fdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55520/0 (socket says 172.21.15.80:55520) 2024-02-13T00:21:50.234 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.220+0000 7f785f7fe700 1 -- 172.21.15.80:0/616068943 learned_addr learned my addr 172.21.15.80:0/616068943 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:50.234 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.220+0000 7f785f7fe700 1 -- 172.21.15.80:0/616068943 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78600fe3b0 con 0x7f78600fd8d0 2024-02-13T00:21:50.234 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.220+0000 7f785f7fe700 1 --2- 172.21.15.80:0/616068943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78600fd8d0 0x7f78600fdcf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7858009ea0 tx=0x7f7858009840).ready entity=mon.0 client_cookie=49da46a38b3f681d server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:50.234 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.220+0000 7f785e7fc700 1 -- 172.21.15.80:0/616068943 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f785800e070 con 0x7f78600fd8d0 2024-02-13T00:21:50.234 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f785e7fc700 1 -- 172.21.15.80:0/616068943 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f785800be70 con 0x7f78600fd8d0 2024-02-13T00:21:50.234 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f785e7fc700 1 -- 172.21.15.80:0/616068943 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7858013d60 con 0x7f78600fd8d0 2024-02-13T00:21:50.237 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f7865fea700 1 -- 172.21.15.80:0/616068943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78600fd8d0 msgr2=0x7f78600fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:50.237 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f7865fea700 1 --2- 172.21.15.80:0/616068943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78600fd8d0 0x7f78600fdcf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7858009ea0 tx=0x7f7858009840).stop 2024-02-13T00:21:50.237 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f7865fea700 1 -- 172.21.15.80:0/616068943 shutdown_connections 2024-02-13T00:21:50.237 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f7865fea700 1 --2- 172.21.15.80:0/616068943 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78600fd8d0 0x7f78600fdcf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:50.237 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f7865fea700 1 -- 172.21.15.80:0/616068943 >> 172.21.15.80:0/616068943 conn(0x7f78600710b0 msgr2=0x7f78600714e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:50.237 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f7865fea700 1 -- 172.21.15.80:0/616068943 shutdown_connections 2024-02-13T00:21:50.238 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f7865fea700 1 -- 172.21.15.80:0/616068943 wait complete. 2024-02-13T00:21:50.238 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f7865fea700 1 Processor -- start 2024-02-13T00:21:50.238 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f7865fea700 1 -- start start 2024-02-13T00:21:50.238 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f7865fea700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78600fd8d0 0x7f786010c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:50.238 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f7865fea700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786010c9c0 con 0x7f78600fd8d0 2024-02-13T00:21:50.238 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f785f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78600fd8d0 0x7f786010c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:50.238 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f785f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78600fd8d0 0x7f786010c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55530/0 (socket says 172.21.15.80:55530) 2024-02-13T00:21:50.238 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f785f7fe700 1 -- 172.21.15.80:0/2612348030 learned_addr learned my addr 172.21.15.80:0/2612348030 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:50.238 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f785f7fe700 1 -- 172.21.15.80:0/2612348030 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7858009ae0 con 0x7f78600fd8d0 2024-02-13T00:21:50.238 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f785f7fe700 1 --2- 172.21.15.80:0/2612348030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78600fd8d0 0x7f786010c4d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7858014f80 tx=0x7f7858009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:50.238 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f785cff9700 1 -- 172.21.15.80:0/2612348030 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f785800e040 con 0x7f78600fd8d0 2024-02-13T00:21:50.238 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f7865fea700 1 -- 172.21.15.80:0/2612348030 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f786010cbc0 con 0x7f78600fd8d0 2024-02-13T00:21:50.238 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f785cff9700 1 -- 172.21.15.80:0/2612348030 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1010+0+0 (secure 0 0 0) 0x7f7858012900 con 0x7f78600fd8d0 2024-02-13T00:21:50.238 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f785cff9700 1 -- 172.21.15.80:0/2612348030 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7858007820 con 0x7f78600fd8d0 2024-02-13T00:21:50.238 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.224+0000 7f7865fea700 1 -- 172.21.15.80:0/2612348030 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f786010d050 con 0x7f78600fd8d0 2024-02-13T00:21:50.239 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.228+0000 7f7865fea700 1 -- 172.21.15.80:0/2612348030 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7860046d80 con 0x7f78600fd8d0 2024-02-13T00:21:50.239 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.228+0000 7f785cff9700 1 -- 172.21.15.80:0/2612348030 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) v1 ==== 38617+0+0 (secure 0 0 0) 0x7f7858003040 con 0x7f78600fd8d0 2024-02-13T00:21:50.239 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.228+0000 7f785cff9700 1 --2- 172.21.15.80:0/2612348030 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f78480325e0 0x7f7848034aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:50.239 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.228+0000 7f785cff9700 1 -- 172.21.15.80:0/2612348030 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f78580447b0 con 0x7f78600fd8d0 2024-02-13T00:21:50.239 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.228+0000 7f785effd700 1 --2- 172.21.15.80:0/2612348030 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f78480325e0 0x7f7848034aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:50.239 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.228+0000 7f785effd700 1 --2- 172.21.15.80:0/2612348030 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f78480325e0 0x7f7848034aa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f7854009780 tx=0x7f7854006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:50.246 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.236+0000 7f785cff9700 1 -- 172.21.15.80:0/2612348030 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f78580119c0 con 0x7f78600fd8d0 2024-02-13T00:21:50.596 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.584+0000 7f7865fea700 1 -- 172.21.15.80:0/2612348030 --> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f786010d970 con 0x7f78480325e0 2024-02-13T00:21:50.603 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.592+0000 7f785cff9700 1 -- 172.21.15.80:0/2612348030 <== mgr.14116 v2:172.21.15.80:6800/3429634547 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f786010d970 con 0x7f78480325e0 2024-02-13T00:21:50.604 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: Scheduled mon update... 2024-02-13T00:21:50.607 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.596+0000 7f7865fea700 1 -- 172.21.15.80:0/2612348030 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f78480325e0 msgr2=0x7f7848034aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:50.607 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.596+0000 7f7865fea700 1 --2- 172.21.15.80:0/2612348030 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f78480325e0 0x7f7848034aa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f7854009780 tx=0x7f7854006cc0).stop 2024-02-13T00:21:50.607 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.596+0000 7f7865fea700 1 -- 172.21.15.80:0/2612348030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78600fd8d0 msgr2=0x7f786010c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:50.607 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.596+0000 7f7865fea700 1 --2- 172.21.15.80:0/2612348030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78600fd8d0 0x7f786010c4d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7858014f80 tx=0x7f7858009840).stop 2024-02-13T00:21:50.608 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.596+0000 7f7865fea700 1 -- 172.21.15.80:0/2612348030 shutdown_connections 2024-02-13T00:21:50.608 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.596+0000 7f7865fea700 1 --2- 172.21.15.80:0/2612348030 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f78480325e0 0x7f7848034aa0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:50.608 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.596+0000 7f7865fea700 1 --2- 172.21.15.80:0/2612348030 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78600fd8d0 0x7f786010c4d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:50.609 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.596+0000 7f7865fea700 1 -- 172.21.15.80:0/2612348030 >> 172.21.15.80:0/2612348030 conn(0x7f78600710b0 msgr2=0x7f78600fc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:50.609 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.596+0000 7f7865fea700 1 -- 172.21.15.80:0/2612348030 shutdown_connections 2024-02-13T00:21:50.609 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:50.596+0000 7f7865fea700 1 -- 172.21.15.80:0/2612348030 wait complete. 2024-02-13T00:21:51.446 INFO:teuthology.orchestra.run.smithi080.stderr:Deploying unmanaged mgr service... 2024-02-13T00:21:52.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:51 smithi080 bash[17386]: audit 2024-02-13T00:21:50.592424+0000 mgr.y (mgr.14116) 11 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:21:52.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:51 smithi080 bash[17386]: cephadm 2024-02-13T00:21:50.595606+0000 mgr.y (mgr.14116) 12 : cephadm [INF] Saving service mon spec with placement count:5 2024-02-13T00:21:52.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:51 smithi080 bash[17386]: audit 2024-02-13T00:21:50.598365+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' 2024-02-13T00:21:52.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:51 smithi080 bash[17386]: audit 2024-02-13T00:21:51.378199+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' 2024-02-13T00:21:52.634 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.620+0000 7f78a58c8700 1 Processor -- start 2024-02-13T00:21:52.634 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.624+0000 7f78a58c8700 1 -- start start 2024-02-13T00:21:52.635 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.624+0000 7f78a58c8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78a00fb6c0 0x7f78a00fbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:52.635 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.624+0000 7f78a58c8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a00fbfd0 con 0x7f78a00fb6c0 2024-02-13T00:21:52.635 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.624+0000 7f789effd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78a00fb6c0 0x7f78a00fbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:52.635 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.624+0000 7f789effd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78a00fb6c0 0x7f78a00fbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55532/0 (socket says 172.21.15.80:55532) 2024-02-13T00:21:52.635 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.624+0000 7f789effd700 1 -- 172.21.15.80:0/3545323810 learned_addr learned my addr 172.21.15.80:0/3545323810 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:52.635 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.624+0000 7f789effd700 1 -- 172.21.15.80:0/3545323810 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a00fc110 con 0x7f78a00fb6c0 2024-02-13T00:21:52.636 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.624+0000 7f789effd700 1 --2- 172.21.15.80:0/3545323810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78a00fb6c0 0x7f78a00fbae0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f7888009730 tx=0x7f78880090f0).ready entity=mon.0 client_cookie=aec84fda06c6637d server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:52.636 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.624+0000 7f789dffb700 1 -- 172.21.15.80:0/3545323810 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f788800b580 con 0x7f78a00fb6c0 2024-02-13T00:21:52.636 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.624+0000 7f789dffb700 1 -- 172.21.15.80:0/3545323810 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f788800bb70 con 0x7f78a00fb6c0 2024-02-13T00:21:52.636 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.624+0000 7f789dffb700 1 -- 172.21.15.80:0/3545323810 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7888011a90 con 0x7f78a00fb6c0 2024-02-13T00:21:52.637 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.624+0000 7f78a58c8700 1 -- 172.21.15.80:0/3545323810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78a00fb6c0 msgr2=0x7f78a00fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:52.637 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.624+0000 7f78a58c8700 1 --2- 172.21.15.80:0/3545323810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78a00fb6c0 0x7f78a00fbae0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f7888009730 tx=0x7f78880090f0).stop 2024-02-13T00:21:52.637 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.624+0000 7f78a58c8700 1 -- 172.21.15.80:0/3545323810 shutdown_connections 2024-02-13T00:21:52.637 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.624+0000 7f78a58c8700 1 --2- 172.21.15.80:0/3545323810 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78a00fb6c0 0x7f78a00fbae0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:52.637 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.624+0000 7f78a58c8700 1 -- 172.21.15.80:0/3545323810 >> 172.21.15.80:0/3545323810 conn(0x7f78a00f6ec0 msgr2=0x7f78a00f92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:52.637 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.624+0000 7f78a58c8700 1 -- 172.21.15.80:0/3545323810 shutdown_connections 2024-02-13T00:21:52.637 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.624+0000 7f78a58c8700 1 -- 172.21.15.80:0/3545323810 wait complete. 2024-02-13T00:21:52.638 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.628+0000 7f78a58c8700 1 Processor -- start 2024-02-13T00:21:52.638 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.628+0000 7f78a58c8700 1 -- start start 2024-02-13T00:21:52.639 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.628+0000 7f78a58c8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78a00fb6c0 0x7f78a0071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:52.639 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.628+0000 7f78a58c8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a0070200 con 0x7f78a00fb6c0 2024-02-13T00:21:52.640 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.628+0000 7f789effd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78a00fb6c0 0x7f78a0071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:52.640 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.628+0000 7f789effd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78a00fb6c0 0x7f78a0071d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55534/0 (socket says 172.21.15.80:55534) 2024-02-13T00:21:52.640 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.628+0000 7f789effd700 1 -- 172.21.15.80:0/1693683626 learned_addr learned my addr 172.21.15.80:0/1693683626 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:52.640 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.628+0000 7f789effd700 1 -- 172.21.15.80:0/1693683626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7888009370 con 0x7f78a00fb6c0 2024-02-13T00:21:52.640 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.628+0000 7f789effd700 1 --2- 172.21.15.80:0/1693683626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78a00fb6c0 0x7f78a0071d80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7888000c00 tx=0x7f78880090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:52.641 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.628+0000 7f7897fff700 1 -- 172.21.15.80:0/1693683626 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f788801a7b0 con 0x7f78a00fb6c0 2024-02-13T00:21:52.641 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.628+0000 7f7897fff700 1 -- 172.21.15.80:0/1693683626 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f788801ada0 con 0x7f78a00fb6c0 2024-02-13T00:21:52.641 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.628+0000 7f78a58c8700 1 -- 172.21.15.80:0/1693683626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a00703a0 con 0x7f78a00fb6c0 2024-02-13T00:21:52.641 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.628+0000 7f7897fff700 1 -- 172.21.15.80:0/1693683626 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7888023c50 con 0x7f78a00fb6c0 2024-02-13T00:21:52.641 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.628+0000 7f78a58c8700 1 -- 172.21.15.80:0/1693683626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a0070830 con 0x7f78a00fb6c0 2024-02-13T00:21:52.642 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.632+0000 7f78a58c8700 1 -- 172.21.15.80:0/1693683626 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a005a3b0 con 0x7f78a00fb6c0 2024-02-13T00:21:52.642 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.632+0000 7f7897fff700 1 -- 172.21.15.80:0/1693683626 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) v1 ==== 38617+0+0 (secure 0 0 0) 0x7f788802c3f0 con 0x7f78a00fb6c0 2024-02-13T00:21:52.643 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.632+0000 7f7897fff700 1 --2- 172.21.15.80:0/1693683626 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f788c032630 0x7f788c034af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:52.643 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.632+0000 7f7897fff700 1 -- 172.21.15.80:0/1693683626 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f7888044f70 con 0x7f78a00fb6c0 2024-02-13T00:21:52.643 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.632+0000 7f789e7fc700 1 --2- 172.21.15.80:0/1693683626 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f788c032630 0x7f788c034af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:52.643 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.632+0000 7f789e7fc700 1 --2- 172.21.15.80:0/1693683626 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f788c032630 0x7f788c034af0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f7890009780 tx=0x7f7890006cb0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:52.648 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.636+0000 7f7897fff700 1 -- 172.21.15.80:0/1693683626 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f788802bb40 con 0x7f78a00fb6c0 2024-02-13T00:21:52.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:52 smithi080 bash[17386]: audit 2024-02-13T00:21:51.641287+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' 2024-02-13T00:21:52.994 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.984+0000 7f78a58c8700 1 -- 172.21.15.80:0/1693683626 --> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f78a0070b30 con 0x7f788c032630 2024-02-13T00:21:53.003 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.992+0000 7f7897fff700 1 -- 172.21.15.80:0/1693683626 <== mgr.14116 v2:172.21.15.80:6800/3429634547 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f78a0070b30 con 0x7f788c032630 2024-02-13T00:21:53.003 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: Scheduled mgr update... 2024-02-13T00:21:53.007 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.996+0000 7f78a58c8700 1 -- 172.21.15.80:0/1693683626 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f788c032630 msgr2=0x7f788c034af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:53.007 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.996+0000 7f78a58c8700 1 --2- 172.21.15.80:0/1693683626 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f788c032630 0x7f788c034af0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f7890009780 tx=0x7f7890006cb0).stop 2024-02-13T00:21:53.007 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.996+0000 7f78a58c8700 1 -- 172.21.15.80:0/1693683626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78a00fb6c0 msgr2=0x7f78a0071d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:53.007 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.996+0000 7f78a58c8700 1 --2- 172.21.15.80:0/1693683626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78a00fb6c0 0x7f78a0071d80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7888000c00 tx=0x7f78880090f0).stop 2024-02-13T00:21:53.007 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.996+0000 7f78a58c8700 1 -- 172.21.15.80:0/1693683626 shutdown_connections 2024-02-13T00:21:53.007 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.996+0000 7f78a58c8700 1 --2- 172.21.15.80:0/1693683626 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f788c032630 0x7f788c034af0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:53.008 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.996+0000 7f78a58c8700 1 --2- 172.21.15.80:0/1693683626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f78a00fb6c0 0x7f78a0071d80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:53.008 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.996+0000 7f78a58c8700 1 -- 172.21.15.80:0/1693683626 >> 172.21.15.80:0/1693683626 conn(0x7f78a00f6ec0 msgr2=0x7f78a00f86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:53.008 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.996+0000 7f78a58c8700 1 -- 172.21.15.80:0/1693683626 shutdown_connections 2024-02-13T00:21:53.008 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:52.996+0000 7f78a58c8700 1 -- 172.21.15.80:0/1693683626 wait complete. 2024-02-13T00:21:54.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:53 smithi080 bash[17386]: audit 2024-02-13T00:21:52.990045+0000 mgr.y (mgr.14116) 13 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:21:54.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:53 smithi080 bash[17386]: cephadm 2024-02-13T00:21:52.992409+0000 mgr.y (mgr.14116) 14 : cephadm [INF] Saving service mgr spec with placement count:2 2024-02-13T00:21:54.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:53 smithi080 bash[17386]: audit 2024-02-13T00:21:52.997258+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' 2024-02-13T00:21:54.689 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.676+0000 7ffb7d58c700 1 Processor -- start 2024-02-13T00:21:54.689 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.676+0000 7ffb7d58c700 1 -- start start 2024-02-13T00:21:54.690 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.676+0000 7ffb7d58c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb780fb6c0 0x7ffb780fbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:54.690 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.676+0000 7ffb7d58c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb780fbfd0 con 0x7ffb780fb6c0 2024-02-13T00:21:54.690 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.680+0000 7ffb76ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb780fb6c0 0x7ffb780fbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:54.690 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.680+0000 7ffb76ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb780fb6c0 0x7ffb780fbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55544/0 (socket says 172.21.15.80:55544) 2024-02-13T00:21:54.690 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.680+0000 7ffb76ffd700 1 -- 172.21.15.80:0/1464575698 learned_addr learned my addr 172.21.15.80:0/1464575698 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:54.691 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.680+0000 7ffb76ffd700 1 -- 172.21.15.80:0/1464575698 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb780fc110 con 0x7ffb780fb6c0 2024-02-13T00:21:54.691 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.680+0000 7ffb76ffd700 1 --2- 172.21.15.80:0/1464575698 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb780fb6c0 0x7ffb780fbae0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ffb68009e50 tx=0x7ffb68009840).ready entity=mon.0 client_cookie=dae712cc856d85a4 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:54.691 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.680+0000 7ffb75ffb700 1 -- 172.21.15.80:0/1464575698 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb6800e070 con 0x7ffb780fb6c0 2024-02-13T00:21:54.691 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.680+0000 7ffb75ffb700 1 -- 172.21.15.80:0/1464575698 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7ffb68013420 con 0x7ffb780fb6c0 2024-02-13T00:21:54.691 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.680+0000 7ffb75ffb700 1 -- 172.21.15.80:0/1464575698 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb68007400 con 0x7ffb780fb6c0 2024-02-13T00:21:54.692 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.680+0000 7ffb7d58c700 1 -- 172.21.15.80:0/1464575698 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb780fb6c0 msgr2=0x7ffb780fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:54.692 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.680+0000 7ffb7d58c700 1 --2- 172.21.15.80:0/1464575698 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb780fb6c0 0x7ffb780fbae0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ffb68009e50 tx=0x7ffb68009840).stop 2024-02-13T00:21:54.692 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.680+0000 7ffb7d58c700 1 -- 172.21.15.80:0/1464575698 shutdown_connections 2024-02-13T00:21:54.692 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.680+0000 7ffb7d58c700 1 --2- 172.21.15.80:0/1464575698 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb780fb6c0 0x7ffb780fbae0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:54.694 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.680+0000 7ffb7d58c700 1 -- 172.21.15.80:0/1464575698 >> 172.21.15.80:0/1464575698 conn(0x7ffb780f6ec0 msgr2=0x7ffb780f92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:54.694 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.680+0000 7ffb7d58c700 1 -- 172.21.15.80:0/1464575698 shutdown_connections 2024-02-13T00:21:54.694 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.680+0000 7ffb7d58c700 1 -- 172.21.15.80:0/1464575698 wait complete. 2024-02-13T00:21:54.694 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.680+0000 7ffb7d58c700 1 Processor -- start 2024-02-13T00:21:54.694 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.684+0000 7ffb7d58c700 1 -- start start 2024-02-13T00:21:54.694 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.684+0000 7ffb7d58c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb780fb6c0 0x7ffb7810c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:54.694 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.684+0000 7ffb7d58c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7810c9a0 con 0x7ffb780fb6c0 2024-02-13T00:21:54.695 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.684+0000 7ffb76ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb780fb6c0 0x7ffb7810c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:54.695 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.684+0000 7ffb76ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb780fb6c0 0x7ffb7810c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55558/0 (socket says 172.21.15.80:55558) 2024-02-13T00:21:54.695 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.684+0000 7ffb76ffd700 1 -- 172.21.15.80:0/1787191410 learned_addr learned my addr 172.21.15.80:0/1787191410 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:54.695 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.684+0000 7ffb76ffd700 1 -- 172.21.15.80:0/1787191410 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb68009ae0 con 0x7ffb780fb6c0 2024-02-13T00:21:54.695 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.684+0000 7ffb76ffd700 1 --2- 172.21.15.80:0/1787191410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb780fb6c0 0x7ffb7810c4b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ffb680139f0 tx=0x7ffb68009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:54.696 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.684+0000 7ffb5ffff700 1 -- 172.21.15.80:0/1787191410 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb68013ea0 con 0x7ffb780fb6c0 2024-02-13T00:21:54.696 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.684+0000 7ffb5ffff700 1 -- 172.21.15.80:0/1787191410 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7ffb68007b00 con 0x7ffb780fb6c0 2024-02-13T00:21:54.696 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.684+0000 7ffb7d58c700 1 -- 172.21.15.80:0/1787191410 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7810cba0 con 0x7ffb780fb6c0 2024-02-13T00:21:54.696 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.684+0000 7ffb5ffff700 1 -- 172.21.15.80:0/1787191410 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb6800e040 con 0x7ffb780fb6c0 2024-02-13T00:21:54.696 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.684+0000 7ffb7d58c700 1 -- 172.21.15.80:0/1787191410 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7810d030 con 0x7ffb780fb6c0 2024-02-13T00:21:54.696 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.684+0000 7ffb5ffff700 1 -- 172.21.15.80:0/1787191410 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) v1 ==== 38617+0+0 (secure 0 0 0) 0x7ffb68003040 con 0x7ffb780fb6c0 2024-02-13T00:21:54.697 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.684+0000 7ffb5ffff700 1 --2- 172.21.15.80:0/1787191410 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7ffb600325e0 0x7ffb60034aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:54.697 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.684+0000 7ffb5ffff700 1 -- 172.21.15.80:0/1787191410 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7ffb680441d0 con 0x7ffb780fb6c0 2024-02-13T00:21:54.697 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.684+0000 7ffb767fc700 1 --2- 172.21.15.80:0/1787191410 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7ffb600325e0 0x7ffb60034aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:54.697 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.688+0000 7ffb7d58c700 1 -- 172.21.15.80:0/1787191410 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7805a3b0 con 0x7ffb780fb6c0 2024-02-13T00:21:54.697 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.688+0000 7ffb767fc700 1 --2- 172.21.15.80:0/1787191410 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7ffb600325e0 0x7ffb60034aa0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7ffb6c009780 tx=0x7ffb6c006cb0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:54.703 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:54.692+0000 7ffb5ffff700 1 -- 172.21.15.80:0/1787191410 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ffb68024540 con 0x7ffb780fb6c0 2024-02-13T00:21:55.030 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:55.020+0000 7ffb7d58c700 1 -- 172.21.15.80:0/1787191410 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7ffb780fd560 con 0x7ffb780fb6c0 2024-02-13T00:21:55.034 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:55.024+0000 7ffb5ffff700 1 -- 172.21.15.80:0/1787191410 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7ffb68021020 con 0x7ffb780fb6c0 2024-02-13T00:21:55.038 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:55.028+0000 7ffb7d58c700 1 -- 172.21.15.80:0/1787191410 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7ffb600325e0 msgr2=0x7ffb60034aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:55.038 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:55.028+0000 7ffb7d58c700 1 --2- 172.21.15.80:0/1787191410 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7ffb600325e0 0x7ffb60034aa0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7ffb6c009780 tx=0x7ffb6c006cb0).stop 2024-02-13T00:21:55.038 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:55.028+0000 7ffb7d58c700 1 -- 172.21.15.80:0/1787191410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb780fb6c0 msgr2=0x7ffb7810c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:55.039 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:55.028+0000 7ffb7d58c700 1 --2- 172.21.15.80:0/1787191410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb780fb6c0 0x7ffb7810c4b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ffb680139f0 tx=0x7ffb68009840).stop 2024-02-13T00:21:55.039 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:55.028+0000 7ffb7d58c700 1 -- 172.21.15.80:0/1787191410 shutdown_connections 2024-02-13T00:21:55.039 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:55.028+0000 7ffb7d58c700 1 --2- 172.21.15.80:0/1787191410 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7ffb600325e0 0x7ffb60034aa0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:55.040 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:55.028+0000 7ffb7d58c700 1 --2- 172.21.15.80:0/1787191410 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffb780fb6c0 0x7ffb7810c4b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:55.040 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:55.028+0000 7ffb7d58c700 1 -- 172.21.15.80:0/1787191410 >> 172.21.15.80:0/1787191410 conn(0x7ffb780f6ec0 msgr2=0x7ffb780f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:55.040 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:55.028+0000 7ffb7d58c700 1 -- 172.21.15.80:0/1787191410 shutdown_connections 2024-02-13T00:21:55.040 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:55.028+0000 7ffb7d58c700 1 -- 172.21.15.80:0/1787191410 wait complete. 2024-02-13T00:21:56.436 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:56 smithi080 bash[17386]: audit 2024-02-13T00:21:55.029000+0000 mon.a (mon.0) 59 : audit [INF] from='client.? 172.21.15.80:0/1787191410' entity='client.admin' 2024-02-13T00:21:56.650 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.640+0000 7f31ecebf700 1 Processor -- start 2024-02-13T00:21:56.650 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.640+0000 7f31ecebf700 1 -- start start 2024-02-13T00:21:56.650 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.640+0000 7f31ecebf700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e80fbba0 0x7f31e80fbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:56.650 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.640+0000 7f31ecebf700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e80fc540 con 0x7f31e80fbba0 2024-02-13T00:21:56.651 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.640+0000 7f31e659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e80fbba0 0x7f31e80fbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:56.651 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.640+0000 7f31e659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e80fbba0 0x7f31e80fbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55572/0 (socket says 172.21.15.80:55572) 2024-02-13T00:21:56.651 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.640+0000 7f31e659c700 1 -- 172.21.15.80:0/3357955219 learned_addr learned my addr 172.21.15.80:0/3357955219 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:56.651 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.640+0000 7f31e659c700 1 -- 172.21.15.80:0/3357955219 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e80fc680 con 0x7f31e80fbba0 2024-02-13T00:21:56.651 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.640+0000 7f31e659c700 1 --2- 172.21.15.80:0/3357955219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e80fbba0 0x7f31e80fbfc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f31d8009730 tx=0x7f31d80090f0).ready entity=mon.0 client_cookie=f619249681016593 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:56.652 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.640+0000 7f31e559a700 1 -- 172.21.15.80:0/3357955219 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31d800b580 con 0x7f31e80fbba0 2024-02-13T00:21:56.652 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.640+0000 7f31e559a700 1 -- 172.21.15.80:0/3357955219 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f31d800bb70 con 0x7f31e80fbba0 2024-02-13T00:21:56.652 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.640+0000 7f31e559a700 1 -- 172.21.15.80:0/3357955219 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31d8011a90 con 0x7f31e80fbba0 2024-02-13T00:21:56.653 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.644+0000 7f31ecebf700 1 -- 172.21.15.80:0/3357955219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e80fbba0 msgr2=0x7f31e80fbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:56.653 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.644+0000 7f31ecebf700 1 --2- 172.21.15.80:0/3357955219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e80fbba0 0x7f31e80fbfc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f31d8009730 tx=0x7f31d80090f0).stop 2024-02-13T00:21:56.653 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.644+0000 7f31ecebf700 1 -- 172.21.15.80:0/3357955219 shutdown_connections 2024-02-13T00:21:56.654 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.644+0000 7f31ecebf700 1 --2- 172.21.15.80:0/3357955219 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e80fbba0 0x7f31e80fbfc0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:56.654 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.644+0000 7f31ecebf700 1 -- 172.21.15.80:0/3357955219 >> 172.21.15.80:0/3357955219 conn(0x7f31e80f5460 msgr2=0x7f31e80f78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:56.654 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.644+0000 7f31ecebf700 1 -- 172.21.15.80:0/3357955219 shutdown_connections 2024-02-13T00:21:56.654 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.644+0000 7f31ecebf700 1 -- 172.21.15.80:0/3357955219 wait complete. 2024-02-13T00:21:56.655 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.644+0000 7f31ecebf700 1 Processor -- start 2024-02-13T00:21:56.656 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.644+0000 7f31ecebf700 1 -- start start 2024-02-13T00:21:56.656 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.644+0000 7f31ecebf700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e80fbba0 0x7f31e810cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:56.656 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.644+0000 7f31ecebf700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e80fa4d0 con 0x7f31e80fbba0 2024-02-13T00:21:56.657 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.648+0000 7f31e659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e80fbba0 0x7f31e810cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:56.657 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.648+0000 7f31e659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e80fbba0 0x7f31e810cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55574/0 (socket says 172.21.15.80:55574) 2024-02-13T00:21:56.657 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.648+0000 7f31e659c700 1 -- 172.21.15.80:0/3264102297 learned_addr learned my addr 172.21.15.80:0/3264102297 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:56.657 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.648+0000 7f31e659c700 1 -- 172.21.15.80:0/3264102297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d8009370 con 0x7f31e80fbba0 2024-02-13T00:21:56.658 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.648+0000 7f31e659c700 1 --2- 172.21.15.80:0/3264102297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e80fbba0 0x7f31e810cf00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f31d80092b0 tx=0x7f31d80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:56.658 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.648+0000 7f31d77fe700 1 -- 172.21.15.80:0/3264102297 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31d801a640 con 0x7f31e80fbba0 2024-02-13T00:21:56.658 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.648+0000 7f31d77fe700 1 -- 172.21.15.80:0/3264102297 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f31d801ac30 con 0x7f31e80fbba0 2024-02-13T00:21:56.658 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.648+0000 7f31d77fe700 1 -- 172.21.15.80:0/3264102297 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31d8022900 con 0x7f31e80fbba0 2024-02-13T00:21:56.658 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.648+0000 7f31ecebf700 1 -- 172.21.15.80:0/3264102297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e80fa6d0 con 0x7f31e80fbba0 2024-02-13T00:21:56.658 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.648+0000 7f31ecebf700 1 -- 172.21.15.80:0/3264102297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e810d630 con 0x7f31e80fbba0 2024-02-13T00:21:56.659 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.648+0000 7f31d77fe700 1 -- 172.21.15.80:0/3264102297 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) v1 ==== 38617+0+0 (secure 0 0 0) 0x7f31d8022a60 con 0x7f31e80fbba0 2024-02-13T00:21:56.659 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.648+0000 7f31d77fe700 1 --2- 172.21.15.80:0/3264102297 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f31d0032630 0x7f31d0034af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:56.660 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.648+0000 7f31d77fe700 1 -- 172.21.15.80:0/3264102297 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f31d8044b80 con 0x7f31e80fbba0 2024-02-13T00:21:56.660 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.648+0000 7f31e5d9b700 1 --2- 172.21.15.80:0/3264102297 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f31d0032630 0x7f31d0034af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:56.660 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.648+0000 7f31d57fa700 1 -- 172.21.15.80:0/3264102297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31cc004f20 con 0x7f31e80fbba0 2024-02-13T00:21:56.661 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.652+0000 7f31e5d9b700 1 --2- 172.21.15.80:0/3264102297 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f31d0032630 0x7f31d0034af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f31dc009780 tx=0x7f31dc006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:56.667 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.656+0000 7f31d77fe700 1 -- 172.21.15.80:0/3264102297 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f31d8018d60 con 0x7f31e80fbba0 2024-02-13T00:21:56.999 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.988+0000 7f31d57fa700 1 -- 172.21.15.80:0/3264102297 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f31cc005750 con 0x7f31e80fbba0 2024-02-13T00:21:57.005 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.996+0000 7f31d77fe700 1 -- 172.21.15.80:0/3264102297 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f31d80320c0 con 0x7f31e80fbba0 2024-02-13T00:21:57.008 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.996+0000 7f31d57fa700 1 -- 172.21.15.80:0/3264102297 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f31d0032630 msgr2=0x7f31d0034af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:57.008 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.996+0000 7f31d57fa700 1 --2- 172.21.15.80:0/3264102297 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f31d0032630 0x7f31d0034af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f31dc009780 tx=0x7f31dc006cc0).stop 2024-02-13T00:21:57.008 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.996+0000 7f31d57fa700 1 -- 172.21.15.80:0/3264102297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e80fbba0 msgr2=0x7f31e810cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:57.008 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.996+0000 7f31d57fa700 1 --2- 172.21.15.80:0/3264102297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e80fbba0 0x7f31e810cf00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f31d80092b0 tx=0x7f31d80090f0).stop 2024-02-13T00:21:57.009 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.996+0000 7f31d57fa700 1 -- 172.21.15.80:0/3264102297 shutdown_connections 2024-02-13T00:21:57.009 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.996+0000 7f31d57fa700 1 --2- 172.21.15.80:0/3264102297 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f31d0032630 0x7f31d0034af0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:57.010 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.996+0000 7f31d57fa700 1 --2- 172.21.15.80:0/3264102297 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f31e80fbba0 0x7f31e810cf00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:57.010 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.996+0000 7f31d57fa700 1 -- 172.21.15.80:0/3264102297 >> 172.21.15.80:0/3264102297 conn(0x7f31e80f5460 msgr2=0x7f31e80f6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:57.010 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.996+0000 7f31d57fa700 1 -- 172.21.15.80:0/3264102297 shutdown_connections 2024-02-13T00:21:57.010 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:56.996+0000 7f31d57fa700 1 -- 172.21.15.80:0/3264102297 wait complete. 2024-02-13T00:21:57.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:57 smithi080 bash[17386]: cluster 2024-02-13T00:21:55.674253+0000 mgr.y (mgr.14116) 15 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:21:57.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:57 smithi080 bash[17386]: audit 2024-02-13T00:21:56.714734+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14116 172.21.15.80:0/1706535863' entity='mgr.y' 2024-02-13T00:21:57.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:57 smithi080 bash[17386]: audit 2024-02-13T00:21:56.999985+0000 mon.a (mon.0) 61 : audit [INF] from='client.? 172.21.15.80:0/3264102297' entity='client.admin' 2024-02-13T00:21:57.680 INFO:teuthology.orchestra.run.smithi080.stderr:Enabling the dashboard module... 2024-02-13T00:21:58.633 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.620+0000 7f678f5ab700 1 Processor -- start 2024-02-13T00:21:58.634 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.620+0000 7f678f5ab700 1 -- start start 2024-02-13T00:21:58.634 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.624+0000 7f678f5ab700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6788071d00 0x7f67880702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:58.635 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.624+0000 7f678f5ab700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6788072120 con 0x7f6788071d00 2024-02-13T00:21:58.635 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.624+0000 7f678d347700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6788071d00 0x7f67880702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:58.635 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.624+0000 7f678d347700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6788071d00 0x7f67880702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55588/0 (socket says 172.21.15.80:55588) 2024-02-13T00:21:58.635 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.624+0000 7f678d347700 1 -- 172.21.15.80:0/395614632 learned_addr learned my addr 172.21.15.80:0/395614632 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:58.635 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.624+0000 7f678d347700 1 -- 172.21.15.80:0/395614632 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6788070790 con 0x7f6788071d00 2024-02-13T00:21:58.636 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.624+0000 7f678d347700 1 --2- 172.21.15.80:0/395614632 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6788071d00 0x7f67880702a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f6784009730 tx=0x7f67840090f0).ready entity=mon.0 client_cookie=67a3a5ec33376cc5 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:58.636 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.624+0000 7f677ffff700 1 -- 172.21.15.80:0/395614632 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f678400b580 con 0x7f6788071d00 2024-02-13T00:21:58.636 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.624+0000 7f677ffff700 1 -- 172.21.15.80:0/395614632 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f678400bb70 con 0x7f6788071d00 2024-02-13T00:21:58.636 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.624+0000 7f677ffff700 1 -- 172.21.15.80:0/395614632 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6784011a90 con 0x7f6788071d00 2024-02-13T00:21:58.636 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.624+0000 7f678f5ab700 1 -- 172.21.15.80:0/395614632 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6788071d00 msgr2=0x7f67880702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:21:58.636 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.624+0000 7f678f5ab700 1 --2- 172.21.15.80:0/395614632 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6788071d00 0x7f67880702a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f6784009730 tx=0x7f67840090f0).stop 2024-02-13T00:21:58.637 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.624+0000 7f678f5ab700 1 -- 172.21.15.80:0/395614632 shutdown_connections 2024-02-13T00:21:58.637 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.624+0000 7f678f5ab700 1 --2- 172.21.15.80:0/395614632 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6788071d00 0x7f67880702a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:21:58.637 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.624+0000 7f678f5ab700 1 -- 172.21.15.80:0/395614632 >> 172.21.15.80:0/395614632 conn(0x7f67880f6ec0 msgr2=0x7f67880f92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:21:58.637 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.624+0000 7f678f5ab700 1 -- 172.21.15.80:0/395614632 shutdown_connections 2024-02-13T00:21:58.639 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.624+0000 7f678f5ab700 1 -- 172.21.15.80:0/395614632 wait complete. 2024-02-13T00:21:58.639 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.628+0000 7f678f5ab700 1 Processor -- start 2024-02-13T00:21:58.640 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.628+0000 7f678f5ab700 1 -- start start 2024-02-13T00:21:58.640 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.628+0000 7f678f5ab700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6788071d00 0x7f678810c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:58.640 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.628+0000 7f678f5ab700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678810c990 con 0x7f6788071d00 2024-02-13T00:21:58.640 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.628+0000 7f678d347700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6788071d00 0x7f678810c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:58.640 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.628+0000 7f678d347700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6788071d00 0x7f678810c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55594/0 (socket says 172.21.15.80:55594) 2024-02-13T00:21:58.640 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.628+0000 7f678d347700 1 -- 172.21.15.80:0/1084344998 learned_addr learned my addr 172.21.15.80:0/1084344998 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:21:58.640 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.628+0000 7f678d347700 1 -- 172.21.15.80:0/1084344998 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6784009370 con 0x7f6788071d00 2024-02-13T00:21:58.641 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.628+0000 7f678d347700 1 --2- 172.21.15.80:0/1084344998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6788071d00 0x7f678810c4a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f6784011440 tx=0x7f67840090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:58.641 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.628+0000 7f677e7fc700 1 -- 172.21.15.80:0/1084344998 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6784011cd0 con 0x7f6788071d00 2024-02-13T00:21:58.642 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.628+0000 7f678f5ab700 1 -- 172.21.15.80:0/1084344998 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678810cb90 con 0x7f6788071d00 2024-02-13T00:21:58.642 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.628+0000 7f677e7fc700 1 -- 172.21.15.80:0/1084344998 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f6784011e30 con 0x7f6788071d00 2024-02-13T00:21:58.642 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.628+0000 7f678f5ab700 1 -- 172.21.15.80:0/1084344998 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678810d020 con 0x7f6788071d00 2024-02-13T00:21:58.642 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.628+0000 7f677e7fc700 1 -- 172.21.15.80:0/1084344998 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f678401a6d0 con 0x7f6788071d00 2024-02-13T00:21:58.642 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.628+0000 7f677e7fc700 1 -- 172.21.15.80:0/1084344998 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 8) v1 ==== 38617+0+0 (secure 0 0 0) 0x7f6784012030 con 0x7f6788071d00 2024-02-13T00:21:58.642 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.632+0000 7f677e7fc700 1 --2- 172.21.15.80:0/1084344998 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f67740325e0 0x7f6774034aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:21:58.642 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.632+0000 7f677e7fc700 1 -- 172.21.15.80:0/1084344998 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f6784044af0 con 0x7f6788071d00 2024-02-13T00:21:58.642 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.632+0000 7f678f5ab700 1 -- 172.21.15.80:0/1084344998 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678805a3b0 con 0x7f6788071d00 2024-02-13T00:21:58.642 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.632+0000 7f678cb46700 1 --2- 172.21.15.80:0/1084344998 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f67740325e0 0x7f6774034aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:21:58.642 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.632+0000 7f678cb46700 1 --2- 172.21.15.80:0/1084344998 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f67740325e0 0x7f6774034aa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f6778009780 tx=0x7f6778006cb0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:21:58.648 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:58.636+0000 7f677e7fc700 1 -- 172.21.15.80:0/1084344998 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f678401e080 con 0x7f6788071d00 2024-02-13T00:21:59.063 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:21:59.052+0000 7f678f5ab700 1 -- 172.21.15.80:0/1084344998 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f6788046d80 con 0x7f6788071d00 2024-02-13T00:21:59.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:21:59 smithi080 bash[17386]: cluster 2024-02-13T00:21:57.674555+0000 mgr.y (mgr.14116) 16 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:22:00.046 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:00.036+0000 7f677e7fc700 1 -- 172.21.15.80:0/1084344998 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 9) v1 ==== 38630+0+0 (secure 0 0 0) 0x7f67840103a0 con 0x7f6788071d00 2024-02-13T00:22:00.047 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:00.036+0000 7f677e7fc700 1 -- 172.21.15.80:0/1084344998 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f6784021360 con 0x7f6788071d00 2024-02-13T00:22:00.051 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:00.040+0000 7f678f5ab700 1 -- 172.21.15.80:0/1084344998 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f67740325e0 msgr2=0x7f6774034aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:00.051 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:00.040+0000 7f678f5ab700 1 --2- 172.21.15.80:0/1084344998 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f67740325e0 0x7f6774034aa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f6778009780 tx=0x7f6778006cb0).stop 2024-02-13T00:22:00.051 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:00.040+0000 7f678f5ab700 1 -- 172.21.15.80:0/1084344998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6788071d00 msgr2=0x7f678810c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:00.052 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:00.040+0000 7f678f5ab700 1 --2- 172.21.15.80:0/1084344998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6788071d00 0x7f678810c4a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f6784011440 tx=0x7f67840090f0).stop 2024-02-13T00:22:00.052 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:00.040+0000 7f678f5ab700 1 -- 172.21.15.80:0/1084344998 shutdown_connections 2024-02-13T00:22:00.052 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:00.040+0000 7f678f5ab700 1 --2- 172.21.15.80:0/1084344998 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f67740325e0 0x7f6774034aa0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:00.052 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:00.040+0000 7f678f5ab700 1 --2- 172.21.15.80:0/1084344998 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6788071d00 0x7f678810c4a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:00.052 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:00.040+0000 7f678f5ab700 1 -- 172.21.15.80:0/1084344998 >> 172.21.15.80:0/1084344998 conn(0x7f67880f6ec0 msgr2=0x7f67880f8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:22:00.052 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:00.040+0000 7f678f5ab700 1 -- 172.21.15.80:0/1084344998 shutdown_connections 2024-02-13T00:22:00.052 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:00.040+0000 7f678f5ab700 1 -- 172.21.15.80:0/1084344998 wait complete. 2024-02-13T00:22:00.337 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:00 smithi080 bash[17386]: audit 2024-02-13T00:21:59.058525+0000 mon.a (mon.0) 62 : audit [INF] from='client.? 172.21.15.80:0/1084344998' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-13T00:22:00.337 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:00 smithi080 bash[17652]: ignoring --setuser ceph since I am not root 2024-02-13T00:22:00.337 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:00 smithi080 bash[17652]: ignoring --setgroup ceph since I am not root 2024-02-13T00:22:00.337 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:00 smithi080 bash[17652]: debug 2024-02-13T00:22:00.232+0000 7f15d5bf6680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-13T00:22:00.760 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:00 smithi080 bash[17652]: debug 2024-02-13T00:22:00.324+0000 7f15d5bf6680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-13T00:22:01.044 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:00 smithi080 bash[17652]: debug 2024-02-13T00:22:00.768+0000 7f15d5bf6680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-13T00:22:01.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:01 smithi080 bash[17386]: audit 2024-02-13T00:22:00.042116+0000 mon.a (mon.0) 63 : audit [INF] from='client.? 172.21.15.80:0/1084344998' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-13T00:22:01.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:01 smithi080 bash[17386]: cluster 2024-02-13T00:22:00.042208+0000 mon.a (mon.0) 64 : cluster [DBG] mgrmap e9: y(active, since 24s) 2024-02-13T00:22:02.010 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:01 smithi080 bash[17652]: debug 2024-02-13T00:22:01.696+0000 7f15d5bf6680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-13T00:22:02.010 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:01 smithi080 bash[17652]: debug 2024-02-13T00:22:01.788+0000 7f15d5bf6680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-13T00:22:02.450 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:02 smithi080 bash[17652]: debug 2024-02-13T00:22:02.040+0000 7f15d5bf6680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-13T00:22:02.642 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.632+0000 7ff05613f700 1 Processor -- start 2024-02-13T00:22:02.642 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.632+0000 7ff05613f700 1 -- start start 2024-02-13T00:22:02.642 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.632+0000 7ff05613f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0500fb6b0 0x7ff0500fbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:02.642 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.632+0000 7ff05613f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500fbfc0 con 0x7ff0500fb6b0 2024-02-13T00:22:02.643 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.632+0000 7ff04f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0500fb6b0 0x7ff0500fbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:02.643 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.632+0000 7ff04f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0500fb6b0 0x7ff0500fbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55184/0 (socket says 172.21.15.80:55184) 2024-02-13T00:22:02.643 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.632+0000 7ff04f7fe700 1 -- 172.21.15.80:0/1620241595 learned_addr learned my addr 172.21.15.80:0/1620241595 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:22:02.643 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.632+0000 7ff04f7fe700 1 -- 172.21.15.80:0/1620241595 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0500fc100 con 0x7ff0500fb6b0 2024-02-13T00:22:02.644 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.632+0000 7ff04f7fe700 1 --2- 172.21.15.80:0/1620241595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0500fb6b0 0x7ff0500fbad0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff040009730 tx=0x7ff0400090f0).ready entity=mon.0 client_cookie=d319abd1a85b4815 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:02.644 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.632+0000 7ff04e7fc700 1 -- 172.21.15.80:0/1620241595 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff04000b580 con 0x7ff0500fb6b0 2024-02-13T00:22:02.644 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.632+0000 7ff04e7fc700 1 -- 172.21.15.80:0/1620241595 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7ff04000bb70 con 0x7ff0500fb6b0 2024-02-13T00:22:02.644 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.632+0000 7ff04e7fc700 1 -- 172.21.15.80:0/1620241595 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff040011a90 con 0x7ff0500fb6b0 2024-02-13T00:22:02.645 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.632+0000 7ff05613f700 1 -- 172.21.15.80:0/1620241595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0500fb6b0 msgr2=0x7ff0500fbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:02.645 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.632+0000 7ff05613f700 1 --2- 172.21.15.80:0/1620241595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0500fb6b0 0x7ff0500fbad0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff040009730 tx=0x7ff0400090f0).stop 2024-02-13T00:22:02.645 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.636+0000 7ff05613f700 1 -- 172.21.15.80:0/1620241595 shutdown_connections 2024-02-13T00:22:02.645 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.636+0000 7ff05613f700 1 --2- 172.21.15.80:0/1620241595 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0500fb6b0 0x7ff0500fbad0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:02.645 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.636+0000 7ff05613f700 1 -- 172.21.15.80:0/1620241595 >> 172.21.15.80:0/1620241595 conn(0x7ff0500f6eb0 msgr2=0x7ff0500f92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:22:02.645 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.636+0000 7ff05613f700 1 -- 172.21.15.80:0/1620241595 shutdown_connections 2024-02-13T00:22:02.645 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.636+0000 7ff05613f700 1 -- 172.21.15.80:0/1620241595 wait complete. 2024-02-13T00:22:02.646 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.636+0000 7ff05613f700 1 Processor -- start 2024-02-13T00:22:02.646 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.636+0000 7ff05613f700 1 -- start start 2024-02-13T00:22:02.647 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.636+0000 7ff05613f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0500fb6b0 0x7ff050071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:02.648 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.636+0000 7ff05613f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff050070200 con 0x7ff0500fb6b0 2024-02-13T00:22:02.648 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.636+0000 7ff04f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0500fb6b0 0x7ff050071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:02.648 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.636+0000 7ff04f7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0500fb6b0 0x7ff050071d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55192/0 (socket says 172.21.15.80:55192) 2024-02-13T00:22:02.648 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.636+0000 7ff04f7fe700 1 -- 172.21.15.80:0/1815257253 learned_addr learned my addr 172.21.15.80:0/1815257253 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:22:02.648 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.636+0000 7ff04f7fe700 1 -- 172.21.15.80:0/1815257253 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff040009370 con 0x7ff0500fb6b0 2024-02-13T00:22:02.649 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.636+0000 7ff04f7fe700 1 --2- 172.21.15.80:0/1815257253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0500fb6b0 0x7ff050071d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7ff040009340 tx=0x7ff0400090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:02.649 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.636+0000 7ff04cff9700 1 -- 172.21.15.80:0/1815257253 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0400196a0 con 0x7ff0500fb6b0 2024-02-13T00:22:02.649 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.636+0000 7ff05613f700 1 -- 172.21.15.80:0/1815257253 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0500703a0 con 0x7ff0500fb6b0 2024-02-13T00:22:02.649 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.636+0000 7ff04cff9700 1 -- 172.21.15.80:0/1815257253 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7ff040019c90 con 0x7ff0500fb6b0 2024-02-13T00:22:02.649 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.636+0000 7ff04cff9700 1 -- 172.21.15.80:0/1815257253 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff04001aa70 con 0x7ff0500fb6b0 2024-02-13T00:22:02.649 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.636+0000 7ff05613f700 1 -- 172.21.15.80:0/1815257253 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff050070830 con 0x7ff0500fb6b0 2024-02-13T00:22:02.650 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.640+0000 7ff04cff9700 1 -- 172.21.15.80:0/1815257253 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 9) v1 ==== 38630+0+0 (secure 0 0 0) 0x7ff04001ac70 con 0x7ff0500fb6b0 2024-02-13T00:22:02.650 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.640+0000 7ff0367fc700 1 -- 172.21.15.80:0/1815257253 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff030004f20 con 0x7ff0500fb6b0 2024-02-13T00:22:02.650 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.640+0000 7ff04cff9700 1 --2- 172.21.15.80:0/1815257253 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7ff038032680 0x7ff038034b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:02.650 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.640+0000 7ff04effd700 1 -- 172.21.15.80:0/1815257253 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7ff038032680 msgr2=0x7ff038034b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/3429634547 2024-02-13T00:22:02.653 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.644+0000 7ff04cff9700 1 -- 172.21.15.80:0/1815257253 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7ff040045d90 con 0x7ff0500fb6b0 2024-02-13T00:22:02.653 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.644+0000 7ff04effd700 1 --2- 172.21.15.80:0/1815257253 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7ff038032680 0x7ff038034b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-02-13T00:22:02.657 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.648+0000 7ff04cff9700 1 -- 172.21.15.80:0/1815257253 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff040023cb0 con 0x7ff0500fb6b0 2024-02-13T00:22:02.857 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.848+0000 7ff04effd700 1 -- 172.21.15.80:0/1815257253 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7ff038032680 msgr2=0x7ff038034b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/3429634547 2024-02-13T00:22:02.857 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:02.848+0000 7ff04effd700 1 --2- 172.21.15.80:0/1815257253 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7ff038032680 0x7ff038034b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-02-13T00:22:03.127 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:03.116+0000 7ff0367fc700 1 -- 172.21.15.80:0/1815257253 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7ff0300059e0 con 0x7ff0500fb6b0 2024-02-13T00:22:03.127 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:03.116+0000 7ff04cff9700 1 -- 172.21.15.80:0/1815257253 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7ff04001e030 con 0x7ff0500fb6b0 2024-02-13T00:22:03.127 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: { 2024-02-13T00:22:03.127 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "epoch": 9, 2024-02-13T00:22:03.127 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "available": true, 2024-02-13T00:22:03.127 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "active_name": "y", 2024-02-13T00:22:03.127 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "num_standby": 0 2024-02-13T00:22:03.127 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: } 2024-02-13T00:22:03.130 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:03.116+0000 7ff0367fc700 1 -- 172.21.15.80:0/1815257253 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7ff038032680 msgr2=0x7ff038034b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-13T00:22:03.130 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:03.116+0000 7ff0367fc700 1 --2- 172.21.15.80:0/1815257253 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7ff038032680 0x7ff038034b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-13T00:22:03.130 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:03.120+0000 7ff0367fc700 1 -- 172.21.15.80:0/1815257253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0500fb6b0 msgr2=0x7ff050071d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:03.130 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:03.120+0000 7ff0367fc700 1 --2- 172.21.15.80:0/1815257253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0500fb6b0 0x7ff050071d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7ff040009340 tx=0x7ff0400090f0).stop 2024-02-13T00:22:03.130 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:03.120+0000 7ff0367fc700 1 -- 172.21.15.80:0/1815257253 shutdown_connections 2024-02-13T00:22:03.130 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:03.120+0000 7ff0367fc700 1 --2- 172.21.15.80:0/1815257253 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7ff038032680 0x7ff038034b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-13T00:22:03.130 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:03.120+0000 7ff0367fc700 1 --2- 172.21.15.80:0/1815257253 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff0500fb6b0 0x7ff050071d80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:03.130 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:03.120+0000 7ff0367fc700 1 -- 172.21.15.80:0/1815257253 >> 172.21.15.80:0/1815257253 conn(0x7ff0500f6eb0 msgr2=0x7ff0500f8660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:22:03.130 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:03.120+0000 7ff0367fc700 1 -- 172.21.15.80:0/1815257253 shutdown_connections 2024-02-13T00:22:03.130 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:03.120+0000 7ff0367fc700 1 -- 172.21.15.80:0/1815257253 wait complete. 2024-02-13T00:22:03.439 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:03 smithi080 bash[17386]: audit 2024-02-13T00:22:03.121666+0000 mon.a (mon.0) 65 : audit [DBG] from='client.? 172.21.15.80:0/1815257253' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-13T00:22:03.440 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:03 smithi080 bash[17652]: debug 2024-02-13T00:22:03.260+0000 7f15d5bf6680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-13T00:22:03.651 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:03 smithi080 bash[17652]: debug 2024-02-13T00:22:03.428+0000 7f15d5bf6680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-13T00:22:03.651 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:03 smithi080 bash[17652]: debug 2024-02-13T00:22:03.524+0000 7f15d5bf6680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-13T00:22:03.651 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:03 smithi080 bash[17652]: debug 2024-02-13T00:22:03.640+0000 7f15d5bf6680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-13T00:22:03.756 INFO:teuthology.orchestra.run.smithi080.stderr:Waiting for the mgr to restart... 2024-02-13T00:22:03.756 INFO:teuthology.orchestra.run.smithi080.stderr:Waiting for mgr epoch 9... 2024-02-13T00:22:04.249 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:03 smithi080 bash[17652]: debug 2024-02-13T00:22:03.856+0000 7f15d5bf6680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-13T00:22:04.510 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:04 smithi080 bash[17652]: debug 2024-02-13T00:22:04.236+0000 7f15d5bf6680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-13T00:22:04.510 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:04 smithi080 bash[17652]: debug 2024-02-13T00:22:04.360+0000 7f15d5bf6680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-13T00:22:04.919 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.908+0000 7f6b1a804700 1 Processor -- start 2024-02-13T00:22:04.920 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.908+0000 7f6b1a804700 1 -- start start 2024-02-13T00:22:04.920 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.908+0000 7f6b1a804700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b140fd8d0 0x7f6b140fdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:04.921 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.908+0000 7f6b1a804700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140fe270 con 0x7f6b140fd8d0 2024-02-13T00:22:04.921 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.908+0000 7f6b13fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b140fd8d0 0x7f6b140fdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:04.921 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.908+0000 7f6b13fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b140fd8d0 0x7f6b140fdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55194/0 (socket says 172.21.15.80:55194) 2024-02-13T00:22:04.921 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.908+0000 7f6b13fff700 1 -- 172.21.15.80:0/3979211397 learned_addr learned my addr 172.21.15.80:0/3979211397 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:22:04.922 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.908+0000 7f6b13fff700 1 -- 172.21.15.80:0/3979211397 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b140fe3b0 con 0x7f6b140fd8d0 2024-02-13T00:22:04.922 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.908+0000 7f6b13fff700 1 --2- 172.21.15.80:0/3979211397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b140fd8d0 0x7f6b140fdcf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f6b04009e40 tx=0x7f6b04009840).ready entity=mon.0 client_cookie=2acfd8e4bc13971 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:04.922 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.912+0000 7f6b12ffd700 1 -- 172.21.15.80:0/3979211397 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b0400e070 con 0x7f6b140fd8d0 2024-02-13T00:22:04.922 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.912+0000 7f6b12ffd700 1 -- 172.21.15.80:0/3979211397 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f6b04013420 con 0x7f6b140fd8d0 2024-02-13T00:22:04.922 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.912+0000 7f6b12ffd700 1 -- 172.21.15.80:0/3979211397 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b04007400 con 0x7f6b140fd8d0 2024-02-13T00:22:04.923 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.912+0000 7f6b1a804700 1 -- 172.21.15.80:0/3979211397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b140fd8d0 msgr2=0x7f6b140fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:04.923 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.912+0000 7f6b1a804700 1 --2- 172.21.15.80:0/3979211397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b140fd8d0 0x7f6b140fdcf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f6b04009e40 tx=0x7f6b04009840).stop 2024-02-13T00:22:04.924 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.912+0000 7f6b1a804700 1 -- 172.21.15.80:0/3979211397 shutdown_connections 2024-02-13T00:22:04.924 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.912+0000 7f6b1a804700 1 --2- 172.21.15.80:0/3979211397 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b140fd8d0 0x7f6b140fdcf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:04.924 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.912+0000 7f6b1a804700 1 -- 172.21.15.80:0/3979211397 >> 172.21.15.80:0/3979211397 conn(0x7f6b140710b0 msgr2=0x7f6b140714e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:22:04.924 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.912+0000 7f6b1a804700 1 -- 172.21.15.80:0/3979211397 shutdown_connections 2024-02-13T00:22:04.924 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.912+0000 7f6b1a804700 1 -- 172.21.15.80:0/3979211397 wait complete. 2024-02-13T00:22:04.924 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.912+0000 7f6b1a804700 1 Processor -- start 2024-02-13T00:22:04.924 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.912+0000 7f6b1a804700 1 -- start start 2024-02-13T00:22:04.924 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.912+0000 7f6b1a804700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b140fd8d0 0x7f6b1410c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:04.924 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.912+0000 7f6b1a804700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1410c9e0 con 0x7f6b140fd8d0 2024-02-13T00:22:04.926 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.912+0000 7f6b13fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b140fd8d0 0x7f6b1410c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:04.926 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.912+0000 7f6b13fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b140fd8d0 0x7f6b1410c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55210/0 (socket says 172.21.15.80:55210) 2024-02-13T00:22:04.926 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.912+0000 7f6b13fff700 1 -- 172.21.15.80:0/3007926086 learned_addr learned my addr 172.21.15.80:0/3007926086 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:22:04.926 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.912+0000 7f6b13fff700 1 -- 172.21.15.80:0/3007926086 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b04009a80 con 0x7f6b140fd8d0 2024-02-13T00:22:04.926 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.916+0000 7f6b13fff700 1 --2- 172.21.15.80:0/3007926086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b140fd8d0 0x7f6b1410c4f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f6b040088e0 tx=0x7f6b04009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:04.926 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.916+0000 7f6b117fa700 1 -- 172.21.15.80:0/3007926086 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b0400e040 con 0x7f6b140fd8d0 2024-02-13T00:22:04.926 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.916+0000 7f6b1a804700 1 -- 172.21.15.80:0/3007926086 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1410cbe0 con 0x7f6b140fd8d0 2024-02-13T00:22:04.926 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.916+0000 7f6b117fa700 1 -- 172.21.15.80:0/3007926086 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f6b04013590 con 0x7f6b140fd8d0 2024-02-13T00:22:04.927 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.916+0000 7f6b117fa700 1 -- 172.21.15.80:0/3007926086 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b0401c9f0 con 0x7f6b140fd8d0 2024-02-13T00:22:04.927 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.916+0000 7f6b1a804700 1 -- 172.21.15.80:0/3007926086 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1410d070 con 0x7f6b140fd8d0 2024-02-13T00:22:04.928 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.916+0000 7f6b117fa700 1 -- 172.21.15.80:0/3007926086 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 9) v1 ==== 38630+0+0 (secure 0 0 0) 0x7f6b04003040 con 0x7f6b140fd8d0 2024-02-13T00:22:04.928 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.916+0000 7f6b117fa700 1 --2- 172.21.15.80:0/3007926086 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f6b00032660 0x7f6b00034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:04.928 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.916+0000 7f6b1a804700 1 -- 172.21.15.80:0/3007926086 --> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b1405a3b0 con 0x7f6b00032660 2024-02-13T00:22:04.928 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.916+0000 7f6b117fa700 1 -- 172.21.15.80:0/3007926086 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 926+0+0 (secure 0 0 0) 0x7f6b04044ac0 con 0x7f6b140fd8d0 2024-02-13T00:22:04.928 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.916+0000 7f6b137fe700 1 -- 172.21.15.80:0/3007926086 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f6b00032660 msgr2=0x7f6b00034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/3429634547 2024-02-13T00:22:04.928 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:04.916+0000 7f6b137fe700 1 --2- 172.21.15.80:0/3007926086 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f6b00032660 0x7f6b00034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-02-13T00:22:05.129 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:05.120+0000 7f6b137fe700 1 -- 172.21.15.80:0/3007926086 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f6b00032660 msgr2=0x7f6b00034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/3429634547 2024-02-13T00:22:05.129 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:05.120+0000 7f6b137fe700 1 --2- 172.21.15.80:0/3007926086 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f6b00032660 0x7f6b00034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-02-13T00:22:05.344 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:05 smithi080 bash[17652]: debug 2024-02-13T00:22:05.228+0000 7f15d5bf6680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-13T00:22:05.533 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:05.524+0000 7f6b137fe700 1 -- 172.21.15.80:0/3007926086 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f6b00032660 msgr2=0x7f6b00034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/3429634547 2024-02-13T00:22:05.534 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:05.524+0000 7f6b137fe700 1 --2- 172.21.15.80:0/3007926086 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f6b00032660 0x7f6b00034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-02-13T00:22:05.689 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:05 smithi080 bash[17652]: debug 2024-02-13T00:22:05.332+0000 7f15d5bf6680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-13T00:22:05.690 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:05 smithi080 bash[17652]: debug 2024-02-13T00:22:05.448+0000 7f15d5bf6680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-13T00:22:05.975 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:05 smithi080 bash[17652]: debug 2024-02-13T00:22:05.680+0000 7f15d5bf6680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-13T00:22:06.260 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:05 smithi080 bash[17652]: debug 2024-02-13T00:22:05.964+0000 7f15d5bf6680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-13T00:22:06.260 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:06 smithi080 bash[17652]: debug 2024-02-13T00:22:06.124+0000 7f15d5bf6680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-13T00:22:06.337 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:06.328+0000 7f6b137fe700 1 -- 172.21.15.80:0/3007926086 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f6b00032660 msgr2=0x7f6b00034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/3429634547 2024-02-13T00:22:06.338 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:06.328+0000 7f6b137fe700 1 --2- 172.21.15.80:0/3007926086 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f6b00032660 0x7f6b00034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-02-13T00:22:06.629 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:06 smithi080 bash[17652]: debug 2024-02-13T00:22:06.296+0000 7f15d5bf6680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-13T00:22:06.630 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:06 smithi080 bash[17652]: debug 2024-02-13T00:22:06.508+0000 7f15d5bf6680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-13T00:22:06.658 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:06.644+0000 7f6b117fa700 1 -- 172.21.15.80:0/3007926086 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mgrmap(e 10) v1 ==== 38454+0+0 (secure 0 0 0) 0x7f6b04025920 con 0x7f6b140fd8d0 2024-02-13T00:22:06.659 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:06.644+0000 7f6b117fa700 1 -- 172.21.15.80:0/3007926086 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f6b00032660 msgr2=0x7f6b00034b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-13T00:22:06.659 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:06.644+0000 7f6b117fa700 1 --2- 172.21.15.80:0/3007926086 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f6b00032660 0x7f6b00034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-13T00:22:06.895 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:06 smithi080 bash[17652]: debug 2024-02-13T00:22:06.620+0000 7f15d5bf6680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-13T00:22:06.895 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:06 smithi080 bash[17386]: cluster 2024-02-13T00:22:06.647100+0000 mon.a (mon.0) 66 : cluster [INF] Active manager daemon y restarted 2024-02-13T00:22:06.895 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:06 smithi080 bash[17386]: cluster 2024-02-13T00:22:06.647562+0000 mon.a (mon.0) 67 : cluster [INF] Activating manager daemon y 2024-02-13T00:22:06.895 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:06 smithi080 bash[17386]: cluster 2024-02-13T00:22:06.651947+0000 mon.a (mon.0) 68 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-02-13T00:22:06.895 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:06 smithi080 bash[17386]: cluster 2024-02-13T00:22:06.652176+0000 mon.a (mon.0) 69 : cluster [DBG] mgrmap e10: y(active, starting, since 0.0047892s) 2024-02-13T00:22:06.895 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:06 smithi080 bash[17386]: audit 2024-02-13T00:22:06.654321+0000 mon.a (mon.0) 70 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T00:22:06.895 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:06 smithi080 bash[17386]: audit 2024-02-13T00:22:06.655119+0000 mon.a (mon.0) 71 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-13T00:22:06.895 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:06 smithi080 bash[17386]: audit 2024-02-13T00:22:06.656035+0000 mon.a (mon.0) 72 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-13T00:22:06.895 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:06 smithi080 bash[17386]: audit 2024-02-13T00:22:06.656254+0000 mon.a (mon.0) 73 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-13T00:22:06.895 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:06 smithi080 bash[17386]: audit 2024-02-13T00:22:06.656479+0000 mon.a (mon.0) 74 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-13T00:22:06.896 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:06 smithi080 bash[17386]: cluster 2024-02-13T00:22:06.683167+0000 mon.a (mon.0) 75 : cluster [INF] Manager daemon y is now available 2024-02-13T00:22:07.260 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:22:06 smithi080 bash[17652]: Warning: Permanently added '172.21.15.80' (ECDSA) to the list of known hosts. 2024-02-13T00:22:07.659 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:07.648+0000 7f6b117fa700 1 -- 172.21.15.80:0/3007926086 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 11) v1 ==== 38524+0+0 (secure 0 0 0) 0x7f6b04025400 con 0x7f6b140fd8d0 2024-02-13T00:22:07.660 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:07.648+0000 7f6b117fa700 1 --2- 172.21.15.80:0/3007926086 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f6b00035fd0 0x7f6b000383c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:07.660 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:07.648+0000 7f6b117fa700 1 -- 172.21.15.80:0/3007926086 --> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b1405a3b0 con 0x7f6b00035fd0 2024-02-13T00:22:07.661 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:07.648+0000 7f6b137fe700 1 --2- 172.21.15.80:0/3007926086 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f6b00035fd0 0x7f6b000383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:07.662 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:07.652+0000 7f6b137fe700 1 --2- 172.21.15.80:0/3007926086 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f6b00035fd0 0x7f6b000383c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f6afc003850 tx=0x7f6afc009350).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:07.663 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:07.652+0000 7f6b117fa700 1 -- 172.21.15.80:0/3007926086 <== mgr.14146 v2:172.21.15.80:6800/461193090 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7f6b1405a3b0 con 0x7f6b00035fd0 2024-02-13T00:22:07.676 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:07.664+0000 7f6b1a804700 1 -- 172.21.15.80:0/3007926086 --> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f6b14046d80 con 0x7f6b00035fd0 2024-02-13T00:22:07.676 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:07.664+0000 7f6b117fa700 1 -- 172.21.15.80:0/3007926086 <== mgr.14146 v2:172.21.15.80:6800/461193090 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f6b14046d80 con 0x7f6b00035fd0 2024-02-13T00:22:07.677 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: { 2024-02-13T00:22:07.677 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2024-02-13T00:22:07.677 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: "initialized": true 2024-02-13T00:22:07.677 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: } 2024-02-13T00:22:07.678 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:07.668+0000 7f6b1a804700 1 -- 172.21.15.80:0/3007926086 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f6b00035fd0 msgr2=0x7f6b000383c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:07.678 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:07.668+0000 7f6b1a804700 1 --2- 172.21.15.80:0/3007926086 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f6b00035fd0 0x7f6b000383c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f6afc003850 tx=0x7f6afc009350).stop 2024-02-13T00:22:07.678 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:07.668+0000 7f6b1a804700 1 -- 172.21.15.80:0/3007926086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b140fd8d0 msgr2=0x7f6b1410c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:07.678 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:07.668+0000 7f6b1a804700 1 --2- 172.21.15.80:0/3007926086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b140fd8d0 0x7f6b1410c4f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f6b040088e0 tx=0x7f6b04009840).stop 2024-02-13T00:22:07.679 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:07.668+0000 7f6b1a804700 1 -- 172.21.15.80:0/3007926086 shutdown_connections 2024-02-13T00:22:07.679 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:07.668+0000 7f6b1a804700 1 --2- 172.21.15.80:0/3007926086 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f6b00035fd0 0x7f6b000383c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:07.679 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:07.668+0000 7f6b1a804700 1 --2- 172.21.15.80:0/3007926086 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6b140fd8d0 0x7f6b1410c4f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:07.679 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:07.668+0000 7f6b1a804700 1 --2- 172.21.15.80:0/3007926086 >> [v2:172.21.15.80:6800/3429634547,v1:172.21.15.80:6801/3429634547] conn(0x7f6b00032660 0x7f6b00034b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-13T00:22:07.679 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:07.668+0000 7f6b1a804700 1 -- 172.21.15.80:0/3007926086 >> 172.21.15.80:0/3007926086 conn(0x7f6b140710b0 msgr2=0x7f6b140fc230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:22:07.680 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:07.668+0000 7f6b1a804700 1 -- 172.21.15.80:0/3007926086 shutdown_connections 2024-02-13T00:22:07.680 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:07.668+0000 7f6b1a804700 1 -- 172.21.15.80:0/3007926086 wait complete. 2024-02-13T00:22:08.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:07 smithi080 bash[17386]: audit 2024-02-13T00:22:06.820774+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:22:08.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:07 smithi080 bash[17386]: audit 2024-02-13T00:22:06.826631+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:22:08.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:07 smithi080 bash[17386]: audit 2024-02-13T00:22:06.869001+0000 mon.a (mon.0) 78 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-13T00:22:08.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:07 smithi080 bash[17386]: audit 2024-02-13T00:22:06.874144+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-13T00:22:08.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:07 smithi080 bash[17386]: cluster 2024-02-13T00:22:07.659213+0000 mon.a (mon.0) 80 : cluster [DBG] mgrmap e11: y(active, since 1.01182s) 2024-02-13T00:22:08.429 INFO:teuthology.orchestra.run.smithi080.stderr:mgr epoch 9 is available 2024-02-13T00:22:08.429 INFO:teuthology.orchestra.run.smithi080.stderr:Generating a dashboard self-signed certificate... 2024-02-13T00:22:08.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:08 smithi080 bash[17386]: audit 2024-02-13T00:22:07.657659+0000 mgr.y (mgr.14146) 1 : audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-13T00:22:08.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:08 smithi080 bash[17386]: audit 2024-02-13T00:22:07.671858+0000 mgr.y (mgr.14146) 2 : audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-13T00:22:09.429 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.416+0000 7fea0a8d0700 1 Processor -- start 2024-02-13T00:22:09.429 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.416+0000 7fea0a8d0700 1 -- start start 2024-02-13T00:22:09.430 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.416+0000 7fea0a8d0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea040fa5e0 0x7fea040faa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:09.430 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.416+0000 7fea0a8d0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea040faf80 con 0x7fea040fa5e0 2024-02-13T00:22:09.430 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.420+0000 7fea03fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea040fa5e0 0x7fea040faa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:09.430 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.420+0000 7fea03fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea040fa5e0 0x7fea040faa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42754/0 (socket says 172.21.15.80:42754) 2024-02-13T00:22:09.431 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.420+0000 7fea03fff700 1 -- 172.21.15.80:0/1362581196 learned_addr learned my addr 172.21.15.80:0/1362581196 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:22:09.431 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.420+0000 7fea03fff700 1 -- 172.21.15.80:0/1362581196 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea040fb0c0 con 0x7fea040fa5e0 2024-02-13T00:22:09.431 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.420+0000 7fea03fff700 1 --2- 172.21.15.80:0/1362581196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea040fa5e0 0x7fea040faa00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fe9f4009720 tx=0x7fe9f40090f0).ready entity=mon.0 client_cookie=be5ca460eee7f77e server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:09.431 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.420+0000 7fea037fe700 1 -- 172.21.15.80:0/1362581196 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9f400b520 con 0x7fea040fa5e0 2024-02-13T00:22:09.431 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.420+0000 7fea037fe700 1 -- 172.21.15.80:0/1362581196 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fe9f400bb10 con 0x7fea040fa5e0 2024-02-13T00:22:09.431 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.420+0000 7fea037fe700 1 -- 172.21.15.80:0/1362581196 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9f40119f0 con 0x7fea040fa5e0 2024-02-13T00:22:09.432 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.420+0000 7fea0a8d0700 1 -- 172.21.15.80:0/1362581196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea040fa5e0 msgr2=0x7fea040faa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:09.432 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.420+0000 7fea0a8d0700 1 --2- 172.21.15.80:0/1362581196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea040fa5e0 0x7fea040faa00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fe9f4009720 tx=0x7fe9f40090f0).stop 2024-02-13T00:22:09.432 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.420+0000 7fea0a8d0700 1 -- 172.21.15.80:0/1362581196 shutdown_connections 2024-02-13T00:22:09.432 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.420+0000 7fea0a8d0700 1 --2- 172.21.15.80:0/1362581196 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea040fa5e0 0x7fea040faa00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:09.432 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.420+0000 7fea0a8d0700 1 -- 172.21.15.80:0/1362581196 >> 172.21.15.80:0/1362581196 conn(0x7fea040f5ce0 msgr2=0x7fea040f8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:22:09.432 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.420+0000 7fea0a8d0700 1 -- 172.21.15.80:0/1362581196 shutdown_connections 2024-02-13T00:22:09.432 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.420+0000 7fea0a8d0700 1 -- 172.21.15.80:0/1362581196 wait complete. 2024-02-13T00:22:09.433 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.420+0000 7fea0a8d0700 1 Processor -- start 2024-02-13T00:22:09.434 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.420+0000 7fea0a8d0700 1 -- start start 2024-02-13T00:22:09.434 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.424+0000 7fea0a8d0700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea040fa5e0 0x7fea04108070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:09.434 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.424+0000 7fea0a8d0700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea04108560 con 0x7fea040fa5e0 2024-02-13T00:22:09.434 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.424+0000 7fea03fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea040fa5e0 0x7fea04108070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:09.434 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.424+0000 7fea03fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea040fa5e0 0x7fea04108070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42756/0 (socket says 172.21.15.80:42756) 2024-02-13T00:22:09.434 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.424+0000 7fea03fff700 1 -- 172.21.15.80:0/3898360330 learned_addr learned my addr 172.21.15.80:0/3898360330 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:22:09.435 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.424+0000 7fea03fff700 1 -- 172.21.15.80:0/3898360330 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f4009310 con 0x7fea040fa5e0 2024-02-13T00:22:09.435 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.424+0000 7fea03fff700 1 --2- 172.21.15.80:0/3898360330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea040fa5e0 0x7fea04108070 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fe9f400bad0 tx=0x7fe9f40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:09.435 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.424+0000 7fea01ffb700 1 -- 172.21.15.80:0/3898360330 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9f4012e40 con 0x7fea040fa5e0 2024-02-13T00:22:09.435 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.424+0000 7fea01ffb700 1 -- 172.21.15.80:0/3898360330 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fe9f401aad0 con 0x7fea040fa5e0 2024-02-13T00:22:09.436 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.424+0000 7fea0a8d0700 1 -- 172.21.15.80:0/3898360330 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea04108760 con 0x7fea040fa5e0 2024-02-13T00:22:09.436 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.424+0000 7fea01ffb700 1 -- 172.21.15.80:0/3898360330 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9f4022ab0 con 0x7fea040fa5e0 2024-02-13T00:22:09.436 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.424+0000 7fea0a8d0700 1 -- 172.21.15.80:0/3898360330 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea04108bf0 con 0x7fea040fa5e0 2024-02-13T00:22:09.436 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.424+0000 7fea01ffb700 1 -- 172.21.15.80:0/3898360330 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 12) v1 ==== 38630+0+0 (secure 0 0 0) 0x7fe9f4022c10 con 0x7fea040fa5e0 2024-02-13T00:22:09.436 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.424+0000 7fea01ffb700 1 --2- 172.21.15.80:0/3898360330 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fe9f00348d0 0x7fe9f0036d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:09.436 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.424+0000 7fea01ffb700 1 -- 172.21.15.80:0/3898360330 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7fe9f4044ac0 con 0x7fea040fa5e0 2024-02-13T00:22:09.436 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.424+0000 7fe9fb7fe700 1 --2- 172.21.15.80:0/3898360330 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fe9f00348d0 0x7fe9f0036d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:09.436 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.424+0000 7fea0a8d0700 1 -- 172.21.15.80:0/3898360330 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea0405a3b0 con 0x7fea040fa5e0 2024-02-13T00:22:09.437 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.424+0000 7fe9fb7fe700 1 --2- 172.21.15.80:0/3898360330 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fe9f00348d0 0x7fe9f0036d90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fe9ec009780 tx=0x7fe9ec006cc0).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:09.442 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.432+0000 7fea01ffb700 1 -- 172.21.15.80:0/3898360330 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe9f401e020 con 0x7fea040fa5e0 2024-02-13T00:22:09.780 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.768+0000 7fea0a8d0700 1 -- 172.21.15.80:0/3898360330 --> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fea041094a0 con 0x7fe9f00348d0 2024-02-13T00:22:09.890 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.880+0000 7fea01ffb700 1 -- 172.21.15.80:0/3898360330 <== mgr.14146 v2:172.21.15.80:6800/461193090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fea041094a0 con 0x7fe9f00348d0 2024-02-13T00:22:09.891 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: Self-signed certificate created 2024-02-13T00:22:09.894 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.884+0000 7fea0a8d0700 1 -- 172.21.15.80:0/3898360330 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fe9f00348d0 msgr2=0x7fe9f0036d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:09.894 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.884+0000 7fea0a8d0700 1 --2- 172.21.15.80:0/3898360330 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fe9f00348d0 0x7fe9f0036d90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fe9ec009780 tx=0x7fe9ec006cc0).stop 2024-02-13T00:22:09.895 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.884+0000 7fea0a8d0700 1 -- 172.21.15.80:0/3898360330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea040fa5e0 msgr2=0x7fea04108070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:09.895 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.884+0000 7fea0a8d0700 1 --2- 172.21.15.80:0/3898360330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea040fa5e0 0x7fea04108070 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fe9f400bad0 tx=0x7fe9f40090f0).stop 2024-02-13T00:22:09.895 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.884+0000 7fea0a8d0700 1 -- 172.21.15.80:0/3898360330 shutdown_connections 2024-02-13T00:22:09.896 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.884+0000 7fea0a8d0700 1 --2- 172.21.15.80:0/3898360330 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fe9f00348d0 0x7fe9f0036d90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:09.896 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.884+0000 7fea0a8d0700 1 --2- 172.21.15.80:0/3898360330 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fea040fa5e0 0x7fea04108070 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:09.896 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.884+0000 7fea0a8d0700 1 -- 172.21.15.80:0/3898360330 >> 172.21.15.80:0/3898360330 conn(0x7fea040f5ce0 msgr2=0x7fea040ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:22:09.896 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.884+0000 7fea0a8d0700 1 -- 172.21.15.80:0/3898360330 shutdown_connections 2024-02-13T00:22:09.896 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:09.884+0000 7fea0a8d0700 1 -- 172.21.15.80:0/3898360330 wait complete. 2024-02-13T00:22:09.971 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:09 smithi080 bash[17386]: cluster 2024-02-13T00:22:08.710936+0000 mon.a (mon.0) 81 : cluster [DBG] mgrmap e12: y(active, since 2s) 2024-02-13T00:22:10.634 INFO:teuthology.orchestra.run.smithi080.stderr:Creating initial admin user... 2024-02-13T00:22:11.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:10 smithi080 bash[17386]: audit 2024-02-13T00:22:09.775734+0000 mgr.y (mgr.14146) 3 : audit [DBG] from='client.14156 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:22:11.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:10 smithi080 bash[17386]: audit 2024-02-13T00:22:09.879288+0000 mon.a (mon.0) 82 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:22:11.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:10 smithi080 bash[17386]: audit 2024-02-13T00:22:09.884834+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:22:11.613 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.600+0000 7fd223ab6700 1 Processor -- start 2024-02-13T00:22:11.613 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.600+0000 7fd223ab6700 1 -- start start 2024-02-13T00:22:11.613 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.600+0000 7fd223ab6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd21c0fb6c0 0x7fd21c0fbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:11.614 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.600+0000 7fd223ab6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c0fbfd0 con 0x7fd21c0fb6c0 2024-02-13T00:22:11.614 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.600+0000 7fd221852700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd21c0fb6c0 0x7fd21c0fbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:11.614 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.600+0000 7fd221852700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd21c0fb6c0 0x7fd21c0fbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42772/0 (socket says 172.21.15.80:42772) 2024-02-13T00:22:11.614 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.600+0000 7fd221852700 1 -- 172.21.15.80:0/1065096469 learned_addr learned my addr 172.21.15.80:0/1065096469 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:22:11.615 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.604+0000 7fd221852700 1 -- 172.21.15.80:0/1065096469 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c0fc110 con 0x7fd21c0fb6c0 2024-02-13T00:22:11.615 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.604+0000 7fd221852700 1 --2- 172.21.15.80:0/1065096469 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd21c0fb6c0 0x7fd21c0fbae0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fd218009e50 tx=0x7fd218009840).ready entity=mon.0 client_cookie=a35e4802f81d0ea2 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:11.615 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.604+0000 7fd220850700 1 -- 172.21.15.80:0/1065096469 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd21800e070 con 0x7fd21c0fb6c0 2024-02-13T00:22:11.615 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.604+0000 7fd220850700 1 -- 172.21.15.80:0/1065096469 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fd218013420 con 0x7fd21c0fb6c0 2024-02-13T00:22:11.615 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.604+0000 7fd220850700 1 -- 172.21.15.80:0/1065096469 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd218007400 con 0x7fd21c0fb6c0 2024-02-13T00:22:11.616 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.604+0000 7fd223ab6700 1 -- 172.21.15.80:0/1065096469 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd21c0fb6c0 msgr2=0x7fd21c0fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:11.616 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.604+0000 7fd223ab6700 1 --2- 172.21.15.80:0/1065096469 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd21c0fb6c0 0x7fd21c0fbae0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fd218009e50 tx=0x7fd218009840).stop 2024-02-13T00:22:11.616 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.604+0000 7fd223ab6700 1 -- 172.21.15.80:0/1065096469 shutdown_connections 2024-02-13T00:22:11.616 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.604+0000 7fd223ab6700 1 --2- 172.21.15.80:0/1065096469 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd21c0fb6c0 0x7fd21c0fbae0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:11.616 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.604+0000 7fd223ab6700 1 -- 172.21.15.80:0/1065096469 >> 172.21.15.80:0/1065096469 conn(0x7fd21c0f6ec0 msgr2=0x7fd21c0f92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:22:11.616 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.604+0000 7fd223ab6700 1 -- 172.21.15.80:0/1065096469 shutdown_connections 2024-02-13T00:22:11.616 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.604+0000 7fd223ab6700 1 -- 172.21.15.80:0/1065096469 wait complete. 2024-02-13T00:22:11.617 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.608+0000 7fd223ab6700 1 Processor -- start 2024-02-13T00:22:11.617 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.608+0000 7fd223ab6700 1 -- start start 2024-02-13T00:22:11.617 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.608+0000 7fd223ab6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd21c0fb6c0 0x7fd21c10a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:11.617 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.608+0000 7fd223ab6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c10a7d0 con 0x7fd21c0fb6c0 2024-02-13T00:22:11.618 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.608+0000 7fd221852700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd21c0fb6c0 0x7fd21c10a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:11.618 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.608+0000 7fd221852700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd21c0fb6c0 0x7fd21c10a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42774/0 (socket says 172.21.15.80:42774) 2024-02-13T00:22:11.618 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.608+0000 7fd221852700 1 -- 172.21.15.80:0/630194952 learned_addr learned my addr 172.21.15.80:0/630194952 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:22:11.618 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.608+0000 7fd221852700 1 -- 172.21.15.80:0/630194952 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd218009ae0 con 0x7fd21c0fb6c0 2024-02-13T00:22:11.619 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.608+0000 7fd221852700 1 --2- 172.21.15.80:0/630194952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd21c0fb6c0 0x7fd21c10a2e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fd2180072f0 tx=0x7fd218009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:11.619 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.608+0000 7fd212f78700 1 -- 172.21.15.80:0/630194952 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd21800e040 con 0x7fd21c0fb6c0 2024-02-13T00:22:11.619 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.608+0000 7fd212f78700 1 -- 172.21.15.80:0/630194952 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fd2180129a0 con 0x7fd21c0fb6c0 2024-02-13T00:22:11.619 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.608+0000 7fd223ab6700 1 -- 172.21.15.80:0/630194952 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21c10a9d0 con 0x7fd21c0fb6c0 2024-02-13T00:22:11.620 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.608+0000 7fd212f78700 1 -- 172.21.15.80:0/630194952 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2180077b0 con 0x7fd21c0fb6c0 2024-02-13T00:22:11.620 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.608+0000 7fd223ab6700 1 -- 172.21.15.80:0/630194952 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21c10ae60 con 0x7fd21c0fb6c0 2024-02-13T00:22:11.621 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.612+0000 7fd223ab6700 1 -- 172.21.15.80:0/630194952 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21c05a3b0 con 0x7fd21c0fb6c0 2024-02-13T00:22:11.622 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.612+0000 7fd212f78700 1 -- 172.21.15.80:0/630194952 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 12) v1 ==== 38630+0+0 (secure 0 0 0) 0x7fd218003040 con 0x7fd21c0fb6c0 2024-02-13T00:22:11.622 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.612+0000 7fd212f78700 1 --2- 172.21.15.80:0/630194952 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fd208032680 0x7fd208034b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:11.622 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.612+0000 7fd212f78700 1 -- 172.21.15.80:0/630194952 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7fd218044910 con 0x7fd21c0fb6c0 2024-02-13T00:22:11.622 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.612+0000 7fd221051700 1 --2- 172.21.15.80:0/630194952 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fd208032680 0x7fd208034b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:11.623 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.612+0000 7fd221051700 1 --2- 172.21.15.80:0/630194952 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fd208032680 0x7fd208034b40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fd20c009780 tx=0x7fd20c006cb0).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:11.630 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.620+0000 7fd212f78700 1 -- 172.21.15.80:0/630194952 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd2180117e0 con 0x7fd21c0fb6c0 2024-02-13T00:22:11.989 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:11.976+0000 7fd223ab6700 1 -- 172.21.15.80:0/630194952 --> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fd21c05a1d0 con 0x7fd208032680 2024-02-13T00:22:12.232 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:12.220+0000 7fd212f78700 1 -- 172.21.15.80:0/630194952 <== mgr.14146 v2:172.21.15.80:6800/461193090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fd21c05a1d0 con 0x7fd208032680 2024-02-13T00:22:12.232 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$yxVvBrf2A6fAJW.SUrGTXOdcqh797t2nuv2eVkPM1bXnnqrE0uwYC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1707783732, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-13T00:22:12.236 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:12.224+0000 7fd223ab6700 1 -- 172.21.15.80:0/630194952 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fd208032680 msgr2=0x7fd208034b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:12.236 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:12.224+0000 7fd223ab6700 1 --2- 172.21.15.80:0/630194952 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fd208032680 0x7fd208034b40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fd20c009780 tx=0x7fd20c006cb0).stop 2024-02-13T00:22:12.236 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:12.224+0000 7fd223ab6700 1 -- 172.21.15.80:0/630194952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd21c0fb6c0 msgr2=0x7fd21c10a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:12.237 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:12.224+0000 7fd223ab6700 1 --2- 172.21.15.80:0/630194952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd21c0fb6c0 0x7fd21c10a2e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fd2180072f0 tx=0x7fd218009840).stop 2024-02-13T00:22:12.237 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:12.224+0000 7fd223ab6700 1 -- 172.21.15.80:0/630194952 shutdown_connections 2024-02-13T00:22:12.237 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:12.224+0000 7fd223ab6700 1 --2- 172.21.15.80:0/630194952 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fd208032680 0x7fd208034b40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:12.237 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:12.224+0000 7fd223ab6700 1 --2- 172.21.15.80:0/630194952 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd21c0fb6c0 0x7fd21c10a2e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:12.237 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:12.224+0000 7fd223ab6700 1 -- 172.21.15.80:0/630194952 >> 172.21.15.80:0/630194952 conn(0x7fd21c0f6ec0 msgr2=0x7fd21c0f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:22:12.237 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:12.224+0000 7fd223ab6700 1 -- 172.21.15.80:0/630194952 shutdown_connections 2024-02-13T00:22:12.237 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:12.224+0000 7fd223ab6700 1 -- 172.21.15.80:0/630194952 wait complete. 2024-02-13T00:22:12.498 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:12 smithi080 bash[17386]: audit 2024-02-13T00:22:11.985389+0000 mgr.y (mgr.14146) 4 : audit [DBG] from='client.14158 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:22:13.007 INFO:teuthology.orchestra.run.smithi080.stderr:Fetching dashboard port number... 2024-02-13T00:22:13.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:13 smithi080 bash[17386]: audit 2024-02-13T00:22:12.226563+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:22:13.980 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.964+0000 7f469283d700 1 Processor -- start 2024-02-13T00:22:13.980 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.964+0000 7f469283d700 1 -- start start 2024-02-13T00:22:13.980 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.968+0000 7f469283d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f468c0fa5e0 0x7f468c0faa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:13.980 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.968+0000 7f469283d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c0faf80 con 0x7f468c0fa5e0 2024-02-13T00:22:13.980 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.968+0000 7f468bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f468c0fa5e0 0x7f468c0faa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:13.980 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.968+0000 7f468bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f468c0fa5e0 0x7f468c0faa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42778/0 (socket says 172.21.15.80:42778) 2024-02-13T00:22:13.980 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.968+0000 7f468bfff700 1 -- 172.21.15.80:0/3561105664 learned_addr learned my addr 172.21.15.80:0/3561105664 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:22:13.980 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.968+0000 7f468bfff700 1 -- 172.21.15.80:0/3561105664 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c0fb0c0 con 0x7f468c0fa5e0 2024-02-13T00:22:13.981 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.968+0000 7f468bfff700 1 --2- 172.21.15.80:0/3561105664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f468c0fa5e0 0x7f468c0faa00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f467c009730 tx=0x7f467c0090f0).ready entity=mon.0 client_cookie=c9f18a53799e1645 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:13.981 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.968+0000 7f468affd700 1 -- 172.21.15.80:0/3561105664 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f467c00b580 con 0x7f468c0fa5e0 2024-02-13T00:22:13.981 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.968+0000 7f468affd700 1 -- 172.21.15.80:0/3561105664 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f467c00bb70 con 0x7f468c0fa5e0 2024-02-13T00:22:13.982 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.968+0000 7f468affd700 1 -- 172.21.15.80:0/3561105664 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f467c011a90 con 0x7f468c0fa5e0 2024-02-13T00:22:13.982 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.968+0000 7f469283d700 1 -- 172.21.15.80:0/3561105664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f468c0fa5e0 msgr2=0x7f468c0faa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:13.982 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.968+0000 7f469283d700 1 --2- 172.21.15.80:0/3561105664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f468c0fa5e0 0x7f468c0faa00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f467c009730 tx=0x7f467c0090f0).stop 2024-02-13T00:22:13.982 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.968+0000 7f469283d700 1 -- 172.21.15.80:0/3561105664 shutdown_connections 2024-02-13T00:22:13.982 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.968+0000 7f469283d700 1 --2- 172.21.15.80:0/3561105664 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f468c0fa5e0 0x7f468c0faa00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:13.982 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.968+0000 7f469283d700 1 -- 172.21.15.80:0/3561105664 >> 172.21.15.80:0/3561105664 conn(0x7f468c0f5d00 msgr2=0x7f468c0f8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:22:13.982 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.968+0000 7f469283d700 1 -- 172.21.15.80:0/3561105664 shutdown_connections 2024-02-13T00:22:13.982 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.968+0000 7f469283d700 1 -- 172.21.15.80:0/3561105664 wait complete. 2024-02-13T00:22:13.983 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.972+0000 7f469283d700 1 Processor -- start 2024-02-13T00:22:13.984 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.972+0000 7f469283d700 1 -- start start 2024-02-13T00:22:13.984 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.972+0000 7f469283d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f468c0fa5e0 0x7f468c10cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:13.984 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.972+0000 7f469283d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c06fc60 con 0x7f468c0fa5e0 2024-02-13T00:22:13.985 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.972+0000 7f468bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f468c0fa5e0 0x7f468c10cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:13.985 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.972+0000 7f468bfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f468c0fa5e0 0x7f468c10cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42794/0 (socket says 172.21.15.80:42794) 2024-02-13T00:22:13.985 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.972+0000 7f468bfff700 1 -- 172.21.15.80:0/656312224 learned_addr learned my addr 172.21.15.80:0/656312224 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:22:13.985 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.972+0000 7f468bfff700 1 -- 172.21.15.80:0/656312224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c009370 con 0x7f468c0fa5e0 2024-02-13T00:22:13.986 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.972+0000 7f468bfff700 1 --2- 172.21.15.80:0/656312224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f468c0fa5e0 0x7f468c10cf80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f467c011440 tx=0x7f467c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:13.986 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.972+0000 7f46897fa700 1 -- 172.21.15.80:0/656312224 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f467c011cd0 con 0x7f468c0fa5e0 2024-02-13T00:22:13.986 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.972+0000 7f46897fa700 1 -- 172.21.15.80:0/656312224 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f467c011e30 con 0x7f468c0fa5e0 2024-02-13T00:22:13.987 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.972+0000 7f46897fa700 1 -- 172.21.15.80:0/656312224 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f467c01a6d0 con 0x7f468c0fa5e0 2024-02-13T00:22:13.988 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.972+0000 7f469283d700 1 -- 172.21.15.80:0/656312224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468c06fe60 con 0x7f468c0fa5e0 2024-02-13T00:22:13.988 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.972+0000 7f469283d700 1 -- 172.21.15.80:0/656312224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f468c10d630 con 0x7f468c0fa5e0 2024-02-13T00:22:13.988 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.976+0000 7f46897fa700 1 -- 172.21.15.80:0/656312224 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 38673+0+0 (secure 0 0 0) 0x7f467c012030 con 0x7f468c0fa5e0 2024-02-13T00:22:13.988 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.976+0000 7f469283d700 1 -- 172.21.15.80:0/656312224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f468c05a3b0 con 0x7f468c0fa5e0 2024-02-13T00:22:13.988 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.976+0000 7f46897fa700 1 --2- 172.21.15.80:0/656312224 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f46740326d0 0x7f4674034b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:13.988 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.976+0000 7f46897fa700 1 -- 172.21.15.80:0/656312224 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f467c044ce0 con 0x7f468c0fa5e0 2024-02-13T00:22:13.988 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.976+0000 7f468b7fe700 1 --2- 172.21.15.80:0/656312224 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f46740326d0 0x7f4674034b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:13.989 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.976+0000 7f468b7fe700 1 --2- 172.21.15.80:0/656312224 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f46740326d0 0x7f4674034b90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f4680009780 tx=0x7f4680006cc0).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:13.993 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:13.984+0000 7f46897fa700 1 -- 172.21.15.80:0/656312224 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f467c0103a0 con 0x7f468c0fa5e0 2024-02-13T00:22:14.324 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:14.312+0000 7f469283d700 1 -- 172.21.15.80:0/656312224 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f468c0fc490 con 0x7f468c0fa5e0 2024-02-13T00:22:14.324 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:14.312+0000 7f46897fa700 1 -- 172.21.15.80:0/656312224 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f467c01e070 con 0x7f468c0fa5e0 2024-02-13T00:22:14.324 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 8443 2024-02-13T00:22:14.328 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:14.316+0000 7f469283d700 1 -- 172.21.15.80:0/656312224 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f46740326d0 msgr2=0x7f4674034b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:14.328 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:14.316+0000 7f469283d700 1 --2- 172.21.15.80:0/656312224 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f46740326d0 0x7f4674034b90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f4680009780 tx=0x7f4680006cc0).stop 2024-02-13T00:22:14.328 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:14.316+0000 7f469283d700 1 -- 172.21.15.80:0/656312224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f468c0fa5e0 msgr2=0x7f468c10cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:14.328 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:14.316+0000 7f469283d700 1 --2- 172.21.15.80:0/656312224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f468c0fa5e0 0x7f468c10cf80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f467c011440 tx=0x7f467c0090f0).stop 2024-02-13T00:22:14.328 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:14.316+0000 7f469283d700 1 -- 172.21.15.80:0/656312224 shutdown_connections 2024-02-13T00:22:14.329 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:14.316+0000 7f469283d700 1 --2- 172.21.15.80:0/656312224 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f46740326d0 0x7f4674034b90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:14.329 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:14.316+0000 7f469283d700 1 --2- 172.21.15.80:0/656312224 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f468c0fa5e0 0x7f468c10cf80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:14.329 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:14.316+0000 7f469283d700 1 -- 172.21.15.80:0/656312224 >> 172.21.15.80:0/656312224 conn(0x7f468c0f5d00 msgr2=0x7f468c0f75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:22:14.329 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:14.316+0000 7f469283d700 1 -- 172.21.15.80:0/656312224 shutdown_connections 2024-02-13T00:22:14.329 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:14.316+0000 7f469283d700 1 -- 172.21.15.80:0/656312224 wait complete. 2024-02-13T00:22:14.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:14 smithi080 bash[17386]: cluster 2024-02-13T00:22:13.230604+0000 mon.a (mon.0) 85 : cluster [DBG] mgrmap e13: y(active, since 6s) 2024-02-13T00:22:14.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:14 smithi080 bash[17386]: audit 2024-02-13T00:22:13.734407+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:22:15.062 INFO:teuthology.orchestra.run.smithi080.stderr:firewalld does not appear to be present 2024-02-13T00:22:15.063 INFO:teuthology.orchestra.run.smithi080.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2024-02-13T00:22:15.064 INFO:teuthology.orchestra.run.smithi080.stderr:Ceph Dashboard is now available at: 2024-02-13T00:22:15.065 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-13T00:22:15.065 INFO:teuthology.orchestra.run.smithi080.stderr: URL: https://smithi080.front.sepia.ceph.com:8443/ 2024-02-13T00:22:15.065 INFO:teuthology.orchestra.run.smithi080.stderr: User: admin 2024-02-13T00:22:15.065 INFO:teuthology.orchestra.run.smithi080.stderr: Password: d8rsfhqkq6 2024-02-13T00:22:15.065 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-13T00:22:15.065 INFO:teuthology.orchestra.run.smithi080.stderr:Enabling autotune for osd_memory_target 2024-02-13T00:22:15.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:15 smithi080 bash[17386]: audit 2024-02-13T00:22:14.319361+0000 mon.a (mon.0) 87 : audit [DBG] from='client.? 172.21.15.80:0/656312224' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-13T00:22:16.071 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.060+0000 7fc2abce5700 1 Processor -- start 2024-02-13T00:22:16.071 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.060+0000 7fc2abce5700 1 -- start start 2024-02-13T00:22:16.071 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.060+0000 7fc2abce5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2a4071ca0 0x7fc2a4070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:16.071 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.060+0000 7fc2abce5700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a40720c0 con 0x7fc2a4071ca0 2024-02-13T00:22:16.071 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.060+0000 7fc2a9a81700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2a4071ca0 0x7fc2a4070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:16.071 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.060+0000 7fc2a9a81700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2a4071ca0 0x7fc2a4070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42796/0 (socket says 172.21.15.80:42796) 2024-02-13T00:22:16.071 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.060+0000 7fc2a9a81700 1 -- 172.21.15.80:0/2101962312 learned_addr learned my addr 172.21.15.80:0/2101962312 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:22:16.071 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.060+0000 7fc2a9a81700 1 -- 172.21.15.80:0/2101962312 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a4070730 con 0x7fc2a4071ca0 2024-02-13T00:22:16.072 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.060+0000 7fc2a9a81700 1 --2- 172.21.15.80:0/2101962312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2a4071ca0 0x7fc2a4070240 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fc2a0009730 tx=0x7fc2a00090f0).ready entity=mon.0 client_cookie=ad54349331412a79 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:16.072 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.060+0000 7fc2a8a7f700 1 -- 172.21.15.80:0/2101962312 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2a000b580 con 0x7fc2a4071ca0 2024-02-13T00:22:16.072 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.060+0000 7fc2a8a7f700 1 -- 172.21.15.80:0/2101962312 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fc2a000bb70 con 0x7fc2a4071ca0 2024-02-13T00:22:16.072 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.060+0000 7fc2a8a7f700 1 -- 172.21.15.80:0/2101962312 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2a0011a90 con 0x7fc2a4071ca0 2024-02-13T00:22:16.073 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.060+0000 7fc2abce5700 1 -- 172.21.15.80:0/2101962312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2a4071ca0 msgr2=0x7fc2a4070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:16.073 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.060+0000 7fc2abce5700 1 --2- 172.21.15.80:0/2101962312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2a4071ca0 0x7fc2a4070240 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fc2a0009730 tx=0x7fc2a00090f0).stop 2024-02-13T00:22:16.073 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.060+0000 7fc2abce5700 1 -- 172.21.15.80:0/2101962312 shutdown_connections 2024-02-13T00:22:16.073 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.060+0000 7fc2abce5700 1 --2- 172.21.15.80:0/2101962312 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2a4071ca0 0x7fc2a4070240 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:16.073 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.060+0000 7fc2abce5700 1 -- 172.21.15.80:0/2101962312 >> 172.21.15.80:0/2101962312 conn(0x7fc2a40f6ec0 msgr2=0x7fc2a40f92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:22:16.074 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.060+0000 7fc2abce5700 1 -- 172.21.15.80:0/2101962312 shutdown_connections 2024-02-13T00:22:16.074 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.064+0000 7fc2abce5700 1 -- 172.21.15.80:0/2101962312 wait complete. 2024-02-13T00:22:16.074 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.064+0000 7fc2abce5700 1 Processor -- start 2024-02-13T00:22:16.075 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.064+0000 7fc2abce5700 1 -- start start 2024-02-13T00:22:16.075 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.064+0000 7fc2abce5700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2a4071ca0 0x7fc2a410c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:16.075 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.064+0000 7fc2abce5700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a410c9c0 con 0x7fc2a4071ca0 2024-02-13T00:22:16.076 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.064+0000 7fc2a9a81700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2a4071ca0 0x7fc2a410c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:16.076 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.064+0000 7fc2a9a81700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2a4071ca0 0x7fc2a410c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42812/0 (socket says 172.21.15.80:42812) 2024-02-13T00:22:16.076 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.064+0000 7fc2a9a81700 1 -- 172.21.15.80:0/1677321614 learned_addr learned my addr 172.21.15.80:0/1677321614 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:22:16.076 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.064+0000 7fc2a9a81700 1 -- 172.21.15.80:0/1677321614 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a0009370 con 0x7fc2a4071ca0 2024-02-13T00:22:16.077 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.064+0000 7fc2a9a81700 1 --2- 172.21.15.80:0/1677321614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2a4071ca0 0x7fc2a410c4d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fc2a0012f10 tx=0x7fc2a00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:16.077 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.064+0000 7fc29affd700 1 -- 172.21.15.80:0/1677321614 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2a001a640 con 0x7fc2a4071ca0 2024-02-13T00:22:16.077 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.064+0000 7fc2abce5700 1 -- 172.21.15.80:0/1677321614 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a410cbc0 con 0x7fc2a4071ca0 2024-02-13T00:22:16.077 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.064+0000 7fc29affd700 1 -- 172.21.15.80:0/1677321614 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fc2a001ac30 con 0x7fc2a4071ca0 2024-02-13T00:22:16.077 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.064+0000 7fc29affd700 1 -- 172.21.15.80:0/1677321614 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2a0023960 con 0x7fc2a4071ca0 2024-02-13T00:22:16.077 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.064+0000 7fc2abce5700 1 -- 172.21.15.80:0/1677321614 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a410d050 con 0x7fc2a4071ca0 2024-02-13T00:22:16.078 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.068+0000 7fc2abce5700 1 -- 172.21.15.80:0/1677321614 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a4046d80 con 0x7fc2a4071ca0 2024-02-13T00:22:16.079 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.068+0000 7fc29affd700 1 -- 172.21.15.80:0/1677321614 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 38673+0+0 (secure 0 0 0) 0x7fc2a001a7a0 con 0x7fc2a4071ca0 2024-02-13T00:22:16.079 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.068+0000 7fc29affd700 1 --2- 172.21.15.80:0/1677321614 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fc2900326d0 0x7fc290034b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:16.080 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.068+0000 7fc29affd700 1 -- 172.21.15.80:0/1677321614 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7fc2a0044dc0 con 0x7fc2a4071ca0 2024-02-13T00:22:16.080 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.068+0000 7fc2a9280700 1 --2- 172.21.15.80:0/1677321614 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fc2900326d0 0x7fc290034b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:16.080 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.068+0000 7fc2a9280700 1 --2- 172.21.15.80:0/1677321614 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fc2900326d0 0x7fc290034b90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fc294009780 tx=0x7fc294006cb0).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:16.085 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.076+0000 7fc29affd700 1 -- 172.21.15.80:0/1677321614 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fc2a00199e0 con 0x7fc2a4071ca0 2024-02-13T00:22:16.410 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.400+0000 7fc2abce5700 1 -- 172.21.15.80:0/1677321614 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fc2a4101930 con 0x7fc2a4071ca0 2024-02-13T00:22:16.410 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.400+0000 7fc29affd700 1 -- 172.21.15.80:0/1677321614 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fc2a001e070 con 0x7fc2a4071ca0 2024-02-13T00:22:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.400+0000 7fc2abce5700 1 -- 172.21.15.80:0/1677321614 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fc2900326d0 msgr2=0x7fc290034b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.400+0000 7fc2abce5700 1 --2- 172.21.15.80:0/1677321614 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fc2900326d0 0x7fc290034b90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fc294009780 tx=0x7fc294006cb0).stop 2024-02-13T00:22:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.400+0000 7fc2abce5700 1 -- 172.21.15.80:0/1677321614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2a4071ca0 msgr2=0x7fc2a410c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.404+0000 7fc2abce5700 1 --2- 172.21.15.80:0/1677321614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2a4071ca0 0x7fc2a410c4d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fc2a0012f10 tx=0x7fc2a00090f0).stop 2024-02-13T00:22:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.404+0000 7fc2abce5700 1 -- 172.21.15.80:0/1677321614 shutdown_connections 2024-02-13T00:22:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.404+0000 7fc2abce5700 1 --2- 172.21.15.80:0/1677321614 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fc2900326d0 0x7fc290034b90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:16.414 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.404+0000 7fc2abce5700 1 --2- 172.21.15.80:0/1677321614 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc2a4071ca0 0x7fc2a410c4d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:16.415 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.404+0000 7fc2abce5700 1 -- 172.21.15.80:0/1677321614 >> 172.21.15.80:0/1677321614 conn(0x7fc2a40f6ec0 msgr2=0x7fc2a40f8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:22:16.415 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.404+0000 7fc2abce5700 1 -- 172.21.15.80:0/1677321614 shutdown_connections 2024-02-13T00:22:16.415 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:16.404+0000 7fc2abce5700 1 -- 172.21.15.80:0/1677321614 wait complete. 2024-02-13T00:22:18.462 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.448+0000 7f8e9e105700 1 Processor -- start 2024-02-13T00:22:18.462 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.448+0000 7f8e9e105700 1 -- start start 2024-02-13T00:22:18.462 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.448+0000 7f8e9e105700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e980fd8d0 0x7f8e980fdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:18.462 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.448+0000 7f8e9e105700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980fe270 con 0x7f8e980fd8d0 2024-02-13T00:22:18.462 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.452+0000 7f8e977fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e980fd8d0 0x7f8e980fdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:18.462 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.452+0000 7f8e977fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e980fd8d0 0x7f8e980fdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42818/0 (socket says 172.21.15.80:42818) 2024-02-13T00:22:18.462 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.452+0000 7f8e977fe700 1 -- 172.21.15.80:0/4010397869 learned_addr learned my addr 172.21.15.80:0/4010397869 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:22:18.465 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.452+0000 7f8e977fe700 1 -- 172.21.15.80:0/4010397869 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e980fe3b0 con 0x7f8e980fd8d0 2024-02-13T00:22:18.465 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.452+0000 7f8e977fe700 1 --2- 172.21.15.80:0/4010397869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e980fd8d0 0x7f8e980fdcf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8e88009730 tx=0x7f8e880090f0).ready entity=mon.0 client_cookie=66a290d6db1d5306 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:18.465 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.452+0000 7f8e96ffd700 1 -- 172.21.15.80:0/4010397869 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e8800b580 con 0x7f8e980fd8d0 2024-02-13T00:22:18.465 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.452+0000 7f8e96ffd700 1 -- 172.21.15.80:0/4010397869 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f8e8800bb70 con 0x7f8e980fd8d0 2024-02-13T00:22:18.465 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.452+0000 7f8e96ffd700 1 -- 172.21.15.80:0/4010397869 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e88011a90 con 0x7f8e980fd8d0 2024-02-13T00:22:18.465 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.452+0000 7f8e9e105700 1 -- 172.21.15.80:0/4010397869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e980fd8d0 msgr2=0x7f8e980fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:18.465 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.452+0000 7f8e9e105700 1 --2- 172.21.15.80:0/4010397869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e980fd8d0 0x7f8e980fdcf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8e88009730 tx=0x7f8e880090f0).stop 2024-02-13T00:22:18.466 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.452+0000 7f8e9e105700 1 -- 172.21.15.80:0/4010397869 shutdown_connections 2024-02-13T00:22:18.466 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.452+0000 7f8e9e105700 1 --2- 172.21.15.80:0/4010397869 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e980fd8d0 0x7f8e980fdcf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:18.466 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.452+0000 7f8e9e105700 1 -- 172.21.15.80:0/4010397869 >> 172.21.15.80:0/4010397869 conn(0x7f8e98070e40 msgr2=0x7f8e98071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:22:18.466 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.452+0000 7f8e9e105700 1 -- 172.21.15.80:0/4010397869 shutdown_connections 2024-02-13T00:22:18.466 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.452+0000 7f8e9e105700 1 -- 172.21.15.80:0/4010397869 wait complete. 2024-02-13T00:22:18.466 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.452+0000 7f8e9e105700 1 Processor -- start 2024-02-13T00:22:18.466 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.452+0000 7f8e9e105700 1 -- start start 2024-02-13T00:22:18.466 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.456+0000 7f8e9e105700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e980fd8d0 0x7f8e9810c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:18.466 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.456+0000 7f8e9e105700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9810c980 con 0x7f8e980fd8d0 2024-02-13T00:22:18.466 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.456+0000 7f8e977fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e980fd8d0 0x7f8e9810c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:18.466 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.456+0000 7f8e977fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e980fd8d0 0x7f8e9810c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42822/0 (socket says 172.21.15.80:42822) 2024-02-13T00:22:18.466 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.456+0000 7f8e977fe700 1 -- 172.21.15.80:0/864121069 learned_addr learned my addr 172.21.15.80:0/864121069 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:22:18.466 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.456+0000 7f8e977fe700 1 -- 172.21.15.80:0/864121069 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e88009370 con 0x7f8e980fd8d0 2024-02-13T00:22:18.467 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.456+0000 7f8e977fe700 1 --2- 172.21.15.80:0/864121069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e980fd8d0 0x7f8e9810c490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f8e88011440 tx=0x7f8e880090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:18.467 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.456+0000 7f8e957fa700 1 -- 172.21.15.80:0/864121069 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e88011cd0 con 0x7f8e980fd8d0 2024-02-13T00:22:18.467 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.456+0000 7f8e957fa700 1 -- 172.21.15.80:0/864121069 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f8e88011e30 con 0x7f8e980fd8d0 2024-02-13T00:22:18.467 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.456+0000 7f8e9e105700 1 -- 172.21.15.80:0/864121069 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9810cb80 con 0x7f8e980fd8d0 2024-02-13T00:22:18.467 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.456+0000 7f8e9e105700 1 -- 172.21.15.80:0/864121069 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9810d010 con 0x7f8e980fd8d0 2024-02-13T00:22:18.467 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.456+0000 7f8e957fa700 1 -- 172.21.15.80:0/864121069 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e8801a6d0 con 0x7f8e980fd8d0 2024-02-13T00:22:18.468 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.456+0000 7f8e957fa700 1 -- 172.21.15.80:0/864121069 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 38673+0+0 (secure 0 0 0) 0x7f8e8801a830 con 0x7f8e980fd8d0 2024-02-13T00:22:18.468 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.456+0000 7f8e9e105700 1 -- 172.21.15.80:0/864121069 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e78004f20 con 0x7f8e980fd8d0 2024-02-13T00:22:18.471 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.456+0000 7f8e957fa700 1 --2- 172.21.15.80:0/864121069 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f8e84032720 0x7f8e84034be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:18.472 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.456+0000 7f8e957fa700 1 -- 172.21.15.80:0/864121069 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f8e88044bb0 con 0x7f8e980fd8d0 2024-02-13T00:22:18.472 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.456+0000 7f8e8effd700 1 --2- 172.21.15.80:0/864121069 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f8e84032720 0x7f8e84034be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:18.472 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.456+0000 7f8e8effd700 1 --2- 172.21.15.80:0/864121069 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f8e84032720 0x7f8e84034be0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f8e80009780 tx=0x7f8e80006cc0).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:18.475 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.464+0000 7f8e957fa700 1 -- 172.21.15.80:0/864121069 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f8e88021540 con 0x7f8e980fd8d0 2024-02-13T00:22:18.996 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.984+0000 7f8e9e105700 1 -- 172.21.15.80:0/864121069 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f8e78005750 con 0x7f8e980fd8d0 2024-02-13T00:22:18.998 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.988+0000 7f8e957fa700 1 -- 172.21.15.80:0/864121069 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v24)=0 set mgr/dashboard/cluster/status v24) v1 ==== 153+0+0 (secure 0 0 0) 0x7f8e8801e070 con 0x7f8e980fd8d0 2024-02-13T00:22:19.002 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.992+0000 7f8e9e105700 1 -- 172.21.15.80:0/864121069 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f8e84032720 msgr2=0x7f8e84034be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:19.002 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.992+0000 7f8e9e105700 1 --2- 172.21.15.80:0/864121069 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f8e84032720 0x7f8e84034be0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f8e80009780 tx=0x7f8e80006cc0).stop 2024-02-13T00:22:19.002 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.992+0000 7f8e9e105700 1 -- 172.21.15.80:0/864121069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e980fd8d0 msgr2=0x7f8e9810c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:19.002 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.992+0000 7f8e9e105700 1 --2- 172.21.15.80:0/864121069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e980fd8d0 0x7f8e9810c490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f8e88011440 tx=0x7f8e880090f0).stop 2024-02-13T00:22:19.002 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.992+0000 7f8e9e105700 1 -- 172.21.15.80:0/864121069 shutdown_connections 2024-02-13T00:22:19.002 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.992+0000 7f8e9e105700 1 --2- 172.21.15.80:0/864121069 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f8e84032720 0x7f8e84034be0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:19.002 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.992+0000 7f8e9e105700 1 --2- 172.21.15.80:0/864121069 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e980fd8d0 0x7f8e9810c490 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:19.002 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.992+0000 7f8e9e105700 1 -- 172.21.15.80:0/864121069 >> 172.21.15.80:0/864121069 conn(0x7f8e98070e40 msgr2=0x7f8e980fc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:22:19.002 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.992+0000 7f8e9e105700 1 -- 172.21.15.80:0/864121069 shutdown_connections 2024-02-13T00:22:19.002 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: 2024-02-13T00:22:18.992+0000 7f8e9e105700 1 -- 172.21.15.80:0/864121069 wait complete. 2024-02-13T00:22:19.003 INFO:teuthology.orchestra.run.smithi080.stderr:/usr/bin/ceph: set mgr/dashboard/cluster/status 2024-02-13T00:22:19.914 INFO:teuthology.orchestra.run.smithi080.stderr:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-02-13T00:22:19.914 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-13T00:22:19.914 INFO:teuthology.orchestra.run.smithi080.stderr: sudo /usr/sbin/cephadm shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-13T00:22:19.914 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-13T00:22:19.914 INFO:teuthology.orchestra.run.smithi080.stderr:Or, if you are only running a single cluster on this host: 2024-02-13T00:22:19.914 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-13T00:22:19.914 INFO:teuthology.orchestra.run.smithi080.stderr: sudo /usr/sbin/cephadm shell 2024-02-13T00:22:19.915 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-13T00:22:19.915 INFO:teuthology.orchestra.run.smithi080.stderr:Please consider enabling telemetry to help improve Ceph: 2024-02-13T00:22:19.915 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-13T00:22:19.915 INFO:teuthology.orchestra.run.smithi080.stderr: ceph telemetry on 2024-02-13T00:22:19.915 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-13T00:22:19.915 INFO:teuthology.orchestra.run.smithi080.stderr:For more information see: 2024-02-13T00:22:19.915 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-13T00:22:19.915 INFO:teuthology.orchestra.run.smithi080.stderr: https://docs.ceph.com/en/pacific/mgr/telemetry/ 2024-02-13T00:22:19.915 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-13T00:22:19.915 INFO:teuthology.orchestra.run.smithi080.stderr:Bootstrap complete. 2024-02-13T00:22:19.951 INFO:tasks.cephadm:Fetching config... 2024-02-13T00:22:19.951 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-13T00:22:19.951 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-13T00:22:20.000 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-13T00:22:20.000 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-13T00:22:20.000 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-13T00:22:20.047 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-13T00:22:20.047 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-13T00:22:20.047 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/keyring of=/dev/stdout 2024-02-13T00:22:20.104 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-13T00:22:20.104 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-13T00:22:20.104 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-13T00:22:20.151 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-13T00:22:20.151 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDX89ABC6tXcWMPnMOomMDdU15fcrca4P/u8B0X0h0mz7Qb006nT6aYOzse05GkTARl2pOHBnWqzrg71ZK2UfgLrLMqSVTqWTccd9U5KZ67YMfZoh5MWf94iRqOhuG6PKcLQYyajb/DBF7LHRfZe9Yy4OlJ0TxKGfwXifVsO6aVxWS5OHhGLkQWk/zW3Y0bZVUJHCkFs8TWomIqKy7gipKr0HDOtC2bTL/V2L1RyNbS4NkN2dhi0pNpb3sAeM34Uehz4SR3s8P9/9aRClJ3MjBri0WnMLca9MkMP+5brC9s+QRMUxmMhogektWgnmXGMS1PPRWc4cct1ARtc85iXEaa2IuxCYnEdNded8hP7q/EiCGS2QLPGIPo20peuCNVJK7xcTgmVMwnV1WyaI3wmFCDr1SgHEml4Z5RCydOveQklnW9/pVwy4vLd6oflJnKcEt6fUYtSOJ++T5iW2e+hR2sCfCKD3Z3sSNHiMx6GoTIyHHAk2YV6YZnRn0cCzcM9eM= ceph-a5ae7724-ca05-11ee-95b9-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-13T00:22:20.204 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:19 smithi080 bash[17386]: audit 2024-02-13T00:22:18.993789+0000 mon.a (mon.0) 88 : audit [INF] from='client.? 172.21.15.80:0/864121069' entity='client.admin' 2024-02-13T00:22:20.212 INFO:teuthology.orchestra.run.smithi080.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDX89ABC6tXcWMPnMOomMDdU15fcrca4P/u8B0X0h0mz7Qb006nT6aYOzse05GkTARl2pOHBnWqzrg71ZK2UfgLrLMqSVTqWTccd9U5KZ67YMfZoh5MWf94iRqOhuG6PKcLQYyajb/DBF7LHRfZe9Yy4OlJ0TxKGfwXifVsO6aVxWS5OHhGLkQWk/zW3Y0bZVUJHCkFs8TWomIqKy7gipKr0HDOtC2bTL/V2L1RyNbS4NkN2dhi0pNpb3sAeM34Uehz4SR3s8P9/9aRClJ3MjBri0WnMLca9MkMP+5brC9s+QRMUxmMhogektWgnmXGMS1PPRWc4cct1ARtc85iXEaa2IuxCYnEdNded8hP7q/EiCGS2QLPGIPo20peuCNVJK7xcTgmVMwnV1WyaI3wmFCDr1SgHEml4Z5RCydOveQklnW9/pVwy4vLd6oflJnKcEt6fUYtSOJ++T5iW2e+hR2sCfCKD3Z3sSNHiMx6GoTIyHHAk2YV6YZnRn0cCzcM9eM= ceph-a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:22:20.222 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDX89ABC6tXcWMPnMOomMDdU15fcrca4P/u8B0X0h0mz7Qb006nT6aYOzse05GkTARl2pOHBnWqzrg71ZK2UfgLrLMqSVTqWTccd9U5KZ67YMfZoh5MWf94iRqOhuG6PKcLQYyajb/DBF7LHRfZe9Yy4OlJ0TxKGfwXifVsO6aVxWS5OHhGLkQWk/zW3Y0bZVUJHCkFs8TWomIqKy7gipKr0HDOtC2bTL/V2L1RyNbS4NkN2dhi0pNpb3sAeM34Uehz4SR3s8P9/9aRClJ3MjBri0WnMLca9MkMP+5brC9s+QRMUxmMhogektWgnmXGMS1PPRWc4cct1ARtc85iXEaa2IuxCYnEdNded8hP7q/EiCGS2QLPGIPo20peuCNVJK7xcTgmVMwnV1WyaI3wmFCDr1SgHEml4Z5RCydOveQklnW9/pVwy4vLd6oflJnKcEt6fUYtSOJ++T5iW2e+hR2sCfCKD3Z3sSNHiMx6GoTIyHHAk2YV6YZnRn0cCzcM9eM= ceph-a5ae7724-ca05-11ee-95b9-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-13T00:22:20.250 INFO:teuthology.orchestra.run.smithi106.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDX89ABC6tXcWMPnMOomMDdU15fcrca4P/u8B0X0h0mz7Qb006nT6aYOzse05GkTARl2pOHBnWqzrg71ZK2UfgLrLMqSVTqWTccd9U5KZ67YMfZoh5MWf94iRqOhuG6PKcLQYyajb/DBF7LHRfZe9Yy4OlJ0TxKGfwXifVsO6aVxWS5OHhGLkQWk/zW3Y0bZVUJHCkFs8TWomIqKy7gipKr0HDOtC2bTL/V2L1RyNbS4NkN2dhi0pNpb3sAeM34Uehz4SR3s8P9/9aRClJ3MjBri0WnMLca9MkMP+5brC9s+QRMUxmMhogektWgnmXGMS1PPRWc4cct1ARtc85iXEaa2IuxCYnEdNded8hP7q/EiCGS2QLPGIPo20peuCNVJK7xcTgmVMwnV1WyaI3wmFCDr1SgHEml4Z5RCydOveQklnW9/pVwy4vLd6oflJnKcEt6fUYtSOJ++T5iW2e+hR2sCfCKD3Z3sSNHiMx6GoTIyHHAk2YV6YZnRn0cCzcM9eM= ceph-a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:22:20.261 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-02-13T00:22:24.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.468+0000 7f2c39904700 1 -- 172.21.15.80:0/1891475240 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c340f9870 msgr2=0x7f2c340f9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:24.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.468+0000 7f2c39904700 1 --2- 172.21.15.80:0/1891475240 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c340f9870 0x7f2c340f9c90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f2c24004770 tx=0x7f2c24009cb0).stop 2024-02-13T00:22:24.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.468+0000 7f2c39904700 1 -- 172.21.15.80:0/1891475240 shutdown_connections 2024-02-13T00:22:24.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.468+0000 7f2c39904700 1 --2- 172.21.15.80:0/1891475240 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c340f9870 0x7f2c340f9c90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:24.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.468+0000 7f2c39904700 1 -- 172.21.15.80:0/1891475240 >> 172.21.15.80:0/1891475240 conn(0x7f2c340f5390 msgr2=0x7f2c340f7780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:22:24.475 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.468+0000 7f2c39904700 1 -- 172.21.15.80:0/1891475240 shutdown_connections 2024-02-13T00:22:24.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.468+0000 7f2c39904700 1 -- 172.21.15.80:0/1891475240 wait complete. 2024-02-13T00:22:24.476 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.468+0000 7f2c39904700 1 Processor -- start 2024-02-13T00:22:24.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.468+0000 7f2c39904700 1 -- start start 2024-02-13T00:22:24.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.468+0000 7f2c39904700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c340f9870 0x7f2c34109020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:24.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.468+0000 7f2c39904700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c34109510 con 0x7f2c340f9870 2024-02-13T00:22:24.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.468+0000 7f2c32ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c340f9870 0x7f2c34109020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:24.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.468+0000 7f2c32ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c340f9870 0x7f2c34109020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:51996/0 (socket says 172.21.15.80:51996) 2024-02-13T00:22:24.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.468+0000 7f2c32ffd700 1 -- 172.21.15.80:0/1695606772 learned_addr learned my addr 172.21.15.80:0/1695606772 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:22:24.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.468+0000 7f2c32ffd700 1 -- 172.21.15.80:0/1695606772 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c24005040 con 0x7f2c340f9870 2024-02-13T00:22:24.477 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.468+0000 7f2c32ffd700 1 --2- 172.21.15.80:0/1695606772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c340f9870 0x7f2c34109020 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f2c24009b10 tx=0x7f2c24009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:24.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.472+0000 7f2c1bfff700 1 -- 172.21.15.80:0/1695606772 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c2400e030 con 0x7f2c340f9870 2024-02-13T00:22:24.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.472+0000 7f2c1bfff700 1 -- 172.21.15.80:0/1695606772 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f2c2401d420 con 0x7f2c340f9870 2024-02-13T00:22:24.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.472+0000 7f2c1bfff700 1 -- 172.21.15.80:0/1695606772 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c24018070 con 0x7f2c340f9870 2024-02-13T00:22:24.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.472+0000 7f2c39904700 1 -- 172.21.15.80:0/1695606772 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c34109710 con 0x7f2c340f9870 2024-02-13T00:22:24.480 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.472+0000 7f2c39904700 1 -- 172.21.15.80:0/1695606772 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c34109ba0 con 0x7f2c340f9870 2024-02-13T00:22:24.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.476+0000 7f2c1bfff700 1 -- 172.21.15.80:0/1695606772 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 38673+0+0 (secure 0 0 0) 0x7f2c24027440 con 0x7f2c340f9870 2024-02-13T00:22:24.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.476+0000 7f2c39904700 1 -- 172.21.15.80:0/1695606772 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c3405a3b0 con 0x7f2c340f9870 2024-02-13T00:22:24.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.476+0000 7f2c1bfff700 1 --2- 172.21.15.80:0/1695606772 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2c1c0326d0 0x7f2c1c034b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:24.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.476+0000 7f2c1bfff700 1 -- 172.21.15.80:0/1695606772 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f2c24044fc0 con 0x7f2c340f9870 2024-02-13T00:22:24.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.476+0000 7f2c327fc700 1 --2- 172.21.15.80:0/1695606772 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2c1c0326d0 0x7f2c1c034b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:24.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.476+0000 7f2c327fc700 1 --2- 172.21.15.80:0/1695606772 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2c1c0326d0 0x7f2c1c034b90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f2c28009780 tx=0x7f2c28006cc0).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:24.486 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.480+0000 7f2c1bfff700 1 -- 172.21.15.80:0/1695606772 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f2c24004490 con 0x7f2c340f9870 2024-02-13T00:22:24.667 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.660+0000 7f2c39904700 1 -- 172.21.15.80:0/1695606772 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f2c34046d80 con 0x7f2c340f9870 2024-02-13T00:22:24.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.668+0000 7f2c1bfff700 1 -- 172.21.15.80:0/1695606772 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2c34046d80 con 0x7f2c340f9870 2024-02-13T00:22:24.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.668+0000 7f2c39904700 1 -- 172.21.15.80:0/1695606772 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2c1c0326d0 msgr2=0x7f2c1c034b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:24.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.668+0000 7f2c39904700 1 --2- 172.21.15.80:0/1695606772 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2c1c0326d0 0x7f2c1c034b90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f2c28009780 tx=0x7f2c28006cc0).stop 2024-02-13T00:22:24.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.668+0000 7f2c39904700 1 -- 172.21.15.80:0/1695606772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c340f9870 msgr2=0x7f2c34109020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:24.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.672+0000 7f2c39904700 1 --2- 172.21.15.80:0/1695606772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c340f9870 0x7f2c34109020 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f2c24009b10 tx=0x7f2c24009cb0).stop 2024-02-13T00:22:24.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.672+0000 7f2c39904700 1 -- 172.21.15.80:0/1695606772 shutdown_connections 2024-02-13T00:22:24.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.672+0000 7f2c39904700 1 --2- 172.21.15.80:0/1695606772 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2c1c0326d0 0x7f2c1c034b90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:24.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.672+0000 7f2c39904700 1 --2- 172.21.15.80:0/1695606772 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f2c340f9870 0x7f2c34109020 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:24.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.672+0000 7f2c39904700 1 -- 172.21.15.80:0/1695606772 >> 172.21.15.80:0/1695606772 conn(0x7f2c340f5390 msgr2=0x7f2c340f6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:22:24.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.672+0000 7f2c39904700 1 -- 172.21.15.80:0/1695606772 shutdown_connections 2024-02-13T00:22:24.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:24.672+0000 7f2c39904700 1 -- 172.21.15.80:0/1695606772 wait complete. 2024-02-13T00:22:25.561 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-02-13T00:22:25.561 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-02-13T00:22:25.860 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:25 smithi080 bash[17386]: audit 2024-02-13T00:22:24.669088+0000 mon.a (mon.0) 89 : audit [INF] from='client.? 172.21.15.80:0/1695606772' entity='client.admin' 2024-02-13T00:22:28.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:28 smithi080 bash[17386]: cluster 2024-02-13T00:22:26.657785+0000 mgr.y (mgr.14146) 5 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:22:28.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:28 smithi080 bash[17386]: audit 2024-02-13T00:22:27.036691+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:22:28.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:28 smithi080 bash[17386]: audit 2024-02-13T00:22:27.359441+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi080", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:22:28.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:28 smithi080 bash[17386]: audit 2024-02-13T00:22:27.363990+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:22:28.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:28 smithi080 bash[17386]: audit 2024-02-13T00:22:27.366836+0000 mon.a (mon.0) 93 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:22:28.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:28 smithi080 bash[17386]: audit 2024-02-13T00:22:27.371710+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:22:28.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.912+0000 7f19b5eb4700 1 -- 172.21.15.80:0/2169677189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19b00f7660 msgr2=0x7f19b00f7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:28.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.912+0000 7f19b5eb4700 1 --2- 172.21.15.80:0/2169677189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19b00f7660 0x7f19b00f7a80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f19a4004770 tx=0x7f19a4009cb0).stop 2024-02-13T00:22:28.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.912+0000 7f19b5eb4700 1 -- 172.21.15.80:0/2169677189 shutdown_connections 2024-02-13T00:22:28.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.912+0000 7f19b5eb4700 1 --2- 172.21.15.80:0/2169677189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19b00f7660 0x7f19b00f7a80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:28.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.912+0000 7f19b5eb4700 1 -- 172.21.15.80:0/2169677189 >> 172.21.15.80:0/2169677189 conn(0x7f19b00f2dc0 msgr2=0x7f19b00f51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:22:28.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.912+0000 7f19b5eb4700 1 -- 172.21.15.80:0/2169677189 shutdown_connections 2024-02-13T00:22:28.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.912+0000 7f19b5eb4700 1 -- 172.21.15.80:0/2169677189 wait complete. 2024-02-13T00:22:28.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.916+0000 7f19b5eb4700 1 Processor -- start 2024-02-13T00:22:28.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.916+0000 7f19b5eb4700 1 -- start start 2024-02-13T00:22:28.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.916+0000 7f19b5eb4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19b00f7660 0x7f19b0106e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:28.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.916+0000 7f19b5eb4700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b0107350 con 0x7f19b00f7660 2024-02-13T00:22:28.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.916+0000 7f19af7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19b00f7660 0x7f19b0106e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:28.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.916+0000 7f19af7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19b00f7660 0x7f19b0106e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:60334/0 (socket says 172.21.15.80:60334) 2024-02-13T00:22:28.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.916+0000 7f19af7fe700 1 -- 172.21.15.80:0/256579567 learned_addr learned my addr 172.21.15.80:0/256579567 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:22:28.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.916+0000 7f19af7fe700 1 -- 172.21.15.80:0/256579567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a4005040 con 0x7f19b00f7660 2024-02-13T00:22:28.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.916+0000 7f19af7fe700 1 --2- 172.21.15.80:0/256579567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19b00f7660 0x7f19b0106e60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f19a4009b10 tx=0x7f19a4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:28.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.916+0000 7f19acff9700 1 -- 172.21.15.80:0/256579567 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19a400e030 con 0x7f19b00f7660 2024-02-13T00:22:28.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.916+0000 7f19acff9700 1 -- 172.21.15.80:0/256579567 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f19a401d420 con 0x7f19b00f7660 2024-02-13T00:22:28.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.916+0000 7f19b5eb4700 1 -- 172.21.15.80:0/256579567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b0107550 con 0x7f19b00f7660 2024-02-13T00:22:28.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.916+0000 7f19acff9700 1 -- 172.21.15.80:0/256579567 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19a4018070 con 0x7f19b00f7660 2024-02-13T00:22:28.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.916+0000 7f19b5eb4700 1 -- 172.21.15.80:0/256579567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b0108160 con 0x7f19b00f7660 2024-02-13T00:22:28.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.916+0000 7f19acff9700 1 -- 172.21.15.80:0/256579567 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 38673+0+0 (secure 0 0 0) 0x7f19a4013a30 con 0x7f19b00f7660 2024-02-13T00:22:28.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.916+0000 7f19acff9700 1 --2- 172.21.15.80:0/256579567 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f1998032720 0x7f1998034be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:22:28.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.916+0000 7f19acff9700 1 -- 172.21.15.80:0/256579567 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f19a40440e0 con 0x7f19b00f7660 2024-02-13T00:22:28.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.916+0000 7f19b5eb4700 1 -- 172.21.15.80:0/256579567 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b01079e0 con 0x7f19b00f7660 2024-02-13T00:22:28.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.920+0000 7f19aeffd700 1 --2- 172.21.15.80:0/256579567 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f1998032720 0x7f1998034be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:22:28.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.920+0000 7f19aeffd700 1 --2- 172.21.15.80:0/256579567 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f1998032720 0x7f1998034be0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f19a0009780 tx=0x7f19a0006cc0).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:22:28.932 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:28.924+0000 7f19acff9700 1 -- 172.21.15.80:0/256579567 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f19b01079e0 con 0x7f19b00f7660 2024-02-13T00:22:29.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:29.116+0000 7f19b5eb4700 1 -- 172.21.15.80:0/256579567 --> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f19b01079e0 con 0x7f1998032720 2024-02-13T00:22:29.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:29.124+0000 7f19acff9700 1 -- 172.21.15.80:0/256579567 <== mgr.14146 v2:172.21.15.80:6800/461193090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f19b01079e0 con 0x7f1998032720 2024-02-13T00:22:29.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:29.124+0000 7f19b5eb4700 1 -- 172.21.15.80:0/256579567 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f1998032720 msgr2=0x7f1998034be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:29.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:29.124+0000 7f19b5eb4700 1 --2- 172.21.15.80:0/256579567 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f1998032720 0x7f1998034be0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f19a0009780 tx=0x7f19a0006cc0).stop 2024-02-13T00:22:29.132 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:29.124+0000 7f19b5eb4700 1 -- 172.21.15.80:0/256579567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19b00f7660 msgr2=0x7f19b0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:22:29.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:29.124+0000 7f19b5eb4700 1 --2- 172.21.15.80:0/256579567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19b00f7660 0x7f19b0106e60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f19a4009b10 tx=0x7f19a4009cb0).stop 2024-02-13T00:22:29.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:29.124+0000 7f19b5eb4700 1 -- 172.21.15.80:0/256579567 shutdown_connections 2024-02-13T00:22:29.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:29.124+0000 7f19b5eb4700 1 --2- 172.21.15.80:0/256579567 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f1998032720 0x7f1998034be0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:29.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:29.124+0000 7f19b5eb4700 1 --2- 172.21.15.80:0/256579567 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f19b00f7660 0x7f19b0106e60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:22:29.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:29.124+0000 7f19b5eb4700 1 -- 172.21.15.80:0/256579567 >> 172.21.15.80:0/256579567 conn(0x7f19b00f2dc0 msgr2=0x7f19b00f3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:22:29.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:29.124+0000 7f19b5eb4700 1 -- 172.21.15.80:0/256579567 shutdown_connections 2024-02-13T00:22:29.133 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:22:29.124+0000 7f19b5eb4700 1 -- 172.21.15.80:0/256579567 wait complete. 2024-02-13T00:22:29.884 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi106 2024-02-13T00:22:29.884 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-02-13T00:22:29.884 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/etc/ceph/ceph.conf 2024-02-13T00:22:29.892 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-02-13T00:22:29.892 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-13T00:22:29.942 INFO:tasks.cephadm:Adding host smithi106 to orchestrator... 2024-02-13T00:22:29.942 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph orch host add smithi106 2024-02-13T00:22:30.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:30 smithi080 bash[17386]: cluster 2024-02-13T00:22:28.658170+0000 mgr.y (mgr.14146) 6 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:22:30.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:30 smithi080 bash[17386]: audit 2024-02-13T00:22:29.124175+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:22:30.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:30 smithi080 bash[17386]: audit 2024-02-13T00:22:29.141258+0000 mon.a (mon.0) 96 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:22:30.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:30 smithi080 bash[17386]: audit 2024-02-13T00:22:29.144207+0000 mon.a (mon.0) 97 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:22:30.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:30 smithi080 bash[17386]: audit 2024-02-13T00:22:29.145661+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:22:30.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:30 smithi080 bash[17386]: audit 2024-02-13T00:22:29.193581+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:22:30.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:30 smithi080 bash[17386]: audit 2024-02-13T00:22:29.198513+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:22:31.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:31 smithi080 bash[17386]: cephadm 2024-02-13T00:22:29.147307+0000 mgr.y (mgr.14146) 8 : cephadm [INF] Updating smithi080:/etc/ceph/ceph.conf 2024-02-13T00:22:31.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:31 smithi080 bash[17386]: cephadm 2024-02-13T00:22:29.164003+0000 mgr.y (mgr.14146) 9 : cephadm [INF] Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2024-02-13T00:22:32.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:32 smithi080 bash[17386]: cluster 2024-02-13T00:22:30.658579+0000 mgr.y (mgr.14146) 10 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:22:34.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:34 smithi080 bash[17386]: cluster 2024-02-13T00:22:32.658910+0000 mgr.y (mgr.14146) 11 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:22:35.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:35 smithi080 bash[17386]: cluster 2024-02-13T00:22:34.659289+0000 mgr.y (mgr.14146) 12 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:22:38.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:37 smithi080 bash[17386]: cluster 2024-02-13T00:22:36.659665+0000 mgr.y (mgr.14146) 13 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:22:40.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:39 smithi080 bash[17386]: cluster 2024-02-13T00:22:38.660046+0000 mgr.y (mgr.14146) 14 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:22:42.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:41 smithi080 bash[17386]: cluster 2024-02-13T00:22:40.660457+0000 mgr.y (mgr.14146) 15 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:22:44.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:43 smithi080 bash[17386]: cluster 2024-02-13T00:22:42.660809+0000 mgr.y (mgr.14146) 16 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:22:45.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:45 smithi080 bash[17386]: cluster 2024-02-13T00:22:44.661227+0000 mgr.y (mgr.14146) 17 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:22:48.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:47 smithi080 bash[17386]: cluster 2024-02-13T00:22:46.661640+0000 mgr.y (mgr.14146) 18 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:22:50.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:49 smithi080 bash[17386]: cluster 2024-02-13T00:22:48.662064+0000 mgr.y (mgr.14146) 19 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:22:52.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:51 smithi080 bash[17386]: cluster 2024-02-13T00:22:50.662433+0000 mgr.y (mgr.14146) 20 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:22:54.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:53 smithi080 bash[17386]: cluster 2024-02-13T00:22:52.662838+0000 mgr.y (mgr.14146) 21 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:22:55.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:55 smithi080 bash[17386]: cluster 2024-02-13T00:22:54.663208+0000 mgr.y (mgr.14146) 22 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:22:58.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:57 smithi080 bash[17386]: cluster 2024-02-13T00:22:56.663582+0000 mgr.y (mgr.14146) 23 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:00.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:22:59 smithi080 bash[17386]: cluster 2024-02-13T00:22:58.663983+0000 mgr.y (mgr.14146) 24 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:02.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:01 smithi080 bash[17386]: cluster 2024-02-13T00:23:00.664424+0000 mgr.y (mgr.14146) 25 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:04.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:03 smithi080 bash[17386]: cluster 2024-02-13T00:23:02.664788+0000 mgr.y (mgr.14146) 26 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:05.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:05 smithi080 bash[17386]: cluster 2024-02-13T00:23:04.665187+0000 mgr.y (mgr.14146) 27 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:08.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:07 smithi080 bash[17386]: cluster 2024-02-13T00:23:06.665568+0000 mgr.y (mgr.14146) 28 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:10.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:09 smithi080 bash[17386]: cluster 2024-02-13T00:23:08.666023+0000 mgr.y (mgr.14146) 29 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:11.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.329+0000 7f6fa6622700 1 -- 172.21.15.106:0/850300635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fa00f6550 msgr2=0x7f6fa00f6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:11.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.329+0000 7f6fa6622700 1 --2- 172.21.15.106:0/850300635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fa00f6550 0x7f6fa00f6970 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f6f90009ae0 tx=0x7f6f90004d10).stop 2024-02-13T00:23:11.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.329+0000 7f6fa6622700 1 -- 172.21.15.106:0/850300635 shutdown_connections 2024-02-13T00:23:11.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.329+0000 7f6fa6622700 1 --2- 172.21.15.106:0/850300635 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fa00f6550 0x7f6fa00f6970 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:11.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.329+0000 7f6fa6622700 1 -- 172.21.15.106:0/850300635 >> 172.21.15.106:0/850300635 conn(0x7f6fa00f1cb0 msgr2=0x7f6fa00f40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:23:11.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.329+0000 7f6fa6622700 1 -- 172.21.15.106:0/850300635 shutdown_connections 2024-02-13T00:23:11.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.329+0000 7f6fa6622700 1 -- 172.21.15.106:0/850300635 wait complete. 2024-02-13T00:23:11.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.333+0000 7f6fa6622700 1 Processor -- start 2024-02-13T00:23:11.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.333+0000 7f6fa6622700 1 -- start start 2024-02-13T00:23:11.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.333+0000 7f6fa6622700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fa00f6550 0x7f6fa0105d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:23:11.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.333+0000 7f6fa6622700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa0106240 con 0x7f6fa00f6550 2024-02-13T00:23:11.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.333+0000 7f6f9ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fa00f6550 0x7f6fa0105d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:23:11.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.333+0000 7f6f9ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fa00f6550 0x7f6fa0105d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.106:43726/0 (socket says 172.21.15.106:43726) 2024-02-13T00:23:11.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.333+0000 7f6f9ffff700 1 -- 172.21.15.106:0/2905092607 learned_addr learned my addr 172.21.15.106:0/2905092607 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-02-13T00:23:11.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.333+0000 7f6f9ffff700 1 -- 172.21.15.106:0/2905092607 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f900097c0 con 0x7f6fa00f6550 2024-02-13T00:23:11.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.333+0000 7f6f9ffff700 1 --2- 172.21.15.106:0/2905092607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fa00f6550 0x7f6fa0105d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f6f9000b3b0 tx=0x7f6f90004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:23:11.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.333+0000 7f6f9dffb700 1 -- 172.21.15.106:0/2905092607 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f9000e070 con 0x7f6fa00f6550 2024-02-13T00:23:11.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.333+0000 7f6fa6622700 1 -- 172.21.15.106:0/2905092607 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa0106440 con 0x7f6fa00f6550 2024-02-13T00:23:11.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.333+0000 7f6f9dffb700 1 -- 172.21.15.106:0/2905092607 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f6f9000bce0 con 0x7f6fa00f6550 2024-02-13T00:23:11.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.333+0000 7f6f9dffb700 1 -- 172.21.15.106:0/2905092607 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f90018070 con 0x7f6fa00f6550 2024-02-13T00:23:11.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.333+0000 7f6fa6622700 1 -- 172.21.15.106:0/2905092607 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa0106ff0 con 0x7f6fa00f6550 2024-02-13T00:23:11.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.337+0000 7f6fa6622700 1 -- 172.21.15.106:0/2905092607 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa005a3b0 con 0x7f6fa00f6550 2024-02-13T00:23:11.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.337+0000 7f6f9dffb700 1 -- 172.21.15.106:0/2905092607 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 38673+0+0 (secure 0 0 0) 0x7f6f90013420 con 0x7f6fa00f6550 2024-02-13T00:23:11.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.337+0000 7f6f9dffb700 1 --2- 172.21.15.106:0/2905092607 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f6f8c0326d0 0x7f6f8c034b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:23:11.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.337+0000 7f6f9dffb700 1 -- 172.21.15.106:0/2905092607 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f6f900443e0 con 0x7f6fa00f6550 2024-02-13T00:23:11.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.337+0000 7f6f977fe700 1 --2- 172.21.15.106:0/2905092607 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f6f8c0326d0 0x7f6f8c034b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:23:11.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.337+0000 7f6f977fe700 1 --2- 172.21.15.106:0/2905092607 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f6f8c0326d0 0x7f6f8c034b90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f6f88009780 tx=0x7f6f88006cc0).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:23:11.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.345+0000 7f6f9dffb700 1 -- 172.21.15.106:0/2905092607 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f6f90004810 con 0x7f6fa00f6550 2024-02-13T00:23:11.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:11.537+0000 7f6fa6622700 1 -- 172.21.15.106:0/2905092607 --> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi106", "target": ["mon-mgr", ""]}) v1 -- 0x7f6fa00008d0 con 0x7f6f8c0326d0 2024-02-13T00:23:12.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:11 smithi080 bash[17386]: cluster 2024-02-13T00:23:10.666449+0000 mgr.y (mgr.14146) 30 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:12.011 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:23:11 smithi080 bash[17652]: Warning: Permanently added 'smithi106,172.21.15.106' (ECDSA) to the list of known hosts. 2024-02-13T00:23:12.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:12.397+0000 7f6f9dffb700 1 -- 172.21.15.106:0/2905092607 <== mgr.14146 v2:172.21.15.80:6800/461193090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f6fa00008d0 con 0x7f6f8c0326d0 2024-02-13T00:23:12.406 INFO:teuthology.orchestra.run.smithi106.stdout:Added host 'smithi106' with addr '172.21.15.106' 2024-02-13T00:23:12.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:12.401+0000 7f6fa6622700 1 -- 172.21.15.106:0/2905092607 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f6f8c0326d0 msgr2=0x7f6f8c034b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:12.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:12.401+0000 7f6fa6622700 1 --2- 172.21.15.106:0/2905092607 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f6f8c0326d0 0x7f6f8c034b90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f6f88009780 tx=0x7f6f88006cc0).stop 2024-02-13T00:23:12.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:12.401+0000 7f6fa6622700 1 -- 172.21.15.106:0/2905092607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fa00f6550 msgr2=0x7f6fa0105d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:12.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:12.401+0000 7f6fa6622700 1 --2- 172.21.15.106:0/2905092607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fa00f6550 0x7f6fa0105d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f6f9000b3b0 tx=0x7f6f90004d10).stop 2024-02-13T00:23:12.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:12.401+0000 7f6fa6622700 1 -- 172.21.15.106:0/2905092607 shutdown_connections 2024-02-13T00:23:12.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:12.401+0000 7f6fa6622700 1 --2- 172.21.15.106:0/2905092607 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f6f8c0326d0 0x7f6f8c034b90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:12.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:12.401+0000 7f6fa6622700 1 --2- 172.21.15.106:0/2905092607 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6fa00f6550 0x7f6fa0105d50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:12.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:12.401+0000 7f6fa6622700 1 -- 172.21.15.106:0/2905092607 >> 172.21.15.106:0/2905092607 conn(0x7f6fa00f1cb0 msgr2=0x7f6fa00f2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:23:12.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:12.401+0000 7f6fa6622700 1 -- 172.21.15.106:0/2905092607 shutdown_connections 2024-02-13T00:23:12.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:12.401+0000 7f6fa6622700 1 -- 172.21.15.106:0/2905092607 wait complete. 2024-02-13T00:23:12.760 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:23:12 smithi080 bash[17652]: Warning: Permanently added '172.21.15.106' (ECDSA) to the list of known hosts. 2024-02-13T00:23:12.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:12 smithi080 bash[17386]: audit 2024-02-13T00:23:11.541820+0000 mgr.y (mgr.14146) 31 : audit [DBG] from='client.14170 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi106", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:23:12.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:12 smithi080 bash[17386]: audit 2024-02-13T00:23:12.398717+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:12.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:12 smithi080 bash[17386]: audit 2024-02-13T00:23:12.440377+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:23:13.172 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph orch host ls --format=json 2024-02-13T00:23:14.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:13 smithi080 bash[17386]: cephadm 2024-02-13T00:23:12.399606+0000 mgr.y (mgr.14146) 32 : cephadm [INF] Added host smithi106 2024-02-13T00:23:14.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:13 smithi080 bash[17386]: cluster 2024-02-13T00:23:12.666942+0000 mgr.y (mgr.14146) 33 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:14.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:13 smithi080 bash[17386]: audit 2024-02-13T00:23:12.987743+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:15.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:15 smithi080 bash[17386]: audit 2024-02-13T00:23:14.256369+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:15.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:15 smithi080 bash[17386]: cluster 2024-02-13T00:23:14.667335+0000 mgr.y (mgr.14146) 34 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:15.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.845+0000 7f400f5d9700 1 -- 172.21.15.106:0/425906023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40080f6560 msgr2=0x7f40080f6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:15.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.845+0000 7f400f5d9700 1 --2- 172.21.15.106:0/425906023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40080f6560 0x7f40080f6980 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f4004004770 tx=0x7f4004009cb0).stop 2024-02-13T00:23:15.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.845+0000 7f400f5d9700 1 -- 172.21.15.106:0/425906023 shutdown_connections 2024-02-13T00:23:15.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.845+0000 7f400f5d9700 1 --2- 172.21.15.106:0/425906023 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40080f6560 0x7f40080f6980 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:15.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.845+0000 7f400f5d9700 1 -- 172.21.15.106:0/425906023 >> 172.21.15.106:0/425906023 conn(0x7f40080f1ca0 msgr2=0x7f40080f40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:23:15.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.845+0000 7f400f5d9700 1 -- 172.21.15.106:0/425906023 shutdown_connections 2024-02-13T00:23:15.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.845+0000 7f400f5d9700 1 -- 172.21.15.106:0/425906023 wait complete. 2024-02-13T00:23:15.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.845+0000 7f400f5d9700 1 Processor -- start 2024-02-13T00:23:15.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.845+0000 7f400f5d9700 1 -- start start 2024-02-13T00:23:15.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.845+0000 7f400f5d9700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40080f6560 0x7f40080f4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:23:15.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.845+0000 7f400f5d9700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40080f26e0 con 0x7f40080f6560 2024-02-13T00:23:15.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.849+0000 7f400d375700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40080f6560 0x7f40080f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:23:15.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.849+0000 7f400d375700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40080f6560 0x7f40080f4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.106:43750/0 (socket says 172.21.15.106:43750) 2024-02-13T00:23:15.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.849+0000 7f400d375700 1 -- 172.21.15.106:0/4247969432 learned_addr learned my addr 172.21.15.106:0/4247969432 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-02-13T00:23:15.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.849+0000 7f400d375700 1 -- 172.21.15.106:0/4247969432 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4004005040 con 0x7f40080f6560 2024-02-13T00:23:15.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.849+0000 7f400d375700 1 --2- 172.21.15.106:0/4247969432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40080f6560 0x7f40080f4260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f40040097f0 tx=0x7f4004009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:23:15.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.849+0000 7f3ffe7fc700 1 -- 172.21.15.106:0/4247969432 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f400400e030 con 0x7f40080f6560 2024-02-13T00:23:15.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.849+0000 7f3ffe7fc700 1 -- 172.21.15.106:0/4247969432 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f4004013e40 con 0x7f40080f6560 2024-02-13T00:23:15.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.849+0000 7f400f5d9700 1 -- 172.21.15.106:0/4247969432 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40080f2880 con 0x7f40080f6560 2024-02-13T00:23:15.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.849+0000 7f3ffe7fc700 1 -- 172.21.15.106:0/4247969432 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4004018070 con 0x7f40080f6560 2024-02-13T00:23:15.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.849+0000 7f400f5d9700 1 -- 172.21.15.106:0/4247969432 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40080f2d10 con 0x7f40080f6560 2024-02-13T00:23:15.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.849+0000 7f3ffe7fc700 1 -- 172.21.15.106:0/4247969432 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 38673+0+0 (secure 0 0 0) 0x7f40040139b0 con 0x7f40080f6560 2024-02-13T00:23:15.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.849+0000 7f3ffe7fc700 1 --2- 172.21.15.106:0/4247969432 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f3ff4032720 0x7f3ff4034be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:23:15.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.849+0000 7f3ffe7fc700 1 -- 172.21.15.106:0/4247969432 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f40040442c0 con 0x7f40080f6560 2024-02-13T00:23:15.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.849+0000 7f400f5d9700 1 -- 172.21.15.106:0/4247969432 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f400805a3b0 con 0x7f40080f6560 2024-02-13T00:23:15.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.853+0000 7f400cb74700 1 --2- 172.21.15.106:0/4247969432 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f3ff4032720 0x7f3ff4034be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:23:15.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.853+0000 7f400cb74700 1 --2- 172.21.15.106:0/4247969432 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f3ff4032720 0x7f3ff4034be0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f3ff8009780 tx=0x7f3ff8006cc0).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:23:15.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:15.861+0000 7f3ffe7fc700 1 -- 172.21.15.106:0/4247969432 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f40040263e0 con 0x7f40080f6560 2024-02-13T00:23:16.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:16.053+0000 7f400f5d9700 1 -- 172.21.15.106:0/4247969432 --> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40080f3010 con 0x7f3ff4032720 2024-02-13T00:23:16.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:16.057+0000 7f3ffe7fc700 1 -- 172.21.15.106:0/4247969432 <== mgr.14146 v2:172.21.15.80:6800/461193090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f40080f3010 con 0x7f3ff4032720 2024-02-13T00:23:16.066 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-02-13T00:23:16.066 INFO:teuthology.orchestra.run.smithi106.stdout:[{"addr": "172.21.15.80", "hostname": "smithi080", "labels": [], "status": ""}, {"addr": "172.21.15.106", "hostname": "smithi106", "labels": [], "status": ""}] 2024-02-13T00:23:16.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:16.061+0000 7f400f5d9700 1 -- 172.21.15.106:0/4247969432 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f3ff4032720 msgr2=0x7f3ff4034be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:16.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:16.061+0000 7f400f5d9700 1 --2- 172.21.15.106:0/4247969432 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f3ff4032720 0x7f3ff4034be0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f3ff8009780 tx=0x7f3ff8006cc0).stop 2024-02-13T00:23:16.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:16.061+0000 7f400f5d9700 1 -- 172.21.15.106:0/4247969432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40080f6560 msgr2=0x7f40080f4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:16.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:16.061+0000 7f400f5d9700 1 --2- 172.21.15.106:0/4247969432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40080f6560 0x7f40080f4260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f40040097f0 tx=0x7f4004009cb0).stop 2024-02-13T00:23:16.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:16.061+0000 7f400f5d9700 1 -- 172.21.15.106:0/4247969432 shutdown_connections 2024-02-13T00:23:16.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:16.061+0000 7f400f5d9700 1 --2- 172.21.15.106:0/4247969432 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f3ff4032720 0x7f3ff4034be0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:16.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:16.061+0000 7f400f5d9700 1 --2- 172.21.15.106:0/4247969432 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f40080f6560 0x7f40080f4260 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:16.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:16.061+0000 7f400f5d9700 1 -- 172.21.15.106:0/4247969432 >> 172.21.15.106:0/4247969432 conn(0x7f40080f1ca0 msgr2=0x7f4008060ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:23:16.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:16.061+0000 7f400f5d9700 1 -- 172.21.15.106:0/4247969432 shutdown_connections 2024-02-13T00:23:16.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:16.061+0000 7f400f5d9700 1 -- 172.21.15.106:0/4247969432 wait complete. 2024-02-13T00:23:16.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:16 smithi080 bash[17386]: audit 2024-02-13T00:23:16.060013+0000 mgr.y (mgr.14146) 35 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-13T00:23:16.995 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-13T00:23:16.996 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph osd crush tunables default 2024-02-13T00:23:17.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:17 smithi080 bash[17386]: cluster 2024-02-13T00:23:16.667804+0000 mgr.y (mgr.14146) 36 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:20.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.990+0000 7f211967c700 1 -- 172.21.15.80:0/2871039819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f211406ccc0 msgr2=0x7f211406b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:20.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.990+0000 7f211967c700 1 --2- 172.21.15.80:0/2871039819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f211406ccc0 0x7f211406b210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f2104004770 tx=0x7f2104009cb0).stop 2024-02-13T00:23:20.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.990+0000 7f211967c700 1 -- 172.21.15.80:0/2871039819 shutdown_connections 2024-02-13T00:23:20.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.990+0000 7f211967c700 1 --2- 172.21.15.80:0/2871039819 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f211406ccc0 0x7f211406b210 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:20.000 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.990+0000 7f211967c700 1 -- 172.21.15.80:0/2871039819 >> 172.21.15.80:0/2871039819 conn(0x7f21140f30f0 msgr2=0x7f21140f5510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:23:20.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.990+0000 7f211967c700 1 -- 172.21.15.80:0/2871039819 shutdown_connections 2024-02-13T00:23:20.001 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.990+0000 7f211967c700 1 -- 172.21.15.80:0/2871039819 wait complete. 2024-02-13T00:23:20.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.990+0000 7f211967c700 1 Processor -- start 2024-02-13T00:23:20.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.994+0000 7f211967c700 1 -- start start 2024-02-13T00:23:20.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.994+0000 7f211967c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f211406ccc0 0x7f2114113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:23:20.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.994+0000 7f211967c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2114113870 con 0x7f211406ccc0 2024-02-13T00:23:20.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.994+0000 7f2113fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f211406ccc0 0x7f2114113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:23:20.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.994+0000 7f2113fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f211406ccc0 0x7f2114113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50018/0 (socket says 172.21.15.80:50018) 2024-02-13T00:23:20.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.994+0000 7f2113fff700 1 -- 172.21.15.80:0/2536237517 learned_addr learned my addr 172.21.15.80:0/2536237517 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:23:20.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.994+0000 7f2113fff700 1 -- 172.21.15.80:0/2536237517 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2104005040 con 0x7f211406ccc0 2024-02-13T00:23:20.002 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.994+0000 7f2113fff700 1 --2- 172.21.15.80:0/2536237517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f211406ccc0 0x7f2114113380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f2104009770 tx=0x7f2104009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:23:20.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.994+0000 7f2111ffb700 1 -- 172.21.15.80:0/2536237517 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f210400e030 con 0x7f211406ccc0 2024-02-13T00:23:20.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.994+0000 7f211967c700 1 -- 172.21.15.80:0/2536237517 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2114113a70 con 0x7f211406ccc0 2024-02-13T00:23:20.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.994+0000 7f211967c700 1 -- 172.21.15.80:0/2536237517 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2114113e80 con 0x7f211406ccc0 2024-02-13T00:23:20.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.994+0000 7f2111ffb700 1 -- 172.21.15.80:0/2536237517 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f2104013dc0 con 0x7f211406ccc0 2024-02-13T00:23:20.003 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.994+0000 7f2111ffb700 1 -- 172.21.15.80:0/2536237517 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2104018070 con 0x7f211406ccc0 2024-02-13T00:23:20.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.994+0000 7f211967c700 1 -- 172.21.15.80:0/2536237517 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211405f0a0 con 0x7f211406ccc0 2024-02-13T00:23:20.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.994+0000 7f2111ffb700 1 -- 172.21.15.80:0/2536237517 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 38673+0+0 (secure 0 0 0) 0x7f210401d520 con 0x7f211406ccc0 2024-02-13T00:23:20.004 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.994+0000 7f2111ffb700 1 --2- 172.21.15.80:0/2536237517 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2100032720 0x7f2100034be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:23:20.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.994+0000 7f2111ffb700 1 -- 172.21.15.80:0/2536237517 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f2104044090 con 0x7f211406ccc0 2024-02-13T00:23:20.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.998+0000 7f210bfff700 1 --2- 172.21.15.80:0/2536237517 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2100032720 0x7f2100034be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:23:20.005 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:19.998+0000 7f210bfff700 1 --2- 172.21.15.80:0/2536237517 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2100032720 0x7f2100034be0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f20fc009780 tx=0x7f20fc006cc0).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:23:20.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:19 smithi080 bash[17386]: cluster 2024-02-13T00:23:18.668292+0000 mgr.y (mgr.14146) 37 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:20.012 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:20.002+0000 7f2111ffb700 1 -- 172.21.15.80:0/2536237517 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f2104025b80 con 0x7f211406ccc0 2024-02-13T00:23:20.198 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:20.190+0000 7f211967c700 1 -- 172.21.15.80:0/2536237517 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f2114046d80 con 0x7f211406ccc0 2024-02-13T00:23:20.739 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:20.730+0000 7f2111ffb700 1 -- 172.21.15.80:0/2536237517 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2104025b80 con 0x7f211406ccc0 2024-02-13T00:23:20.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:20.734+0000 7f211967c700 1 -- 172.21.15.80:0/2536237517 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2100032720 msgr2=0x7f2100034be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:20.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:20.734+0000 7f211967c700 1 --2- 172.21.15.80:0/2536237517 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2100032720 0x7f2100034be0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f20fc009780 tx=0x7f20fc006cc0).stop 2024-02-13T00:23:20.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:20.734+0000 7f211967c700 1 -- 172.21.15.80:0/2536237517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f211406ccc0 msgr2=0x7f2114113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:20.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:20.734+0000 7f211967c700 1 --2- 172.21.15.80:0/2536237517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f211406ccc0 0x7f2114113380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f2104009770 tx=0x7f2104009cb0).stop 2024-02-13T00:23:20.742 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:20.734+0000 7f211967c700 1 -- 172.21.15.80:0/2536237517 shutdown_connections 2024-02-13T00:23:20.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:20.734+0000 7f211967c700 1 --2- 172.21.15.80:0/2536237517 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2100032720 0x7f2100034be0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:20.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:20.734+0000 7f211967c700 1 --2- 172.21.15.80:0/2536237517 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f211406ccc0 0x7f2114113380 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:20.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:20.734+0000 7f211967c700 1 -- 172.21.15.80:0/2536237517 >> 172.21.15.80:0/2536237517 conn(0x7f21140f30f0 msgr2=0x7f21140f3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:23:20.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:20.734+0000 7f211967c700 1 -- 172.21.15.80:0/2536237517 shutdown_connections 2024-02-13T00:23:20.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:20.734+0000 7f211967c700 1 -- 172.21.15.80:0/2536237517 wait complete. 2024-02-13T00:23:20.743 INFO:teuthology.orchestra.run.smithi080.stderr:adjusted tunables profile to default 2024-02-13T00:23:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:20 smithi080 bash[17386]: audit 2024-02-13T00:23:20.193875+0000 mon.a (mon.0) 105 : audit [INF] from='client.? 172.21.15.80:0/2536237517' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-13T00:23:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:20 smithi080 bash[17386]: audit 2024-02-13T00:23:20.349552+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:20 smithi080 bash[17386]: audit 2024-02-13T00:23:20.658810+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:20 smithi080 bash[17386]: audit 2024-02-13T00:23:20.660118+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi106", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:23:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:20 smithi080 bash[17386]: audit 2024-02-13T00:23:20.661958+0000 mon.a (mon.0) 109 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:20 smithi080 bash[17386]: audit 2024-02-13T00:23:20.663420+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:23:21.514 INFO:tasks.cephadm:Adding mon.a on smithi080 2024-02-13T00:23:21.514 INFO:tasks.cephadm:Adding mon.c on smithi080 2024-02-13T00:23:21.514 INFO:tasks.cephadm:Adding mon.b on smithi106 2024-02-13T00:23:21.514 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph orch apply mon '3;smithi080:172.21.15.80=a;smithi080:[v2:172.21.15.80:3301,v1:172.21.15.80:6790]=c;smithi106:172.21.15.106=b' 2024-02-13T00:23:22.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:21 smithi080 bash[17386]: cephadm 2024-02-13T00:23:20.665752+0000 mgr.y (mgr.14146) 38 : cephadm [INF] Updating smithi106:/etc/ceph/ceph.conf 2024-02-13T00:23:22.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:21 smithi080 bash[17386]: cluster 2024-02-13T00:23:20.668665+0000 mgr.y (mgr.14146) 39 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:22.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:21 smithi080 bash[17386]: cephadm 2024-02-13T00:23:20.690669+0000 mgr.y (mgr.14146) 40 : cephadm [INF] Updating smithi106:/etc/ceph/ceph.client.admin.keyring 2024-02-13T00:23:22.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:21 smithi080 bash[17386]: audit 2024-02-13T00:23:20.734402+0000 mon.a (mon.0) 111 : audit [INF] from='client.? 172.21.15.80:0/2536237517' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-13T00:23:22.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:21 smithi080 bash[17386]: cluster 2024-02-13T00:23:20.734461+0000 mon.a (mon.0) 112 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-13T00:23:22.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:21 smithi080 bash[17386]: audit 2024-02-13T00:23:20.741615+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:22.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:21 smithi080 bash[17386]: audit 2024-02-13T00:23:20.749614+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:24.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:23 smithi080 bash[17386]: cluster 2024-02-13T00:23:22.669060+0000 mgr.y (mgr.14146) 41 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:24.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.045+0000 7ff65ca57700 1 -- 172.21.15.106:0/1848110342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6580f8650 msgr2=0x7ff6580f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:24.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.045+0000 7ff65ca57700 1 --2- 172.21.15.106:0/1848110342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6580f8650 0x7ff6580f8a30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7ff648004770 tx=0x7ff648009cb0).stop 2024-02-13T00:23:24.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.045+0000 7ff65ca57700 1 -- 172.21.15.106:0/1848110342 shutdown_connections 2024-02-13T00:23:24.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.045+0000 7ff65ca57700 1 --2- 172.21.15.106:0/1848110342 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6580f8650 0x7ff6580f8a30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:24.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.045+0000 7ff65ca57700 1 -- 172.21.15.106:0/1848110342 >> 172.21.15.106:0/1848110342 conn(0x7ff6580f21a0 msgr2=0x7ff6580f45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:23:24.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.045+0000 7ff65ca57700 1 -- 172.21.15.106:0/1848110342 shutdown_connections 2024-02-13T00:23:24.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.045+0000 7ff65ca57700 1 -- 172.21.15.106:0/1848110342 wait complete. 2024-02-13T00:23:24.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.049+0000 7ff65ca57700 1 Processor -- start 2024-02-13T00:23:24.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.049+0000 7ff65ca57700 1 -- start start 2024-02-13T00:23:24.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.049+0000 7ff65ca57700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6580f8650 0x7ff65810cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:23:24.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.049+0000 7ff65ca57700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65810d3d0 con 0x7ff6580f8650 2024-02-13T00:23:24.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.049+0000 7ff65659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6580f8650 0x7ff65810cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:23:24.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.049+0000 7ff65659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6580f8650 0x7ff65810cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.106:59398/0 (socket says 172.21.15.106:59398) 2024-02-13T00:23:24.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.049+0000 7ff65659c700 1 -- 172.21.15.106:0/1901062296 learned_addr learned my addr 172.21.15.106:0/1901062296 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-02-13T00:23:24.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.049+0000 7ff65659c700 1 -- 172.21.15.106:0/1901062296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff648005040 con 0x7ff6580f8650 2024-02-13T00:23:24.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.049+0000 7ff65659c700 1 --2- 172.21.15.106:0/1901062296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6580f8650 0x7ff65810cee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7ff6480097f0 tx=0x7ff648009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:23:24.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.049+0000 7ff64ffff700 1 -- 172.21.15.106:0/1901062296 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff64800e030 con 0x7ff6580f8650 2024-02-13T00:23:24.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.049+0000 7ff65ca57700 1 -- 172.21.15.106:0/1901062296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65810d5d0 con 0x7ff6580f8650 2024-02-13T00:23:24.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.049+0000 7ff64ffff700 1 -- 172.21.15.106:0/1901062296 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7ff648013df0 con 0x7ff6580f8650 2024-02-13T00:23:24.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.049+0000 7ff64ffff700 1 -- 172.21.15.106:0/1901062296 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff648018070 con 0x7ff6580f8650 2024-02-13T00:23:24.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.049+0000 7ff65ca57700 1 -- 172.21.15.106:0/1901062296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65810d9e0 con 0x7ff6580f8650 2024-02-13T00:23:24.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.053+0000 7ff65ca57700 1 -- 172.21.15.106:0/1901062296 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65805fee0 con 0x7ff6580f8650 2024-02-13T00:23:24.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.053+0000 7ff64ffff700 1 -- 172.21.15.106:0/1901062296 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 38673+0+0 (secure 0 0 0) 0x7ff648013960 con 0x7ff6580f8650 2024-02-13T00:23:24.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.053+0000 7ff64ffff700 1 --2- 172.21.15.106:0/1901062296 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7ff6380326d0 0x7ff638034b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:23:24.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.053+0000 7ff64ffff700 1 -- 172.21.15.106:0/1901062296 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1098+0+0 (secure 0 0 0) 0x7ff648044280 con 0x7ff6580f8650 2024-02-13T00:23:24.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.053+0000 7ff64dd9b700 1 --2- 172.21.15.106:0/1901062296 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7ff6380326d0 0x7ff638034b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:23:24.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.053+0000 7ff64dd9b700 1 --2- 172.21.15.106:0/1901062296 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7ff6380326d0 0x7ff638034b90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7ff640009780 tx=0x7ff640006cc0).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:23:24.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.061+0000 7ff64ffff700 1 -- 172.21.15.106:0/1901062296 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff64801d4b0 con 0x7ff6580f8650 2024-02-13T00:23:24.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.257+0000 7ff65ca57700 1 -- 172.21.15.106:0/1901062296 --> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi080:172.21.15.80=a;smithi080:[v2:172.21.15.80:3301,v1:172.21.15.80:6790]=c;smithi106:172.21.15.106=b", "target": ["mon-mgr", ""]}) v1 -- 0x7ff658046df0 con 0x7ff6380326d0 2024-02-13T00:23:24.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.269+0000 7ff64ffff700 1 -- 172.21.15.106:0/1901062296 <== mgr.14146 v2:172.21.15.80:6800/461193090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ff658046df0 con 0x7ff6380326d0 2024-02-13T00:23:24.274 INFO:teuthology.orchestra.run.smithi106.stdout:Scheduled mon update... 2024-02-13T00:23:24.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.273+0000 7ff65ca57700 1 -- 172.21.15.106:0/1901062296 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7ff6380326d0 msgr2=0x7ff638034b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:24.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.273+0000 7ff65ca57700 1 --2- 172.21.15.106:0/1901062296 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7ff6380326d0 0x7ff638034b90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7ff640009780 tx=0x7ff640006cc0).stop 2024-02-13T00:23:24.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.273+0000 7ff65ca57700 1 -- 172.21.15.106:0/1901062296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6580f8650 msgr2=0x7ff65810cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:24.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.273+0000 7ff65ca57700 1 --2- 172.21.15.106:0/1901062296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6580f8650 0x7ff65810cee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7ff6480097f0 tx=0x7ff648009cb0).stop 2024-02-13T00:23:24.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.273+0000 7ff65ca57700 1 -- 172.21.15.106:0/1901062296 shutdown_connections 2024-02-13T00:23:24.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.273+0000 7ff65ca57700 1 --2- 172.21.15.106:0/1901062296 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7ff6380326d0 0x7ff638034b90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:24.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.273+0000 7ff65ca57700 1 --2- 172.21.15.106:0/1901062296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff6580f8650 0x7ff65810cee0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:24.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.273+0000 7ff65ca57700 1 -- 172.21.15.106:0/1901062296 >> 172.21.15.106:0/1901062296 conn(0x7ff6580f21a0 msgr2=0x7ff6580fb670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:23:24.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.273+0000 7ff65ca57700 1 -- 172.21.15.106:0/1901062296 shutdown_connections 2024-02-13T00:23:24.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:24.273+0000 7ff65ca57700 1 -- 172.21.15.106:0/1901062296 wait complete. 2024-02-13T00:23:25.259 DEBUG:teuthology.orchestra.run.smithi080:mon.c> sudo journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@mon.c.service 2024-02-13T00:23:25.262 DEBUG:teuthology.orchestra.run.smithi106:mon.b> sudo journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@mon.b.service 2024-02-13T00:23:25.264 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-02-13T00:23:25.264 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph mon dump -f json 2024-02-13T00:23:25.644 INFO:journalctl@ceph.mon.c.smithi080.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-13T00:23:25.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:25 smithi080 bash[17386]: audit 2024-02-13T00:23:24.258121+0000 mgr.y (mgr.14146) 42 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi080:172.21.15.80=a;smithi080:[v2:172.21.15.80:3301,v1:172.21.15.80:6790]=c;smithi106:172.21.15.106=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:23:25.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:25 smithi080 bash[17386]: cephadm 2024-02-13T00:23:24.264340+0000 mgr.y (mgr.14146) 43 : cephadm [INF] Saving service mon spec with placement smithi080:172.21.15.80=a;smithi080:[v2:172.21.15.80:3301,v1:172.21.15.80:6790]=c;smithi106:172.21.15.106=b;count:3 2024-02-13T00:23:25.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:25 smithi080 bash[17386]: audit 2024-02-13T00:23:24.268644+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:25.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:25 smithi080 bash[17386]: audit 2024-02-13T00:23:24.274363+0000 mon.a (mon.0) 116 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:23:25.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:25 smithi080 bash[17386]: audit 2024-02-13T00:23:24.277674+0000 mon.a (mon.0) 117 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:25.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:25 smithi080 bash[17386]: audit 2024-02-13T00:23:24.279360+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:23:25.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:25 smithi080 bash[17386]: audit 2024-02-13T00:23:24.285428+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:25.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:25 smithi080 bash[17386]: audit 2024-02-13T00:23:24.288235+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T00:23:25.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:25 smithi080 bash[17386]: audit 2024-02-13T00:23:24.289620+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:25.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:25 smithi080 bash[17386]: cephadm 2024-02-13T00:23:24.290857+0000 mgr.y (mgr.14146) 44 : cephadm [INF] Deploying daemon mon.b on smithi106 2024-02-13T00:23:25.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:25 smithi080 bash[17386]: cluster 2024-02-13T00:23:24.669502+0000 mgr.y (mgr.14146) 45 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:26.535 INFO:journalctl@ceph.mon.b.smithi106.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-13T00:23:28.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:27 smithi080 bash[17386]: cluster 2024-02-13T00:23:26.669959+0000 mgr.y (mgr.14146) 46 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:29.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.857+0000 7f16d1739700 1 -- 172.21.15.106:0/394159324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16cc0fbd00 msgr2=0x7f16cc0fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:29.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.857+0000 7f16d1739700 1 --2- 172.21.15.106:0/394159324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16cc0fbd00 0x7f16cc0fc0e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f16bc004770 tx=0x7f16bc009cb0).stop 2024-02-13T00:23:29.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.857+0000 7f16d1739700 1 -- 172.21.15.106:0/394159324 shutdown_connections 2024-02-13T00:23:29.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.857+0000 7f16d1739700 1 --2- 172.21.15.106:0/394159324 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16cc0fbd00 0x7f16cc0fc0e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:29.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.857+0000 7f16d1739700 1 -- 172.21.15.106:0/394159324 >> 172.21.15.106:0/394159324 conn(0x7f16cc0f1930 msgr2=0x7f16cc0f3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:23:29.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.857+0000 7f16d1739700 1 -- 172.21.15.106:0/394159324 shutdown_connections 2024-02-13T00:23:29.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.857+0000 7f16d1739700 1 -- 172.21.15.106:0/394159324 wait complete. 2024-02-13T00:23:29.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.857+0000 7f16d1739700 1 Processor -- start 2024-02-13T00:23:29.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.861+0000 7f16d1739700 1 -- start start 2024-02-13T00:23:29.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.861+0000 7f16d1739700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16cc0fbd00 0x7f16cc10ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:23:29.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.861+0000 7f16d1739700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc10b200 con 0x7f16cc0fbd00 2024-02-13T00:23:29.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.861+0000 7f16caffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16cc0fbd00 0x7f16cc10ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:23:29.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.861+0000 7f16caffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16cc0fbd00 0x7f16cc10ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.106:58788/0 (socket says 172.21.15.106:58788) 2024-02-13T00:23:29.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.861+0000 7f16caffd700 1 -- 172.21.15.106:0/920673449 learned_addr learned my addr 172.21.15.106:0/920673449 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-02-13T00:23:29.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.861+0000 7f16caffd700 1 -- 172.21.15.106:0/920673449 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc005040 con 0x7f16cc0fbd00 2024-02-13T00:23:29.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.861+0000 7f16caffd700 1 --2- 172.21.15.106:0/920673449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16cc0fbd00 0x7f16cc10ad10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f16bc0097f0 tx=0x7f16bc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:23:29.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.861+0000 7f16b3fff700 1 -- 172.21.15.106:0/920673449 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f16bc00e030 con 0x7f16cc0fbd00 2024-02-13T00:23:29.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.861+0000 7f16b3fff700 1 -- 172.21.15.106:0/920673449 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f16bc013df0 con 0x7f16cc0fbd00 2024-02-13T00:23:29.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.861+0000 7f16d1739700 1 -- 172.21.15.106:0/920673449 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16cc10b400 con 0x7f16cc0fbd00 2024-02-13T00:23:29.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.861+0000 7f16b3fff700 1 -- 172.21.15.106:0/920673449 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f16bc018070 con 0x7f16cc0fbd00 2024-02-13T00:23:29.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.861+0000 7f16d1739700 1 -- 172.21.15.106:0/920673449 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16cc10b810 con 0x7f16cc0fbd00 2024-02-13T00:23:29.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.861+0000 7f16d1739700 1 -- 172.21.15.106:0/920673449 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16cc05f100 con 0x7f16cc0fbd00 2024-02-13T00:23:29.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.861+0000 7f16b3fff700 1 -- 172.21.15.106:0/920673449 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 38673+0+0 (secure 0 0 0) 0x7f16bc013960 con 0x7f16cc0fbd00 2024-02-13T00:23:29.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.861+0000 7f16b3fff700 1 --2- 172.21.15.106:0/920673449 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f16b4034910 0x7f16b4036dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:23:29.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.865+0000 7f16b3fff700 1 -- 172.21.15.106:0/920673449 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f16bc044180 con 0x7f16cc0fbd00 2024-02-13T00:23:29.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.865+0000 7f16ca7fc700 1 --2- 172.21.15.106:0/920673449 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f16b4034910 0x7f16b4036dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:23:29.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.865+0000 7f16ca7fc700 1 --2- 172.21.15.106:0/920673449 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f16b4034910 0x7f16b4036dd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f16c0009780 tx=0x7f16c0006cc0).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:23:29.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:29.873+0000 7f16b3fff700 1 -- 172.21.15.106:0/920673449 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f16bc01d4b0 con 0x7f16cc0fbd00 2024-02-13T00:23:30.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:29 smithi080 bash[17386]: cluster 2024-02-13T00:23:28.670360+0000 mgr.y (mgr.14146) 47 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:30.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:30.133+0000 7f16d1739700 1 -- 172.21.15.106:0/920673449 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f16cc046d80 con 0x7f16cc0fbd00 2024-02-13T00:23:30.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:30.137+0000 7f16b3fff700 1 -- 172.21.15.106:0/920673449 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+723 (secure 0 0 0) 0x7f16bc01b370 con 0x7f16cc0fbd00 2024-02-13T00:23:30.140 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-02-13T00:23:30.140 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":1,"fsid":"a5ae7724-ca05-11ee-95b9-87774f69a715","modified":"2024-02-13T00:21:03.263470Z","created":"2024-02-13T00:21:03.263470Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3300","nonce":0},{"type":"v1","addr":"172.21.15.80:6789","nonce":0}]},"addr":"172.21.15.80:6789/0","public_addr":"172.21.15.80:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-13T00:23:30.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:30.141+0000 7f16d1739700 1 -- 172.21.15.106:0/920673449 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f16b4034910 msgr2=0x7f16b4036dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:30.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:30.141+0000 7f16d1739700 1 --2- 172.21.15.106:0/920673449 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f16b4034910 0x7f16b4036dd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f16c0009780 tx=0x7f16c0006cc0).stop 2024-02-13T00:23:30.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:30.141+0000 7f16d1739700 1 -- 172.21.15.106:0/920673449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16cc0fbd00 msgr2=0x7f16cc10ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:30.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:30.141+0000 7f16d1739700 1 --2- 172.21.15.106:0/920673449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16cc0fbd00 0x7f16cc10ad10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f16bc0097f0 tx=0x7f16bc009cb0).stop 2024-02-13T00:23:30.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:30.141+0000 7f16d1739700 1 -- 172.21.15.106:0/920673449 shutdown_connections 2024-02-13T00:23:30.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:30.141+0000 7f16d1739700 1 --2- 172.21.15.106:0/920673449 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f16b4034910 0x7f16b4036dd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:30.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:30.141+0000 7f16d1739700 1 --2- 172.21.15.106:0/920673449 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f16cc0fbd00 0x7f16cc10ad10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:30.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:30.141+0000 7f16d1739700 1 -- 172.21.15.106:0/920673449 >> 172.21.15.106:0/920673449 conn(0x7f16cc0f1930 msgr2=0x7f16cc0f9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:23:30.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:30.141+0000 7f16d1739700 1 -- 172.21.15.106:0/920673449 shutdown_connections 2024-02-13T00:23:30.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:30.145+0000 7f16d1739700 1 -- 172.21.15.106:0/920673449 wait complete. 2024-02-13T00:23:30.149 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 1 2024-02-13T00:23:30.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:30 smithi106 systemd[1]: Started Ceph mon.b for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:23:31.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:30 smithi080 bash[17386]: audit 2024-02-13T00:23:30.135225+0000 mon.a (mon.0) 122 : audit [DBG] from='client.? 172.21.15.106:0/920673449' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-13T00:23:31.935 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-02-13T00:23:31.935 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph mon dump -f json 2024-02-13T00:23:31.949 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.745+0000 7f25ff792880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-13T00:23:31.949 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.745+0000 7f25ff792880 0 ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable), process ceph-mon, pid 7 2024-02-13T00:23:31.949 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.745+0000 7f25ff792880 0 pidfile_write: ignore empty --pid-file 2024-02-13T00:23:31.949 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.749+0000 7f25ff792880 0 load: jerasure load: lrc load: isa 2024-02-13T00:23:31.949 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: RocksDB version: 6.8.1 2024-02-13T00:23:31.949 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-13T00:23:31.950 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Compile date Feb 8 2024 2024-02-13T00:23:31.950 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: DB SUMMARY 2024-02-13T00:23:31.950 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: CURRENT file: CURRENT 2024-02-13T00:23:31.950 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-13T00:23:31.950 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2024-02-13T00:23:31.950 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-02-13T00:23:31.950 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000003.log size: 511 ; 2024-02-13T00:23:31.950 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.error_if_exists: 0 2024-02-13T00:23:31.950 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.create_if_missing: 0 2024-02-13T00:23:31.950 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.paranoid_checks: 1 2024-02-13T00:23:31.950 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.env: 0x558a6e026080 2024-02-13T00:23:31.950 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.fs: Posix File System 2024-02-13T00:23:31.951 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.info_log: 0x558a6f364220 2024-02-13T00:23:31.951 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-13T00:23:31.951 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.statistics: (nil) 2024-02-13T00:23:31.951 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.use_fsync: 0 2024-02-13T00:23:31.951 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_log_file_size: 0 2024-02-13T00:23:31.951 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-13T00:23:31.951 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-13T00:23:31.951 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-13T00:23:31.951 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-13T00:23:31.951 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.allow_fallocate: 1 2024-02-13T00:23:31.951 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-13T00:23:31.951 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-13T00:23:31.951 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.use_direct_reads: 0 2024-02-13T00:23:31.951 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-13T00:23:31.952 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-13T00:23:31.952 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.db_log_dir: 2024-02-13T00:23:31.952 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2024-02-13T00:23:31.952 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-13T00:23:31.952 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_subcompactions: 1 2024-02-13T00:23:31.952 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_background_flushes: -1 2024-02-13T00:23:31.952 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-13T00:23:31.952 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-13T00:23:31.952 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-13T00:23:31.952 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-13T00:23:31.952 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-13T00:23:31.952 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-13T00:23:31.952 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-13T00:23:31.952 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.write_buffer_manager: 0x558a700583f0 2024-02-13T00:23:31.953 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-13T00:23:31.953 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-13T00:23:31.953 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-13T00:23:31.953 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-13T00:23:31.953 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-13T00:23:31.953 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-13T00:23:31.953 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-13T00:23:31.953 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-13T00:23:31.953 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-13T00:23:31.953 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.unordered_write: 0 2024-02-13T00:23:31.953 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-13T00:23:31.953 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-13T00:23:31.953 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-13T00:23:31.954 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-13T00:23:31.954 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.row_cache: None 2024-02-13T00:23:31.954 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.wal_filter: None 2024-02-13T00:23:31.954 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-13T00:23:31.954 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-13T00:23:31.954 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.preserve_deletes: 0 2024-02-13T00:23:31.954 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.two_write_queues: 0 2024-02-13T00:23:31.954 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-13T00:23:31.954 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.atomic_flush: 0 2024-02-13T00:23:31.954 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-13T00:23:31.954 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-13T00:23:31.954 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-13T00:23:31.954 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.log_readahead_size: 0 2024-02-13T00:23:31.954 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-13T00:23:31.954 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_background_jobs: 2 2024-02-13T00:23:31.954 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_background_compactions: -1 2024-02-13T00:23:31.954 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-13T00:23:31.955 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-13T00:23:31.955 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-13T00:23:31.955 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-13T00:23:31.955 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-13T00:23:31.955 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-13T00:23:31.957 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-13T00:23:31.957 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-13T00:23:31.957 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_open_files: -1 2024-02-13T00:23:31.957 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-13T00:23:31.957 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-13T00:23:31.957 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-13T00:23:31.957 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-13T00:23:31.957 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Compression algorithms supported: 2024-02-13T00:23:31.957 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-13T00:23:31.957 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: kZSTD supported: 0 2024-02-13T00:23:31.957 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: kXpressCompression supported: 0 2024-02-13T00:23:31.957 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-13T00:23:31.958 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: kLZ4Compression supported: 1 2024-02-13T00:23:31.958 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: kBZip2Compression supported: 0 2024-02-13T00:23:31.958 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: kZlibCompression supported: 1 2024-02-13T00:23:31.958 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: kSnappyCompression supported: 1 2024-02-13T00:23:31.958 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-13T00:23:31.958 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 2024-02-13T00:23:31.958 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-13T00:23:31.958 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-13T00:23:31.958 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.merge_operator: 2024-02-13T00:23:31.958 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.compaction_filter: None 2024-02-13T00:23:31.958 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-13T00:23:31.958 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-13T00:23:31.958 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-13T00:23:31.958 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558a6f307d28) 2024-02-13T00:23:31.958 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: cache_index_and_filter_blocks: 1 2024-02-13T00:23:31.958 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-13T00:23:31.959 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-13T00:23:31.959 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: pin_top_level_index_and_filter: 1 2024-02-13T00:23:31.959 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: index_type: 0 2024-02-13T00:23:31.959 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: data_block_index_type: 0 2024-02-13T00:23:31.959 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: index_shortening: 1 2024-02-13T00:23:31.959 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: data_block_hash_table_util_ratio: 0.750000 2024-02-13T00:23:31.959 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: hash_index_allow_collision: 1 2024-02-13T00:23:31.959 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: checksum: 1 2024-02-13T00:23:31.959 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: no_block_cache: 0 2024-02-13T00:23:31.959 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: block_cache: 0x558a6f33ef10 2024-02-13T00:23:31.959 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: block_cache_name: BinnedLRUCache 2024-02-13T00:23:31.959 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: block_cache_options: 2024-02-13T00:23:31.959 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: capacity : 536870912 2024-02-13T00:23:31.959 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: num_shard_bits : 4 2024-02-13T00:23:31.959 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: strict_capacity_limit : 0 2024-02-13T00:23:31.959 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: high_pri_pool_ratio: 0.000 2024-02-13T00:23:31.959 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: block_cache_compressed: (nil) 2024-02-13T00:23:31.960 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: persistent_cache: (nil) 2024-02-13T00:23:31.960 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: block_size: 4096 2024-02-13T00:23:31.960 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: block_size_deviation: 10 2024-02-13T00:23:31.960 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: block_restart_interval: 16 2024-02-13T00:23:31.960 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: index_block_restart_interval: 1 2024-02-13T00:23:31.960 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: metadata_block_size: 4096 2024-02-13T00:23:31.960 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: partition_filters: 0 2024-02-13T00:23:31.960 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: use_delta_encoding: 1 2024-02-13T00:23:31.960 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-13T00:23:31.960 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: whole_key_filtering: 1 2024-02-13T00:23:31.960 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: verify_compression: 0 2024-02-13T00:23:31.960 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: read_amp_bytes_per_bit: 0 2024-02-13T00:23:31.960 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: format_version: 2 2024-02-13T00:23:31.960 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: enable_index_compression: 1 2024-02-13T00:23:31.960 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: block_align: 0 2024-02-13T00:23:31.961 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-13T00:23:31.961 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-13T00:23:31.961 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.compression: NoCompression 2024-02-13T00:23:31.961 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-13T00:23:31.961 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-13T00:23:31.961 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-13T00:23:31.961 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.num_levels: 7 2024-02-13T00:23:31.961 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-13T00:23:31.961 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-13T00:23:31.961 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-13T00:23:31.961 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-13T00:23:31.961 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-13T00:23:31.961 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-13T00:23:31.961 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-13T00:23:31.961 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-13T00:23:31.961 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-13T00:23:31.962 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-13T00:23:31.962 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-13T00:23:31.962 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-13T00:23:31.962 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-13T00:23:31.962 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-13T00:23:31.962 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-13T00:23:31.962 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-13T00:23:31.962 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-13T00:23:31.962 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-13T00:23:31.962 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-13T00:23:31.962 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-13T00:23:31.962 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-13T00:23:31.962 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-13T00:23:31.962 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-13T00:23:31.962 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-13T00:23:31.962 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-13T00:23:31.962 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-13T00:23:31.963 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-13T00:23:31.963 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-13T00:23:31.963 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-13T00:23:31.963 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-13T00:23:31.963 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-13T00:23:31.963 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-13T00:23:31.963 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-13T00:23:31.963 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-13T00:23:31.963 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-13T00:23:31.963 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-13T00:23:31.963 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-13T00:23:31.963 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-13T00:23:31.963 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-13T00:23:31.963 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-13T00:23:31.963 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-13T00:23:31.964 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-13T00:23:31.964 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-13T00:23:31.964 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-13T00:23:31.964 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-13T00:23:31.964 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-13T00:23:31.964 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-13T00:23:31.964 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.table_properties_collectors: 2024-02-13T00:23:31.964 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.inplace_update_support: 0 2024-02-13T00:23:31.964 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-13T00:23:31.964 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-13T00:23:31.964 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-13T00:23:31.964 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-13T00:23:31.964 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.bloom_locality: 0 2024-02-13T00:23:31.964 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.max_successive_merges: 0 2024-02-13T00:23:31.964 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-13T00:23:31.965 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-13T00:23:31.965 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-13T00:23:31.965 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-13T00:23:31.965 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.ttl: 2592000 2024-02-13T00:23:31.965 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-13T00:23:31.965 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-13T00:23:31.965 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2024-02-13T00:23:31.965 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707783811754989, "job": 1, "event": "recovery_started", "log_files": [3]} 2024-02-13T00:23:31.965 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2024-02-13T00:23:31.965 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-13T00:23:31.965 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707783811755647, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1437, "table_properties": {"data_size": 523, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1707783811, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-13T00:23:31.965 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2024-02-13T00:23:31.965 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707783811756153, "job": 1, "event": "recovery_finished"} 2024-02-13T00:23:31.965 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 4 rocksdb: DB pointer 0x558a6f407800 2024-02-13T00:23:31.965 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25e6583700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-13T00:23:31.966 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25e6583700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-13T00:23:31.966 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: ** DB Stats ** 2024-02-13T00:23:31.966 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-13T00:23:31.966 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-13T00:23:31.966 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-13T00:23:31.966 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-13T00:23:31.966 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-13T00:23:31.966 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-13T00:23:31.966 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-13T00:23:31.966 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: ** Compaction Stats [default] ** 2024-02-13T00:23:31.967 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-13T00:23:31.967 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-13T00:23:31.967 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.4 0.00 0.00 1 0.001 0 0 2024-02-13T00:23:31.967 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.4 0.00 0.00 1 0.001 0 0 2024-02-13T00:23:31.967 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.4 0.00 0.00 1 0.001 0 0 2024-02-13T00:23:31.967 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: ** Compaction Stats [default] ** 2024-02-13T00:23:31.967 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-13T00:23:31.967 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-13T00:23:31.967 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.4 0.00 0.00 1 0.001 0 0 2024-02-13T00:23:31.967 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-13T00:23:31.967 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-13T00:23:31.967 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-13T00:23:31.967 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: AddFile(Total Files): cumulative 0, interval 0 2024-02-13T00:23:31.967 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-13T00:23:31.968 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: AddFile(Keys): cumulative 0, interval 0 2024-02-13T00:23:31.968 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Cumulative compaction: 0.00 GB write, 0.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-13T00:23:31.968 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Interval compaction: 0.00 GB write, 0.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-13T00:23:31.968 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-13T00:23:31.968 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: ** File Read Latency Histogram By Level [default] ** 2024-02-13T00:23:31.968 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: ** Compaction Stats [default] ** 2024-02-13T00:23:31.968 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-13T00:23:31.968 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-13T00:23:31.968 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.4 0.00 0.00 1 0.001 0 0 2024-02-13T00:23:31.968 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.4 0.00 0.00 1 0.001 0 0 2024-02-13T00:23:31.968 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-13T00:23:31.968 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: ** Compaction Stats [default] ** 2024-02-13T00:23:31.968 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-13T00:23:31.968 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-13T00:23:31.969 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.4 0.00 0.00 1 0.001 0 0 2024-02-13T00:23:31.969 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-13T00:23:31.969 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-13T00:23:31.969 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-13T00:23:31.969 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: AddFile(Total Files): cumulative 0, interval 0 2024-02-13T00:23:31.969 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-13T00:23:31.969 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: AddFile(Keys): cumulative 0, interval 0 2024-02-13T00:23:31.969 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Cumulative compaction: 0.00 GB write, 0.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-13T00:23:31.969 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-13T00:23:31.969 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-13T00:23:31.969 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: ** File Read Latency Histogram By Level [default] ** 2024-02-13T00:23:31.969 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.753+0000 7f25ff792880 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2024-02-13T00:23:31.969 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.757+0000 7f25ff792880 0 using public_addr v2:172.21.15.106:0/0 -> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] 2024-02-13T00:23:31.969 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.757+0000 7f25ff792880 0 starting mon.b rank -1 at public addrs [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] at bind addrs [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:23:31.969 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.757+0000 7f25ff792880 1 mon.b@-1(???) e0 preinit fsid a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:23:31.969 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.789+0000 7f25e8d88700 0 mon.b@-1(synchronizing).mds e1 new map 2024-02-13T00:23:31.970 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.789+0000 7f25e8d88700 0 mon.b@-1(synchronizing).mds e1 print_map 2024-02-13T00:23:31.970 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: e1 2024-02-13T00:23:31.970 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: enable_multiple, ever_enabled_multiple: 1,1 2024-02-13T00:23:31.970 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-13T00:23:31.970 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: legacy client fscid: -1 2024-02-13T00:23:31.970 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: 2024-02-13T00:23:31.970 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: No filesystems configured 2024-02-13T00:23:31.970 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.789+0000 7f25e8d88700 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-02-13T00:23:31.970 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.789+0000 7f25e8d88700 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-13T00:23:31.970 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.789+0000 7f25e8d88700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-13T00:23:31.970 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.789+0000 7f25e8d88700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-13T00:23:31.970 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.789+0000 7f25e8d88700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-13T00:23:31.970 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.789+0000 7f25e8d88700 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-13T00:23:31.970 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.793+0000 7f25e8d88700 0 mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-13T00:23:31.970 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.793+0000 7f25e8d88700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-13T00:23:31.971 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.793+0000 7f25e8d88700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-13T00:23:31.971 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.793+0000 7f25e8d88700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-13T00:23:31.971 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: cluster 2024-02-13T00:23:30.670803+0000 mgr.y (mgr.14146) 48 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:31.971 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: audit 2024-02-13T00:23:30.744950+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:31.971 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: audit 2024-02-13T00:23:30.746520+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T00:23:31.971 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: audit 2024-02-13T00:23:30.747892+0000 mon.a (mon.0) 125 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:31.971 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: cephadm 2024-02-13T00:23:30.749027+0000 mgr.y (mgr.14146) 49 : cephadm [INF] Deploying daemon mon.c on smithi080 2024-02-13T00:23:31.971 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:31 smithi106 bash[18459]: debug 2024-02-13T00:23:31.793+0000 7f25e8d88700 1 mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-02-13T00:23:32.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:31 smithi080 bash[17386]: cluster 2024-02-13T00:23:30.670803+0000 mgr.y (mgr.14146) 48 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:32.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:31 smithi080 bash[17386]: audit 2024-02-13T00:23:30.744950+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:32.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:31 smithi080 bash[17386]: audit 2024-02-13T00:23:30.746520+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T00:23:32.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:31 smithi080 bash[17386]: audit 2024-02-13T00:23:30.747892+0000 mon.a (mon.0) 125 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:32.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:31 smithi080 bash[17386]: cephadm 2024-02-13T00:23:30.749027+0000 mgr.y (mgr.14146) 49 : cephadm [INF] Deploying daemon mon.c on smithi080 2024-02-13T00:23:35.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:34 smithi080 systemd[1]: Started Ceph mon.c for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:23:36.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.822+0000 7f5748616880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-13T00:23:36.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.822+0000 7f5748616880 0 ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable), process ceph-mon, pid 7 2024-02-13T00:23:36.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.822+0000 7f5748616880 0 pidfile_write: ignore empty --pid-file 2024-02-13T00:23:36.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 0 load: jerasure load: lrc load: isa 2024-02-13T00:23:36.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: RocksDB version: 6.8.1 2024-02-13T00:23:36.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-13T00:23:36.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Compile date Feb 8 2024 2024-02-13T00:23:36.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: DB SUMMARY 2024-02-13T00:23:36.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: CURRENT file: CURRENT 2024-02-13T00:23:36.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-13T00:23:36.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2024-02-13T00:23:36.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-02-13T00:23:36.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000003.log size: 511 ; 2024-02-13T00:23:36.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.error_if_exists: 0 2024-02-13T00:23:36.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.create_if_missing: 0 2024-02-13T00:23:36.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.paranoid_checks: 1 2024-02-13T00:23:36.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.env: 0x55c9d3826080 2024-02-13T00:23:36.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.fs: Posix File System 2024-02-13T00:23:36.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.info_log: 0x55c9d4aa6220 2024-02-13T00:23:36.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-13T00:23:36.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.statistics: (nil) 2024-02-13T00:23:36.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.use_fsync: 0 2024-02-13T00:23:36.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_log_file_size: 0 2024-02-13T00:23:36.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-13T00:23:36.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-13T00:23:36.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-13T00:23:36.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-13T00:23:36.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.allow_fallocate: 1 2024-02-13T00:23:36.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-13T00:23:36.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-13T00:23:36.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.use_direct_reads: 0 2024-02-13T00:23:36.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-13T00:23:36.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-13T00:23:36.015 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.db_log_dir: 2024-02-13T00:23:36.015 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2024-02-13T00:23:36.015 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-13T00:23:36.015 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_subcompactions: 1 2024-02-13T00:23:36.015 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_background_flushes: -1 2024-02-13T00:23:36.015 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-13T00:23:36.015 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-13T00:23:36.015 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-13T00:23:36.015 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-13T00:23:36.015 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-13T00:23:36.015 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-13T00:23:36.016 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-13T00:23:36.016 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.write_buffer_manager: 0x55c9d5718420 2024-02-13T00:23:36.016 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-13T00:23:36.016 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-13T00:23:36.016 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-13T00:23:36.016 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-13T00:23:36.016 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-13T00:23:36.016 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-13T00:23:36.016 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-13T00:23:36.016 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-13T00:23:36.018 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-13T00:23:36.018 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.unordered_write: 0 2024-02-13T00:23:36.018 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-13T00:23:36.018 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-13T00:23:36.018 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-13T00:23:36.018 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-13T00:23:36.018 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.row_cache: None 2024-02-13T00:23:36.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.wal_filter: None 2024-02-13T00:23:36.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-13T00:23:36.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-13T00:23:36.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.preserve_deletes: 0 2024-02-13T00:23:36.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.two_write_queues: 0 2024-02-13T00:23:36.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-13T00:23:36.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.atomic_flush: 0 2024-02-13T00:23:36.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-13T00:23:36.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-13T00:23:36.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-13T00:23:36.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.log_readahead_size: 0 2024-02-13T00:23:36.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-13T00:23:36.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_background_jobs: 2 2024-02-13T00:23:36.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_background_compactions: -1 2024-02-13T00:23:36.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-13T00:23:36.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-13T00:23:36.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-13T00:23:36.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-13T00:23:36.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-13T00:23:36.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-13T00:23:36.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-13T00:23:36.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-13T00:23:36.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_open_files: -1 2024-02-13T00:23:36.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-13T00:23:36.020 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-13T00:23:36.021 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-13T00:23:36.021 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-13T00:23:36.021 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Compression algorithms supported: 2024-02-13T00:23:36.021 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-13T00:23:36.021 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: kZSTD supported: 0 2024-02-13T00:23:36.021 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: kXpressCompression supported: 0 2024-02-13T00:23:36.021 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-13T00:23:36.021 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: kLZ4Compression supported: 1 2024-02-13T00:23:36.021 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: kBZip2Compression supported: 0 2024-02-13T00:23:36.021 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: kZlibCompression supported: 1 2024-02-13T00:23:36.021 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: kSnappyCompression supported: 1 2024-02-13T00:23:36.021 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-13T00:23:36.022 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 2024-02-13T00:23:36.022 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-13T00:23:36.022 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-13T00:23:36.022 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.merge_operator: 2024-02-13T00:23:36.022 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.compaction_filter: None 2024-02-13T00:23:36.022 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-13T00:23:36.022 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-13T00:23:36.022 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-13T00:23:36.022 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c9d4a49d28) 2024-02-13T00:23:36.022 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: cache_index_and_filter_blocks: 1 2024-02-13T00:23:36.022 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-13T00:23:36.022 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-13T00:23:36.022 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: pin_top_level_index_and_filter: 1 2024-02-13T00:23:36.023 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: index_type: 0 2024-02-13T00:23:36.023 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: data_block_index_type: 0 2024-02-13T00:23:36.023 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: index_shortening: 1 2024-02-13T00:23:36.023 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: data_block_hash_table_util_ratio: 0.750000 2024-02-13T00:23:36.023 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: hash_index_allow_collision: 1 2024-02-13T00:23:36.023 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: checksum: 1 2024-02-13T00:23:36.023 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: no_block_cache: 0 2024-02-13T00:23:36.023 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: block_cache: 0x55c9d4a80f10 2024-02-13T00:23:36.023 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: block_cache_name: BinnedLRUCache 2024-02-13T00:23:36.023 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: block_cache_options: 2024-02-13T00:23:36.023 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: capacity : 536870912 2024-02-13T00:23:36.023 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: num_shard_bits : 4 2024-02-13T00:23:36.023 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: strict_capacity_limit : 0 2024-02-13T00:23:36.024 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: high_pri_pool_ratio: 0.000 2024-02-13T00:23:36.024 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: block_cache_compressed: (nil) 2024-02-13T00:23:36.024 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: persistent_cache: (nil) 2024-02-13T00:23:36.024 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: block_size: 4096 2024-02-13T00:23:36.024 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: block_size_deviation: 10 2024-02-13T00:23:36.024 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: block_restart_interval: 16 2024-02-13T00:23:36.024 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: index_block_restart_interval: 1 2024-02-13T00:23:36.024 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: metadata_block_size: 4096 2024-02-13T00:23:36.024 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: partition_filters: 0 2024-02-13T00:23:36.024 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: use_delta_encoding: 1 2024-02-13T00:23:36.024 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-13T00:23:36.024 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: whole_key_filtering: 1 2024-02-13T00:23:36.025 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: verify_compression: 0 2024-02-13T00:23:36.025 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: read_amp_bytes_per_bit: 0 2024-02-13T00:23:36.025 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: format_version: 2 2024-02-13T00:23:36.025 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: enable_index_compression: 1 2024-02-13T00:23:36.025 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: block_align: 0 2024-02-13T00:23:36.025 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-13T00:23:36.025 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-13T00:23:36.025 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.compression: NoCompression 2024-02-13T00:23:36.025 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-13T00:23:36.025 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-13T00:23:36.025 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-13T00:23:36.025 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.num_levels: 7 2024-02-13T00:23:36.025 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-13T00:23:36.025 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-13T00:23:36.026 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-13T00:23:36.026 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-13T00:23:36.026 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-13T00:23:36.026 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-13T00:23:36.026 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-13T00:23:36.026 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-13T00:23:36.026 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-13T00:23:36.026 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-13T00:23:36.026 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-13T00:23:36.026 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-13T00:23:36.026 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-13T00:23:36.026 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-13T00:23:36.027 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-13T00:23:36.027 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-13T00:23:36.027 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-13T00:23:36.027 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-13T00:23:36.027 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-13T00:23:36.027 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-13T00:23:36.027 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-13T00:23:36.027 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-13T00:23:36.027 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-13T00:23:36.027 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-13T00:23:36.027 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-13T00:23:36.027 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-13T00:23:36.027 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-13T00:23:36.027 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-13T00:23:36.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-13T00:23:36.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-13T00:23:36.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-13T00:23:36.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-13T00:23:36.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-13T00:23:36.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-13T00:23:36.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-13T00:23:36.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-13T00:23:36.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-13T00:23:36.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-13T00:23:36.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-13T00:23:36.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-13T00:23:36.028 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-13T00:23:36.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-13T00:23:36.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-13T00:23:36.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-13T00:23:36.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-13T00:23:36.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-13T00:23:36.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-13T00:23:36.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.table_properties_collectors: 2024-02-13T00:23:36.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.inplace_update_support: 0 2024-02-13T00:23:36.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-13T00:23:36.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-13T00:23:36.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-13T00:23:36.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-13T00:23:36.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.bloom_locality: 0 2024-02-13T00:23:36.029 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.max_successive_merges: 0 2024-02-13T00:23:36.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-13T00:23:36.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-13T00:23:36.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-13T00:23:36.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-13T00:23:36.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.ttl: 2592000 2024-02-13T00:23:36.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.826+0000 7f5748616880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-13T00:23:36.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.830+0000 7f5748616880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-13T00:23:36.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.830+0000 7f5748616880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2024-02-13T00:23:36.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.830+0000 7f5748616880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707783815833606, "job": 1, "event": "recovery_started", "log_files": [3]} 2024-02-13T00:23:36.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.830+0000 7f5748616880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2024-02-13T00:23:36.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.830+0000 7f5748616880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-13T00:23:36.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.830+0000 7f5748616880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707783815834445, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1437, "table_properties": {"data_size": 523, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1707783815, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-13T00:23:36.030 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.830+0000 7f5748616880 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2024-02-13T00:23:36.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.830+0000 7f5748616880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707783815835110, "job": 1, "event": "recovery_finished"} 2024-02-13T00:23:36.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.834+0000 7f5748616880 4 rocksdb: DB pointer 0x55c9d4b49800 2024-02-13T00:23:36.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.834+0000 7f572f407700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-13T00:23:36.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.834+0000 7f572f407700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-13T00:23:36.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: ** DB Stats ** 2024-02-13T00:23:36.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-13T00:23:36.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-13T00:23:36.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-13T00:23:36.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-13T00:23:36.031 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-13T00:23:36.032 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-13T00:23:36.032 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-13T00:23:36.032 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: ** Compaction Stats [default] ** 2024-02-13T00:23:36.032 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-13T00:23:36.032 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-13T00:23:36.032 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.0 0.00 0.00 1 0.001 0 0 2024-02-13T00:23:36.032 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.0 0.00 0.00 1 0.001 0 0 2024-02-13T00:23:36.032 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.0 0.00 0.00 1 0.001 0 0 2024-02-13T00:23:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: ** Compaction Stats [default] ** 2024-02-13T00:23:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-13T00:23:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-13T00:23:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.0 0.00 0.00 1 0.001 0 0 2024-02-13T00:23:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-13T00:23:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-13T00:23:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-13T00:23:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: AddFile(Total Files): cumulative 0, interval 0 2024-02-13T00:23:36.033 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-13T00:23:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: AddFile(Keys): cumulative 0, interval 0 2024-02-13T00:23:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Cumulative compaction: 0.00 GB write, 0.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-13T00:23:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Interval compaction: 0.00 GB write, 0.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-13T00:23:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-13T00:23:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: ** File Read Latency Histogram By Level [default] ** 2024-02-13T00:23:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: ** Compaction Stats [default] ** 2024-02-13T00:23:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-13T00:23:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-13T00:23:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.0 0.00 0.00 1 0.001 0 0 2024-02-13T00:23:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.0 0.00 0.00 1 0.001 0 0 2024-02-13T00:23:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-13T00:23:36.034 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: ** Compaction Stats [default] ** 2024-02-13T00:23:36.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-13T00:23:36.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-13T00:23:36.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.0 0.00 0.00 1 0.001 0 0 2024-02-13T00:23:36.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-13T00:23:36.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-13T00:23:36.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-13T00:23:36.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: AddFile(Total Files): cumulative 0, interval 0 2024-02-13T00:23:36.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-13T00:23:36.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: AddFile(Keys): cumulative 0, interval 0 2024-02-13T00:23:36.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Cumulative compaction: 0.00 GB write, 0.28 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-13T00:23:36.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-13T00:23:36.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-13T00:23:36.035 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: ** File Read Latency Histogram By Level [default] ** 2024-02-13T00:23:36.036 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.834+0000 7f5748616880 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2024-02-13T00:23:36.036 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.834+0000 7f5748616880 0 using public_addrv [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] 2024-02-13T00:23:36.036 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.834+0000 7f5748616880 0 starting mon.c rank -1 at public addrs [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] at bind addrs [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:23:36.036 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.834+0000 7f5748616880 1 mon.c@-1(???) e0 preinit fsid a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:23:36.036 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.858+0000 7f5731c0c700 0 mon.c@-1(synchronizing).mds e1 new map 2024-02-13T00:23:36.036 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.858+0000 7f5731c0c700 0 mon.c@-1(synchronizing).mds e1 print_map 2024-02-13T00:23:36.036 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: e1 2024-02-13T00:23:36.036 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: enable_multiple, ever_enabled_multiple: 1,1 2024-02-13T00:23:36.036 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-13T00:23:36.036 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: legacy client fscid: -1 2024-02-13T00:23:36.036 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: 2024-02-13T00:23:36.036 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: No filesystems configured 2024-02-13T00:23:36.037 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.858+0000 7f5731c0c700 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-02-13T00:23:36.037 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.858+0000 7f5731c0c700 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-13T00:23:36.037 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.858+0000 7f5731c0c700 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-13T00:23:36.037 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.858+0000 7f5731c0c700 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-13T00:23:36.037 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.858+0000 7f5731c0c700 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-13T00:23:36.037 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.862+0000 7f5731c0c700 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-13T00:23:36.037 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.862+0000 7f5731c0c700 0 mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-13T00:23:36.037 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.862+0000 7f5731c0c700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-13T00:23:36.037 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.862+0000 7f5731c0c700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-13T00:23:36.037 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.862+0000 7f5731c0c700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-13T00:23:36.037 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: cluster 2024-02-13T00:23:30.670803+0000 mgr.y (mgr.14146) 48 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:36.037 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: audit 2024-02-13T00:23:30.744950+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:36.037 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: audit 2024-02-13T00:23:30.746520+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T00:23:36.038 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: audit 2024-02-13T00:23:30.747892+0000 mon.a (mon.0) 125 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:36.038 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: cephadm 2024-02-13T00:23:30.749027+0000 mgr.y (mgr.14146) 49 : cephadm [INF] Deploying daemon mon.c on smithi080 2024-02-13T00:23:36.038 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:35 smithi080 bash[24237]: debug 2024-02-13T00:23:35.862+0000 7f5731c0c700 1 mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-02-13T00:23:37.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:36 smithi106 bash[18459]: audit 2024-02-13T00:23:31.803744+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T00:23:37.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:36 smithi106 bash[18459]: cluster 2024-02-13T00:23:31.804174+0000 mon.a (mon.0) 128 : cluster [INF] mon.a calling monitor election 2024-02-13T00:23:37.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:36 smithi106 bash[18459]: audit 2024-02-13T00:23:31.825090+0000 mon.a (mon.0) 129 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:23:37.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:36 smithi106 bash[18459]: cluster 2024-02-13T00:23:32.671235+0000 mgr.y (mgr.14146) 50 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:37.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:36 smithi106 bash[18459]: audit 2024-02-13T00:23:32.798033+0000 mon.a (mon.0) 130 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:23:37.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:36 smithi106 bash[18459]: audit 2024-02-13T00:23:33.798448+0000 mon.a (mon.0) 131 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:23:37.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:36 smithi106 bash[18459]: cluster 2024-02-13T00:23:33.802440+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-02-13T00:23:37.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:36 smithi106 bash[18459]: cluster 2024-02-13T00:23:34.671680+0000 mgr.y (mgr.14146) 51 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:37.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:36 smithi106 bash[18459]: audit 2024-02-13T00:23:34.798021+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:23:37.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:36 smithi106 bash[18459]: audit 2024-02-13T00:23:35.798775+0000 mon.a (mon.0) 133 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:23:37.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:36 smithi106 bash[18459]: audit 2024-02-13T00:23:35.871188+0000 mon.a (mon.0) 134 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:37.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:36 smithi106 bash[18459]: audit 2024-02-13T00:23:36.798740+0000 mon.a (mon.0) 135 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:23:37.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:36 smithi106 bash[18459]: cluster 2024-02-13T00:23:36.845829+0000 mon.a (mon.0) 136 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-02-13T00:23:37.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:36 smithi106 bash[18459]: cluster 2024-02-13T00:23:36.855661+0000 mon.a (mon.0) 137 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0]} removed_ranks: {} 2024-02-13T00:23:37.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:36 smithi106 bash[18459]: cluster 2024-02-13T00:23:36.873100+0000 mon.a (mon.0) 138 : cluster [DBG] fsmap 2024-02-13T00:23:37.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:36 smithi106 bash[18459]: cluster 2024-02-13T00:23:36.873152+0000 mon.a (mon.0) 139 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-13T00:23:37.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:36 smithi106 bash[18459]: cluster 2024-02-13T00:23:36.873473+0000 mon.a (mon.0) 140 : cluster [DBG] mgrmap e13: y(active, since 90s) 2024-02-13T00:23:37.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:36 smithi106 bash[18459]: audit 2024-02-13T00:23:36.876667+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:37.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:36 smithi106 bash[18459]: cluster 2024-02-13T00:23:36.879840+0000 mon.a (mon.0) 142 : cluster [INF] overall HEALTH_OK 2024-02-13T00:23:37.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:36 smithi106 bash[18459]: audit 2024-02-13T00:23:36.883832+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:37.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:36 smithi106 bash[18459]: audit 2024-02-13T00:23:36.885461+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:23:37.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:36 smithi080 bash[17386]: audit 2024-02-13T00:23:31.803744+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T00:23:37.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:36 smithi080 bash[17386]: cluster 2024-02-13T00:23:31.804174+0000 mon.a (mon.0) 128 : cluster [INF] mon.a calling monitor election 2024-02-13T00:23:37.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:36 smithi080 bash[17386]: audit 2024-02-13T00:23:31.825090+0000 mon.a (mon.0) 129 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:23:37.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:36 smithi080 bash[17386]: cluster 2024-02-13T00:23:32.671235+0000 mgr.y (mgr.14146) 50 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:37.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:36 smithi080 bash[17386]: audit 2024-02-13T00:23:32.798033+0000 mon.a (mon.0) 130 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:23:37.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:36 smithi080 bash[17386]: audit 2024-02-13T00:23:33.798448+0000 mon.a (mon.0) 131 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:23:37.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:36 smithi080 bash[17386]: cluster 2024-02-13T00:23:33.802440+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-02-13T00:23:37.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:36 smithi080 bash[17386]: cluster 2024-02-13T00:23:34.671680+0000 mgr.y (mgr.14146) 51 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:37.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:36 smithi080 bash[17386]: audit 2024-02-13T00:23:34.798021+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:23:37.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:36 smithi080 bash[17386]: audit 2024-02-13T00:23:35.798775+0000 mon.a (mon.0) 133 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:23:37.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:36 smithi080 bash[17386]: audit 2024-02-13T00:23:35.871188+0000 mon.a (mon.0) 134 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:37.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:36 smithi080 bash[17386]: audit 2024-02-13T00:23:36.798740+0000 mon.a (mon.0) 135 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:23:37.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:36 smithi080 bash[17386]: cluster 2024-02-13T00:23:36.845829+0000 mon.a (mon.0) 136 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-02-13T00:23:37.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:36 smithi080 bash[17386]: cluster 2024-02-13T00:23:36.855661+0000 mon.a (mon.0) 137 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0]} removed_ranks: {} 2024-02-13T00:23:37.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:36 smithi080 bash[17386]: cluster 2024-02-13T00:23:36.873100+0000 mon.a (mon.0) 138 : cluster [DBG] fsmap 2024-02-13T00:23:37.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:36 smithi080 bash[17386]: cluster 2024-02-13T00:23:36.873152+0000 mon.a (mon.0) 139 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-13T00:23:37.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:36 smithi080 bash[17386]: cluster 2024-02-13T00:23:36.873473+0000 mon.a (mon.0) 140 : cluster [DBG] mgrmap e13: y(active, since 90s) 2024-02-13T00:23:37.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:36 smithi080 bash[17386]: audit 2024-02-13T00:23:36.876667+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:37.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:36 smithi080 bash[17386]: cluster 2024-02-13T00:23:36.879840+0000 mon.a (mon.0) 142 : cluster [INF] overall HEALTH_OK 2024-02-13T00:23:37.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:36 smithi080 bash[17386]: audit 2024-02-13T00:23:36.883832+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:37.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:36 smithi080 bash[17386]: audit 2024-02-13T00:23:36.885461+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:23:37.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.609+0000 7ff78882d700 1 -- 172.21.15.106:0/1189379204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff770003400 msgr2=0x7ff770005890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:37.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.613+0000 7ff78882d700 1 --2- 172.21.15.106:0/1189379204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff770003400 0x7ff770005890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7ff78406c300 tx=0x7ff774009040).stop 2024-02-13T00:23:37.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.613+0000 7ff78882d700 1 -- 172.21.15.106:0/1189379204 shutdown_connections 2024-02-13T00:23:37.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.613+0000 7ff78882d700 1 --2- 172.21.15.106:0/1189379204 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff770003400 0x7ff770005890 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:37.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.613+0000 7ff78882d700 1 -- 172.21.15.106:0/1189379204 >> 172.21.15.106:0/1189379204 conn(0x7ff7840f3270 msgr2=0x7ff7840f5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:23:37.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.613+0000 7ff78882d700 1 -- 172.21.15.106:0/1189379204 shutdown_connections 2024-02-13T00:23:37.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.613+0000 7ff78882d700 1 -- 172.21.15.106:0/1189379204 wait complete. 2024-02-13T00:23:37.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.613+0000 7ff78882d700 1 Processor -- start 2024-02-13T00:23:37.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.613+0000 7ff78882d700 1 -- start start 2024-02-13T00:23:37.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.613+0000 7ff78882d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff770003400 0x7ff78410f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:23:37.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.613+0000 7ff78882d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff78410f7c0 0x7ff7841092a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:23:37.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.613+0000 7ff78882d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78410fd50 con 0x7ff770003400 2024-02-13T00:23:37.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.613+0000 7ff78882d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78410fe90 con 0x7ff78410f7c0 2024-02-13T00:23:37.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.613+0000 7ff781d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff78410f7c0 0x7ff7841092a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:23:37.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.613+0000 7ff78259c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff770003400 0x7ff78410f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:23:37.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.613+0000 7ff781d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff78410f7c0 0x7ff7841092a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60348/0 (socket says 172.21.15.106:60348) 2024-02-13T00:23:37.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.613+0000 7ff781d9b700 1 -- 172.21.15.106:0/1770795189 learned_addr learned my addr 172.21.15.106:0/1770795189 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-02-13T00:23:37.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.613+0000 7ff781d9b700 1 -- 172.21.15.106:0/1770795189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff78410f7c0 msgr2=0x7ff7841092a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-13T00:23:37.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.613+0000 7ff781d9b700 1 -- 172.21.15.106:0/1770795189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff78410f7c0 msgr2=0x7ff7841092a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-13T00:23:37.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.613+0000 7ff781d9b700 1 --2- 172.21.15.106:0/1770795189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff78410f7c0 0x7ff7841092a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-13T00:23:37.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.613+0000 7ff781d9b700 1 --2- 172.21.15.106:0/1770795189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff78410f7c0 0x7ff7841092a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-02-13T00:23:37.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.613+0000 7ff78259c700 1 -- 172.21.15.106:0/1770795189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff78410f7c0 msgr2=0x7ff7841092a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-13T00:23:37.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.613+0000 7ff78259c700 1 --2- 172.21.15.106:0/1770795189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff78410f7c0 0x7ff7841092a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:37.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.617+0000 7ff78259c700 1 -- 172.21.15.106:0/1770795189 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff774007860 con 0x7ff770003400 2024-02-13T00:23:37.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.617+0000 7ff78259c700 1 --2- 172.21.15.106:0/1770795189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff770003400 0x7ff78410f2d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ff77401a000 tx=0x7ff774009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:23:37.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.617+0000 7ff77b7fe700 1 -- 172.21.15.106:0/1770795189 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7ff7740217d0 con 0x7ff770003400 2024-02-13T00:23:37.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.617+0000 7ff78882d700 1 -- 172.21.15.106:0/1770795189 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff784109790 con 0x7ff770003400 2024-02-13T00:23:37.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.617+0000 7ff77b7fe700 1 -- 172.21.15.106:0/1770795189 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7ff774021dc0 con 0x7ff770003400 2024-02-13T00:23:37.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.617+0000 7ff77b7fe700 1 -- 172.21.15.106:0/1770795189 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7ff77401fd00 con 0x7ff770003400 2024-02-13T00:23:37.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.617+0000 7ff78882d700 1 -- 172.21.15.106:0/1770795189 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff784109cd0 con 0x7ff770003400 2024-02-13T00:23:37.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.617+0000 7ff77b7fe700 1 -- 172.21.15.106:0/1770795189 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 38673+0+0 (secure 0 0 0) 0x7ff77402a400 con 0x7ff770003400 2024-02-13T00:23:37.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.617+0000 7ff77b7fe700 1 --2- 172.21.15.106:0/1770795189 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7ff764032830 0x7ff764034cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:23:37.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.617+0000 7ff77b7fe700 1 -- 172.21.15.106:0/1770795189 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1098+0+0 (secure 0 0 0) 0x7ff774046f80 con 0x7ff770003400 2024-02-13T00:23:37.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.617+0000 7ff781d9b700 1 --2- 172.21.15.106:0/1770795189 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7ff764032830 0x7ff764034cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:23:37.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.617+0000 7ff78882d700 1 -- 172.21.15.106:0/1770795189 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78405fee0 con 0x7ff770003400 2024-02-13T00:23:37.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.621+0000 7ff781d9b700 1 --2- 172.21.15.106:0/1770795189 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7ff764032830 0x7ff764034cf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ff76c006fd0 tx=0x7ff76c008040).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:23:37.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.629+0000 7ff77b7fe700 1 -- 172.21.15.106:0/1770795189 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff7740033b0 con 0x7ff770003400 2024-02-13T00:23:37.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.873+0000 7ff77b7fe700 1 -- 172.21.15.106:0/1770795189 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774029ed0 con 0x7ff770003400 2024-02-13T00:23:37.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:37.885+0000 7ff78882d700 1 -- 172.21.15.106:0/1770795189 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff784046d80 con 0x7ff770003400 2024-02-13T00:23:39.260 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:23:38 smithi080 bash[17652]: debug 2024-02-13T00:23:38.794+0000 7f15893e1700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-02-13T00:23:42.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:42.980+0000 7ff77b7fe700 1 -- 172.21.15.106:0/1770795189 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1259 (secure 0 0 0) 0x7ff774028b40 con 0x7ff770003400 2024-02-13T00:23:42.984 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-02-13T00:23:42.984 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":3,"fsid":"a5ae7724-ca05-11ee-95b9-87774f69a715","modified":"2024-02-13T00:23:37.872125Z","created":"2024-02-13T00:21:03.263470Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3300","nonce":0},{"type":"v1","addr":"172.21.15.80:6789","nonce":0}]},"addr":"172.21.15.80:6789/0","public_addr":"172.21.15.80:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:3300","nonce":0},{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3301","nonce":0},{"type":"v1","addr":"172.21.15.80:6790","nonce":0}]},"addr":"172.21.15.80:6790/0","public_addr":"172.21.15.80:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-02-13T00:23:42.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:42.984+0000 7ff78882d700 1 -- 172.21.15.106:0/1770795189 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7ff764032830 msgr2=0x7ff764034cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:42.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:42.984+0000 7ff78882d700 1 --2- 172.21.15.106:0/1770795189 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7ff764032830 0x7ff764034cf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ff76c006fd0 tx=0x7ff76c008040).stop 2024-02-13T00:23:42.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:42.984+0000 7ff78882d700 1 -- 172.21.15.106:0/1770795189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff770003400 msgr2=0x7ff78410f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:42.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:42.984+0000 7ff78882d700 1 --2- 172.21.15.106:0/1770795189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff770003400 0x7ff78410f2d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ff77401a000 tx=0x7ff774009040).stop 2024-02-13T00:23:42.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:42.984+0000 7ff78882d700 1 -- 172.21.15.106:0/1770795189 shutdown_connections 2024-02-13T00:23:42.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:42.984+0000 7ff78882d700 1 --2- 172.21.15.106:0/1770795189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ff770003400 0x7ff78410f2d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:42.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:42.984+0000 7ff78882d700 1 --2- 172.21.15.106:0/1770795189 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7ff764032830 0x7ff764034cf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:42.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:42.984+0000 7ff78882d700 1 --2- 172.21.15.106:0/1770795189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff78410f7c0 0x7ff7841092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:42.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:42.984+0000 7ff78882d700 1 -- 172.21.15.106:0/1770795189 >> 172.21.15.106:0/1770795189 conn(0x7ff7840f3270 msgr2=0x7ff7840fba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:23:42.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:42.984+0000 7ff78882d700 1 -- 172.21.15.106:0/1770795189 shutdown_connections 2024-02-13T00:23:42.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:42.984+0000 7ff78882d700 1 -- 172.21.15.106:0/1770795189 wait complete. 2024-02-13T00:23:42.990 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 3 2024-02-13T00:23:43.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: audit 2024-02-13T00:23:37.877776+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T00:23:43.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: cluster 2024-02-13T00:23:37.878163+0000 mon.a (mon.0) 148 : cluster [INF] mon.a calling monitor election 2024-02-13T00:23:43.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: cluster 2024-02-13T00:23:37.883690+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-02-13T00:23:43.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: audit 2024-02-13T00:23:37.901777+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:23:43.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: audit 2024-02-13T00:23:37.902097+0000 mon.a (mon.0) 150 : audit [DBG] from='client.? 172.21.15.106:0/1770795189' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-13T00:23:43.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: audit 2024-02-13T00:23:37.902346+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:43.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: cluster 2024-02-13T00:23:38.672543+0000 mgr.y (mgr.14146) 53 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:43.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: audit 2024-02-13T00:23:38.871856+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:43.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: audit 2024-02-13T00:23:39.872656+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:43.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: cluster 2024-02-13T00:23:39.874072+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-02-13T00:23:43.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: cluster 2024-02-13T00:23:40.672958+0000 mgr.y (mgr.14146) 54 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:43.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: audit 2024-02-13T00:23:40.871786+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:43.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: audit 2024-02-13T00:23:41.871830+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:43.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: audit 2024-02-13T00:23:42.872495+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:43.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: cluster 2024-02-13T00:23:42.901508+0000 mon.a (mon.0) 157 : cluster [INF] mon.a calling monitor election 2024-02-13T00:23:43.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: cluster 2024-02-13T00:23:42.944819+0000 mon.a (mon.0) 158 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-02-13T00:23:43.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: cluster 2024-02-13T00:23:42.956709+0000 mon.a (mon.0) 159 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0],c=[v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0]} removed_ranks: {} 2024-02-13T00:23:43.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: cluster 2024-02-13T00:23:42.977151+0000 mon.a (mon.0) 160 : cluster [DBG] fsmap 2024-02-13T00:23:43.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: cluster 2024-02-13T00:23:42.977252+0000 mon.a (mon.0) 161 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-13T00:23:43.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: cluster 2024-02-13T00:23:42.977606+0000 mon.a (mon.0) 162 : cluster [DBG] mgrmap e13: y(active, since 96s) 2024-02-13T00:23:43.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: cluster 2024-02-13T00:23:42.984934+0000 mon.a (mon.0) 163 : cluster [INF] overall HEALTH_OK 2024-02-13T00:23:43.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: audit 2024-02-13T00:23:42.990794+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:43.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: audit 2024-02-13T00:23:42.994188+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:43.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[17386]: audit 2024-02-13T00:23:42.997520+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:43.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:42 smithi080 bash[24237]: audit 2024-02-13T00:23:31.803744+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T00:23:43.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:42 smithi080 bash[24237]: cluster 2024-02-13T00:23:31.804174+0000 mon.a (mon.0) 128 : cluster [INF] mon.a calling monitor election 2024-02-13T00:23:43.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:42 smithi080 bash[24237]: audit 2024-02-13T00:23:31.825090+0000 mon.a (mon.0) 129 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:23:43.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:42 smithi080 bash[24237]: cluster 2024-02-13T00:23:32.671235+0000 mgr.y (mgr.14146) 50 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:43.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:42 smithi080 bash[24237]: audit 2024-02-13T00:23:32.798033+0000 mon.a (mon.0) 130 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:23:43.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:42 smithi080 bash[24237]: audit 2024-02-13T00:23:33.798448+0000 mon.a (mon.0) 131 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:23:43.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:42 smithi080 bash[24237]: cluster 2024-02-13T00:23:33.802440+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-02-13T00:23:43.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:42 smithi080 bash[24237]: cluster 2024-02-13T00:23:34.671680+0000 mgr.y (mgr.14146) 51 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:43.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:42 smithi080 bash[24237]: audit 2024-02-13T00:23:34.798021+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:23:43.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:42 smithi080 bash[24237]: audit 2024-02-13T00:23:35.798775+0000 mon.a (mon.0) 133 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:23:43.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:42 smithi080 bash[24237]: audit 2024-02-13T00:23:35.871188+0000 mon.a (mon.0) 134 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:43.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:42 smithi080 bash[24237]: audit 2024-02-13T00:23:36.798740+0000 mon.a (mon.0) 135 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:23:43.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:42 smithi080 bash[24237]: cluster 2024-02-13T00:23:36.845829+0000 mon.a (mon.0) 136 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-02-13T00:23:43.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:42 smithi080 bash[24237]: cluster 2024-02-13T00:23:36.855661+0000 mon.a (mon.0) 137 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0]} removed_ranks: {} 2024-02-13T00:23:43.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:42 smithi080 bash[24237]: cluster 2024-02-13T00:23:36.873100+0000 mon.a (mon.0) 138 : cluster [DBG] fsmap 2024-02-13T00:23:43.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:42 smithi080 bash[24237]: cluster 2024-02-13T00:23:36.873152+0000 mon.a (mon.0) 139 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-13T00:23:43.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:42 smithi080 bash[24237]: cluster 2024-02-13T00:23:36.873473+0000 mon.a (mon.0) 140 : cluster [DBG] mgrmap e13: y(active, since 90s) 2024-02-13T00:23:43.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:42 smithi080 bash[24237]: audit 2024-02-13T00:23:36.876667+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:43.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:42 smithi080 bash[24237]: cluster 2024-02-13T00:23:36.879840+0000 mon.a (mon.0) 142 : cluster [INF] overall HEALTH_OK 2024-02-13T00:23:43.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:42 smithi080 bash[24237]: audit 2024-02-13T00:23:36.883832+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:43.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:42 smithi080 bash[24237]: audit 2024-02-13T00:23:36.885461+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:23:43.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: audit 2024-02-13T00:23:37.877776+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T00:23:43.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: cluster 2024-02-13T00:23:37.878163+0000 mon.a (mon.0) 148 : cluster [INF] mon.a calling monitor election 2024-02-13T00:23:43.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: cluster 2024-02-13T00:23:37.883690+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-02-13T00:23:43.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: audit 2024-02-13T00:23:37.901777+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:23:43.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: audit 2024-02-13T00:23:37.902097+0000 mon.a (mon.0) 150 : audit [DBG] from='client.? 172.21.15.106:0/1770795189' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-13T00:23:43.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: audit 2024-02-13T00:23:37.902346+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:43.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: cluster 2024-02-13T00:23:38.672543+0000 mgr.y (mgr.14146) 53 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:43.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: audit 2024-02-13T00:23:38.871856+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:43.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: audit 2024-02-13T00:23:39.872656+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:43.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: cluster 2024-02-13T00:23:39.874072+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-02-13T00:23:43.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: cluster 2024-02-13T00:23:40.672958+0000 mgr.y (mgr.14146) 54 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:43.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: audit 2024-02-13T00:23:40.871786+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:43.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: audit 2024-02-13T00:23:41.871830+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:43.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: audit 2024-02-13T00:23:42.872495+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:43.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: cluster 2024-02-13T00:23:42.901508+0000 mon.a (mon.0) 157 : cluster [INF] mon.a calling monitor election 2024-02-13T00:23:43.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: cluster 2024-02-13T00:23:42.944819+0000 mon.a (mon.0) 158 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-02-13T00:23:43.266 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: cluster 2024-02-13T00:23:42.956709+0000 mon.a (mon.0) 159 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0],c=[v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0]} removed_ranks: {} 2024-02-13T00:23:43.266 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: cluster 2024-02-13T00:23:42.977151+0000 mon.a (mon.0) 160 : cluster [DBG] fsmap 2024-02-13T00:23:43.266 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: cluster 2024-02-13T00:23:42.977252+0000 mon.a (mon.0) 161 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-13T00:23:43.266 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: cluster 2024-02-13T00:23:42.977606+0000 mon.a (mon.0) 162 : cluster [DBG] mgrmap e13: y(active, since 96s) 2024-02-13T00:23:43.266 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: cluster 2024-02-13T00:23:42.984934+0000 mon.a (mon.0) 163 : cluster [INF] overall HEALTH_OK 2024-02-13T00:23:43.266 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: audit 2024-02-13T00:23:42.990794+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:43.266 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: audit 2024-02-13T00:23:42.994188+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:43.266 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:43 smithi080 bash[24237]: audit 2024-02-13T00:23:42.997520+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:43.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: audit 2024-02-13T00:23:37.877776+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T00:23:43.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: cluster 2024-02-13T00:23:37.878163+0000 mon.a (mon.0) 148 : cluster [INF] mon.a calling monitor election 2024-02-13T00:23:43.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: cluster 2024-02-13T00:23:37.883690+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-02-13T00:23:43.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: audit 2024-02-13T00:23:37.901777+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:23:43.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: audit 2024-02-13T00:23:37.902097+0000 mon.a (mon.0) 150 : audit [DBG] from='client.? 172.21.15.106:0/1770795189' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-13T00:23:43.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: audit 2024-02-13T00:23:37.902346+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:43.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: cluster 2024-02-13T00:23:38.672543+0000 mgr.y (mgr.14146) 53 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:43.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: audit 2024-02-13T00:23:38.871856+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:43.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: audit 2024-02-13T00:23:39.872656+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:43.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: cluster 2024-02-13T00:23:39.874072+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-02-13T00:23:43.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: cluster 2024-02-13T00:23:40.672958+0000 mgr.y (mgr.14146) 54 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:43.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: audit 2024-02-13T00:23:40.871786+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:43.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: audit 2024-02-13T00:23:41.871830+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:43.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: audit 2024-02-13T00:23:42.872495+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:43.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: cluster 2024-02-13T00:23:42.901508+0000 mon.a (mon.0) 157 : cluster [INF] mon.a calling monitor election 2024-02-13T00:23:43.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: cluster 2024-02-13T00:23:42.944819+0000 mon.a (mon.0) 158 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-02-13T00:23:43.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: cluster 2024-02-13T00:23:42.956709+0000 mon.a (mon.0) 159 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],b=[v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0],c=[v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0]} removed_ranks: {} 2024-02-13T00:23:43.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: cluster 2024-02-13T00:23:42.977151+0000 mon.a (mon.0) 160 : cluster [DBG] fsmap 2024-02-13T00:23:43.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: cluster 2024-02-13T00:23:42.977252+0000 mon.a (mon.0) 161 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-13T00:23:43.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: cluster 2024-02-13T00:23:42.977606+0000 mon.a (mon.0) 162 : cluster [DBG] mgrmap e13: y(active, since 96s) 2024-02-13T00:23:43.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: cluster 2024-02-13T00:23:42.984934+0000 mon.a (mon.0) 163 : cluster [INF] overall HEALTH_OK 2024-02-13T00:23:43.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: audit 2024-02-13T00:23:42.990794+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:43.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: audit 2024-02-13T00:23:42.994188+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:43.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:43 smithi106 bash[18459]: audit 2024-02-13T00:23:42.997520+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:43.666 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-13T00:23:43.666 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph config generate-minimal-conf 2024-02-13T00:23:44.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:44 smithi080 bash[17386]: cluster 2024-02-13T00:23:42.673369+0000 mgr.y (mgr.14146) 55 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:44.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:44 smithi080 bash[17386]: audit 2024-02-13T00:23:43.260679+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:44.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:44 smithi080 bash[17386]: audit 2024-02-13T00:23:43.262285+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:23:44.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:44 smithi080 bash[17386]: audit 2024-02-13T00:23:43.302239+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:44.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:44 smithi080 bash[17386]: audit 2024-02-13T00:23:43.459252+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:44.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:44 smithi080 bash[17386]: audit 2024-02-13T00:23:43.466909+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:44.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:44 smithi080 bash[17386]: audit 2024-02-13T00:23:43.469784+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T00:23:44.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:44 smithi080 bash[17386]: audit 2024-02-13T00:23:43.471120+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-13T00:23:44.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:44 smithi080 bash[17386]: audit 2024-02-13T00:23:43.472376+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:44.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:44 smithi080 bash[17386]: audit 2024-02-13T00:23:43.871488+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:44.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:44 smithi080 bash[24237]: cluster 2024-02-13T00:23:42.673369+0000 mgr.y (mgr.14146) 55 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:44.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:44 smithi080 bash[24237]: audit 2024-02-13T00:23:43.260679+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:44.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:44 smithi080 bash[24237]: audit 2024-02-13T00:23:43.262285+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:23:44.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:44 smithi080 bash[24237]: audit 2024-02-13T00:23:43.302239+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:44.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:44 smithi080 bash[24237]: audit 2024-02-13T00:23:43.459252+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:44.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:44 smithi080 bash[24237]: audit 2024-02-13T00:23:43.466909+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:44.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:44 smithi080 bash[24237]: audit 2024-02-13T00:23:43.469784+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T00:23:44.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:44 smithi080 bash[24237]: audit 2024-02-13T00:23:43.471120+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-13T00:23:44.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:44 smithi080 bash[24237]: audit 2024-02-13T00:23:43.472376+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:44.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:44 smithi080 bash[24237]: audit 2024-02-13T00:23:43.871488+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:44.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:44 smithi106 bash[18459]: cluster 2024-02-13T00:23:42.673369+0000 mgr.y (mgr.14146) 55 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:44.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:44 smithi106 bash[18459]: audit 2024-02-13T00:23:43.260679+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:44.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:44 smithi106 bash[18459]: audit 2024-02-13T00:23:43.262285+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:23:44.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:44 smithi106 bash[18459]: audit 2024-02-13T00:23:43.302239+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:44.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:44 smithi106 bash[18459]: audit 2024-02-13T00:23:43.459252+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:44.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:44 smithi106 bash[18459]: audit 2024-02-13T00:23:43.466909+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:44.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:44 smithi106 bash[18459]: audit 2024-02-13T00:23:43.469784+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T00:23:44.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:44 smithi106 bash[18459]: audit 2024-02-13T00:23:43.471120+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-13T00:23:44.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:44 smithi106 bash[18459]: audit 2024-02-13T00:23:43.472376+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:44.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:44 smithi106 bash[18459]: audit 2024-02-13T00:23:43.871488+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:23:45.338 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:45 smithi080 bash[24237]: cephadm 2024-02-13T00:23:43.264433+0000 mgr.y (mgr.14146) 56 : cephadm [INF] Updating smithi080:/etc/ceph/ceph.conf 2024-02-13T00:23:45.338 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:45 smithi080 bash[24237]: cephadm 2024-02-13T00:23:43.264962+0000 mgr.y (mgr.14146) 57 : cephadm [INF] Updating smithi106:/etc/ceph/ceph.conf 2024-02-13T00:23:45.338 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:45 smithi080 bash[24237]: cephadm 2024-02-13T00:23:43.469312+0000 mgr.y (mgr.14146) 58 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-02-13T00:23:45.338 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:45 smithi080 bash[24237]: cephadm 2024-02-13T00:23:43.473559+0000 mgr.y (mgr.14146) 59 : cephadm [INF] Reconfiguring daemon mon.a on smithi080 2024-02-13T00:23:45.338 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:45 smithi080 bash[17386]: cephadm 2024-02-13T00:23:43.264433+0000 mgr.y (mgr.14146) 56 : cephadm [INF] Updating smithi080:/etc/ceph/ceph.conf 2024-02-13T00:23:45.338 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:45 smithi080 bash[17386]: cephadm 2024-02-13T00:23:43.264962+0000 mgr.y (mgr.14146) 57 : cephadm [INF] Updating smithi106:/etc/ceph/ceph.conf 2024-02-13T00:23:45.338 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:45 smithi080 bash[17386]: cephadm 2024-02-13T00:23:43.469312+0000 mgr.y (mgr.14146) 58 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-02-13T00:23:45.339 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:45 smithi080 bash[17386]: cephadm 2024-02-13T00:23:43.473559+0000 mgr.y (mgr.14146) 59 : cephadm [INF] Reconfiguring daemon mon.a on smithi080 2024-02-13T00:23:45.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:45 smithi106 bash[18459]: cephadm 2024-02-13T00:23:43.264433+0000 mgr.y (mgr.14146) 56 : cephadm [INF] Updating smithi080:/etc/ceph/ceph.conf 2024-02-13T00:23:45.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:45 smithi106 bash[18459]: cephadm 2024-02-13T00:23:43.264962+0000 mgr.y (mgr.14146) 57 : cephadm [INF] Updating smithi106:/etc/ceph/ceph.conf 2024-02-13T00:23:45.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:45 smithi106 bash[18459]: cephadm 2024-02-13T00:23:43.469312+0000 mgr.y (mgr.14146) 58 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-02-13T00:23:45.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:45 smithi106 bash[18459]: cephadm 2024-02-13T00:23:43.473559+0000 mgr.y (mgr.14146) 59 : cephadm [INF] Reconfiguring daemon mon.a on smithi080 2024-02-13T00:23:46.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:46 smithi106 bash[18459]: cluster 2024-02-13T00:23:44.673815+0000 mgr.y (mgr.14146) 60 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:46.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:46 smithi080 bash[17386]: cluster 2024-02-13T00:23:44.673815+0000 mgr.y (mgr.14146) 60 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:46.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:46 smithi080 bash[24237]: cluster 2024-02-13T00:23:44.673815+0000 mgr.y (mgr.14146) 60 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:48.130 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:47 smithi080 bash[24237]: cluster 2024-02-13T00:23:46.674254+0000 mgr.y (mgr.14146) 61 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:48.130 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:47 smithi080 bash[24237]: audit 2024-02-13T00:23:46.809628+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:48.130 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:47 smithi080 bash[24237]: cephadm 2024-02-13T00:23:46.810533+0000 mgr.y (mgr.14146) 62 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-13T00:23:48.130 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:47 smithi080 bash[24237]: audit 2024-02-13T00:23:46.810905+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T00:23:48.130 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:47 smithi080 bash[24237]: audit 2024-02-13T00:23:46.811985+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-13T00:23:48.130 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:47 smithi080 bash[24237]: audit 2024-02-13T00:23:46.813004+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:48.131 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:47 smithi080 bash[24237]: cephadm 2024-02-13T00:23:46.813907+0000 mgr.y (mgr.14146) 63 : cephadm [INF] Reconfiguring daemon mon.c on smithi080 2024-02-13T00:23:48.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:47 smithi080 bash[17386]: cluster 2024-02-13T00:23:46.674254+0000 mgr.y (mgr.14146) 61 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:48.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:47 smithi080 bash[17386]: audit 2024-02-13T00:23:46.809628+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:48.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:47 smithi080 bash[17386]: cephadm 2024-02-13T00:23:46.810533+0000 mgr.y (mgr.14146) 62 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-13T00:23:48.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:47 smithi080 bash[17386]: audit 2024-02-13T00:23:46.810905+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T00:23:48.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:47 smithi080 bash[17386]: audit 2024-02-13T00:23:46.811985+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-13T00:23:48.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:47 smithi080 bash[17386]: audit 2024-02-13T00:23:46.813004+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:48.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:47 smithi080 bash[17386]: cephadm 2024-02-13T00:23:46.813907+0000 mgr.y (mgr.14146) 63 : cephadm [INF] Reconfiguring daemon mon.c on smithi080 2024-02-13T00:23:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:47 smithi106 bash[18459]: cluster 2024-02-13T00:23:46.674254+0000 mgr.y (mgr.14146) 61 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:47 smithi106 bash[18459]: audit 2024-02-13T00:23:46.809628+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:47 smithi106 bash[18459]: cephadm 2024-02-13T00:23:46.810533+0000 mgr.y (mgr.14146) 62 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-13T00:23:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:47 smithi106 bash[18459]: audit 2024-02-13T00:23:46.810905+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T00:23:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:47 smithi106 bash[18459]: audit 2024-02-13T00:23:46.811985+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-13T00:23:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:47 smithi106 bash[18459]: audit 2024-02-13T00:23:46.813004+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:47 smithi106 bash[18459]: cephadm 2024-02-13T00:23:46.813907+0000 mgr.y (mgr.14146) 63 : cephadm [INF] Reconfiguring daemon mon.c on smithi080 2024-02-13T00:23:48.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d5e967700 1 -- 172.21.15.80:0/3486767456 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d580f7340 msgr2=0x7f5d58103940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:48.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d5e967700 1 --2- 172.21.15.80:0/3486767456 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d580f7340 0x7f5d58103940 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f5d50009be0 tx=0x7f5d50004d10).stop 2024-02-13T00:23:48.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d5e967700 1 -- 172.21.15.80:0/3486767456 shutdown_connections 2024-02-13T00:23:48.302 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d5e967700 1 --2- 172.21.15.80:0/3486767456 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d580fcad0 0x7f5d580fceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:48.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d5e967700 1 --2- 172.21.15.80:0/3486767456 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d580f7340 0x7f5d58103940 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:48.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d5e967700 1 --2- 172.21.15.80:0/3486767456 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d580fd430 0x7f5d580f6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:48.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d5e967700 1 -- 172.21.15.80:0/3486767456 >> 172.21.15.80:0/3486767456 conn(0x7f5d580f26e0 msgr2=0x7f5d580f4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:23:48.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d5e967700 1 -- 172.21.15.80:0/3486767456 shutdown_connections 2024-02-13T00:23:48.303 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d5e967700 1 -- 172.21.15.80:0/3486767456 wait complete. 2024-02-13T00:23:48.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d5e967700 1 Processor -- start 2024-02-13T00:23:48.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d5e967700 1 -- start start 2024-02-13T00:23:48.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d5e967700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d580f7340 0x7f5d5810dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:23:48.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d5e967700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d580fcad0 0x7f5d5810e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:23:48.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d5e967700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d580fd430 0x7f5d58107e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:23:48.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d5e967700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d581082f0 con 0x7f5d580fcad0 2024-02-13T00:23:48.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d5e967700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d58108460 con 0x7f5d580f7340 2024-02-13T00:23:48.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d5e967700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d58108620 con 0x7f5d580fd430 2024-02-13T00:23:48.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d577fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d580fcad0 0x7f5d5810e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:23:48.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d577fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d580fcad0 0x7f5d5810e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:43808/0 (socket says 172.21.15.80:43808) 2024-02-13T00:23:48.305 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d5cf04700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d580fd430 0x7f5d58107e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:23:48.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d577fe700 1 -- 172.21.15.80:0/4268370826 learned_addr learned my addr 172.21.15.80:0/4268370826 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:23:48.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d57fff700 1 --2- 172.21.15.80:0/4268370826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d580f7340 0x7f5d5810dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:23:48.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d577fe700 1 -- 172.21.15.80:0/4268370826 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d580fd430 msgr2=0x7f5d58107e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:48.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d577fe700 1 --2- 172.21.15.80:0/4268370826 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d580fd430 0x7f5d58107e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:48.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d577fe700 1 -- 172.21.15.80:0/4268370826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d580f7340 msgr2=0x7f5d5810dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:48.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d577fe700 1 --2- 172.21.15.80:0/4268370826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d580f7340 0x7f5d5810dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:48.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d577fe700 1 -- 172.21.15.80:0/4268370826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c005040 con 0x7f5d580fcad0 2024-02-13T00:23:48.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d577fe700 1 --2- 172.21.15.80:0/4268370826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d580fcad0 0x7f5d5810e150 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f5d4c004870 tx=0x7f5d4c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:23:48.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.294+0000 7f5d557fa700 1 -- 172.21.15.80:0/4268370826 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c00e030 con 0x7f5d580fcad0 2024-02-13T00:23:48.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.298+0000 7f5d557fa700 1 -- 172.21.15.80:0/4268370826 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f5d4c00f040 con 0x7f5d580fcad0 2024-02-13T00:23:48.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.298+0000 7f5d5e967700 1 -- 172.21.15.80:0/4268370826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d500097c0 con 0x7f5d580fcad0 2024-02-13T00:23:48.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.298+0000 7f5d557fa700 1 -- 172.21.15.80:0/4268370826 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c0146c0 con 0x7f5d580fcad0 2024-02-13T00:23:48.306 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.298+0000 7f5d5e967700 1 -- 172.21.15.80:0/4268370826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d58114a90 con 0x7f5d580fcad0 2024-02-13T00:23:48.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.298+0000 7f5d5e967700 1 -- 172.21.15.80:0/4268370826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d5805f900 con 0x7f5d580fcad0 2024-02-13T00:23:48.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.298+0000 7f5d557fa700 1 -- 172.21.15.80:0/4268370826 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 38673+0+0 (secure 0 0 0) 0x7f5d4c014af0 con 0x7f5d580fcad0 2024-02-13T00:23:48.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.298+0000 7f5d557fa700 1 --2- 172.21.15.80:0/4268370826 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f5d400328f0 0x7f5d40034db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:23:48.307 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.298+0000 7f5d557fa700 1 -- 172.21.15.80:0/4268370826 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f5d4c0430f0 con 0x7f5d580fcad0 2024-02-13T00:23:48.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.298+0000 7f5d57fff700 1 --2- 172.21.15.80:0/4268370826 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f5d400328f0 0x7f5d40034db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:23:48.308 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.298+0000 7f5d57fff700 1 --2- 172.21.15.80:0/4268370826 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f5d400328f0 0x7f5d40034db0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f5d48004dc0 tx=0x7f5d4800b040).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:23:48.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.306+0000 7f5d557fa700 1 -- 172.21.15.80:0/4268370826 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5d4c012960 con 0x7f5d580fcad0 2024-02-13T00:23:48.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.494+0000 7f5d5e967700 1 -- 172.21.15.80:0/4268370826 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f5d5805f400 con 0x7f5d580fcad0 2024-02-13T00:23:48.503 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.494+0000 7f5d557fa700 1 -- 172.21.15.80:0/4268370826 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+273 (secure 0 0 0) 0x7f5d4c012360 con 0x7f5d580fcad0 2024-02-13T00:23:48.503 INFO:teuthology.orchestra.run.smithi080.stdout:# minimal ceph.conf for a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:23:48.504 INFO:teuthology.orchestra.run.smithi080.stdout:[global] 2024-02-13T00:23:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: fsid = a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:23:48.504 INFO:teuthology.orchestra.run.smithi080.stdout: mon_host = [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] 2024-02-13T00:23:48.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.498+0000 7f5d5e967700 1 -- 172.21.15.80:0/4268370826 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f5d400328f0 msgr2=0x7f5d40034db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:48.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.498+0000 7f5d5e967700 1 --2- 172.21.15.80:0/4268370826 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f5d400328f0 0x7f5d40034db0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f5d48004dc0 tx=0x7f5d4800b040).stop 2024-02-13T00:23:48.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.498+0000 7f5d5e967700 1 -- 172.21.15.80:0/4268370826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d580fcad0 msgr2=0x7f5d5810e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:48.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.498+0000 7f5d5e967700 1 --2- 172.21.15.80:0/4268370826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d580fcad0 0x7f5d5810e150 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f5d4c004870 tx=0x7f5d4c009cb0).stop 2024-02-13T00:23:48.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.498+0000 7f5d5e967700 1 -- 172.21.15.80:0/4268370826 shutdown_connections 2024-02-13T00:23:48.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.498+0000 7f5d5e967700 1 --2- 172.21.15.80:0/4268370826 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f5d400328f0 0x7f5d40034db0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:48.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.498+0000 7f5d5e967700 1 --2- 172.21.15.80:0/4268370826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d580f7340 0x7f5d5810dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:48.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.498+0000 7f5d5e967700 1 --2- 172.21.15.80:0/4268370826 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d580fd430 0x7f5d58107e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:48.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.498+0000 7f5d5e967700 1 --2- 172.21.15.80:0/4268370826 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d580fcad0 0x7f5d5810e150 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0x7f5d4c004870 tx=0x7f5d4c009cb0).stop 2024-02-13T00:23:48.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.498+0000 7f5d5e967700 1 -- 172.21.15.80:0/4268370826 >> 172.21.15.80:0/4268370826 conn(0x7f5d580f26e0 msgr2=0x7f5d580f43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:23:48.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.498+0000 7f5d5e967700 1 -- 172.21.15.80:0/4268370826 shutdown_connections 2024-02-13T00:23:48.506 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:23:48.498+0000 7f5d5e967700 1 -- 172.21.15.80:0/4268370826 wait complete. 2024-02-13T00:23:49.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:48 smithi080 bash[17386]: audit 2024-02-13T00:23:48.498692+0000 mon.a (mon.0) 180 : audit [DBG] from='client.? 172.21.15.80:0/4268370826' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:49.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:48 smithi080 bash[24237]: audit 2024-02-13T00:23:48.498692+0000 mon.a (mon.0) 180 : audit [DBG] from='client.? 172.21.15.80:0/4268370826' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:49.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:48 smithi106 bash[18459]: audit 2024-02-13T00:23:48.498692+0000 mon.a (mon.0) 180 : audit [DBG] from='client.? 172.21.15.80:0/4268370826' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:49.576 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-13T00:23:49.577 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-13T00:23:49.577 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.conf 2024-02-13T00:23:49.593 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-13T00:23:49.593 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-13T00:23:49.650 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-02-13T00:23:49.650 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.conf 2024-02-13T00:23:49.666 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-02-13T00:23:49.666 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-13T00:23:49.719 INFO:tasks.cephadm:Adding mgr.y on smithi080 2024-02-13T00:23:49.719 INFO:tasks.cephadm:Adding mgr.x on smithi106 2024-02-13T00:23:49.719 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph orch apply mgr '2;smithi080=y;smithi106=x' 2024-02-13T00:23:49.946 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:49 smithi106 bash[18459]: cluster 2024-02-13T00:23:48.674653+0000 mgr.y (mgr.14146) 64 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:49.947 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:49 smithi106 bash[18459]: audit 2024-02-13T00:23:49.513735+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:49.947 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:49 smithi106 bash[18459]: audit 2024-02-13T00:23:49.514900+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T00:23:49.947 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:49 smithi106 bash[18459]: audit 2024-02-13T00:23:49.516061+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-13T00:23:49.947 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:49 smithi106 bash[18459]: audit 2024-02-13T00:23:49.516997+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:50.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:49 smithi080 bash[17386]: cluster 2024-02-13T00:23:48.674653+0000 mgr.y (mgr.14146) 64 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:50.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:49 smithi080 bash[17386]: audit 2024-02-13T00:23:49.513735+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:50.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:49 smithi080 bash[17386]: audit 2024-02-13T00:23:49.514900+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T00:23:50.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:49 smithi080 bash[17386]: audit 2024-02-13T00:23:49.516061+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-13T00:23:50.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:49 smithi080 bash[17386]: audit 2024-02-13T00:23:49.516997+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:50.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:49 smithi080 bash[24237]: cluster 2024-02-13T00:23:48.674653+0000 mgr.y (mgr.14146) 64 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:50.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:49 smithi080 bash[24237]: audit 2024-02-13T00:23:49.513735+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:50.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:49 smithi080 bash[24237]: audit 2024-02-13T00:23:49.514900+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T00:23:50.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:49 smithi080 bash[24237]: audit 2024-02-13T00:23:49.516061+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-13T00:23:50.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:49 smithi080 bash[24237]: audit 2024-02-13T00:23:49.516997+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:51.104 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:50 smithi106 bash[18459]: cephadm 2024-02-13T00:23:49.514524+0000 mgr.y (mgr.14146) 65 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-13T00:23:51.104 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:50 smithi106 bash[18459]: cephadm 2024-02-13T00:23:49.517790+0000 mgr.y (mgr.14146) 66 : cephadm [INF] Reconfiguring daemon mon.b on smithi106 2024-02-13T00:23:51.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:50 smithi080 bash[17386]: cephadm 2024-02-13T00:23:49.514524+0000 mgr.y (mgr.14146) 65 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-13T00:23:51.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:50 smithi080 bash[17386]: cephadm 2024-02-13T00:23:49.517790+0000 mgr.y (mgr.14146) 66 : cephadm [INF] Reconfiguring daemon mon.b on smithi106 2024-02-13T00:23:51.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:50 smithi080 bash[24237]: cephadm 2024-02-13T00:23:49.514524+0000 mgr.y (mgr.14146) 65 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-13T00:23:51.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:50 smithi080 bash[24237]: cephadm 2024-02-13T00:23:49.517790+0000 mgr.y (mgr.14146) 66 : cephadm [INF] Reconfiguring daemon mon.b on smithi106 2024-02-13T00:23:52.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:51 smithi106 bash[18459]: cluster 2024-02-13T00:23:50.675078+0000 mgr.y (mgr.14146) 67 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:52.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:51 smithi080 bash[17386]: cluster 2024-02-13T00:23:50.675078+0000 mgr.y (mgr.14146) 67 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:52.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:51 smithi080 bash[24237]: cluster 2024-02-13T00:23:50.675078+0000 mgr.y (mgr.14146) 67 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:53.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.240+0000 7f1e1e875700 1 -- 172.21.15.106:0/1694735006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e180f7b40 msgr2=0x7f1e180f7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:53.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.240+0000 7f1e1e875700 1 --2- 172.21.15.106:0/1694735006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e180f7b40 0x7f1e180f7f60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f1e08009c60 tx=0x7f1e08004c50).stop 2024-02-13T00:23:53.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.240+0000 7f1e1e875700 1 -- 172.21.15.106:0/1694735006 shutdown_connections 2024-02-13T00:23:53.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.240+0000 7f1e1e875700 1 --2- 172.21.15.106:0/1694735006 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e180f9730 0x7f1e18100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:53.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.240+0000 7f1e1e875700 1 --2- 172.21.15.106:0/1694735006 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e180f7b40 0x7f1e180f7f60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:53.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.240+0000 7f1e1e875700 1 --2- 172.21.15.106:0/1694735006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e180f8de0 0x7f1e180f9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:53.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.240+0000 7f1e1e875700 1 -- 172.21.15.106:0/1694735006 >> 172.21.15.106:0/1694735006 conn(0x7f1e180f3340 msgr2=0x7f1e180f5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:23:53.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.240+0000 7f1e1e875700 1 -- 172.21.15.106:0/1694735006 shutdown_connections 2024-02-13T00:23:53.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.240+0000 7f1e1e875700 1 -- 172.21.15.106:0/1694735006 wait complete. 2024-02-13T00:23:53.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.240+0000 7f1e1e875700 1 Processor -- start 2024-02-13T00:23:53.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.240+0000 7f1e1e875700 1 -- start start 2024-02-13T00:23:53.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.240+0000 7f1e1e875700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e180f7b40 0x7f1e1806ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:23:53.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.240+0000 7f1e1e875700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e180f8de0 0x7f1e1806b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:23:53.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.240+0000 7f1e1e875700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e180f9730 0x7f1e1806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:23:53.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.240+0000 7f1e1e875700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1806bbe0 con 0x7f1e180f8de0 2024-02-13T00:23:53.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.240+0000 7f1e1e875700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1806bd50 con 0x7f1e180f9730 2024-02-13T00:23:53.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.240+0000 7f1e1e875700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1806bf10 con 0x7f1e180f7b40 2024-02-13T00:23:53.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.240+0000 7f1e1ce12700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e180f9730 0x7f1e1806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:23:53.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.244+0000 7f1e1ce12700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e180f9730 0x7f1e1806b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33106/0 (socket says 172.21.15.106:33106) 2024-02-13T00:23:53.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.244+0000 7f1e17fff700 1 --2- 172.21.15.106:0/2049975681 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e180f7b40 0x7f1e1806ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:23:53.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.244+0000 7f1e1ce12700 1 -- 172.21.15.106:0/2049975681 learned_addr learned my addr 172.21.15.106:0/2049975681 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-02-13T00:23:53.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.244+0000 7f1e177fe700 1 --2- 172.21.15.106:0/2049975681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e180f8de0 0x7f1e1806b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:23:53.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.244+0000 7f1e1ce12700 1 -- 172.21.15.106:0/2049975681 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e180f7b40 msgr2=0x7f1e1806ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:53.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.244+0000 7f1e1ce12700 1 --2- 172.21.15.106:0/2049975681 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e180f7b40 0x7f1e1806ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:53.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.244+0000 7f1e1ce12700 1 -- 172.21.15.106:0/2049975681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e180f8de0 msgr2=0x7f1e1806b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:53.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.244+0000 7f1e1ce12700 1 --2- 172.21.15.106:0/2049975681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e180f8de0 0x7f1e1806b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:53.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.244+0000 7f1e1ce12700 1 -- 172.21.15.106:0/2049975681 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e080097c0 con 0x7f1e180f9730 2024-02-13T00:23:53.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.244+0000 7f1e1ce12700 1 --2- 172.21.15.106:0/2049975681 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e180f9730 0x7f1e1806b5c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f1e1000e940 tx=0x7f1e1000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:23:53.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.244+0000 7f1e157fa700 1 -- 172.21.15.106:0/2049975681 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e10004680 con 0x7f1e180f9730 2024-02-13T00:23:53.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.244+0000 7f1e1e875700 1 -- 172.21.15.106:0/2049975681 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e181121f0 con 0x7f1e180f9730 2024-02-13T00:23:53.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.244+0000 7f1e1e875700 1 -- 172.21.15.106:0/2049975681 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e18112760 con 0x7f1e180f9730 2024-02-13T00:23:53.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.244+0000 7f1e157fa700 1 -- 172.21.15.106:0/2049975681 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f1e1000f040 con 0x7f1e180f9730 2024-02-13T00:23:53.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.244+0000 7f1e157fa700 1 -- 172.21.15.106:0/2049975681 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e10014460 con 0x7f1e180f9730 2024-02-13T00:23:53.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.244+0000 7f1e1e875700 1 -- 172.21.15.106:0/2049975681 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e04004f50 con 0x7f1e180f9730 2024-02-13T00:23:53.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.244+0000 7f1e157fa700 1 -- 172.21.15.106:0/2049975681 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 13) v1 ==== 38673+0+0 (secure 0 0 0) 0x7f1e100090d0 con 0x7f1e180f9730 2024-02-13T00:23:53.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.244+0000 7f1e157fa700 1 --2- 172.21.15.106:0/2049975681 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f1e000328f0 0x7f1e00034db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:23:53.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.244+0000 7f1e157fa700 1 -- 172.21.15.106:0/2049975681 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f1e10042620 con 0x7f1e180f9730 2024-02-13T00:23:53.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.248+0000 7f1e17fff700 1 --2- 172.21.15.106:0/2049975681 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f1e000328f0 0x7f1e00034db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:23:53.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.248+0000 7f1e17fff700 1 --2- 172.21.15.106:0/2049975681 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f1e000328f0 0x7f1e00034db0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f1e08009fd0 tx=0x7f1e08004c50).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:23:53.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.252+0000 7f1e157fa700 1 -- 172.21.15.106:0/2049975681 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1e1001c360 con 0x7f1e180f9730 2024-02-13T00:23:53.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.440+0000 7f1e1e875700 1 -- 172.21.15.106:0/2049975681 --> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi080=y;smithi106=x", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e04000bf0 con 0x7f1e000328f0 2024-02-13T00:23:53.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.456+0000 7f1e157fa700 1 -- 172.21.15.106:0/2049975681 <== mgr.14146 v2:172.21.15.80:6800/461193090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f1e04000bf0 con 0x7f1e000328f0 2024-02-13T00:23:53.461 INFO:teuthology.orchestra.run.smithi106.stdout:Scheduled mgr update... 2024-02-13T00:23:53.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.460+0000 7f1e1e875700 1 -- 172.21.15.106:0/2049975681 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f1e000328f0 msgr2=0x7f1e00034db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:53.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.460+0000 7f1e1e875700 1 --2- 172.21.15.106:0/2049975681 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f1e000328f0 0x7f1e00034db0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f1e08009fd0 tx=0x7f1e08004c50).stop 2024-02-13T00:23:53.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.460+0000 7f1e1e875700 1 -- 172.21.15.106:0/2049975681 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e180f9730 msgr2=0x7f1e1806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:23:53.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.460+0000 7f1e1e875700 1 --2- 172.21.15.106:0/2049975681 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e180f9730 0x7f1e1806b5c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f1e1000e940 tx=0x7f1e1000b040).stop 2024-02-13T00:23:53.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.460+0000 7f1e1e875700 1 -- 172.21.15.106:0/2049975681 shutdown_connections 2024-02-13T00:23:53.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.460+0000 7f1e1e875700 1 --2- 172.21.15.106:0/2049975681 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f1e000328f0 0x7f1e00034db0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:53.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.460+0000 7f1e1e875700 1 --2- 172.21.15.106:0/2049975681 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e180f9730 0x7f1e1806b5c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:53.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.460+0000 7f1e1e875700 1 --2- 172.21.15.106:0/2049975681 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1e180f7b40 0x7f1e1806ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:53.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.460+0000 7f1e1e875700 1 --2- 172.21.15.106:0/2049975681 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1e180f8de0 0x7f1e1806b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:23:53.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.460+0000 7f1e1e875700 1 -- 172.21.15.106:0/2049975681 >> 172.21.15.106:0/2049975681 conn(0x7f1e180f3340 msgr2=0x7f1e180f5740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:23:53.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.460+0000 7f1e1e875700 1 -- 172.21.15.106:0/2049975681 shutdown_connections 2024-02-13T00:23:53.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:23:53.460+0000 7f1e1e875700 1 -- 172.21.15.106:0/2049975681 wait complete. 2024-02-13T00:23:53.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:53 smithi106 bash[18459]: audit 2024-02-13T00:23:52.461144+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:53.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:53 smithi106 bash[18459]: audit 2024-02-13T00:23:52.462624+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:23:53.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:53 smithi106 bash[18459]: audit 2024-02-13T00:23:52.464960+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:53.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:53 smithi106 bash[18459]: audit 2024-02-13T00:23:52.466186+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:23:53.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:53 smithi106 bash[18459]: audit 2024-02-13T00:23:52.474560+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:53.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:53 smithi106 bash[18459]: cluster 2024-02-13T00:23:52.675478+0000 mgr.y (mgr.14146) 68 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:53.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:53 smithi106 bash[18459]: audit 2024-02-13T00:23:53.454799+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:53.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:53 smithi080 bash[17386]: audit 2024-02-13T00:23:52.461144+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:53.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:53 smithi080 bash[17386]: audit 2024-02-13T00:23:52.462624+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:23:53.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:53 smithi080 bash[17386]: audit 2024-02-13T00:23:52.464960+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:53.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:53 smithi080 bash[17386]: audit 2024-02-13T00:23:52.466186+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:23:53.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:53 smithi080 bash[17386]: audit 2024-02-13T00:23:52.474560+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:53.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:53 smithi080 bash[17386]: cluster 2024-02-13T00:23:52.675478+0000 mgr.y (mgr.14146) 68 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:53.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:53 smithi080 bash[17386]: audit 2024-02-13T00:23:53.454799+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:53.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:53 smithi080 bash[24237]: audit 2024-02-13T00:23:52.461144+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:53.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:53 smithi080 bash[24237]: audit 2024-02-13T00:23:52.462624+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:23:53.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:53 smithi080 bash[24237]: audit 2024-02-13T00:23:52.464960+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:53.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:53 smithi080 bash[24237]: audit 2024-02-13T00:23:52.466186+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:23:53.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:53 smithi080 bash[24237]: audit 2024-02-13T00:23:52.474560+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:53.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:53 smithi080 bash[24237]: cluster 2024-02-13T00:23:52.675478+0000 mgr.y (mgr.14146) 68 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:53.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:53 smithi080 bash[24237]: audit 2024-02-13T00:23:53.454799+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:54.432 DEBUG:teuthology.orchestra.run.smithi106:mgr.x> sudo journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@mgr.x.service 2024-02-13T00:23:54.434 INFO:tasks.cephadm:Deploying OSDs... 2024-02-13T00:23:54.434 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-13T00:23:54.435 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/scratch_devs of=/dev/stdout 2024-02-13T00:23:54.442 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-13T00:23:54.442 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_1 2024-02-13T00:23:54.490 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-13T00:23:54.491 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-13T00:23:54.491 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 494 Links: 1 2024-02-13T00:23:54.491 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-13T00:23:54.491 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-02-13 00:16:39.515038740 +0000 2024-02-13T00:23:54.491 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-02-13 00:16:39.247044919 +0000 2024-02-13T00:23:54.491 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-02-13 00:16:39.247044919 +0000 2024-02-13T00:23:54.491 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-02-13T00:23:54.491 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-13T00:23:54.547 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-02-13T00:23:54.547 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-02-13T00:23:54.547 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000426434 s, 1.2 MB/s 2024-02-13T00:23:54.548 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-13T00:23:54.601 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_2 2024-02-13T00:23:54.655 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-13T00:23:54.656 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-13T00:23:54.656 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 501 Links: 1 2024-02-13T00:23:54.656 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-13T00:23:54.656 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-02-13 00:16:40.007027393 +0000 2024-02-13T00:23:54.656 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-02-13 00:16:39.739033573 +0000 2024-02-13T00:23:54.656 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-02-13 00:16:39.739033573 +0000 2024-02-13T00:23:54.657 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-02-13T00:23:54.657 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-13T00:23:54.711 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-02-13T00:23:54.711 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-02-13T00:23:54.711 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000437981 s, 1.2 MB/s 2024-02-13T00:23:54.712 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-13T00:23:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:54 smithi106 bash[18459]: audit 2024-02-13T00:23:53.445008+0000 mgr.y (mgr.14146) 69 : audit [DBG] from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi080=y;smithi106=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:23:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:54 smithi106 bash[18459]: cephadm 2024-02-13T00:23:53.448460+0000 mgr.y (mgr.14146) 70 : cephadm [INF] Saving service mgr spec with placement smithi080=y;smithi106=x;count:2 2024-02-13T00:23:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:54 smithi106 bash[18459]: audit 2024-02-13T00:23:53.494281+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:23:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:54 smithi106 bash[18459]: audit 2024-02-13T00:23:53.497811+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:54 smithi106 bash[18459]: audit 2024-02-13T00:23:53.499554+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:23:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:54 smithi106 bash[18459]: audit 2024-02-13T00:23:53.509509+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:54 smithi106 bash[18459]: audit 2024-02-13T00:23:53.511303+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-13T00:23:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:54 smithi106 bash[18459]: audit 2024-02-13T00:23:53.517331+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-13T00:23:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:54 smithi106 bash[18459]: audit 2024-02-13T00:23:53.518539+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-13T00:23:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:54 smithi106 bash[18459]: audit 2024-02-13T00:23:53.520024+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:54 smithi106 bash[18459]: cephadm 2024-02-13T00:23:53.521082+0000 mgr.y (mgr.14146) 71 : cephadm [INF] Deploying daemon mgr.x on smithi106 2024-02-13T00:23:54.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:54 smithi080 bash[17386]: audit 2024-02-13T00:23:53.445008+0000 mgr.y (mgr.14146) 69 : audit [DBG] from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi080=y;smithi106=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:23:54.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:54 smithi080 bash[17386]: cephadm 2024-02-13T00:23:53.448460+0000 mgr.y (mgr.14146) 70 : cephadm [INF] Saving service mgr spec with placement smithi080=y;smithi106=x;count:2 2024-02-13T00:23:54.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:54 smithi080 bash[17386]: audit 2024-02-13T00:23:53.494281+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:23:54.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:54 smithi080 bash[17386]: audit 2024-02-13T00:23:53.497811+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:54.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:54 smithi080 bash[17386]: audit 2024-02-13T00:23:53.499554+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:23:54.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:54 smithi080 bash[17386]: audit 2024-02-13T00:23:53.509509+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:54.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:54 smithi080 bash[17386]: audit 2024-02-13T00:23:53.511303+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-13T00:23:54.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:54 smithi080 bash[17386]: audit 2024-02-13T00:23:53.517331+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-13T00:23:54.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:54 smithi080 bash[17386]: audit 2024-02-13T00:23:53.518539+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-13T00:23:54.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:54 smithi080 bash[17386]: audit 2024-02-13T00:23:53.520024+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:54.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:54 smithi080 bash[17386]: cephadm 2024-02-13T00:23:53.521082+0000 mgr.y (mgr.14146) 71 : cephadm [INF] Deploying daemon mgr.x on smithi106 2024-02-13T00:23:54.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:54 smithi080 bash[24237]: audit 2024-02-13T00:23:53.445008+0000 mgr.y (mgr.14146) 69 : audit [DBG] from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi080=y;smithi106=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:23:54.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:54 smithi080 bash[24237]: cephadm 2024-02-13T00:23:53.448460+0000 mgr.y (mgr.14146) 70 : cephadm [INF] Saving service mgr spec with placement smithi080=y;smithi106=x;count:2 2024-02-13T00:23:54.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:54 smithi080 bash[24237]: audit 2024-02-13T00:23:53.494281+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:23:54.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:54 smithi080 bash[24237]: audit 2024-02-13T00:23:53.497811+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:54.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:54 smithi080 bash[24237]: audit 2024-02-13T00:23:53.499554+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:23:54.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:54 smithi080 bash[24237]: audit 2024-02-13T00:23:53.509509+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:54.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:54 smithi080 bash[24237]: audit 2024-02-13T00:23:53.511303+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-13T00:23:54.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:54 smithi080 bash[24237]: audit 2024-02-13T00:23:53.517331+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-13T00:23:54.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:54 smithi080 bash[24237]: audit 2024-02-13T00:23:53.518539+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-13T00:23:54.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:54 smithi080 bash[24237]: audit 2024-02-13T00:23:53.520024+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:23:54.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:54 smithi080 bash[24237]: cephadm 2024-02-13T00:23:53.521082+0000 mgr.y (mgr.14146) 71 : cephadm [INF] Deploying daemon mgr.x on smithi106 2024-02-13T00:23:54.762 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_3 2024-02-13T00:23:54.812 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-13T00:23:54.812 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-13T00:23:54.813 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 507 Links: 1 2024-02-13T00:23:54.813 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-13T00:23:54.813 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-02-13 00:16:40.463016877 +0000 2024-02-13T00:23:54.813 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-02-13 00:16:40.215022596 +0000 2024-02-13T00:23:54.813 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-02-13 00:16:40.215022596 +0000 2024-02-13T00:23:54.813 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-02-13T00:23:54.814 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-13T00:23:54.820 INFO:journalctl@ceph.mgr.x.smithi106.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-13T00:23:54.871 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-02-13T00:23:54.871 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-02-13T00:23:54.871 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000390744 s, 1.3 MB/s 2024-02-13T00:23:54.872 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-13T00:23:54.925 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_4 2024-02-13T00:23:54.975 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-13T00:23:54.976 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-13T00:23:54.976 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 510 Links: 1 2024-02-13T00:23:54.976 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-13T00:23:54.976 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-02-13 00:16:40.951005624 +0000 2024-02-13T00:23:54.976 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-02-13 00:16:40.691011619 +0000 2024-02-13T00:23:54.976 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-02-13 00:16:40.691011619 +0000 2024-02-13T00:23:54.976 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-02-13T00:23:54.976 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-13T00:23:55.031 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-02-13T00:23:55.031 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-02-13T00:23:55.031 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000418603 s, 1.2 MB/s 2024-02-13T00:23:55.032 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-13T00:23:55.085 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-02-13T00:23:55.086 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/scratch_devs of=/dev/stdout 2024-02-13T00:23:55.093 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-13T00:23:55.093 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_1 2024-02-13T00:23:55.142 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-13T00:23:55.142 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-13T00:23:55.143 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 492 Links: 1 2024-02-13T00:23:55.143 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-13T00:23:55.143 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-02-13 00:16:39.068643754 +0000 2024-02-13T00:23:55.143 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-02-13 00:16:39.064643846 +0000 2024-02-13T00:23:55.143 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-02-13 00:16:39.064643846 +0000 2024-02-13T00:23:55.143 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2024-02-13T00:23:55.143 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-13T00:23:55.192 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-02-13T00:23:55.192 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-02-13T00:23:55.192 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000445371 s, 1.1 MB/s 2024-02-13T00:23:55.193 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-13T00:23:55.248 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_2 2024-02-13T00:23:55.298 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-13T00:23:55.299 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-13T00:23:55.299 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 500 Links: 1 2024-02-13T00:23:55.299 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-13T00:23:55.299 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-02-13 00:16:39.780627335 +0000 2024-02-13T00:23:55.299 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-02-13 00:16:39.536632961 +0000 2024-02-13T00:23:55.299 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-02-13 00:16:39.536632961 +0000 2024-02-13T00:23:55.299 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2024-02-13T00:23:55.299 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-13T00:23:55.347 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-02-13T00:23:55.347 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-02-13T00:23:55.347 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000414708 s, 1.2 MB/s 2024-02-13T00:23:55.348 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-13T00:23:55.399 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_3 2024-02-13T00:23:55.450 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-13T00:23:55.450 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-13T00:23:55.450 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 506 Links: 1 2024-02-13T00:23:55.450 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-13T00:23:55.450 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-02-13 00:16:40.012621984 +0000 2024-02-13T00:23:55.450 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-02-13 00:16:40.008622077 +0000 2024-02-13T00:23:55.450 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-02-13 00:16:40.008622077 +0000 2024-02-13T00:23:55.451 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2024-02-13T00:23:55.451 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-13T00:23:55.503 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-02-13T00:23:55.503 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-02-13T00:23:55.503 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000401427 s, 1.3 MB/s 2024-02-13T00:23:55.504 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-13T00:23:55.556 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_4 2024-02-13T00:23:55.606 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-13T00:23:55.606 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-13T00:23:55.606 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 513 Links: 1 2024-02-13T00:23:55.606 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-13T00:23:55.606 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-02-13 00:16:40.744605103 +0000 2024-02-13T00:23:55.607 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-02-13 00:16:40.484611100 +0000 2024-02-13T00:23:55.607 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-02-13 00:16:40.484611100 +0000 2024-02-13T00:23:55.607 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2024-02-13T00:23:55.607 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-13T00:23:55.659 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-02-13T00:23:55.659 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-02-13T00:23:55.659 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000272714 s, 1.9 MB/s 2024-02-13T00:23:55.660 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-13T00:23:55.712 INFO:tasks.cephadm:Deploying osd.0 on smithi080 with /dev/vg_nvme/lv_4... 2024-02-13T00:23:55.712 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-13T00:23:55.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:55 smithi106 bash[18459]: cluster 2024-02-13T00:23:54.675913+0000 mgr.y (mgr.14146) 72 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:55.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:55 smithi080 bash[17386]: cluster 2024-02-13T00:23:54.675913+0000 mgr.y (mgr.14146) 72 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:55.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:55 smithi080 bash[24237]: cluster 2024-02-13T00:23:54.675913+0000 mgr.y (mgr.14146) 72 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:56.203 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:23:56 smithi106 systemd[1]: Started Ceph mgr.x for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:23:57.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:57 smithi106 bash[18459]: audit 2024-02-13T00:23:56.173149+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:57.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:57 smithi106 bash[18459]: audit 2024-02-13T00:23:56.177063+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:23:57.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:57 smithi106 bash[18459]: cluster 2024-02-13T00:23:56.676408+0000 mgr.y (mgr.14146) 73 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:57.256 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:23:57 smithi106 bash[19299]: debug 2024-02-13T00:23:57.104+0000 7f7d11952700 1 -- 172.21.15.106:0/4016779205 <== mon.1 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5587615f24e0 con 0x5587616e6800 2024-02-13T00:23:57.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:57 smithi080 bash[17386]: audit 2024-02-13T00:23:56.173149+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:57.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:57 smithi080 bash[17386]: audit 2024-02-13T00:23:56.177063+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:23:57.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:57 smithi080 bash[17386]: cluster 2024-02-13T00:23:56.676408+0000 mgr.y (mgr.14146) 73 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:57.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:57 smithi080 bash[24237]: audit 2024-02-13T00:23:56.173149+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:57.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:57 smithi080 bash[24237]: audit 2024-02-13T00:23:56.177063+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:23:57.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:57 smithi080 bash[24237]: cluster 2024-02-13T00:23:56.676408+0000 mgr.y (mgr.14146) 73 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:23:57.755 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:23:57 smithi106 bash[19299]: debug 2024-02-13T00:23:57.272+0000 7f7d21f4e680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-13T00:23:57.756 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:23:57 smithi106 bash[19299]: debug 2024-02-13T00:23:57.380+0000 7f7d21f4e680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-13T00:23:58.256 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:23:57 smithi106 bash[19299]: debug 2024-02-13T00:23:57.844+0000 7f7d21f4e680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-13T00:23:59.110 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:23:59 smithi106 bash[18459]: audit 2024-02-13T00:23:57.999898+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:59.111 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:23:58 smithi106 bash[19299]: debug 2024-02-13T00:23:58.756+0000 7f7d21f4e680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-13T00:23:59.111 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:23:58 smithi106 bash[19299]: debug 2024-02-13T00:23:58.852+0000 7f7d21f4e680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-13T00:23:59.191 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-13T00:23:59.191 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-13T00:23:59.191 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-02-13T00:23:59.191 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-02-13T00:23:59.191 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0161946 s, 647 MB/s 2024-02-13T00:23:59.192 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-02-13T00:23:59.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:23:59 smithi080 bash[17386]: audit 2024-02-13T00:23:57.999898+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:59.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:23:59 smithi080 bash[24237]: audit 2024-02-13T00:23:57.999898+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:23:59.932 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi080:vg_nvme/lv_4 2024-02-13T00:24:00.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:00 smithi080 bash[17386]: cluster 2024-02-13T00:23:58.676729+0000 mgr.y (mgr.14146) 74 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:00.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:00 smithi080 bash[24237]: cluster 2024-02-13T00:23:58.676729+0000 mgr.y (mgr.14146) 74 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:00.409 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:00 smithi106 bash[18459]: cluster 2024-02-13T00:23:58.676729+0000 mgr.y (mgr.14146) 74 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:00.409 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:23:59 smithi106 bash[19299]: debug 2024-02-13T00:23:59.104+0000 7f7d21f4e680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-13T00:24:00.409 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:24:00 smithi106 bash[19299]: debug 2024-02-13T00:24:00.240+0000 7f7d21f4e680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-13T00:24:00.756 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:24:00 smithi106 bash[19299]: debug 2024-02-13T00:24:00.404+0000 7f7d21f4e680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-13T00:24:00.756 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:24:00 smithi106 bash[19299]: debug 2024-02-13T00:24:00.500+0000 7f7d21f4e680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-13T00:24:00.756 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:24:00 smithi106 bash[19299]: debug 2024-02-13T00:24:00.608+0000 7f7d21f4e680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-13T00:24:01.210 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:24:00 smithi106 bash[19299]: debug 2024-02-13T00:24:00.828+0000 7f7d21f4e680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-13T00:24:01.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:24:01 smithi106 bash[19299]: debug 2024-02-13T00:24:01.204+0000 7f7d21f4e680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-13T00:24:01.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:24:01 smithi106 bash[19299]: debug 2024-02-13T00:24:01.328+0000 7f7d21f4e680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-13T00:24:02.293 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:24:02 smithi106 bash[19299]: debug 2024-02-13T00:24:02.180+0000 7f7d21f4e680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-13T00:24:02.293 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:02 smithi106 bash[18459]: cluster 2024-02-13T00:24:00.677104+0000 mgr.y (mgr.14146) 75 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:02.293 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:02 smithi106 bash[18459]: audit 2024-02-13T00:24:01.177739+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:02.294 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:02 smithi106 bash[18459]: audit 2024-02-13T00:24:01.178962+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:02.294 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:02 smithi106 bash[18459]: audit 2024-02-13T00:24:01.180053+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:24:02.294 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:02 smithi106 bash[18459]: audit 2024-02-13T00:24:01.187078+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:02.294 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:02 smithi106 bash[18459]: audit 2024-02-13T00:24:01.189732+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-13T00:24:02.294 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:02 smithi106 bash[18459]: audit 2024-02-13T00:24:01.190784+0000 mon.a (mon.0) 207 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-13T00:24:02.294 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:02 smithi106 bash[18459]: audit 2024-02-13T00:24:01.191618+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:02.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:02 smithi080 bash[17386]: cluster 2024-02-13T00:24:00.677104+0000 mgr.y (mgr.14146) 75 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:02.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:02 smithi080 bash[17386]: audit 2024-02-13T00:24:01.177739+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:02.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:02 smithi080 bash[17386]: audit 2024-02-13T00:24:01.178962+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:02.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:02 smithi080 bash[17386]: audit 2024-02-13T00:24:01.180053+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:24:02.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:02 smithi080 bash[17386]: audit 2024-02-13T00:24:01.187078+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:02.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:02 smithi080 bash[17386]: audit 2024-02-13T00:24:01.189732+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-13T00:24:02.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:02 smithi080 bash[17386]: audit 2024-02-13T00:24:01.190784+0000 mon.a (mon.0) 207 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-13T00:24:02.326 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:02 smithi080 bash[17386]: audit 2024-02-13T00:24:01.191618+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:02.326 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:02 smithi080 bash[24237]: cluster 2024-02-13T00:24:00.677104+0000 mgr.y (mgr.14146) 75 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:02.326 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:02 smithi080 bash[24237]: audit 2024-02-13T00:24:01.177739+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:02.327 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:02 smithi080 bash[24237]: audit 2024-02-13T00:24:01.178962+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:02.327 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:02 smithi080 bash[24237]: audit 2024-02-13T00:24:01.180053+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:24:02.327 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:02 smithi080 bash[24237]: audit 2024-02-13T00:24:01.187078+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:02.327 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:02 smithi080 bash[24237]: audit 2024-02-13T00:24:01.189732+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-13T00:24:02.327 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:02 smithi080 bash[24237]: audit 2024-02-13T00:24:01.190784+0000 mon.a (mon.0) 207 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-13T00:24:02.327 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:02 smithi080 bash[24237]: audit 2024-02-13T00:24:01.191618+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:02.654 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:24:02 smithi106 bash[19299]: debug 2024-02-13T00:24:02.288+0000 7f7d21f4e680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-13T00:24:02.654 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:24:02 smithi106 bash[19299]: debug 2024-02-13T00:24:02.412+0000 7f7d21f4e680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-13T00:24:02.654 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:24:02 smithi106 bash[19299]: debug 2024-02-13T00:24:02.648+0000 7f7d21f4e680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-13T00:24:03.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:03 smithi106 bash[18459]: cephadm 2024-02-13T00:24:01.189339+0000 mgr.y (mgr.14146) 76 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-02-13T00:24:03.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:03 smithi106 bash[18459]: cephadm 2024-02-13T00:24:01.192407+0000 mgr.y (mgr.14146) 77 : cephadm [INF] Reconfiguring daemon mgr.y on smithi080 2024-02-13T00:24:03.256 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:24:02 smithi106 bash[19299]: debug 2024-02-13T00:24:02.948+0000 7f7d21f4e680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-13T00:24:03.256 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:24:03 smithi106 bash[19299]: debug 2024-02-13T00:24:03.116+0000 7f7d21f4e680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-13T00:24:03.375 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:03 smithi080 bash[24237]: cephadm 2024-02-13T00:24:01.189339+0000 mgr.y (mgr.14146) 76 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-02-13T00:24:03.375 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:03 smithi080 bash[24237]: cephadm 2024-02-13T00:24:01.192407+0000 mgr.y (mgr.14146) 77 : cephadm [INF] Reconfiguring daemon mgr.y on smithi080 2024-02-13T00:24:03.375 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:03 smithi080 bash[17386]: cephadm 2024-02-13T00:24:01.189339+0000 mgr.y (mgr.14146) 76 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-02-13T00:24:03.376 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:03 smithi080 bash[17386]: cephadm 2024-02-13T00:24:01.192407+0000 mgr.y (mgr.14146) 77 : cephadm [INF] Reconfiguring daemon mgr.y on smithi080 2024-02-13T00:24:03.605 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:24:03 smithi106 bash[19299]: debug 2024-02-13T00:24:03.284+0000 7f7d21f4e680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-13T00:24:03.605 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:24:03 smithi106 bash[19299]: debug 2024-02-13T00:24:03.496+0000 7f7d21f4e680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-13T00:24:03.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.662+0000 7f06cf41c700 1 -- 172.21.15.80:0/1828715565 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06c80f6ea0 msgr2=0x7f06c80f72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:24:03.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.662+0000 7f06cf41c700 1 --2- 172.21.15.80:0/1828715565 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06c80f6ea0 0x7f06c80f72c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f06c4004870 tx=0x7f06c4009cb0).stop 2024-02-13T00:24:03.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.662+0000 7f06cf41c700 1 -- 172.21.15.80:0/1828715565 shutdown_connections 2024-02-13T00:24:03.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.662+0000 7f06cf41c700 1 --2- 172.21.15.80:0/1828715565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06c80f6560 0x7f06c80fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:24:03.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.662+0000 7f06cf41c700 1 --2- 172.21.15.80:0/1828715565 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06c80f6ea0 0x7f06c80f72c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:24:03.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.662+0000 7f06cf41c700 1 --2- 172.21.15.80:0/1828715565 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06c80f5bf0 0x7f06c80f6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:24:03.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.662+0000 7f06cf41c700 1 -- 172.21.15.80:0/1828715565 >> 172.21.15.80:0/1828715565 conn(0x7f06c80f19d0 msgr2=0x7f06c80f3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:24:03.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.662+0000 7f06cf41c700 1 -- 172.21.15.80:0/1828715565 shutdown_connections 2024-02-13T00:24:03.673 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.662+0000 7f06cf41c700 1 -- 172.21.15.80:0/1828715565 wait complete. 2024-02-13T00:24:03.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cf41c700 1 Processor -- start 2024-02-13T00:24:03.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cf41c700 1 -- start start 2024-02-13T00:24:03.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cf41c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06c80f5bf0 0x7f06c810e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:24:03.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cf41c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06c80f6560 0x7f06c810ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:24:03.676 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cf41c700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06c80f6ea0 0x7f06c8115b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cf41c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c8116000 con 0x7f06c80f5bf0 2024-02-13T00:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cf41c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c8116140 con 0x7f06c80f6560 2024-02-13T00:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cf41c700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c8116280 con 0x7f06c80f6ea0 2024-02-13T00:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cd1b8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06c80f5bf0 0x7f06c810e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cd1b8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06c80f5bf0 0x7f06c810e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:58902/0 (socket says 172.21.15.80:58902) 2024-02-13T00:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cd1b8700 1 -- 172.21.15.80:0/298165242 learned_addr learned my addr 172.21.15.80:0/298165242 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cd9b9700 1 --2- 172.21.15.80:0/298165242 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06c80f6ea0 0x7f06c8115b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cc9b7700 1 --2- 172.21.15.80:0/298165242 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06c80f6560 0x7f06c810ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cd1b8700 1 -- 172.21.15.80:0/298165242 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06c80f6ea0 msgr2=0x7f06c8115b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cd1b8700 1 --2- 172.21.15.80:0/298165242 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06c80f6ea0 0x7f06c8115b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cd1b8700 1 -- 172.21.15.80:0/298165242 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06c80f6560 msgr2=0x7f06c810ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cd1b8700 1 --2- 172.21.15.80:0/298165242 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06c80f6560 0x7f06c810ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cd1b8700 1 -- 172.21.15.80:0/298165242 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c4005040 con 0x7f06c80f5bf0 2024-02-13T00:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cd1b8700 1 --2- 172.21.15.80:0/298165242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06c80f5bf0 0x7f06c810e540 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f06c4013700 tx=0x7f06c4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:24:03.677 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06be7fc700 1 -- 172.21.15.80:0/298165242 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c400e030 con 0x7f06c80f5bf0 2024-02-13T00:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06be7fc700 1 -- 172.21.15.80:0/298165242 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f06c4013e30 con 0x7f06c80f5bf0 2024-02-13T00:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cf41c700 1 -- 172.21.15.80:0/298165242 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c8116500 con 0x7f06c80f5bf0 2024-02-13T00:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06be7fc700 1 -- 172.21.15.80:0/298165242 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c4018070 con 0x7f06c80f5bf0 2024-02-13T00:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cf41c700 1 -- 172.21.15.80:0/298165242 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c8116930 con 0x7f06c80f5bf0 2024-02-13T00:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06be7fc700 1 -- 172.21.15.80:0/298165242 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 13) v1 ==== 38673+0+0 (secure 0 0 0) 0x7f06c4009240 con 0x7f06c80f5bf0 2024-02-13T00:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06be7fc700 1 --2- 172.21.15.80:0/298165242 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f06b40327c0 0x7f06b4034c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06be7fc700 1 -- 172.21.15.80:0/298165242 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1098+0+0 (secure 0 0 0) 0x7f06c4043a70 con 0x7f06c80f5bf0 2024-02-13T00:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cc9b7700 1 --2- 172.21.15.80:0/298165242 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f06b40327c0 0x7f06b4034c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cf41c700 1 -- 172.21.15.80:0/298165242 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c8060070 con 0x7f06c80f5bf0 2024-02-13T00:24:03.678 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.666+0000 7f06cc9b7700 1 --2- 172.21.15.80:0/298165242 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f06b40327c0 0x7f06b4034c80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f06b8004ee0 tx=0x7f06b800b040).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:24:03.681 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.674+0000 7f06be7fc700 1 -- 172.21.15.80:0/298165242 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f06c4009540 con 0x7f06c80f5bf0 2024-02-13T00:24:03.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:03.861+0000 7f06cf41c700 1 -- 172.21.15.80:0/298165242 --> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f06c8108db0 con 0x7f06b40327c0 2024-02-13T00:24:04.006 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:24:03 smithi106 bash[19299]: debug 2024-02-13T00:24:03.600+0000 7f7d21f4e680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-13T00:24:04.030 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:04.021+0000 7f06be7fc700 1 -- 172.21.15.80:0/298165242 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mgrmap(e 14) v1 ==== 77064+0+0 (secure 0 0 0) 0x7f06c4026950 con 0x7f06c80f5bf0 2024-02-13T00:24:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:04 smithi106 bash[18459]: cluster 2024-02-13T00:24:02.677585+0000 mgr.y (mgr.14146) 78 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:04 smithi106 bash[18459]: cluster 2024-02-13T00:24:03.622190+0000 mon.a (mon.0) 209 : cluster [DBG] Standby manager daemon x started 2024-02-13T00:24:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:04 smithi106 bash[18459]: audit 2024-02-13T00:24:03.626575+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.106:0/768612604' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-13T00:24:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:04 smithi106 bash[18459]: audit 2024-02-13T00:24:03.627500+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.106:0/768612604' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-13T00:24:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:04 smithi106 bash[18459]: audit 2024-02-13T00:24:03.629546+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.106:0/768612604' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-13T00:24:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:04 smithi106 bash[18459]: audit 2024-02-13T00:24:03.630247+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.106:0/768612604' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-13T00:24:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:04 smithi106 bash[18459]: audit 2024-02-13T00:24:03.870945+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:24:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:04 smithi106 bash[18459]: audit 2024-02-13T00:24:03.873562+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:24:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:04 smithi106 bash[18459]: audit 2024-02-13T00:24:03.874462+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:04.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:04 smithi080 bash[17386]: cluster 2024-02-13T00:24:02.677585+0000 mgr.y (mgr.14146) 78 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:04.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:04 smithi080 bash[17386]: cluster 2024-02-13T00:24:03.622190+0000 mon.a (mon.0) 209 : cluster [DBG] Standby manager daemon x started 2024-02-13T00:24:04.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:04 smithi080 bash[17386]: audit 2024-02-13T00:24:03.626575+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.106:0/768612604' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-13T00:24:04.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:04 smithi080 bash[17386]: audit 2024-02-13T00:24:03.627500+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.106:0/768612604' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-13T00:24:04.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:04 smithi080 bash[17386]: audit 2024-02-13T00:24:03.629546+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.106:0/768612604' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-13T00:24:04.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:04 smithi080 bash[17386]: audit 2024-02-13T00:24:03.630247+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.106:0/768612604' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-13T00:24:04.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:04 smithi080 bash[17386]: audit 2024-02-13T00:24:03.870945+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:24:04.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:04 smithi080 bash[17386]: audit 2024-02-13T00:24:03.873562+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:24:04.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:04 smithi080 bash[17386]: audit 2024-02-13T00:24:03.874462+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:04.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:04 smithi080 bash[24237]: cluster 2024-02-13T00:24:02.677585+0000 mgr.y (mgr.14146) 78 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:04.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:04 smithi080 bash[24237]: cluster 2024-02-13T00:24:03.622190+0000 mon.a (mon.0) 209 : cluster [DBG] Standby manager daemon x started 2024-02-13T00:24:04.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:04 smithi080 bash[24237]: audit 2024-02-13T00:24:03.626575+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.106:0/768612604' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-13T00:24:04.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:04 smithi080 bash[24237]: audit 2024-02-13T00:24:03.627500+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.106:0/768612604' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-13T00:24:04.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:04 smithi080 bash[24237]: audit 2024-02-13T00:24:03.629546+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.106:0/768612604' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-13T00:24:04.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:04 smithi080 bash[24237]: audit 2024-02-13T00:24:03.630247+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.106:0/768612604' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-13T00:24:04.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:04 smithi080 bash[24237]: audit 2024-02-13T00:24:03.870945+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:24:04.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:04 smithi080 bash[24237]: audit 2024-02-13T00:24:03.873562+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:24:04.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:04 smithi080 bash[24237]: audit 2024-02-13T00:24:03.874462+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:05 smithi106 bash[18459]: audit 2024-02-13T00:24:03.867508+0000 mgr.y (mgr.14146) 79 : audit [DBG] from='client.14202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:24:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:05 smithi106 bash[18459]: cluster 2024-02-13T00:24:04.027339+0000 mon.a (mon.0) 213 : cluster [DBG] mgrmap e14: y(active, since 117s), standbys: x 2024-02-13T00:24:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:05 smithi106 bash[18459]: audit 2024-02-13T00:24:04.027761+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-13T00:24:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:05 smithi106 bash[18459]: audit 2024-02-13T00:24:04.192852+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:05 smithi106 bash[18459]: audit 2024-02-13T00:24:04.194436+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:24:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:05 smithi106 bash[18459]: audit 2024-02-13T00:24:04.196490+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:05 smithi106 bash[18459]: audit 2024-02-13T00:24:04.197530+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:24:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:05 smithi106 bash[18459]: audit 2024-02-13T00:24:04.212746+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:05.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:05 smithi080 bash[17386]: audit 2024-02-13T00:24:03.867508+0000 mgr.y (mgr.14146) 79 : audit [DBG] from='client.14202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:24:05.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:05 smithi080 bash[17386]: cluster 2024-02-13T00:24:04.027339+0000 mon.a (mon.0) 213 : cluster [DBG] mgrmap e14: y(active, since 117s), standbys: x 2024-02-13T00:24:05.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:05 smithi080 bash[17386]: audit 2024-02-13T00:24:04.027761+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-13T00:24:05.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:05 smithi080 bash[17386]: audit 2024-02-13T00:24:04.192852+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:05.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:05 smithi080 bash[17386]: audit 2024-02-13T00:24:04.194436+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:24:05.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:05 smithi080 bash[17386]: audit 2024-02-13T00:24:04.196490+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:05.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:05 smithi080 bash[17386]: audit 2024-02-13T00:24:04.197530+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:24:05.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:05 smithi080 bash[17386]: audit 2024-02-13T00:24:04.212746+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:05.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:05 smithi080 bash[24237]: audit 2024-02-13T00:24:03.867508+0000 mgr.y (mgr.14146) 79 : audit [DBG] from='client.14202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:24:05.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:05 smithi080 bash[24237]: cluster 2024-02-13T00:24:04.027339+0000 mon.a (mon.0) 213 : cluster [DBG] mgrmap e14: y(active, since 117s), standbys: x 2024-02-13T00:24:05.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:05 smithi080 bash[24237]: audit 2024-02-13T00:24:04.027761+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-13T00:24:05.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:05 smithi080 bash[24237]: audit 2024-02-13T00:24:04.192852+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:05.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:05 smithi080 bash[24237]: audit 2024-02-13T00:24:04.194436+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:24:05.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:05 smithi080 bash[24237]: audit 2024-02-13T00:24:04.196490+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:05.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:05 smithi080 bash[24237]: audit 2024-02-13T00:24:04.197530+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:24:05.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:05 smithi080 bash[24237]: audit 2024-02-13T00:24:04.212746+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:06 smithi106 bash[18459]: cluster 2024-02-13T00:24:04.677990+0000 mgr.y (mgr.14146) 80 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:06.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:06 smithi080 bash[17386]: cluster 2024-02-13T00:24:04.677990+0000 mgr.y (mgr.14146) 80 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:06.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:06 smithi080 bash[24237]: cluster 2024-02-13T00:24:04.677990+0000 mgr.y (mgr.14146) 80 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:08 smithi106 bash[18459]: cluster 2024-02-13T00:24:06.678339+0000 mgr.y (mgr.14146) 81 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:08.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:08 smithi080 bash[17386]: cluster 2024-02-13T00:24:06.678339+0000 mgr.y (mgr.14146) 81 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:08.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:08 smithi080 bash[24237]: cluster 2024-02-13T00:24:06.678339+0000 mgr.y (mgr.14146) 81 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:10.302 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:10 smithi080 bash[17386]: cluster 2024-02-13T00:24:08.678764+0000 mgr.y (mgr.14146) 82 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:10.302 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:10 smithi080 bash[24237]: cluster 2024-02-13T00:24:08.678764+0000 mgr.y (mgr.14146) 82 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:10 smithi106 bash[18459]: cluster 2024-02-13T00:24:08.678764+0000 mgr.y (mgr.14146) 82 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:12.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:12 smithi106 bash[18459]: cluster 2024-02-13T00:24:10.679176+0000 mgr.y (mgr.14146) 83 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:12.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:12 smithi106 bash[18459]: audit 2024-02-13T00:24:11.909462+0000 mon.c (mon.2) 2 : audit [INF] from='client.? 172.21.15.80:0/2768772468' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5a7f0c8-0fa3-4f12-add7-5fb78c8cc514"}]: dispatch 2024-02-13T00:24:12.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:12 smithi106 bash[18459]: audit 2024-02-13T00:24:11.910279+0000 mon.a (mon.0) 220 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5a7f0c8-0fa3-4f12-add7-5fb78c8cc514"}]: dispatch 2024-02-13T00:24:12.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:12 smithi106 bash[18459]: audit 2024-02-13T00:24:11.919415+0000 mon.a (mon.0) 221 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e5a7f0c8-0fa3-4f12-add7-5fb78c8cc514"}]': finished 2024-02-13T00:24:12.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:12 smithi106 bash[18459]: cluster 2024-02-13T00:24:11.919538+0000 mon.a (mon.0) 222 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-02-13T00:24:12.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:12 smithi106 bash[18459]: audit 2024-02-13T00:24:11.919696+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T00:24:12.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:12 smithi080 bash[17386]: cluster 2024-02-13T00:24:10.679176+0000 mgr.y (mgr.14146) 83 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:12.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:12 smithi080 bash[17386]: audit 2024-02-13T00:24:11.909462+0000 mon.c (mon.2) 2 : audit [INF] from='client.? 172.21.15.80:0/2768772468' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5a7f0c8-0fa3-4f12-add7-5fb78c8cc514"}]: dispatch 2024-02-13T00:24:12.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:12 smithi080 bash[17386]: audit 2024-02-13T00:24:11.910279+0000 mon.a (mon.0) 220 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5a7f0c8-0fa3-4f12-add7-5fb78c8cc514"}]: dispatch 2024-02-13T00:24:12.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:12 smithi080 bash[17386]: audit 2024-02-13T00:24:11.919415+0000 mon.a (mon.0) 221 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e5a7f0c8-0fa3-4f12-add7-5fb78c8cc514"}]': finished 2024-02-13T00:24:12.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:12 smithi080 bash[17386]: cluster 2024-02-13T00:24:11.919538+0000 mon.a (mon.0) 222 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-02-13T00:24:12.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:12 smithi080 bash[17386]: audit 2024-02-13T00:24:11.919696+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T00:24:12.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:12 smithi080 bash[24237]: cluster 2024-02-13T00:24:10.679176+0000 mgr.y (mgr.14146) 83 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:12.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:12 smithi080 bash[24237]: audit 2024-02-13T00:24:11.909462+0000 mon.c (mon.2) 2 : audit [INF] from='client.? 172.21.15.80:0/2768772468' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5a7f0c8-0fa3-4f12-add7-5fb78c8cc514"}]: dispatch 2024-02-13T00:24:12.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:12 smithi080 bash[24237]: audit 2024-02-13T00:24:11.910279+0000 mon.a (mon.0) 220 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5a7f0c8-0fa3-4f12-add7-5fb78c8cc514"}]: dispatch 2024-02-13T00:24:12.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:12 smithi080 bash[24237]: audit 2024-02-13T00:24:11.919415+0000 mon.a (mon.0) 221 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e5a7f0c8-0fa3-4f12-add7-5fb78c8cc514"}]': finished 2024-02-13T00:24:12.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:12 smithi080 bash[24237]: cluster 2024-02-13T00:24:11.919538+0000 mon.a (mon.0) 222 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-02-13T00:24:12.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:12 smithi080 bash[24237]: audit 2024-02-13T00:24:11.919696+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T00:24:13.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:13 smithi106 bash[18459]: audit 2024-02-13T00:24:12.609409+0000 mon.a (mon.0) 224 : audit [DBG] from='client.? 172.21.15.80:0/3433226631' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:24:13.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:13 smithi080 bash[17386]: audit 2024-02-13T00:24:12.609409+0000 mon.a (mon.0) 224 : audit [DBG] from='client.? 172.21.15.80:0/3433226631' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:24:13.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:13 smithi080 bash[24237]: audit 2024-02-13T00:24:12.609409+0000 mon.a (mon.0) 224 : audit [DBG] from='client.? 172.21.15.80:0/3433226631' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:24:14.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:14 smithi106 bash[18459]: cluster 2024-02-13T00:24:12.679629+0000 mgr.y (mgr.14146) 84 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:14.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:14 smithi080 bash[17386]: cluster 2024-02-13T00:24:12.679629+0000 mgr.y (mgr.14146) 84 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:14.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:14 smithi080 bash[24237]: cluster 2024-02-13T00:24:12.679629+0000 mgr.y (mgr.14146) 84 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:15.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:15 smithi106 bash[18459]: cluster 2024-02-13T00:24:14.680063+0000 mgr.y (mgr.14146) 85 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:15.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:15 smithi080 bash[17386]: cluster 2024-02-13T00:24:14.680063+0000 mgr.y (mgr.14146) 85 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:15.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:15 smithi080 bash[24237]: cluster 2024-02-13T00:24:14.680063+0000 mgr.y (mgr.14146) 85 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:18.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:17 smithi106 bash[18459]: cluster 2024-02-13T00:24:16.680479+0000 mgr.y (mgr.14146) 86 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:18.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:17 smithi080 bash[17386]: cluster 2024-02-13T00:24:16.680479+0000 mgr.y (mgr.14146) 86 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:18.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:17 smithi080 bash[24237]: cluster 2024-02-13T00:24:16.680479+0000 mgr.y (mgr.14146) 86 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:20.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:19 smithi106 bash[18459]: cluster 2024-02-13T00:24:18.680869+0000 mgr.y (mgr.14146) 87 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:20.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:19 smithi080 bash[17386]: cluster 2024-02-13T00:24:18.680869+0000 mgr.y (mgr.14146) 87 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:20.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:19 smithi080 bash[24237]: cluster 2024-02-13T00:24:18.680869+0000 mgr.y (mgr.14146) 87 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:22.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:21 smithi106 bash[18459]: cluster 2024-02-13T00:24:20.681213+0000 mgr.y (mgr.14146) 88 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:22.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:21 smithi080 bash[17386]: cluster 2024-02-13T00:24:20.681213+0000 mgr.y (mgr.14146) 88 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:22.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:21 smithi080 bash[24237]: cluster 2024-02-13T00:24:20.681213+0000 mgr.y (mgr.14146) 88 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:24.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:23 smithi106 bash[18459]: cluster 2024-02-13T00:24:22.681541+0000 mgr.y (mgr.14146) 89 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:24.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:23 smithi080 bash[17386]: cluster 2024-02-13T00:24:22.681541+0000 mgr.y (mgr.14146) 89 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:24.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:23 smithi080 bash[24237]: cluster 2024-02-13T00:24:22.681541+0000 mgr.y (mgr.14146) 89 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:25.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:25 smithi106 bash[18459]: audit 2024-02-13T00:24:24.235013+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-13T00:24:25.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:25 smithi106 bash[18459]: audit 2024-02-13T00:24:24.236564+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:25.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:25 smithi106 bash[18459]: cephadm 2024-02-13T00:24:24.237633+0000 mgr.y (mgr.14146) 90 : cephadm [INF] Deploying daemon osd.0 on smithi080 2024-02-13T00:24:25.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:25 smithi106 bash[18459]: cluster 2024-02-13T00:24:24.681905+0000 mgr.y (mgr.14146) 91 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:25.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:25 smithi080 bash[17386]: audit 2024-02-13T00:24:24.235013+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-13T00:24:25.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:25 smithi080 bash[17386]: audit 2024-02-13T00:24:24.236564+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:25.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:25 smithi080 bash[17386]: cephadm 2024-02-13T00:24:24.237633+0000 mgr.y (mgr.14146) 90 : cephadm [INF] Deploying daemon osd.0 on smithi080 2024-02-13T00:24:25.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:25 smithi080 bash[17386]: cluster 2024-02-13T00:24:24.681905+0000 mgr.y (mgr.14146) 91 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:25.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:25 smithi080 bash[24237]: audit 2024-02-13T00:24:24.235013+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-13T00:24:25.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:25 smithi080 bash[24237]: audit 2024-02-13T00:24:24.236564+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:25.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:25 smithi080 bash[24237]: cephadm 2024-02-13T00:24:24.237633+0000 mgr.y (mgr.14146) 90 : cephadm [INF] Deploying daemon osd.0 on smithi080 2024-02-13T00:24:25.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:25 smithi080 bash[24237]: cluster 2024-02-13T00:24:24.681905+0000 mgr.y (mgr.14146) 91 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:28.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:27 smithi106 bash[18459]: cluster 2024-02-13T00:24:26.682269+0000 mgr.y (mgr.14146) 92 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:28.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:27 smithi080 bash[24237]: cluster 2024-02-13T00:24:26.682269+0000 mgr.y (mgr.14146) 92 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:28.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:27 smithi080 bash[17386]: cluster 2024-02-13T00:24:26.682269+0000 mgr.y (mgr.14146) 92 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:29.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:29 smithi080 bash[17386]: audit 2024-02-13T00:24:28.260625+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:29.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:29 smithi080 bash[17386]: audit 2024-02-13T00:24:28.294584+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:24:29.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:29 smithi080 bash[17386]: cluster 2024-02-13T00:24:28.682704+0000 mgr.y (mgr.14146) 93 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:29.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:29 smithi080 bash[24237]: audit 2024-02-13T00:24:28.260625+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:29.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:29 smithi080 bash[24237]: audit 2024-02-13T00:24:28.294584+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:24:29.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:29 smithi080 bash[24237]: cluster 2024-02-13T00:24:28.682704+0000 mgr.y (mgr.14146) 93 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:29.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:29 smithi106 bash[18459]: audit 2024-02-13T00:24:28.260625+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:29.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:29 smithi106 bash[18459]: audit 2024-02-13T00:24:28.294584+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:24:29.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:29 smithi106 bash[18459]: cluster 2024-02-13T00:24:28.682704+0000 mgr.y (mgr.14146) 93 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:32.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:31 smithi106 bash[18459]: cluster 2024-02-13T00:24:30.683147+0000 mgr.y (mgr.14146) 94 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:32.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:31 smithi080 bash[17386]: cluster 2024-02-13T00:24:30.683147+0000 mgr.y (mgr.14146) 94 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:32.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:31 smithi080 bash[24237]: cluster 2024-02-13T00:24:30.683147+0000 mgr.y (mgr.14146) 94 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:34.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:33 smithi106 bash[18459]: cluster 2024-02-13T00:24:32.683580+0000 mgr.y (mgr.14146) 95 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:34.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:33 smithi106 bash[18459]: audit 2024-02-13T00:24:33.358120+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:34.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:33 smithi106 bash[18459]: audit 2024-02-13T00:24:33.359229+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:34.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:33 smithi106 bash[18459]: audit 2024-02-13T00:24:33.360378+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:24:34.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:33 smithi106 bash[18459]: audit 2024-02-13T00:24:33.366507+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:34.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:33 smithi080 bash[17386]: cluster 2024-02-13T00:24:32.683580+0000 mgr.y (mgr.14146) 95 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:34.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:33 smithi080 bash[17386]: audit 2024-02-13T00:24:33.358120+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:34.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:33 smithi080 bash[17386]: audit 2024-02-13T00:24:33.359229+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:34.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:33 smithi080 bash[17386]: audit 2024-02-13T00:24:33.360378+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:24:34.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:33 smithi080 bash[17386]: audit 2024-02-13T00:24:33.366507+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:34.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:33 smithi080 bash[24237]: cluster 2024-02-13T00:24:32.683580+0000 mgr.y (mgr.14146) 95 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:34.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:33 smithi080 bash[24237]: audit 2024-02-13T00:24:33.358120+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:34.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:33 smithi080 bash[24237]: audit 2024-02-13T00:24:33.359229+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:34.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:33 smithi080 bash[24237]: audit 2024-02-13T00:24:33.360378+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:24:34.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:33 smithi080 bash[24237]: audit 2024-02-13T00:24:33.366507+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:35.488 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:35 smithi080 bash[17386]: cluster 2024-02-13T00:24:34.683998+0000 mgr.y (mgr.14146) 96 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:35.488 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:35 smithi080 bash[17386]: audit 2024-02-13T00:24:34.957675+0000 mon.c (mon.2) 3 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/635200923,v1:172.21.15.80:6803/635200923]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-13T00:24:35.488 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:35 smithi080 bash[17386]: audit 2024-02-13T00:24:34.958280+0000 mon.a (mon.0) 233 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-13T00:24:35.489 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:35 smithi080 bash[24237]: cluster 2024-02-13T00:24:34.683998+0000 mgr.y (mgr.14146) 96 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:35.489 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:35 smithi080 bash[24237]: audit 2024-02-13T00:24:34.957675+0000 mon.c (mon.2) 3 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/635200923,v1:172.21.15.80:6803/635200923]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-13T00:24:35.489 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:35 smithi080 bash[24237]: audit 2024-02-13T00:24:34.958280+0000 mon.a (mon.0) 233 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-13T00:24:35.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:35 smithi106 bash[18459]: cluster 2024-02-13T00:24:34.683998+0000 mgr.y (mgr.14146) 96 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:35.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:35 smithi106 bash[18459]: audit 2024-02-13T00:24:34.957675+0000 mon.c (mon.2) 3 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/635200923,v1:172.21.15.80:6803/635200923]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-13T00:24:35.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:35 smithi106 bash[18459]: audit 2024-02-13T00:24:34.958280+0000 mon.a (mon.0) 233 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-13T00:24:36.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:36 smithi106 bash[18459]: audit 2024-02-13T00:24:35.221592+0000 mon.a (mon.0) 234 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-13T00:24:36.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:36 smithi106 bash[18459]: cluster 2024-02-13T00:24:35.221804+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-02-13T00:24:36.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:36 smithi106 bash[18459]: audit 2024-02-13T00:24:35.222032+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T00:24:36.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:36 smithi106 bash[18459]: audit 2024-02-13T00:24:35.222675+0000 mon.c (mon.2) 4 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/635200923,v1:172.21.15.80:6803/635200923]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-13T00:24:36.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:36 smithi106 bash[18459]: audit 2024-02-13T00:24:35.223163+0000 mon.a (mon.0) 237 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-13T00:24:36.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:36 smithi080 bash[17386]: audit 2024-02-13T00:24:35.221592+0000 mon.a (mon.0) 234 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-13T00:24:36.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:36 smithi080 bash[17386]: cluster 2024-02-13T00:24:35.221804+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-02-13T00:24:36.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:36 smithi080 bash[17386]: audit 2024-02-13T00:24:35.222032+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T00:24:36.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:36 smithi080 bash[17386]: audit 2024-02-13T00:24:35.222675+0000 mon.c (mon.2) 4 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/635200923,v1:172.21.15.80:6803/635200923]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-13T00:24:36.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:36 smithi080 bash[17386]: audit 2024-02-13T00:24:35.223163+0000 mon.a (mon.0) 237 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-13T00:24:36.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:36 smithi080 bash[24237]: audit 2024-02-13T00:24:35.221592+0000 mon.a (mon.0) 234 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-13T00:24:36.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:36 smithi080 bash[24237]: cluster 2024-02-13T00:24:35.221804+0000 mon.a (mon.0) 235 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-02-13T00:24:36.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:36 smithi080 bash[24237]: audit 2024-02-13T00:24:35.222032+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T00:24:36.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:36 smithi080 bash[24237]: audit 2024-02-13T00:24:35.222675+0000 mon.c (mon.2) 4 : audit [INF] from='osd.0 [v2:172.21.15.80:6802/635200923,v1:172.21.15.80:6803/635200923]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-13T00:24:36.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:36 smithi080 bash[24237]: audit 2024-02-13T00:24:35.223163+0000 mon.a (mon.0) 237 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-13T00:24:36.609 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:36.597+0000 7f06be7fc700 1 -- 172.21.15.80:0/298165242 <== mgr.14146 v2:172.21.15.80:6800/461193090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f06c8108db0 con 0x7f06b40327c0 2024-02-13T00:24:36.609 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 0 on host 'smithi080' 2024-02-13T00:24:36.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:36.601+0000 7f06cf41c700 1 -- 172.21.15.80:0/298165242 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f06b40327c0 msgr2=0x7f06b4034c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:24:36.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:36.601+0000 7f06cf41c700 1 --2- 172.21.15.80:0/298165242 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f06b40327c0 0x7f06b4034c80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f06b8004ee0 tx=0x7f06b800b040).stop 2024-02-13T00:24:36.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:36.601+0000 7f06cf41c700 1 -- 172.21.15.80:0/298165242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06c80f5bf0 msgr2=0x7f06c810e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:24:36.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:36.601+0000 7f06cf41c700 1 --2- 172.21.15.80:0/298165242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06c80f5bf0 0x7f06c810e540 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f06c4013700 tx=0x7f06c4009cb0).stop 2024-02-13T00:24:36.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:36.601+0000 7f06cf41c700 1 -- 172.21.15.80:0/298165242 shutdown_connections 2024-02-13T00:24:36.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:36.601+0000 7f06cf41c700 1 --2- 172.21.15.80:0/298165242 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f06c80f6ea0 0x7f06c8115b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:24:36.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:36.601+0000 7f06cf41c700 1 --2- 172.21.15.80:0/298165242 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f06c80f5bf0 0x7f06c810e540 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:24:36.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:36.601+0000 7f06cf41c700 1 --2- 172.21.15.80:0/298165242 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f06b40327c0 0x7f06b4034c80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:24:36.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:36.601+0000 7f06cf41c700 1 --2- 172.21.15.80:0/298165242 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06c80f6560 0x7f06c810ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:24:36.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:36.601+0000 7f06cf41c700 1 -- 172.21.15.80:0/298165242 >> 172.21.15.80:0/298165242 conn(0x7f06c80f19d0 msgr2=0x7f06c80f3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:24:36.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:36.605+0000 7f06cf41c700 1 -- 172.21.15.80:0/298165242 shutdown_connections 2024-02-13T00:24:36.613 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:36.605+0000 7f06cf41c700 1 -- 172.21.15.80:0/298165242 wait complete. 2024-02-13T00:24:37.329 DEBUG:teuthology.orchestra.run.smithi080:osd.0> sudo journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.0.service 2024-02-13T00:24:37.331 INFO:tasks.cephadm:Deploying osd.1 on smithi080 with /dev/vg_nvme/lv_3... 2024-02-13T00:24:37.331 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-13T00:24:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:37 smithi106 bash[18459]: audit 2024-02-13T00:24:36.223320+0000 mon.a (mon.0) 238 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-13T00:24:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:37 smithi106 bash[18459]: cluster 2024-02-13T00:24:36.223455+0000 mon.a (mon.0) 239 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-02-13T00:24:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:37 smithi106 bash[18459]: audit 2024-02-13T00:24:36.224029+0000 mon.a (mon.0) 240 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T00:24:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:37 smithi106 bash[18459]: audit 2024-02-13T00:24:36.230576+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T00:24:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:37 smithi106 bash[18459]: audit 2024-02-13T00:24:36.603181+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:37 smithi106 bash[18459]: audit 2024-02-13T00:24:36.641734+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:24:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:37 smithi106 bash[18459]: cluster 2024-02-13T00:24:36.684339+0000 mgr.y (mgr.14146) 97 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:37.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:37 smithi080 bash[24237]: audit 2024-02-13T00:24:36.223320+0000 mon.a (mon.0) 238 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-13T00:24:37.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:37 smithi080 bash[24237]: cluster 2024-02-13T00:24:36.223455+0000 mon.a (mon.0) 239 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-02-13T00:24:37.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:37 smithi080 bash[24237]: audit 2024-02-13T00:24:36.224029+0000 mon.a (mon.0) 240 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T00:24:37.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:37 smithi080 bash[24237]: audit 2024-02-13T00:24:36.230576+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T00:24:37.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:37 smithi080 bash[24237]: audit 2024-02-13T00:24:36.603181+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:37.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:37 smithi080 bash[24237]: audit 2024-02-13T00:24:36.641734+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:24:37.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:37 smithi080 bash[24237]: cluster 2024-02-13T00:24:36.684339+0000 mgr.y (mgr.14146) 97 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:37.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:37 smithi080 bash[17386]: audit 2024-02-13T00:24:36.223320+0000 mon.a (mon.0) 238 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-13T00:24:37.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:37 smithi080 bash[17386]: cluster 2024-02-13T00:24:36.223455+0000 mon.a (mon.0) 239 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-02-13T00:24:37.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:37 smithi080 bash[17386]: audit 2024-02-13T00:24:36.224029+0000 mon.a (mon.0) 240 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T00:24:37.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:37 smithi080 bash[17386]: audit 2024-02-13T00:24:36.230576+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T00:24:37.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:37 smithi080 bash[17386]: audit 2024-02-13T00:24:36.603181+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:37.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:37 smithi080 bash[17386]: audit 2024-02-13T00:24:36.641734+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:24:37.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:37 smithi080 bash[17386]: cluster 2024-02-13T00:24:36.684339+0000 mgr.y (mgr.14146) 97 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T00:24:37.513 INFO:journalctl@ceph.osd.0.smithi080.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-13T00:24:38.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:38 smithi106 bash[18459]: cluster 2024-02-13T00:24:35.972075+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:24:38.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:38 smithi106 bash[18459]: cluster 2024-02-13T00:24:35.972173+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:24:38.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:38 smithi106 bash[18459]: cluster 2024-02-13T00:24:37.233346+0000 mon.a (mon.0) 244 : cluster [INF] osd.0 [v2:172.21.15.80:6802/635200923,v1:172.21.15.80:6803/635200923] boot 2024-02-13T00:24:38.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:38 smithi106 bash[18459]: cluster 2024-02-13T00:24:37.233429+0000 mon.a (mon.0) 245 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-02-13T00:24:38.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:38 smithi106 bash[18459]: audit 2024-02-13T00:24:37.234272+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T00:24:38.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:38 smithi080 bash[17386]: cluster 2024-02-13T00:24:35.972075+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:24:38.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:38 smithi080 bash[17386]: cluster 2024-02-13T00:24:35.972173+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:24:38.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:38 smithi080 bash[17386]: cluster 2024-02-13T00:24:37.233346+0000 mon.a (mon.0) 244 : cluster [INF] osd.0 [v2:172.21.15.80:6802/635200923,v1:172.21.15.80:6803/635200923] boot 2024-02-13T00:24:38.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:38 smithi080 bash[17386]: cluster 2024-02-13T00:24:37.233429+0000 mon.a (mon.0) 245 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-02-13T00:24:38.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:38 smithi080 bash[17386]: audit 2024-02-13T00:24:37.234272+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T00:24:38.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:38 smithi080 bash[24237]: cluster 2024-02-13T00:24:35.972075+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:24:38.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:38 smithi080 bash[24237]: cluster 2024-02-13T00:24:35.972173+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:24:38.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:38 smithi080 bash[24237]: cluster 2024-02-13T00:24:37.233346+0000 mon.a (mon.0) 244 : cluster [INF] osd.0 [v2:172.21.15.80:6802/635200923,v1:172.21.15.80:6803/635200923] boot 2024-02-13T00:24:38.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:38 smithi080 bash[24237]: cluster 2024-02-13T00:24:37.233429+0000 mon.a (mon.0) 245 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-02-13T00:24:38.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:38 smithi080 bash[24237]: audit 2024-02-13T00:24:37.234272+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T00:24:40.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:39 smithi106 bash[18459]: cluster 2024-02-13T00:24:38.604828+0000 mon.a (mon.0) 247 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-02-13T00:24:40.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:39 smithi106 bash[18459]: cluster 2024-02-13T00:24:38.684764+0000 mgr.y (mgr.14146) 98 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:40.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:39 smithi080 bash[24237]: cluster 2024-02-13T00:24:38.604828+0000 mon.a (mon.0) 247 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-02-13T00:24:40.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:39 smithi080 bash[24237]: cluster 2024-02-13T00:24:38.684764+0000 mgr.y (mgr.14146) 98 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:40.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:39 smithi080 bash[17386]: cluster 2024-02-13T00:24:38.604828+0000 mon.a (mon.0) 247 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-02-13T00:24:40.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:39 smithi080 bash[17386]: cluster 2024-02-13T00:24:38.684764+0000 mgr.y (mgr.14146) 98 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:40.710 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-13T00:24:40.710 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-13T00:24:40.710 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-02-13T00:24:40.710 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-02-13T00:24:40.710 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0157485 s, 666 MB/s 2024-02-13T00:24:40.710 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-02-13T00:24:41.430 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi080:vg_nvme/lv_3 2024-02-13T00:24:42.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:41 smithi106 bash[18459]: cluster 2024-02-13T00:24:40.685140+0000 mgr.y (mgr.14146) 99 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:42.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:41 smithi080 bash[24237]: cluster 2024-02-13T00:24:40.685140+0000 mgr.y (mgr.14146) 99 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:42.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:41 smithi080 bash[17386]: cluster 2024-02-13T00:24:40.685140+0000 mgr.y (mgr.14146) 99 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:44.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:43 smithi106 bash[18459]: cluster 2024-02-13T00:24:42.685584+0000 mgr.y (mgr.14146) 100 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:44.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:43 smithi080 bash[17386]: cluster 2024-02-13T00:24:42.685584+0000 mgr.y (mgr.14146) 100 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:44.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:43 smithi080 bash[24237]: cluster 2024-02-13T00:24:42.685584+0000 mgr.y (mgr.14146) 100 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:45.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:45 smithi106 bash[18459]: cluster 2024-02-13T00:24:44.686089+0000 mgr.y (mgr.14146) 101 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:45.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:45 smithi080 bash[17386]: cluster 2024-02-13T00:24:44.686089+0000 mgr.y (mgr.14146) 101 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:45.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:45 smithi080 bash[24237]: cluster 2024-02-13T00:24:44.686089+0000 mgr.y (mgr.14146) 101 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:45.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.909+0000 7f171821a700 1 -- 172.21.15.80:0/1936764285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17100f7cd0 msgr2=0x7f17100f8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:24:45.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.909+0000 7f171821a700 1 --2- 172.21.15.80:0/1936764285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17100f7cd0 0x7f17100f8130 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f17000047b0 tx=0x7f1700009cb0).stop 2024-02-13T00:24:45.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.909+0000 7f171821a700 1 -- 172.21.15.80:0/1936764285 shutdown_connections 2024-02-13T00:24:45.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.909+0000 7f171821a700 1 --2- 172.21.15.80:0/1936764285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17100f8620 0x7f17100fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:24:45.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.909+0000 7f171821a700 1 --2- 172.21.15.80:0/1936764285 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17100f6a30 0x7f17100f6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:24:45.920 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.909+0000 7f171821a700 1 --2- 172.21.15.80:0/1936764285 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17100f7cd0 0x7f17100f8130 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:24:45.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.909+0000 7f171821a700 1 -- 172.21.15.80:0/1936764285 >> 172.21.15.80:0/1936764285 conn(0x7f17100f2230 msgr2=0x7f17100f4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:24:45.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.909+0000 7f171821a700 1 -- 172.21.15.80:0/1936764285 shutdown_connections 2024-02-13T00:24:45.921 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.909+0000 7f171821a700 1 -- 172.21.15.80:0/1936764285 wait complete. 2024-02-13T00:24:45.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f171821a700 1 Processor -- start 2024-02-13T00:24:45.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f171821a700 1 -- start start 2024-02-13T00:24:45.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f171821a700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17100f6a30 0x7f1710106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:24:45.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f171821a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17100f7cd0 0x7f17101073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:24:45.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f171821a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17100f8620 0x7f171010e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:24:45.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f171821a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171010e980 con 0x7f17100f7cd0 2024-02-13T00:24:45.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f171821a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1710060a80 con 0x7f17100f8620 2024-02-13T00:24:45.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f171821a700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1710060c40 con 0x7f17100f6a30 2024-02-13T00:24:45.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f1715fb6700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17100f6a30 0x7f1710106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:24:45.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f1715fb6700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17100f6a30 0x7f1710106ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:49614/0 (socket says 172.21.15.80:49614) 2024-02-13T00:24:45.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f1715fb6700 1 -- 172.21.15.80:0/583255736 learned_addr learned my addr 172.21.15.80:0/583255736 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:24:45.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f17157b5700 1 --2- 172.21.15.80:0/583255736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17100f7cd0 0x7f17101073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:24:45.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f17167b7700 1 --2- 172.21.15.80:0/583255736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17100f8620 0x7f171010e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:24:45.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f1715fb6700 1 -- 172.21.15.80:0/583255736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17100f8620 msgr2=0x7f171010e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:24:45.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f1715fb6700 1 --2- 172.21.15.80:0/583255736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17100f8620 0x7f171010e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:24:45.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f1715fb6700 1 -- 172.21.15.80:0/583255736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17100f7cd0 msgr2=0x7f17101073b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:24:45.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f1715fb6700 1 --2- 172.21.15.80:0/583255736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17100f7cd0 0x7f17101073b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:24:45.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f1715fb6700 1 -- 172.21.15.80:0/583255736 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1700005040 con 0x7f17100f6a30 2024-02-13T00:24:45.924 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f17157b5700 1 --2- 172.21.15.80:0/583255736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17100f7cd0 0x7f17101073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-13T00:24:45.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f1715fb6700 1 --2- 172.21.15.80:0/583255736 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17100f6a30 0x7f1710106ec0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f170c00e940 tx=0x7f170c00b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:24:45.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f1706ffd700 1 -- 172.21.15.80:0/583255736 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c00eee0 con 0x7f17100f6a30 2024-02-13T00:24:45.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f1706ffd700 1 -- 172.21.15.80:0/583255736 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f170c00f040 con 0x7f17100f6a30 2024-02-13T00:24:45.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f171821a700 1 -- 172.21.15.80:0/583255736 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1710060ec0 con 0x7f17100f6a30 2024-02-13T00:24:45.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f1706ffd700 1 -- 172.21.15.80:0/583255736 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c00c840 con 0x7f17100f6a30 2024-02-13T00:24:45.925 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.913+0000 7f171821a700 1 -- 172.21.15.80:0/583255736 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1710061480 con 0x7f17100f6a30 2024-02-13T00:24:45.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.917+0000 7f171821a700 1 -- 172.21.15.80:0/583255736 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f171005f400 con 0x7f17100f6a30 2024-02-13T00:24:45.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.917+0000 7f1706ffd700 1 -- 172.21.15.80:0/583255736 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 14) v1 ==== 77064+0+0 (secure 0 0 0) 0x7f170c00cc70 con 0x7f17100f6a30 2024-02-13T00:24:45.926 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.917+0000 7f1706ffd700 1 --2- 172.21.15.80:0/583255736 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f16fc061250 0x7f16fc063710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:24:45.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.917+0000 7f1706ffd700 1 -- 172.21.15.80:0/583255736 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1710+0+0 (secure 0 0 0) 0x7f170c07b390 con 0x7f17100f6a30 2024-02-13T00:24:45.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.917+0000 7f17157b5700 1 --2- 172.21.15.80:0/583255736 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f16fc061250 0x7f16fc063710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:24:45.927 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.917+0000 7f17157b5700 1 --2- 172.21.15.80:0/583255736 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f16fc061250 0x7f16fc063710 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f1700004e20 tx=0x7f1700016040).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:24:45.934 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:45.925+0000 7f1706ffd700 1 -- 172.21.15.80:0/583255736 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f170c04af60 con 0x7f17100f6a30 2024-02-13T00:24:46.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:24:46.121+0000 7f171821a700 1 -- 172.21.15.80:0/583255736 --> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f17100fe4f0 con 0x7f16fc061250 2024-02-13T00:24:46.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:46 smithi106 bash[18459]: audit 2024-02-13T00:24:46.132728+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:24:46.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:46 smithi106 bash[18459]: audit 2024-02-13T00:24:46.136192+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:24:46.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:46 smithi106 bash[18459]: audit 2024-02-13T00:24:46.137014+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:46.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:46 smithi080 bash[24237]: audit 2024-02-13T00:24:46.132728+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:24:46.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:46 smithi080 bash[24237]: audit 2024-02-13T00:24:46.136192+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:24:46.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:46 smithi080 bash[24237]: audit 2024-02-13T00:24:46.137014+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:46.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:46 smithi080 bash[17386]: audit 2024-02-13T00:24:46.132728+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:24:46.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:46 smithi080 bash[17386]: audit 2024-02-13T00:24:46.136192+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:24:46.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:46 smithi080 bash[17386]: audit 2024-02-13T00:24:46.137014+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:47.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:47 smithi106 bash[18459]: audit 2024-02-13T00:24:46.126355+0000 mgr.y (mgr.14146) 102 : audit [DBG] from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:24:47.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:47 smithi106 bash[18459]: cluster 2024-02-13T00:24:46.686468+0000 mgr.y (mgr.14146) 103 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:47.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:47 smithi080 bash[17386]: audit 2024-02-13T00:24:46.126355+0000 mgr.y (mgr.14146) 102 : audit [DBG] from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:24:47.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:47 smithi080 bash[17386]: cluster 2024-02-13T00:24:46.686468+0000 mgr.y (mgr.14146) 103 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:47.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:47 smithi080 bash[24237]: audit 2024-02-13T00:24:46.126355+0000 mgr.y (mgr.14146) 102 : audit [DBG] from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:24:47.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:47 smithi080 bash[24237]: cluster 2024-02-13T00:24:46.686468+0000 mgr.y (mgr.14146) 103 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:49.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:48 smithi106 bash[18459]: cephadm 2024-02-13T00:24:47.659970+0000 mgr.y (mgr.14146) 104 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-13T00:24:49.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:48 smithi106 bash[18459]: audit 2024-02-13T00:24:47.669798+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:49.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:48 smithi106 bash[18459]: audit 2024-02-13T00:24:47.959298+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:24:49.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:48 smithi106 bash[18459]: cephadm 2024-02-13T00:24:47.960832+0000 mgr.y (mgr.14146) 105 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 16241M 2024-02-13T00:24:49.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:48 smithi106 bash[18459]: audit 2024-02-13T00:24:47.966261+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:49.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:48 smithi106 bash[18459]: audit 2024-02-13T00:24:47.967463+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:49.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:48 smithi106 bash[18459]: audit 2024-02-13T00:24:47.968569+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:24:49.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:48 smithi106 bash[18459]: audit 2024-02-13T00:24:47.974600+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:49.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:48 smithi080 bash[17386]: cephadm 2024-02-13T00:24:47.659970+0000 mgr.y (mgr.14146) 104 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-13T00:24:49.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:48 smithi080 bash[17386]: audit 2024-02-13T00:24:47.669798+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:49.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:48 smithi080 bash[17386]: audit 2024-02-13T00:24:47.959298+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:24:49.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:48 smithi080 bash[17386]: cephadm 2024-02-13T00:24:47.960832+0000 mgr.y (mgr.14146) 105 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 16241M 2024-02-13T00:24:49.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:48 smithi080 bash[17386]: audit 2024-02-13T00:24:47.966261+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:49.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:48 smithi080 bash[17386]: audit 2024-02-13T00:24:47.967463+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:49.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:48 smithi080 bash[17386]: audit 2024-02-13T00:24:47.968569+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:24:49.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:48 smithi080 bash[17386]: audit 2024-02-13T00:24:47.974600+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:49.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:48 smithi080 bash[24237]: cephadm 2024-02-13T00:24:47.659970+0000 mgr.y (mgr.14146) 104 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-13T00:24:49.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:48 smithi080 bash[24237]: audit 2024-02-13T00:24:47.669798+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:49.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:48 smithi080 bash[24237]: audit 2024-02-13T00:24:47.959298+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:24:49.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:48 smithi080 bash[24237]: cephadm 2024-02-13T00:24:47.960832+0000 mgr.y (mgr.14146) 105 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 16241M 2024-02-13T00:24:49.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:48 smithi080 bash[24237]: audit 2024-02-13T00:24:47.966261+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:49.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:48 smithi080 bash[24237]: audit 2024-02-13T00:24:47.967463+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:24:49.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:48 smithi080 bash[24237]: audit 2024-02-13T00:24:47.968569+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:24:49.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:48 smithi080 bash[24237]: audit 2024-02-13T00:24:47.974600+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:24:50.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:49 smithi106 bash[18459]: cluster 2024-02-13T00:24:48.686869+0000 mgr.y (mgr.14146) 106 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:50.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:49 smithi080 bash[17386]: cluster 2024-02-13T00:24:48.686869+0000 mgr.y (mgr.14146) 106 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:50.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:49 smithi080 bash[24237]: cluster 2024-02-13T00:24:48.686869+0000 mgr.y (mgr.14146) 106 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:52.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:51 smithi106 bash[18459]: cluster 2024-02-13T00:24:50.687309+0000 mgr.y (mgr.14146) 107 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:52.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:51 smithi080 bash[17386]: cluster 2024-02-13T00:24:50.687309+0000 mgr.y (mgr.14146) 107 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:52.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:51 smithi080 bash[24237]: cluster 2024-02-13T00:24:50.687309+0000 mgr.y (mgr.14146) 107 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:54.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:53 smithi106 bash[18459]: cluster 2024-02-13T00:24:52.687773+0000 mgr.y (mgr.14146) 108 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:54.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:53 smithi080 bash[17386]: cluster 2024-02-13T00:24:52.687773+0000 mgr.y (mgr.14146) 108 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:54.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:53 smithi080 bash[24237]: cluster 2024-02-13T00:24:52.687773+0000 mgr.y (mgr.14146) 108 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:55.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:55 smithi106 bash[18459]: audit 2024-02-13T00:24:54.349059+0000 mon.a (mon.0) 257 : audit [INF] from='client.? 172.21.15.80:0/672926913' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33c91336-14a3-4f0d-8669-2309f34c49c3"}]: dispatch 2024-02-13T00:24:55.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:55 smithi106 bash[18459]: audit 2024-02-13T00:24:54.357998+0000 mon.a (mon.0) 258 : audit [INF] from='client.? 172.21.15.80:0/672926913' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "33c91336-14a3-4f0d-8669-2309f34c49c3"}]': finished 2024-02-13T00:24:55.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:55 smithi106 bash[18459]: cluster 2024-02-13T00:24:54.358057+0000 mon.a (mon.0) 259 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-02-13T00:24:55.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:55 smithi106 bash[18459]: audit 2024-02-13T00:24:54.358245+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T00:24:55.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:55 smithi106 bash[18459]: cluster 2024-02-13T00:24:54.688255+0000 mgr.y (mgr.14146) 109 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:55.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:55 smithi106 bash[18459]: audit 2024-02-13T00:24:55.066671+0000 mon.a (mon.0) 261 : audit [DBG] from='client.? 172.21.15.80:0/3403739308' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:24:55.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:55 smithi080 bash[17386]: audit 2024-02-13T00:24:54.349059+0000 mon.a (mon.0) 257 : audit [INF] from='client.? 172.21.15.80:0/672926913' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33c91336-14a3-4f0d-8669-2309f34c49c3"}]: dispatch 2024-02-13T00:24:55.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:55 smithi080 bash[17386]: audit 2024-02-13T00:24:54.357998+0000 mon.a (mon.0) 258 : audit [INF] from='client.? 172.21.15.80:0/672926913' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "33c91336-14a3-4f0d-8669-2309f34c49c3"}]': finished 2024-02-13T00:24:55.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:55 smithi080 bash[17386]: cluster 2024-02-13T00:24:54.358057+0000 mon.a (mon.0) 259 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-02-13T00:24:55.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:55 smithi080 bash[17386]: audit 2024-02-13T00:24:54.358245+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T00:24:55.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:55 smithi080 bash[17386]: cluster 2024-02-13T00:24:54.688255+0000 mgr.y (mgr.14146) 109 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:55.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:55 smithi080 bash[17386]: audit 2024-02-13T00:24:55.066671+0000 mon.a (mon.0) 261 : audit [DBG] from='client.? 172.21.15.80:0/3403739308' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:24:55.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:55 smithi080 bash[24237]: audit 2024-02-13T00:24:54.349059+0000 mon.a (mon.0) 257 : audit [INF] from='client.? 172.21.15.80:0/672926913' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "33c91336-14a3-4f0d-8669-2309f34c49c3"}]: dispatch 2024-02-13T00:24:55.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:55 smithi080 bash[24237]: audit 2024-02-13T00:24:54.357998+0000 mon.a (mon.0) 258 : audit [INF] from='client.? 172.21.15.80:0/672926913' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "33c91336-14a3-4f0d-8669-2309f34c49c3"}]': finished 2024-02-13T00:24:55.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:55 smithi080 bash[24237]: cluster 2024-02-13T00:24:54.358057+0000 mon.a (mon.0) 259 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-02-13T00:24:55.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:55 smithi080 bash[24237]: audit 2024-02-13T00:24:54.358245+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T00:24:55.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:55 smithi080 bash[24237]: cluster 2024-02-13T00:24:54.688255+0000 mgr.y (mgr.14146) 109 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:55.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:55 smithi080 bash[24237]: audit 2024-02-13T00:24:55.066671+0000 mon.a (mon.0) 261 : audit [DBG] from='client.? 172.21.15.80:0/3403739308' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:24:58.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:57 smithi106 bash[18459]: cluster 2024-02-13T00:24:56.688739+0000 mgr.y (mgr.14146) 110 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:58.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:57 smithi080 bash[17386]: cluster 2024-02-13T00:24:56.688739+0000 mgr.y (mgr.14146) 110 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:24:58.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:57 smithi080 bash[24237]: cluster 2024-02-13T00:24:56.688739+0000 mgr.y (mgr.14146) 110 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:00.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:24:59 smithi106 bash[18459]: cluster 2024-02-13T00:24:58.689244+0000 mgr.y (mgr.14146) 111 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:00.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:24:59 smithi080 bash[17386]: cluster 2024-02-13T00:24:58.689244+0000 mgr.y (mgr.14146) 111 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:00.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:24:59 smithi080 bash[24237]: cluster 2024-02-13T00:24:58.689244+0000 mgr.y (mgr.14146) 111 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:02.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:01 smithi080 bash[24237]: cluster 2024-02-13T00:25:00.689826+0000 mgr.y (mgr.14146) 112 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:02.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:01 smithi080 bash[17386]: cluster 2024-02-13T00:25:00.689826+0000 mgr.y (mgr.14146) 112 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:02.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:01 smithi106 bash[18459]: cluster 2024-02-13T00:25:00.689826+0000 mgr.y (mgr.14146) 112 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:04.091 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:03 smithi080 bash[17386]: cluster 2024-02-13T00:25:02.690298+0000 mgr.y (mgr.14146) 113 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:04.092 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:03 smithi080 bash[24237]: cluster 2024-02-13T00:25:02.690298+0000 mgr.y (mgr.14146) 113 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:04.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:03 smithi106 bash[18459]: cluster 2024-02-13T00:25:02.690298+0000 mgr.y (mgr.14146) 113 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:05.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:05 smithi106 bash[18459]: cluster 2024-02-13T00:25:04.690795+0000 mgr.y (mgr.14146) 114 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:05.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:05 smithi080 bash[17386]: cluster 2024-02-13T00:25:04.690795+0000 mgr.y (mgr.14146) 114 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:05.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:05 smithi080 bash[24237]: cluster 2024-02-13T00:25:04.690795+0000 mgr.y (mgr.14146) 114 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:07.959 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:07 smithi080 bash[24237]: cluster 2024-02-13T00:25:06.691254+0000 mgr.y (mgr.14146) 115 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:07.959 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:07 smithi080 bash[24237]: audit 2024-02-13T00:25:06.755586+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-13T00:25:07.960 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:07 smithi080 bash[24237]: audit 2024-02-13T00:25:06.756705+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:25:07.960 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:07 smithi080 bash[24237]: cephadm 2024-02-13T00:25:06.757505+0000 mgr.y (mgr.14146) 116 : cephadm [INF] Deploying daemon osd.1 on smithi080 2024-02-13T00:25:07.960 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:07 smithi080 bash[17386]: cluster 2024-02-13T00:25:06.691254+0000 mgr.y (mgr.14146) 115 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:07.960 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:07 smithi080 bash[17386]: audit 2024-02-13T00:25:06.755586+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-13T00:25:07.960 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:07 smithi080 bash[17386]: audit 2024-02-13T00:25:06.756705+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:25:07.960 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:07 smithi080 bash[17386]: cephadm 2024-02-13T00:25:06.757505+0000 mgr.y (mgr.14146) 116 : cephadm [INF] Deploying daemon osd.1 on smithi080 2024-02-13T00:25:08.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:07 smithi106 bash[18459]: cluster 2024-02-13T00:25:06.691254+0000 mgr.y (mgr.14146) 115 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:08.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:07 smithi106 bash[18459]: audit 2024-02-13T00:25:06.755586+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-13T00:25:08.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:07 smithi106 bash[18459]: audit 2024-02-13T00:25:06.756705+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:25:08.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:07 smithi106 bash[18459]: cephadm 2024-02-13T00:25:06.757505+0000 mgr.y (mgr.14146) 116 : cephadm [INF] Deploying daemon osd.1 on smithi080 2024-02-13T00:25:10.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:09 smithi080 bash[17386]: cluster 2024-02-13T00:25:08.691680+0000 mgr.y (mgr.14146) 117 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:10.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:09 smithi080 bash[24237]: cluster 2024-02-13T00:25:08.691680+0000 mgr.y (mgr.14146) 117 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:10.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:09 smithi106 bash[18459]: cluster 2024-02-13T00:25:08.691680+0000 mgr.y (mgr.14146) 117 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:12.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:11 smithi106 bash[18459]: cluster 2024-02-13T00:25:10.692063+0000 mgr.y (mgr.14146) 118 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:12.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:11 smithi106 bash[18459]: audit 2024-02-13T00:25:10.720080+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:12.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:11 smithi106 bash[18459]: audit 2024-02-13T00:25:10.746798+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:25:12.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:11 smithi080 bash[17386]: cluster 2024-02-13T00:25:10.692063+0000 mgr.y (mgr.14146) 118 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:12.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:11 smithi080 bash[17386]: audit 2024-02-13T00:25:10.720080+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:12.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:11 smithi080 bash[17386]: audit 2024-02-13T00:25:10.746798+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:25:12.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:11 smithi080 bash[24237]: cluster 2024-02-13T00:25:10.692063+0000 mgr.y (mgr.14146) 118 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:12.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:11 smithi080 bash[24237]: audit 2024-02-13T00:25:10.720080+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:12.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:11 smithi080 bash[24237]: audit 2024-02-13T00:25:10.746798+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:25:14.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:13 smithi106 bash[18459]: cluster 2024-02-13T00:25:12.692519+0000 mgr.y (mgr.14146) 119 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:14.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:13 smithi080 bash[17386]: cluster 2024-02-13T00:25:12.692519+0000 mgr.y (mgr.14146) 119 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:14.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:13 smithi080 bash[24237]: cluster 2024-02-13T00:25:12.692519+0000 mgr.y (mgr.14146) 119 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:15.491 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:15 smithi080 bash[17386]: cluster 2024-02-13T00:25:14.693026+0000 mgr.y (mgr.14146) 120 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:15.491 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:15 smithi080 bash[24237]: cluster 2024-02-13T00:25:14.693026+0000 mgr.y (mgr.14146) 120 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:15.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:15 smithi106 bash[18459]: cluster 2024-02-13T00:25:14.693026+0000 mgr.y (mgr.14146) 120 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:17.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:16 smithi080 bash[24237]: audit 2024-02-13T00:25:15.850490+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:17.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:16 smithi080 bash[24237]: audit 2024-02-13T00:25:15.851665+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:25:17.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:16 smithi080 bash[24237]: audit 2024-02-13T00:25:15.853151+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:25:17.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:16 smithi080 bash[24237]: audit 2024-02-13T00:25:15.858822+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:17.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:16 smithi080 bash[17386]: audit 2024-02-13T00:25:15.850490+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:17.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:16 smithi080 bash[17386]: audit 2024-02-13T00:25:15.851665+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:25:17.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:16 smithi080 bash[17386]: audit 2024-02-13T00:25:15.853151+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:25:17.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:16 smithi080 bash[17386]: audit 2024-02-13T00:25:15.858822+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:17.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:16 smithi106 bash[18459]: audit 2024-02-13T00:25:15.850490+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:17.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:16 smithi106 bash[18459]: audit 2024-02-13T00:25:15.851665+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:25:17.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:16 smithi106 bash[18459]: audit 2024-02-13T00:25:15.853151+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:25:17.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:16 smithi106 bash[18459]: audit 2024-02-13T00:25:15.858822+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:18.153 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:17 smithi080 bash[17386]: cluster 2024-02-13T00:25:16.693530+0000 mgr.y (mgr.14146) 121 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:18.153 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:17 smithi080 bash[17386]: audit 2024-02-13T00:25:17.283980+0000 mon.a (mon.0) 270 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1803743584,v1:172.21.15.80:6811/1803743584]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-13T00:25:18.153 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:17 smithi080 bash[24237]: cluster 2024-02-13T00:25:16.693530+0000 mgr.y (mgr.14146) 121 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:18.153 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:17 smithi080 bash[24237]: audit 2024-02-13T00:25:17.283980+0000 mon.a (mon.0) 270 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1803743584,v1:172.21.15.80:6811/1803743584]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-13T00:25:18.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:17 smithi106 bash[18459]: cluster 2024-02-13T00:25:16.693530+0000 mgr.y (mgr.14146) 121 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:18.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:17 smithi106 bash[18459]: audit 2024-02-13T00:25:17.283980+0000 mon.a (mon.0) 270 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1803743584,v1:172.21.15.80:6811/1803743584]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-13T00:25:19.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:18 smithi106 bash[18459]: audit 2024-02-13T00:25:17.870152+0000 mon.a (mon.0) 271 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1803743584,v1:172.21.15.80:6811/1803743584]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-13T00:25:19.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:18 smithi106 bash[18459]: cluster 2024-02-13T00:25:17.870251+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-02-13T00:25:19.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:18 smithi106 bash[18459]: audit 2024-02-13T00:25:17.871032+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T00:25:19.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:18 smithi106 bash[18459]: audit 2024-02-13T00:25:17.871409+0000 mon.a (mon.0) 274 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1803743584,v1:172.21.15.80:6811/1803743584]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-13T00:25:19.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:18 smithi106 bash[18459]: audit 2024-02-13T00:25:18.868720+0000 mon.a (mon.0) 275 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1803743584,v1:172.21.15.80:6811/1803743584]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-13T00:25:19.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:18 smithi106 bash[18459]: cluster 2024-02-13T00:25:18.868774+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-02-13T00:25:19.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:18 smithi106 bash[18459]: audit 2024-02-13T00:25:18.869051+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T00:25:19.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[24237]: audit 2024-02-13T00:25:17.870152+0000 mon.a (mon.0) 271 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1803743584,v1:172.21.15.80:6811/1803743584]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-13T00:25:19.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[24237]: cluster 2024-02-13T00:25:17.870251+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-02-13T00:25:19.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[24237]: audit 2024-02-13T00:25:17.871032+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T00:25:19.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[24237]: audit 2024-02-13T00:25:17.871409+0000 mon.a (mon.0) 274 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1803743584,v1:172.21.15.80:6811/1803743584]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-13T00:25:19.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[24237]: audit 2024-02-13T00:25:18.868720+0000 mon.a (mon.0) 275 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1803743584,v1:172.21.15.80:6811/1803743584]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-13T00:25:19.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[24237]: cluster 2024-02-13T00:25:18.868774+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-02-13T00:25:19.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[24237]: audit 2024-02-13T00:25:18.869051+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T00:25:19.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[17386]: audit 2024-02-13T00:25:17.870152+0000 mon.a (mon.0) 271 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1803743584,v1:172.21.15.80:6811/1803743584]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-13T00:25:19.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[17386]: cluster 2024-02-13T00:25:17.870251+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-02-13T00:25:19.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[17386]: audit 2024-02-13T00:25:17.871032+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T00:25:19.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[17386]: audit 2024-02-13T00:25:17.871409+0000 mon.a (mon.0) 274 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1803743584,v1:172.21.15.80:6811/1803743584]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-13T00:25:19.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[17386]: audit 2024-02-13T00:25:18.868720+0000 mon.a (mon.0) 275 : audit [INF] from='osd.1 [v2:172.21.15.80:6810/1803743584,v1:172.21.15.80:6811/1803743584]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-13T00:25:19.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[17386]: cluster 2024-02-13T00:25:18.868774+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-02-13T00:25:19.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[17386]: audit 2024-02-13T00:25:18.869051+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T00:25:19.361 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:19.352+0000 7f1706ffd700 1 -- 172.21.15.80:0/583255736 <== mgr.14146 v2:172.21.15.80:6800/461193090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f17100fe4f0 con 0x7f16fc061250 2024-02-13T00:25:19.361 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 1 on host 'smithi080' 2024-02-13T00:25:19.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:19.352+0000 7f171821a700 1 -- 172.21.15.80:0/583255736 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f16fc061250 msgr2=0x7f16fc063710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:25:19.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:19.352+0000 7f171821a700 1 --2- 172.21.15.80:0/583255736 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f16fc061250 0x7f16fc063710 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f1700004e20 tx=0x7f1700016040).stop 2024-02-13T00:25:19.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:19.352+0000 7f171821a700 1 -- 172.21.15.80:0/583255736 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17100f6a30 msgr2=0x7f1710106ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:25:19.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:19.352+0000 7f171821a700 1 --2- 172.21.15.80:0/583255736 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17100f6a30 0x7f1710106ec0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f170c00e940 tx=0x7f170c00b040).stop 2024-02-13T00:25:19.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:19.352+0000 7f171821a700 1 -- 172.21.15.80:0/583255736 shutdown_connections 2024-02-13T00:25:19.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:19.352+0000 7f171821a700 1 --2- 172.21.15.80:0/583255736 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f16fc061250 0x7f16fc063710 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:25:19.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:19.352+0000 7f171821a700 1 --2- 172.21.15.80:0/583255736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17100f8620 0x7f171010e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:25:19.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:19.352+0000 7f171821a700 1 --2- 172.21.15.80:0/583255736 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f17100f6a30 0x7f1710106ec0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:25:19.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:19.352+0000 7f171821a700 1 --2- 172.21.15.80:0/583255736 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f17100f7cd0 0x7f17101073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:25:19.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:19.352+0000 7f171821a700 1 -- 172.21.15.80:0/583255736 >> 172.21.15.80:0/583255736 conn(0x7f17100f2230 msgr2=0x7f17100fb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:25:19.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:19.352+0000 7f171821a700 1 -- 172.21.15.80:0/583255736 shutdown_connections 2024-02-13T00:25:19.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:19.356+0000 7f171821a700 1 -- 172.21.15.80:0/583255736 wait complete. 2024-02-13T00:25:20.067 DEBUG:teuthology.orchestra.run.smithi080:osd.1> sudo journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.1.service 2024-02-13T00:25:20.070 INFO:tasks.cephadm:Deploying osd.2 on smithi080 with /dev/vg_nvme/lv_2... 2024-02-13T00:25:20.070 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-13T00:25:20.121 INFO:journalctl@ceph.osd.1.smithi080.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-13T00:25:20.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:19 smithi106 bash[18459]: cluster 2024-02-13T00:25:18.694123+0000 mgr.y (mgr.14146) 122 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:20.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:19 smithi106 bash[18459]: audit 2024-02-13T00:25:18.877470+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T00:25:20.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:19 smithi106 bash[18459]: audit 2024-02-13T00:25:19.355308+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:20.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:19 smithi106 bash[18459]: audit 2024-02-13T00:25:19.384777+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:25:20.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:19 smithi106 bash[18459]: audit 2024-02-13T00:25:19.874350+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T00:25:20.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[17386]: cluster 2024-02-13T00:25:18.694123+0000 mgr.y (mgr.14146) 122 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:20.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[17386]: audit 2024-02-13T00:25:18.877470+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T00:25:20.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[17386]: audit 2024-02-13T00:25:19.355308+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:20.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[17386]: audit 2024-02-13T00:25:19.384777+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:25:20.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[17386]: audit 2024-02-13T00:25:19.874350+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T00:25:20.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[24237]: cluster 2024-02-13T00:25:18.694123+0000 mgr.y (mgr.14146) 122 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:20.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[24237]: audit 2024-02-13T00:25:18.877470+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T00:25:20.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[24237]: audit 2024-02-13T00:25:19.355308+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:20.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[24237]: audit 2024-02-13T00:25:19.384777+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:25:20.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:19 smithi080 bash[24237]: audit 2024-02-13T00:25:19.874350+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T00:25:21.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:20 smithi106 bash[18459]: cluster 2024-02-13T00:25:18.309504+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:25:21.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:20 smithi106 bash[18459]: cluster 2024-02-13T00:25:18.309634+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:25:21.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:20 smithi106 bash[18459]: cluster 2024-02-13T00:25:19.889579+0000 mon.a (mon.0) 282 : cluster [INF] osd.1 [v2:172.21.15.80:6810/1803743584,v1:172.21.15.80:6811/1803743584] boot 2024-02-13T00:25:21.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:20 smithi106 bash[18459]: cluster 2024-02-13T00:25:19.889624+0000 mon.a (mon.0) 283 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-02-13T00:25:21.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:20 smithi106 bash[18459]: audit 2024-02-13T00:25:19.889829+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T00:25:21.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:20 smithi080 bash[17386]: cluster 2024-02-13T00:25:18.309504+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:25:21.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:20 smithi080 bash[17386]: cluster 2024-02-13T00:25:18.309634+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:25:21.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:20 smithi080 bash[17386]: cluster 2024-02-13T00:25:19.889579+0000 mon.a (mon.0) 282 : cluster [INF] osd.1 [v2:172.21.15.80:6810/1803743584,v1:172.21.15.80:6811/1803743584] boot 2024-02-13T00:25:21.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:20 smithi080 bash[17386]: cluster 2024-02-13T00:25:19.889624+0000 mon.a (mon.0) 283 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-02-13T00:25:21.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:20 smithi080 bash[17386]: audit 2024-02-13T00:25:19.889829+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T00:25:21.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:20 smithi080 bash[24237]: cluster 2024-02-13T00:25:18.309504+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:25:21.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:20 smithi080 bash[24237]: cluster 2024-02-13T00:25:18.309634+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:25:21.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:20 smithi080 bash[24237]: cluster 2024-02-13T00:25:19.889579+0000 mon.a (mon.0) 282 : cluster [INF] osd.1 [v2:172.21.15.80:6810/1803743584,v1:172.21.15.80:6811/1803743584] boot 2024-02-13T00:25:21.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:20 smithi080 bash[24237]: cluster 2024-02-13T00:25:19.889624+0000 mon.a (mon.0) 283 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-02-13T00:25:21.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:20 smithi080 bash[24237]: audit 2024-02-13T00:25:19.889829+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T00:25:22.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:21 smithi106 bash[18459]: cluster 2024-02-13T00:25:20.694559+0000 mgr.y (mgr.14146) 123 : cluster [DBG] pgmap v100: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:22.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:21 smithi106 bash[18459]: cluster 2024-02-13T00:25:20.898563+0000 mon.a (mon.0) 285 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-02-13T00:25:22.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:21 smithi080 bash[17386]: cluster 2024-02-13T00:25:20.694559+0000 mgr.y (mgr.14146) 123 : cluster [DBG] pgmap v100: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:22.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:21 smithi080 bash[17386]: cluster 2024-02-13T00:25:20.898563+0000 mon.a (mon.0) 285 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-02-13T00:25:22.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:21 smithi080 bash[24237]: cluster 2024-02-13T00:25:20.694559+0000 mgr.y (mgr.14146) 123 : cluster [DBG] pgmap v100: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-13T00:25:22.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:21 smithi080 bash[24237]: cluster 2024-02-13T00:25:20.898563+0000 mon.a (mon.0) 285 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-02-13T00:25:23.691 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-13T00:25:23.691 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-13T00:25:23.691 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-02-13T00:25:23.692 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-02-13T00:25:23.692 INFO:teuthology.orchestra.run.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0152468 s, 688 MB/s 2024-02-13T00:25:23.692 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-02-13T00:25:24.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:23 smithi080 bash[17386]: cluster 2024-02-13T00:25:22.695037+0000 mgr.y (mgr.14146) 124 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:24.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:23 smithi080 bash[24237]: cluster 2024-02-13T00:25:22.695037+0000 mgr.y (mgr.14146) 124 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:24.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:23 smithi106 bash[18459]: cluster 2024-02-13T00:25:22.695037+0000 mgr.y (mgr.14146) 124 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:24.488 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi080:vg_nvme/lv_2 2024-02-13T00:25:25.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:25 smithi106 bash[18459]: cluster 2024-02-13T00:25:24.695499+0000 mgr.y (mgr.14146) 125 : cluster [DBG] pgmap v103: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:25.597 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:25 smithi080 bash[17386]: cluster 2024-02-13T00:25:24.695499+0000 mgr.y (mgr.14146) 125 : cluster [DBG] pgmap v103: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:25.597 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:25 smithi080 bash[24237]: cluster 2024-02-13T00:25:24.695499+0000 mgr.y (mgr.14146) 125 : cluster [DBG] pgmap v103: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:28.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:27 smithi080 bash[17386]: cluster 2024-02-13T00:25:26.695984+0000 mgr.y (mgr.14146) 126 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:28.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:27 smithi080 bash[24237]: cluster 2024-02-13T00:25:26.695984+0000 mgr.y (mgr.14146) 126 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:28.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:27 smithi106 bash[18459]: cluster 2024-02-13T00:25:26.695984+0000 mgr.y (mgr.14146) 126 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:29.158 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d7646700 1 -- 172.21.15.80:0/2895767466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9d00f8620 msgr2=0x7fc9d00fef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:25:29.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d7646700 1 --2- 172.21.15.80:0/2895767466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9d00f8620 0x7fc9d00fef20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc9c8004870 tx=0x7fc9c8009cb0).stop 2024-02-13T00:25:29.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d7646700 1 -- 172.21.15.80:0/2895767466 shutdown_connections 2024-02-13T00:25:29.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d7646700 1 --2- 172.21.15.80:0/2895767466 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9d00f8620 0x7fc9d00fef20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:25:29.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d7646700 1 --2- 172.21.15.80:0/2895767466 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc9d00f6a30 0x7fc9d00f6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:25:29.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d7646700 1 --2- 172.21.15.80:0/2895767466 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9d00f7cd0 0x7fc9d00f8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:25:29.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d7646700 1 -- 172.21.15.80:0/2895767466 >> 172.21.15.80:0/2895767466 conn(0x7fc9d00f2230 msgr2=0x7fc9d00f4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:25:29.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d7646700 1 -- 172.21.15.80:0/2895767466 shutdown_connections 2024-02-13T00:25:29.159 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d7646700 1 -- 172.21.15.80:0/2895767466 wait complete. 2024-02-13T00:25:29.161 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d7646700 1 Processor -- start 2024-02-13T00:25:29.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d7646700 1 -- start start 2024-02-13T00:25:29.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d7646700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc9d00f6a30 0x7fc9d0107ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:25:29.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d7646700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9d00f7cd0 0x7fc9d01081d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:25:29.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d7646700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9d00f8620 0x7fc9d010f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:25:29.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d7646700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d010f760 con 0x7fc9d00f7cd0 2024-02-13T00:25:29.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d7646700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d010f8a0 con 0x7fc9d00f8620 2024-02-13T00:25:29.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d7646700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d010fa30 con 0x7fc9d00f6a30 2024-02-13T00:25:29.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d53e2700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc9d00f6a30 0x7fc9d0107ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:25:29.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d53e2700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc9d00f6a30 0x7fc9d0107ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:34236/0 (socket says 172.21.15.80:34236) 2024-02-13T00:25:29.162 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d53e2700 1 -- 172.21.15.80:0/1845950479 learned_addr learned my addr 172.21.15.80:0/1845950479 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:25:29.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d4be1700 1 --2- 172.21.15.80:0/1845950479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9d00f7cd0 0x7fc9d01081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:25:29.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d5be3700 1 --2- 172.21.15.80:0/1845950479 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9d00f8620 0x7fc9d010f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:25:29.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d53e2700 1 -- 172.21.15.80:0/1845950479 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9d00f8620 msgr2=0x7fc9d010f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:25:29.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d53e2700 1 --2- 172.21.15.80:0/1845950479 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9d00f8620 0x7fc9d010f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:25:29.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d53e2700 1 -- 172.21.15.80:0/1845950479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9d00f7cd0 msgr2=0x7fc9d01081d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:25:29.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d53e2700 1 --2- 172.21.15.80:0/1845950479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9d00f7cd0 0x7fc9d01081d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:25:29.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d53e2700 1 -- 172.21.15.80:0/1845950479 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c8005040 con 0x7fc9d00f6a30 2024-02-13T00:25:29.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9d53e2700 1 --2- 172.21.15.80:0/1845950479 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc9d00f6a30 0x7fc9d0107ce0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fc9cc00eca0 tx=0x7fc9cc00b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:25:29.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.152+0000 7fc9c67fc700 1 -- 172.21.15.80:0/1845950479 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc009910 con 0x7fc9d00f6a30 2024-02-13T00:25:29.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.156+0000 7fc9c67fc700 1 -- 172.21.15.80:0/1845950479 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fc9cc00f040 con 0x7fc9d00f6a30 2024-02-13T00:25:29.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.156+0000 7fc9c67fc700 1 -- 172.21.15.80:0/1845950479 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc00c9a0 con 0x7fc9d00f6a30 2024-02-13T00:25:29.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.156+0000 7fc9d7646700 1 -- 172.21.15.80:0/1845950479 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d010fd10 con 0x7fc9d00f6a30 2024-02-13T00:25:29.163 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.156+0000 7fc9d7646700 1 -- 172.21.15.80:0/1845950479 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d0110140 con 0x7fc9d00f6a30 2024-02-13T00:25:29.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.156+0000 7fc9d7646700 1 -- 172.21.15.80:0/1845950479 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d005f400 con 0x7fc9d00f6a30 2024-02-13T00:25:29.164 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.156+0000 7fc9c67fc700 1 -- 172.21.15.80:0/1845950479 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 14) v1 ==== 77064+0+0 (secure 0 0 0) 0x7fc9cc0092e0 con 0x7fc9d00f6a30 2024-02-13T00:25:29.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.156+0000 7fc9c67fc700 1 --2- 172.21.15.80:0/1845950479 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fc9bc061280 0x7fc9bc063740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:25:29.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.156+0000 7fc9c67fc700 1 -- 172.21.15.80:0/1845950479 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2142+0+0 (secure 0 0 0) 0x7fc9cc07b760 con 0x7fc9d00f6a30 2024-02-13T00:25:29.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.156+0000 7fc9d4be1700 1 --2- 172.21.15.80:0/1845950479 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fc9bc061280 0x7fc9bc063740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:25:29.165 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.160+0000 7fc9d4be1700 1 --2- 172.21.15.80:0/1845950479 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fc9bc061280 0x7fc9bc063740 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fc9c00048b0 tx=0x7fc9c000b040).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:25:29.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.164+0000 7fc9c67fc700 1 -- 172.21.15.80:0/1845950479 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fc9cc04ca10 con 0x7fc9d00f6a30 2024-02-13T00:25:29.377 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:25:29.372+0000 7fc9d7646700 1 -- 172.21.15.80:0/1845950479 --> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9d0061190 con 0x7fc9bc061280 2024-02-13T00:25:30.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:29 smithi080 bash[17386]: cluster 2024-02-13T00:25:28.696571+0000 mgr.y (mgr.14146) 127 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:30.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:29 smithi080 bash[17386]: audit 2024-02-13T00:25:29.380856+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:25:30.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:29 smithi080 bash[17386]: audit 2024-02-13T00:25:29.385505+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:25:30.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:29 smithi080 bash[17386]: audit 2024-02-13T00:25:29.386641+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:25:30.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:29 smithi080 bash[24237]: cluster 2024-02-13T00:25:28.696571+0000 mgr.y (mgr.14146) 127 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:30.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:29 smithi080 bash[24237]: audit 2024-02-13T00:25:29.380856+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:25:30.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:29 smithi080 bash[24237]: audit 2024-02-13T00:25:29.385505+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:25:30.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:29 smithi080 bash[24237]: audit 2024-02-13T00:25:29.386641+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:25:30.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:29 smithi106 bash[18459]: cluster 2024-02-13T00:25:28.696571+0000 mgr.y (mgr.14146) 127 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:30.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:29 smithi106 bash[18459]: audit 2024-02-13T00:25:29.380856+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:25:30.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:29 smithi106 bash[18459]: audit 2024-02-13T00:25:29.385505+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:25:30.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:29 smithi106 bash[18459]: audit 2024-02-13T00:25:29.386641+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:25:31.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:30 smithi106 bash[18459]: audit 2024-02-13T00:25:29.374530+0000 mgr.y (mgr.14146) 128 : audit [DBG] from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:25:31.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:30 smithi080 bash[17386]: audit 2024-02-13T00:25:29.374530+0000 mgr.y (mgr.14146) 128 : audit [DBG] from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:25:31.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:30 smithi080 bash[24237]: audit 2024-02-13T00:25:29.374530+0000 mgr.y (mgr.14146) 128 : audit [DBG] from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:25:32.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:31 smithi106 bash[18459]: cluster 2024-02-13T00:25:30.697002+0000 mgr.y (mgr.14146) 129 : cluster [DBG] pgmap v106: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:32.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:31 smithi106 bash[18459]: cephadm 2024-02-13T00:25:30.915768+0000 mgr.y (mgr.14146) 130 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-13T00:25:32.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:31 smithi106 bash[18459]: audit 2024-02-13T00:25:30.924721+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:32.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:31 smithi106 bash[18459]: audit 2024-02-13T00:25:30.926042+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:25:32.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:31 smithi106 bash[18459]: audit 2024-02-13T00:25:30.927251+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:25:32.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:31 smithi106 bash[18459]: cephadm 2024-02-13T00:25:30.928111+0000 mgr.y (mgr.14146) 131 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 8120M 2024-02-13T00:25:32.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:31 smithi106 bash[18459]: audit 2024-02-13T00:25:30.933318+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:32.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:31 smithi106 bash[18459]: audit 2024-02-13T00:25:30.934734+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:25:32.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:31 smithi106 bash[18459]: audit 2024-02-13T00:25:30.935790+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:25:32.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:31 smithi106 bash[18459]: audit 2024-02-13T00:25:30.942405+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:32.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:31 smithi080 bash[17386]: cluster 2024-02-13T00:25:30.697002+0000 mgr.y (mgr.14146) 129 : cluster [DBG] pgmap v106: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:32.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:31 smithi080 bash[17386]: cephadm 2024-02-13T00:25:30.915768+0000 mgr.y (mgr.14146) 130 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-13T00:25:32.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:31 smithi080 bash[17386]: audit 2024-02-13T00:25:30.924721+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:32.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:31 smithi080 bash[17386]: audit 2024-02-13T00:25:30.926042+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:25:32.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:31 smithi080 bash[17386]: audit 2024-02-13T00:25:30.927251+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:25:32.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:31 smithi080 bash[17386]: cephadm 2024-02-13T00:25:30.928111+0000 mgr.y (mgr.14146) 131 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 8120M 2024-02-13T00:25:32.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:31 smithi080 bash[17386]: audit 2024-02-13T00:25:30.933318+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:32.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:31 smithi080 bash[17386]: audit 2024-02-13T00:25:30.934734+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:25:32.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:31 smithi080 bash[17386]: audit 2024-02-13T00:25:30.935790+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:25:32.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:31 smithi080 bash[17386]: audit 2024-02-13T00:25:30.942405+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:32.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:31 smithi080 bash[24237]: cluster 2024-02-13T00:25:30.697002+0000 mgr.y (mgr.14146) 129 : cluster [DBG] pgmap v106: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:32.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:31 smithi080 bash[24237]: cephadm 2024-02-13T00:25:30.915768+0000 mgr.y (mgr.14146) 130 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-13T00:25:32.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:31 smithi080 bash[24237]: audit 2024-02-13T00:25:30.924721+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:32.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:31 smithi080 bash[24237]: audit 2024-02-13T00:25:30.926042+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:25:32.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:31 smithi080 bash[24237]: audit 2024-02-13T00:25:30.927251+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:25:32.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:31 smithi080 bash[24237]: cephadm 2024-02-13T00:25:30.928111+0000 mgr.y (mgr.14146) 131 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 8120M 2024-02-13T00:25:32.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:31 smithi080 bash[24237]: audit 2024-02-13T00:25:30.933318+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:32.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:31 smithi080 bash[24237]: audit 2024-02-13T00:25:30.934734+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:25:32.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:31 smithi080 bash[24237]: audit 2024-02-13T00:25:30.935790+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:25:32.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:31 smithi080 bash[24237]: audit 2024-02-13T00:25:30.942405+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:34.254 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:33 smithi080 bash[17386]: cluster 2024-02-13T00:25:32.697401+0000 mgr.y (mgr.14146) 132 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:34.254 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:33 smithi080 bash[24237]: cluster 2024-02-13T00:25:32.697401+0000 mgr.y (mgr.14146) 132 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:34.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:33 smithi106 bash[18459]: cluster 2024-02-13T00:25:32.697401+0000 mgr.y (mgr.14146) 132 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:35.486 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:35 smithi080 bash[17386]: cluster 2024-02-13T00:25:34.697840+0000 mgr.y (mgr.14146) 133 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:35.487 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:35 smithi080 bash[24237]: cluster 2024-02-13T00:25:34.697840+0000 mgr.y (mgr.14146) 133 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:35.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:35 smithi106 bash[18459]: cluster 2024-02-13T00:25:34.697840+0000 mgr.y (mgr.14146) 133 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:38.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:37 smithi080 bash[17386]: cluster 2024-02-13T00:25:36.698280+0000 mgr.y (mgr.14146) 134 : cluster [DBG] pgmap v109: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:38.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:37 smithi080 bash[17386]: audit 2024-02-13T00:25:37.710800+0000 mon.a (mon.0) 296 : audit [INF] from='client.? 172.21.15.80:0/2340955884' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "734aa898-b774-4744-a7b7-15c30c3c4187"}]: dispatch 2024-02-13T00:25:38.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:37 smithi080 bash[17386]: audit 2024-02-13T00:25:37.718992+0000 mon.a (mon.0) 297 : audit [INF] from='client.? 172.21.15.80:0/2340955884' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "734aa898-b774-4744-a7b7-15c30c3c4187"}]': finished 2024-02-13T00:25:38.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:37 smithi080 bash[17386]: cluster 2024-02-13T00:25:37.719084+0000 mon.a (mon.0) 298 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-02-13T00:25:38.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:37 smithi080 bash[17386]: audit 2024-02-13T00:25:37.719253+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T00:25:38.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:37 smithi080 bash[24237]: cluster 2024-02-13T00:25:36.698280+0000 mgr.y (mgr.14146) 134 : cluster [DBG] pgmap v109: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:38.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:37 smithi080 bash[24237]: audit 2024-02-13T00:25:37.710800+0000 mon.a (mon.0) 296 : audit [INF] from='client.? 172.21.15.80:0/2340955884' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "734aa898-b774-4744-a7b7-15c30c3c4187"}]: dispatch 2024-02-13T00:25:38.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:37 smithi080 bash[24237]: audit 2024-02-13T00:25:37.718992+0000 mon.a (mon.0) 297 : audit [INF] from='client.? 172.21.15.80:0/2340955884' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "734aa898-b774-4744-a7b7-15c30c3c4187"}]': finished 2024-02-13T00:25:38.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:37 smithi080 bash[24237]: cluster 2024-02-13T00:25:37.719084+0000 mon.a (mon.0) 298 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-02-13T00:25:38.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:37 smithi080 bash[24237]: audit 2024-02-13T00:25:37.719253+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T00:25:38.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:37 smithi106 bash[18459]: cluster 2024-02-13T00:25:36.698280+0000 mgr.y (mgr.14146) 134 : cluster [DBG] pgmap v109: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:38.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:37 smithi106 bash[18459]: audit 2024-02-13T00:25:37.710800+0000 mon.a (mon.0) 296 : audit [INF] from='client.? 172.21.15.80:0/2340955884' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "734aa898-b774-4744-a7b7-15c30c3c4187"}]: dispatch 2024-02-13T00:25:38.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:37 smithi106 bash[18459]: audit 2024-02-13T00:25:37.718992+0000 mon.a (mon.0) 297 : audit [INF] from='client.? 172.21.15.80:0/2340955884' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "734aa898-b774-4744-a7b7-15c30c3c4187"}]': finished 2024-02-13T00:25:38.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:37 smithi106 bash[18459]: cluster 2024-02-13T00:25:37.719084+0000 mon.a (mon.0) 298 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-02-13T00:25:38.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:37 smithi106 bash[18459]: audit 2024-02-13T00:25:37.719253+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T00:25:39.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:38 smithi106 bash[18459]: audit 2024-02-13T00:25:38.444812+0000 mon.c (mon.2) 5 : audit [DBG] from='client.? 172.21.15.80:0/2760384743' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:25:39.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:38 smithi080 bash[17386]: audit 2024-02-13T00:25:38.444812+0000 mon.c (mon.2) 5 : audit [DBG] from='client.? 172.21.15.80:0/2760384743' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:25:39.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:38 smithi080 bash[24237]: audit 2024-02-13T00:25:38.444812+0000 mon.c (mon.2) 5 : audit [DBG] from='client.? 172.21.15.80:0/2760384743' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:25:40.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:39 smithi106 bash[18459]: cluster 2024-02-13T00:25:38.698813+0000 mgr.y (mgr.14146) 135 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:40.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:39 smithi080 bash[17386]: cluster 2024-02-13T00:25:38.698813+0000 mgr.y (mgr.14146) 135 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:40.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:39 smithi080 bash[24237]: cluster 2024-02-13T00:25:38.698813+0000 mgr.y (mgr.14146) 135 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:42.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:41 smithi106 bash[18459]: cluster 2024-02-13T00:25:40.699298+0000 mgr.y (mgr.14146) 136 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:42.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:41 smithi080 bash[17386]: cluster 2024-02-13T00:25:40.699298+0000 mgr.y (mgr.14146) 136 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:42.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:41 smithi080 bash[24237]: cluster 2024-02-13T00:25:40.699298+0000 mgr.y (mgr.14146) 136 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:44.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:43 smithi106 bash[18459]: cluster 2024-02-13T00:25:42.699772+0000 mgr.y (mgr.14146) 137 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:44.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:43 smithi080 bash[17386]: cluster 2024-02-13T00:25:42.699772+0000 mgr.y (mgr.14146) 137 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:44.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:43 smithi080 bash[24237]: cluster 2024-02-13T00:25:42.699772+0000 mgr.y (mgr.14146) 137 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:45.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:45 smithi106 bash[18459]: cluster 2024-02-13T00:25:44.700252+0000 mgr.y (mgr.14146) 138 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:45.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:45 smithi080 bash[17386]: cluster 2024-02-13T00:25:44.700252+0000 mgr.y (mgr.14146) 138 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:45.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:45 smithi080 bash[24237]: cluster 2024-02-13T00:25:44.700252+0000 mgr.y (mgr.14146) 138 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:48.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:47 smithi106 bash[18459]: cluster 2024-02-13T00:25:46.700590+0000 mgr.y (mgr.14146) 139 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:48.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:47 smithi080 bash[24237]: cluster 2024-02-13T00:25:46.700590+0000 mgr.y (mgr.14146) 139 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:48.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:47 smithi080 bash[17386]: cluster 2024-02-13T00:25:46.700590+0000 mgr.y (mgr.14146) 139 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:50.024 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:49 smithi080 bash[17386]: cluster 2024-02-13T00:25:48.701026+0000 mgr.y (mgr.14146) 140 : cluster [DBG] pgmap v116: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:50.024 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:49 smithi080 bash[24237]: cluster 2024-02-13T00:25:48.701026+0000 mgr.y (mgr.14146) 140 : cluster [DBG] pgmap v116: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:50.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:49 smithi106 bash[18459]: cluster 2024-02-13T00:25:48.701026+0000 mgr.y (mgr.14146) 140 : cluster [DBG] pgmap v116: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:51.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:50 smithi106 bash[18459]: audit 2024-02-13T00:25:50.509675+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-13T00:25:51.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:50 smithi106 bash[18459]: audit 2024-02-13T00:25:50.511107+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:25:51.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:50 smithi080 bash[17386]: audit 2024-02-13T00:25:50.509675+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-13T00:25:51.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:50 smithi080 bash[17386]: audit 2024-02-13T00:25:50.511107+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:25:51.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:50 smithi080 bash[24237]: audit 2024-02-13T00:25:50.509675+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-13T00:25:51.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:50 smithi080 bash[24237]: audit 2024-02-13T00:25:50.511107+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:25:52.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:51 smithi080 bash[17386]: cephadm 2024-02-13T00:25:50.512353+0000 mgr.y (mgr.14146) 141 : cephadm [INF] Deploying daemon osd.2 on smithi080 2024-02-13T00:25:52.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:51 smithi080 bash[17386]: cluster 2024-02-13T00:25:50.701380+0000 mgr.y (mgr.14146) 142 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:52.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:51 smithi080 bash[24237]: cephadm 2024-02-13T00:25:50.512353+0000 mgr.y (mgr.14146) 141 : cephadm [INF] Deploying daemon osd.2 on smithi080 2024-02-13T00:25:52.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:51 smithi080 bash[24237]: cluster 2024-02-13T00:25:50.701380+0000 mgr.y (mgr.14146) 142 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:52.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:51 smithi106 bash[18459]: cephadm 2024-02-13T00:25:50.512353+0000 mgr.y (mgr.14146) 141 : cephadm [INF] Deploying daemon osd.2 on smithi080 2024-02-13T00:25:52.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:51 smithi106 bash[18459]: cluster 2024-02-13T00:25:50.701380+0000 mgr.y (mgr.14146) 142 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:54.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:53 smithi080 bash[17386]: cluster 2024-02-13T00:25:52.701653+0000 mgr.y (mgr.14146) 143 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:54.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:53 smithi080 bash[24237]: cluster 2024-02-13T00:25:52.701653+0000 mgr.y (mgr.14146) 143 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:54.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:53 smithi106 bash[18459]: cluster 2024-02-13T00:25:52.701653+0000 mgr.y (mgr.14146) 143 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:56.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:55 smithi106 bash[18459]: cluster 2024-02-13T00:25:54.702033+0000 mgr.y (mgr.14146) 144 : cluster [DBG] pgmap v119: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:56.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:55 smithi106 bash[18459]: audit 2024-02-13T00:25:54.945687+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:56.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:55 smithi106 bash[18459]: audit 2024-02-13T00:25:54.970317+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:25:56.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:55 smithi080 bash[17386]: cluster 2024-02-13T00:25:54.702033+0000 mgr.y (mgr.14146) 144 : cluster [DBG] pgmap v119: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:56.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:55 smithi080 bash[17386]: audit 2024-02-13T00:25:54.945687+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:56.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:55 smithi080 bash[17386]: audit 2024-02-13T00:25:54.970317+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:25:56.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:55 smithi080 bash[24237]: cluster 2024-02-13T00:25:54.702033+0000 mgr.y (mgr.14146) 144 : cluster [DBG] pgmap v119: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:56.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:55 smithi080 bash[24237]: audit 2024-02-13T00:25:54.945687+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:25:56.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:55 smithi080 bash[24237]: audit 2024-02-13T00:25:54.970317+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:25:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:57 smithi106 bash[18459]: cluster 2024-02-13T00:25:56.702446+0000 mgr.y (mgr.14146) 145 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:58.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:57 smithi080 bash[24237]: cluster 2024-02-13T00:25:56.702446+0000 mgr.y (mgr.14146) 145 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:25:58.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:57 smithi080 bash[17386]: cluster 2024-02-13T00:25:56.702446+0000 mgr.y (mgr.14146) 145 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:26:00.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:25:59 smithi106 bash[18459]: cluster 2024-02-13T00:25:58.702916+0000 mgr.y (mgr.14146) 146 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:26:00.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:25:59 smithi080 bash[17386]: cluster 2024-02-13T00:25:58.702916+0000 mgr.y (mgr.14146) 146 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:26:00.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:25:59 smithi080 bash[24237]: cluster 2024-02-13T00:25:58.702916+0000 mgr.y (mgr.14146) 146 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:26:01.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:01 smithi080 bash[17386]: audit 2024-02-13T00:26:00.273464+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:01.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:01 smithi080 bash[17386]: audit 2024-02-13T00:26:00.526190+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:26:01.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:01 smithi080 bash[17386]: audit 2024-02-13T00:26:00.527275+0000 mon.a (mon.0) 306 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:26:01.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:01 smithi080 bash[17386]: audit 2024-02-13T00:26:00.532836+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:01.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:01 smithi080 bash[17386]: cluster 2024-02-13T00:26:00.703342+0000 mgr.y (mgr.14146) 147 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:26:01.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:01 smithi080 bash[24237]: audit 2024-02-13T00:26:00.273464+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:01.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:01 smithi080 bash[24237]: audit 2024-02-13T00:26:00.526190+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:26:01.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:01 smithi080 bash[24237]: audit 2024-02-13T00:26:00.527275+0000 mon.a (mon.0) 306 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:26:01.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:01 smithi080 bash[24237]: audit 2024-02-13T00:26:00.532836+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:01.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:01 smithi080 bash[24237]: cluster 2024-02-13T00:26:00.703342+0000 mgr.y (mgr.14146) 147 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:26:01.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:01 smithi106 bash[18459]: audit 2024-02-13T00:26:00.273464+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:01.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:01 smithi106 bash[18459]: audit 2024-02-13T00:26:00.526190+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:26:01.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:01 smithi106 bash[18459]: audit 2024-02-13T00:26:00.527275+0000 mon.a (mon.0) 306 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:26:01.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:01 smithi106 bash[18459]: audit 2024-02-13T00:26:00.532836+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:01.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:01 smithi106 bash[18459]: cluster 2024-02-13T00:26:00.703342+0000 mgr.y (mgr.14146) 147 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:26:03.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:02 smithi106 bash[18459]: audit 2024-02-13T00:26:01.730014+0000 mon.a (mon.0) 308 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/238755079,v1:172.21.15.80:6819/238755079]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-13T00:26:03.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:02 smithi080 bash[24237]: audit 2024-02-13T00:26:01.730014+0000 mon.a (mon.0) 308 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/238755079,v1:172.21.15.80:6819/238755079]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-13T00:26:03.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:02 smithi080 bash[17386]: audit 2024-02-13T00:26:01.730014+0000 mon.a (mon.0) 308 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/238755079,v1:172.21.15.80:6819/238755079]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-13T00:26:03.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:03 smithi080 bash[24237]: audit 2024-02-13T00:26:02.544656+0000 mon.a (mon.0) 309 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/238755079,v1:172.21.15.80:6819/238755079]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-13T00:26:03.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:03 smithi080 bash[24237]: cluster 2024-02-13T00:26:02.544813+0000 mon.a (mon.0) 310 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-02-13T00:26:03.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:03 smithi080 bash[24237]: audit 2024-02-13T00:26:02.545000+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T00:26:03.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:03 smithi080 bash[24237]: audit 2024-02-13T00:26:02.545561+0000 mon.a (mon.0) 312 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/238755079,v1:172.21.15.80:6819/238755079]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-13T00:26:03.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:03 smithi080 bash[24237]: cluster 2024-02-13T00:26:02.703724+0000 mgr.y (mgr.14146) 148 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:26:03.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:03 smithi080 bash[17386]: audit 2024-02-13T00:26:02.544656+0000 mon.a (mon.0) 309 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/238755079,v1:172.21.15.80:6819/238755079]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-13T00:26:03.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:03 smithi080 bash[17386]: cluster 2024-02-13T00:26:02.544813+0000 mon.a (mon.0) 310 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-02-13T00:26:03.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:03 smithi080 bash[17386]: audit 2024-02-13T00:26:02.545000+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T00:26:03.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:03 smithi080 bash[17386]: audit 2024-02-13T00:26:02.545561+0000 mon.a (mon.0) 312 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/238755079,v1:172.21.15.80:6819/238755079]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-13T00:26:03.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:03 smithi080 bash[17386]: cluster 2024-02-13T00:26:02.703724+0000 mgr.y (mgr.14146) 148 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:26:03.866 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:03.859+0000 7fc9c67fc700 1 -- 172.21.15.80:0/1845950479 <== mgr.14146 v2:172.21.15.80:6800/461193090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc9d0061190 con 0x7fc9bc061280 2024-02-13T00:26:03.866 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 2 on host 'smithi080' 2024-02-13T00:26:03.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:03.863+0000 7fc9d7646700 1 -- 172.21.15.80:0/1845950479 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fc9bc061280 msgr2=0x7fc9bc063740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:26:03.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:03.863+0000 7fc9d7646700 1 --2- 172.21.15.80:0/1845950479 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fc9bc061280 0x7fc9bc063740 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fc9c00048b0 tx=0x7fc9c000b040).stop 2024-02-13T00:26:03.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:03.863+0000 7fc9d7646700 1 -- 172.21.15.80:0/1845950479 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc9d00f6a30 msgr2=0x7fc9d0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:26:03.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:03.863+0000 7fc9d7646700 1 --2- 172.21.15.80:0/1845950479 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc9d00f6a30 0x7fc9d0107ce0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fc9cc00eca0 tx=0x7fc9cc00b040).stop 2024-02-13T00:26:03.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:03.863+0000 7fc9d7646700 1 -- 172.21.15.80:0/1845950479 shutdown_connections 2024-02-13T00:26:03.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:03.863+0000 7fc9d7646700 1 --2- 172.21.15.80:0/1845950479 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fc9bc061280 0x7fc9bc063740 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:26:03.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:03.863+0000 7fc9d7646700 1 --2- 172.21.15.80:0/1845950479 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9d00f8620 0x7fc9d010f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:26:03.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:03.863+0000 7fc9d7646700 1 --2- 172.21.15.80:0/1845950479 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fc9d00f6a30 0x7fc9d0107ce0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:26:03.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:03.863+0000 7fc9d7646700 1 --2- 172.21.15.80:0/1845950479 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fc9d00f7cd0 0x7fc9d01081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:26:03.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:03.863+0000 7fc9d7646700 1 -- 172.21.15.80:0/1845950479 >> 172.21.15.80:0/1845950479 conn(0x7fc9d00f2230 msgr2=0x7fc9d0060a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:26:03.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:03.863+0000 7fc9d7646700 1 -- 172.21.15.80:0/1845950479 shutdown_connections 2024-02-13T00:26:03.871 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:03.863+0000 7fc9d7646700 1 -- 172.21.15.80:0/1845950479 wait complete. 2024-02-13T00:26:04.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:03 smithi106 bash[18459]: audit 2024-02-13T00:26:02.544656+0000 mon.a (mon.0) 309 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/238755079,v1:172.21.15.80:6819/238755079]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-13T00:26:04.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:03 smithi106 bash[18459]: cluster 2024-02-13T00:26:02.544813+0000 mon.a (mon.0) 310 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-02-13T00:26:04.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:03 smithi106 bash[18459]: audit 2024-02-13T00:26:02.545000+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T00:26:04.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:03 smithi106 bash[18459]: audit 2024-02-13T00:26:02.545561+0000 mon.a (mon.0) 312 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/238755079,v1:172.21.15.80:6819/238755079]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-13T00:26:04.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:03 smithi106 bash[18459]: cluster 2024-02-13T00:26:02.703724+0000 mgr.y (mgr.14146) 148 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:26:04.568 DEBUG:teuthology.orchestra.run.smithi080:osd.2> sudo journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.2.service 2024-02-13T00:26:04.570 INFO:tasks.cephadm:Deploying osd.3 on smithi080 with /dev/vg_nvme/lv_1... 2024-02-13T00:26:04.570 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-13T00:26:04.779 INFO:journalctl@ceph.osd.2.smithi080.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-13T00:26:05.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:05 smithi080 bash[17386]: audit 2024-02-13T00:26:03.548141+0000 mon.a (mon.0) 313 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/238755079,v1:172.21.15.80:6819/238755079]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-13T00:26:05.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:05 smithi080 bash[17386]: cluster 2024-02-13T00:26:03.548247+0000 mon.a (mon.0) 314 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-02-13T00:26:05.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:05 smithi080 bash[17386]: audit 2024-02-13T00:26:03.550105+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T00:26:05.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:05 smithi080 bash[17386]: audit 2024-02-13T00:26:03.557544+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T00:26:05.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:05 smithi080 bash[17386]: audit 2024-02-13T00:26:03.860196+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:05.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:05 smithi080 bash[17386]: audit 2024-02-13T00:26:03.860867+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:26:05.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:05 smithi080 bash[24237]: audit 2024-02-13T00:26:03.548141+0000 mon.a (mon.0) 313 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/238755079,v1:172.21.15.80:6819/238755079]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-13T00:26:05.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:05 smithi080 bash[24237]: cluster 2024-02-13T00:26:03.548247+0000 mon.a (mon.0) 314 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-02-13T00:26:05.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:05 smithi080 bash[24237]: audit 2024-02-13T00:26:03.550105+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T00:26:05.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:05 smithi080 bash[24237]: audit 2024-02-13T00:26:03.557544+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T00:26:05.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:05 smithi080 bash[24237]: audit 2024-02-13T00:26:03.860196+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:05.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:05 smithi080 bash[24237]: audit 2024-02-13T00:26:03.860867+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:26:05.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:05 smithi106 bash[18459]: audit 2024-02-13T00:26:03.548141+0000 mon.a (mon.0) 313 : audit [INF] from='osd.2 [v2:172.21.15.80:6818/238755079,v1:172.21.15.80:6819/238755079]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-13T00:26:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:05 smithi106 bash[18459]: cluster 2024-02-13T00:26:03.548247+0000 mon.a (mon.0) 314 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-02-13T00:26:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:05 smithi106 bash[18459]: audit 2024-02-13T00:26:03.550105+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T00:26:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:05 smithi106 bash[18459]: audit 2024-02-13T00:26:03.557544+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T00:26:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:05 smithi106 bash[18459]: audit 2024-02-13T00:26:03.860196+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:05 smithi106 bash[18459]: audit 2024-02-13T00:26:03.860867+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:26:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:06 smithi106 bash[18459]: cluster 2024-02-13T00:26:02.696958+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:26:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:06 smithi106 bash[18459]: cluster 2024-02-13T00:26:02.697039+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:26:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:06 smithi106 bash[18459]: audit 2024-02-13T00:26:04.555502+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T00:26:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:06 smithi106 bash[18459]: cluster 2024-02-13T00:26:04.564161+0000 mon.a (mon.0) 320 : cluster [INF] osd.2 [v2:172.21.15.80:6818/238755079,v1:172.21.15.80:6819/238755079] boot 2024-02-13T00:26:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:06 smithi106 bash[18459]: cluster 2024-02-13T00:26:04.564215+0000 mon.a (mon.0) 321 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-02-13T00:26:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:06 smithi106 bash[18459]: audit 2024-02-13T00:26:04.565532+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T00:26:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:06 smithi106 bash[18459]: audit 2024-02-13T00:26:04.566016+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-13T00:26:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:06 smithi106 bash[18459]: cluster 2024-02-13T00:26:04.704087+0000 mgr.y (mgr.14146) 149 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:26:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:06 smithi106 bash[18459]: audit 2024-02-13T00:26:05.565249+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-13T00:26:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:06 smithi106 bash[18459]: cluster 2024-02-13T00:26:05.565357+0000 mon.a (mon.0) 325 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-02-13T00:26:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:06 smithi106 bash[18459]: audit 2024-02-13T00:26:05.566968+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-13T00:26:06.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:06 smithi080 bash[17386]: cluster 2024-02-13T00:26:02.696958+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:26:06.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:06 smithi080 bash[17386]: cluster 2024-02-13T00:26:02.697039+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:26:06.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:06 smithi080 bash[17386]: audit 2024-02-13T00:26:04.555502+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T00:26:06.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:06 smithi080 bash[17386]: cluster 2024-02-13T00:26:04.564161+0000 mon.a (mon.0) 320 : cluster [INF] osd.2 [v2:172.21.15.80:6818/238755079,v1:172.21.15.80:6819/238755079] boot 2024-02-13T00:26:06.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:06 smithi080 bash[17386]: cluster 2024-02-13T00:26:04.564215+0000 mon.a (mon.0) 321 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-02-13T00:26:06.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:06 smithi080 bash[17386]: audit 2024-02-13T00:26:04.565532+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T00:26:06.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:06 smithi080 bash[17386]: audit 2024-02-13T00:26:04.566016+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-13T00:26:06.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:06 smithi080 bash[17386]: cluster 2024-02-13T00:26:04.704087+0000 mgr.y (mgr.14146) 149 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:26:06.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:06 smithi080 bash[17386]: audit 2024-02-13T00:26:05.565249+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-13T00:26:06.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:06 smithi080 bash[17386]: cluster 2024-02-13T00:26:05.565357+0000 mon.a (mon.0) 325 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-02-13T00:26:06.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:06 smithi080 bash[17386]: audit 2024-02-13T00:26:05.566968+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-13T00:26:06.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:06 smithi080 bash[24237]: cluster 2024-02-13T00:26:02.696958+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:26:06.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:06 smithi080 bash[24237]: cluster 2024-02-13T00:26:02.697039+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:26:06.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:06 smithi080 bash[24237]: audit 2024-02-13T00:26:04.555502+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T00:26:06.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:06 smithi080 bash[24237]: cluster 2024-02-13T00:26:04.564161+0000 mon.a (mon.0) 320 : cluster [INF] osd.2 [v2:172.21.15.80:6818/238755079,v1:172.21.15.80:6819/238755079] boot 2024-02-13T00:26:06.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:06 smithi080 bash[24237]: cluster 2024-02-13T00:26:04.564215+0000 mon.a (mon.0) 321 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-02-13T00:26:06.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:06 smithi080 bash[24237]: audit 2024-02-13T00:26:04.565532+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T00:26:06.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:06 smithi080 bash[24237]: audit 2024-02-13T00:26:04.566016+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-13T00:26:06.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:06 smithi080 bash[24237]: cluster 2024-02-13T00:26:04.704087+0000 mgr.y (mgr.14146) 149 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-13T00:26:06.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:06 smithi080 bash[24237]: audit 2024-02-13T00:26:05.565249+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-13T00:26:06.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:06 smithi080 bash[24237]: cluster 2024-02-13T00:26:05.565357+0000 mon.a (mon.0) 325 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-02-13T00:26:06.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:06 smithi080 bash[24237]: audit 2024-02-13T00:26:05.566968+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-13T00:26:07.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:07 smithi080 bash[17386]: audit 2024-02-13T00:26:06.567700+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-13T00:26:07.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:07 smithi080 bash[17386]: cluster 2024-02-13T00:26:06.568155+0000 mon.a (mon.0) 328 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-02-13T00:26:07.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:07 smithi080 bash[17386]: cluster 2024-02-13T00:26:06.704596+0000 mgr.y (mgr.14146) 150 : cluster [DBG] pgmap v130: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:07.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:07 smithi080 bash[24237]: audit 2024-02-13T00:26:06.567700+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-13T00:26:07.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:07 smithi080 bash[24237]: cluster 2024-02-13T00:26:06.568155+0000 mon.a (mon.0) 328 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-02-13T00:26:07.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:07 smithi080 bash[24237]: cluster 2024-02-13T00:26:06.704596+0000 mgr.y (mgr.14146) 150 : cluster [DBG] pgmap v130: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:08.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:07 smithi106 bash[18459]: audit 2024-02-13T00:26:06.567700+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-13T00:26:08.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:07 smithi106 bash[18459]: cluster 2024-02-13T00:26:06.568155+0000 mon.a (mon.0) 328 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-02-13T00:26:08.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:07 smithi106 bash[18459]: cluster 2024-02-13T00:26:06.704596+0000 mgr.y (mgr.14146) 150 : cluster [DBG] pgmap v130: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:08.178 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-13T00:26:08.179 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-13T00:26:08.179 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-02-13T00:26:08.179 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-02-13T00:26:08.179 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0186973 s, 561 MB/s 2024-02-13T00:26:08.179 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-02-13T00:26:08.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:08 smithi080 bash[17386]: cluster 2024-02-13T00:26:07.576736+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-13T00:26:08.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:08 smithi080 bash[24237]: cluster 2024-02-13T00:26:07.576736+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-13T00:26:08.937 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi080:vg_nvme/lv_1 2024-02-13T00:26:09.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:08 smithi106 bash[18459]: cluster 2024-02-13T00:26:07.576736+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-13T00:26:09.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:09 smithi080 bash[17386]: cluster 2024-02-13T00:26:08.705110+0000 mgr.y (mgr.14146) 151 : cluster [DBG] pgmap v132: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:09.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:09 smithi080 bash[24237]: cluster 2024-02-13T00:26:08.705110+0000 mgr.y (mgr.14146) 151 : cluster [DBG] pgmap v132: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:10.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:09 smithi106 bash[18459]: cluster 2024-02-13T00:26:08.705110+0000 mgr.y (mgr.14146) 151 : cluster [DBG] pgmap v132: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:11.953 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:11 smithi080 bash[17386]: cluster 2024-02-13T00:26:10.705550+0000 mgr.y (mgr.14146) 152 : cluster [DBG] pgmap v133: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:11.953 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:11 smithi080 bash[24237]: cluster 2024-02-13T00:26:10.705550+0000 mgr.y (mgr.14146) 152 : cluster [DBG] pgmap v133: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:12.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:11 smithi106 bash[18459]: cluster 2024-02-13T00:26:10.705550+0000 mgr.y (mgr.14146) 152 : cluster [DBG] pgmap v133: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:13.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.407+0000 7fde024cb700 1 -- 172.21.15.80:0/1578113357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddfc0f8620 msgr2=0x7fddfc0fef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:26:13.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.407+0000 7fde024cb700 1 --2- 172.21.15.80:0/1578113357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddfc0f8620 0x7fddfc0fef20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fddf4009c30 tx=0x7fddf4004c50).stop 2024-02-13T00:26:13.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.407+0000 7fde024cb700 1 -- 172.21.15.80:0/1578113357 shutdown_connections 2024-02-13T00:26:13.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.407+0000 7fde024cb700 1 --2- 172.21.15.80:0/1578113357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddfc0f6a30 0x7fddfc0f6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:26:13.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.407+0000 7fde024cb700 1 --2- 172.21.15.80:0/1578113357 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddfc0f8620 0x7fddfc0fef20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:26:13.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.407+0000 7fde024cb700 1 --2- 172.21.15.80:0/1578113357 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fddfc0f7cd0 0x7fddfc0f8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:26:13.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.407+0000 7fde024cb700 1 -- 172.21.15.80:0/1578113357 >> 172.21.15.80:0/1578113357 conn(0x7fddfc0f2230 msgr2=0x7fddfc0f4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:26:13.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.407+0000 7fde024cb700 1 -- 172.21.15.80:0/1578113357 shutdown_connections 2024-02-13T00:26:13.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.407+0000 7fde024cb700 1 -- 172.21.15.80:0/1578113357 wait complete. 2024-02-13T00:26:13.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.407+0000 7fde024cb700 1 Processor -- start 2024-02-13T00:26:13.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.407+0000 7fde024cb700 1 -- start start 2024-02-13T00:26:13.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.407+0000 7fde024cb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddfc0f6a30 0x7fddfc106c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:26:13.416 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.407+0000 7fde024cb700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fddfc0f7cd0 0x7fddfc107100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:26:13.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.407+0000 7fde024cb700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddfc0f8620 0x7fddfc10e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:26:13.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.407+0000 7fde024cb700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc10e690 con 0x7fddfc0f8620 2024-02-13T00:26:13.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.407+0000 7fde024cb700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc10e7d0 con 0x7fddfc0f6a30 2024-02-13T00:26:13.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.407+0000 7fde024cb700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc10e960 con 0x7fddfc0f7cd0 2024-02-13T00:26:13.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.411+0000 7fddfb7fe700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fddfc0f7cd0 0x7fddfc107100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:26:13.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.411+0000 7fddfb7fe700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fddfc0f7cd0 0x7fddfc107100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:34488/0 (socket says 172.21.15.80:34488) 2024-02-13T00:26:13.418 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.411+0000 7fde00a68700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddfc0f8620 0x7fddfc10e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:26:13.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.411+0000 7fddfb7fe700 1 -- 172.21.15.80:0/805223089 learned_addr learned my addr 172.21.15.80:0/805223089 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:26:13.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.411+0000 7fddfbfff700 1 --2- 172.21.15.80:0/805223089 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddfc0f6a30 0x7fddfc106c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:26:13.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.411+0000 7fde00a68700 1 -- 172.21.15.80:0/805223089 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fddfc0f7cd0 msgr2=0x7fddfc107100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:26:13.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.411+0000 7fde00a68700 1 --2- 172.21.15.80:0/805223089 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fddfc0f7cd0 0x7fddfc107100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:26:13.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.411+0000 7fde00a68700 1 -- 172.21.15.80:0/805223089 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddfc0f6a30 msgr2=0x7fddfc106c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:26:13.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.411+0000 7fde00a68700 1 --2- 172.21.15.80:0/805223089 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddfc0f6a30 0x7fddfc106c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:26:13.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.411+0000 7fde00a68700 1 -- 172.21.15.80:0/805223089 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf40097c0 con 0x7fddfc0f8620 2024-02-13T00:26:13.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.411+0000 7fddfb7fe700 1 --2- 172.21.15.80:0/805223089 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fddfc0f7cd0 0x7fddfc107100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:26:13.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.411+0000 7fde00a68700 1 --2- 172.21.15.80:0/805223089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddfc0f8620 0x7fddfc10e1a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fddf40049a0 tx=0x7fddf4004c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:26:13.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.411+0000 7fddf97fa700 1 -- 172.21.15.80:0/805223089 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf400e040 con 0x7fddfc0f8620 2024-02-13T00:26:13.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.411+0000 7fddf97fa700 1 -- 172.21.15.80:0/805223089 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fddf4018040 con 0x7fddfc0f8620 2024-02-13T00:26:13.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.411+0000 7fde024cb700 1 -- 172.21.15.80:0/805223089 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddfc060a80 con 0x7fddfc0f8620 2024-02-13T00:26:13.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.411+0000 7fddf97fa700 1 -- 172.21.15.80:0/805223089 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4013e40 con 0x7fddfc0f8620 2024-02-13T00:26:13.419 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.411+0000 7fde024cb700 1 -- 172.21.15.80:0/805223089 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddfc060f90 con 0x7fddfc0f8620 2024-02-13T00:26:13.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.411+0000 7fddf97fa700 1 -- 172.21.15.80:0/805223089 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 14) v1 ==== 77064+0+0 (secure 0 0 0) 0x7fddf401d610 con 0x7fddfc0f8620 2024-02-13T00:26:13.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.411+0000 7fde024cb700 1 -- 172.21.15.80:0/805223089 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde8004f50 con 0x7fddfc0f8620 2024-02-13T00:26:13.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.411+0000 7fddf97fa700 1 --2- 172.21.15.80:0/805223089 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fdde4061280 0x7fdde4063740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:26:13.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.411+0000 7fddf97fa700 1 -- 172.21.15.80:0/805223089 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 2990+0+0 (secure 0 0 0) 0x7fddf407d710 con 0x7fddfc0f8620 2024-02-13T00:26:13.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.411+0000 7fddfbfff700 1 --2- 172.21.15.80:0/805223089 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fdde4061280 0x7fdde4063740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:26:13.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.415+0000 7fddfbfff700 1 --2- 172.21.15.80:0/805223089 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fdde4061280 0x7fdde4063740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fddfc108100 tx=0x7fddec00b040).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:26:13.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.419+0000 7fddf97fa700 1 -- 172.21.15.80:0/805223089 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fddf404f430 con 0x7fddfc0f8620 2024-02-13T00:26:13.618 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:13.611+0000 7fde024cb700 1 -- 172.21.15.80:0/805223089 --> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fdde8000bf0 con 0x7fdde4061280 2024-02-13T00:26:14.127 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:13 smithi080 bash[17386]: cluster 2024-02-13T00:26:12.706092+0000 mgr.y (mgr.14146) 153 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:14.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:13 smithi080 bash[17386]: audit 2024-02-13T00:26:13.621065+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:26:14.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:13 smithi080 bash[17386]: audit 2024-02-13T00:26:13.624862+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:26:14.128 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:13 smithi080 bash[17386]: audit 2024-02-13T00:26:13.626142+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:26:14.128 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:13 smithi080 bash[24237]: cluster 2024-02-13T00:26:12.706092+0000 mgr.y (mgr.14146) 153 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:14.128 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:13 smithi080 bash[24237]: audit 2024-02-13T00:26:13.621065+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:26:14.128 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:13 smithi080 bash[24237]: audit 2024-02-13T00:26:13.624862+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:26:14.128 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:13 smithi080 bash[24237]: audit 2024-02-13T00:26:13.626142+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:26:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:13 smithi106 bash[18459]: cluster 2024-02-13T00:26:12.706092+0000 mgr.y (mgr.14146) 153 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:13 smithi106 bash[18459]: audit 2024-02-13T00:26:13.621065+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:26:14.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:13 smithi106 bash[18459]: audit 2024-02-13T00:26:13.624862+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:26:14.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:13 smithi106 bash[18459]: audit 2024-02-13T00:26:13.626142+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:26:15.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:14 smithi106 bash[18459]: audit 2024-02-13T00:26:13.614669+0000 mgr.y (mgr.14146) 154 : audit [DBG] from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:26:15.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:14 smithi080 bash[17386]: audit 2024-02-13T00:26:13.614669+0000 mgr.y (mgr.14146) 154 : audit [DBG] from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:26:15.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:14 smithi080 bash[24237]: audit 2024-02-13T00:26:13.614669+0000 mgr.y (mgr.14146) 154 : audit [DBG] from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:26:16.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:16 smithi106 bash[18459]: cluster 2024-02-13T00:26:14.706664+0000 mgr.y (mgr.14146) 155 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:16 smithi106 bash[18459]: cephadm 2024-02-13T00:26:15.074584+0000 mgr.y (mgr.14146) 156 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-13T00:26:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:16 smithi106 bash[18459]: audit 2024-02-13T00:26:15.083457+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:16 smithi106 bash[18459]: audit 2024-02-13T00:26:15.085063+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:26:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:16 smithi106 bash[18459]: audit 2024-02-13T00:26:15.086078+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:26:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:16 smithi106 bash[18459]: audit 2024-02-13T00:26:15.087103+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:26:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:16 smithi106 bash[18459]: cephadm 2024-02-13T00:26:15.087988+0000 mgr.y (mgr.14146) 157 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 5413M 2024-02-13T00:26:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:16 smithi106 bash[18459]: audit 2024-02-13T00:26:15.092713+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:16 smithi106 bash[18459]: audit 2024-02-13T00:26:15.094054+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:26:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:16 smithi106 bash[18459]: audit 2024-02-13T00:26:15.094998+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:26:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:16 smithi106 bash[18459]: audit 2024-02-13T00:26:15.100543+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:16.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:16 smithi080 bash[17386]: cluster 2024-02-13T00:26:14.706664+0000 mgr.y (mgr.14146) 155 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:16.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:16 smithi080 bash[17386]: cephadm 2024-02-13T00:26:15.074584+0000 mgr.y (mgr.14146) 156 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-13T00:26:16.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:16 smithi080 bash[17386]: audit 2024-02-13T00:26:15.083457+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:16.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:16 smithi080 bash[17386]: audit 2024-02-13T00:26:15.085063+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:26:16.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:16 smithi080 bash[17386]: audit 2024-02-13T00:26:15.086078+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:26:16.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:16 smithi080 bash[17386]: audit 2024-02-13T00:26:15.087103+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:26:16.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:16 smithi080 bash[17386]: cephadm 2024-02-13T00:26:15.087988+0000 mgr.y (mgr.14146) 157 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 5413M 2024-02-13T00:26:16.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:16 smithi080 bash[17386]: audit 2024-02-13T00:26:15.092713+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:16.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:16 smithi080 bash[17386]: audit 2024-02-13T00:26:15.094054+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:26:16.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:16 smithi080 bash[17386]: audit 2024-02-13T00:26:15.094998+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:26:16.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:16 smithi080 bash[17386]: audit 2024-02-13T00:26:15.100543+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:16.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:16 smithi080 bash[24237]: cluster 2024-02-13T00:26:14.706664+0000 mgr.y (mgr.14146) 155 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:16.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:16 smithi080 bash[24237]: cephadm 2024-02-13T00:26:15.074584+0000 mgr.y (mgr.14146) 156 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-13T00:26:16.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:16 smithi080 bash[24237]: audit 2024-02-13T00:26:15.083457+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:16.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:16 smithi080 bash[24237]: audit 2024-02-13T00:26:15.085063+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:26:16.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:16 smithi080 bash[24237]: audit 2024-02-13T00:26:15.086078+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:26:16.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:16 smithi080 bash[24237]: audit 2024-02-13T00:26:15.087103+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:26:16.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:16 smithi080 bash[24237]: cephadm 2024-02-13T00:26:15.087988+0000 mgr.y (mgr.14146) 157 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 5413M 2024-02-13T00:26:16.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:16 smithi080 bash[24237]: audit 2024-02-13T00:26:15.092713+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:16.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:16 smithi080 bash[24237]: audit 2024-02-13T00:26:15.094054+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:26:16.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:16 smithi080 bash[24237]: audit 2024-02-13T00:26:15.094998+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:26:16.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:16 smithi080 bash[24237]: audit 2024-02-13T00:26:15.100543+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:18.414 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:18 smithi080 bash[17386]: cluster 2024-02-13T00:26:16.707228+0000 mgr.y (mgr.14146) 158 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:18.414 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:18 smithi080 bash[24237]: cluster 2024-02-13T00:26:16.707228+0000 mgr.y (mgr.14146) 158 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:18.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:18 smithi106 bash[18459]: cluster 2024-02-13T00:26:16.707228+0000 mgr.y (mgr.14146) 158 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:20.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:20 smithi106 bash[18459]: cluster 2024-02-13T00:26:18.707774+0000 mgr.y (mgr.14146) 159 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:20.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:20 smithi080 bash[24237]: cluster 2024-02-13T00:26:18.707774+0000 mgr.y (mgr.14146) 159 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:20.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:20 smithi080 bash[17386]: cluster 2024-02-13T00:26:18.707774+0000 mgr.y (mgr.14146) 159 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:22.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:22 smithi106 bash[18459]: cluster 2024-02-13T00:26:20.708320+0000 mgr.y (mgr.14146) 160 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:22.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:22 smithi106 bash[18459]: audit 2024-02-13T00:26:21.876054+0000 mon.a (mon.0) 341 : audit [INF] from='client.? 172.21.15.80:0/3321230702' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6772f249-7ded-4e8f-b0d2-f04e72eee540"}]: dispatch 2024-02-13T00:26:22.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:22 smithi106 bash[18459]: audit 2024-02-13T00:26:21.888372+0000 mon.a (mon.0) 342 : audit [INF] from='client.? 172.21.15.80:0/3321230702' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6772f249-7ded-4e8f-b0d2-f04e72eee540"}]': finished 2024-02-13T00:26:22.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:22 smithi106 bash[18459]: cluster 2024-02-13T00:26:21.888438+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2024-02-13T00:26:22.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:22 smithi106 bash[18459]: audit 2024-02-13T00:26:21.888913+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T00:26:22.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:22 smithi080 bash[24237]: cluster 2024-02-13T00:26:20.708320+0000 mgr.y (mgr.14146) 160 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:22.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:22 smithi080 bash[24237]: audit 2024-02-13T00:26:21.876054+0000 mon.a (mon.0) 341 : audit [INF] from='client.? 172.21.15.80:0/3321230702' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6772f249-7ded-4e8f-b0d2-f04e72eee540"}]: dispatch 2024-02-13T00:26:22.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:22 smithi080 bash[24237]: audit 2024-02-13T00:26:21.888372+0000 mon.a (mon.0) 342 : audit [INF] from='client.? 172.21.15.80:0/3321230702' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6772f249-7ded-4e8f-b0d2-f04e72eee540"}]': finished 2024-02-13T00:26:22.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:22 smithi080 bash[24237]: cluster 2024-02-13T00:26:21.888438+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2024-02-13T00:26:22.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:22 smithi080 bash[24237]: audit 2024-02-13T00:26:21.888913+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T00:26:22.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:22 smithi080 bash[17386]: cluster 2024-02-13T00:26:20.708320+0000 mgr.y (mgr.14146) 160 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:22.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:22 smithi080 bash[17386]: audit 2024-02-13T00:26:21.876054+0000 mon.a (mon.0) 341 : audit [INF] from='client.? 172.21.15.80:0/3321230702' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6772f249-7ded-4e8f-b0d2-f04e72eee540"}]: dispatch 2024-02-13T00:26:22.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:22 smithi080 bash[17386]: audit 2024-02-13T00:26:21.888372+0000 mon.a (mon.0) 342 : audit [INF] from='client.? 172.21.15.80:0/3321230702' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6772f249-7ded-4e8f-b0d2-f04e72eee540"}]': finished 2024-02-13T00:26:22.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:22 smithi080 bash[17386]: cluster 2024-02-13T00:26:21.888438+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2024-02-13T00:26:22.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:22 smithi080 bash[17386]: audit 2024-02-13T00:26:21.888913+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T00:26:23.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:23 smithi106 bash[18459]: audit 2024-02-13T00:26:22.588885+0000 mon.a (mon.0) 345 : audit [DBG] from='client.? 172.21.15.80:0/2307831958' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:26:23.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:23 smithi080 bash[24237]: audit 2024-02-13T00:26:22.588885+0000 mon.a (mon.0) 345 : audit [DBG] from='client.? 172.21.15.80:0/2307831958' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:26:23.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:23 smithi080 bash[17386]: audit 2024-02-13T00:26:22.588885+0000 mon.a (mon.0) 345 : audit [DBG] from='client.? 172.21.15.80:0/2307831958' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:26:24.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:24 smithi106 bash[18459]: cluster 2024-02-13T00:26:22.708614+0000 mgr.y (mgr.14146) 161 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:24.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:24 smithi080 bash[24237]: cluster 2024-02-13T00:26:22.708614+0000 mgr.y (mgr.14146) 161 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:24.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:24 smithi080 bash[17386]: cluster 2024-02-13T00:26:22.708614+0000 mgr.y (mgr.14146) 161 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:25.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:25 smithi106 bash[18459]: cluster 2024-02-13T00:26:24.709034+0000 mgr.y (mgr.14146) 162 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:25.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:25 smithi080 bash[17386]: cluster 2024-02-13T00:26:24.709034+0000 mgr.y (mgr.14146) 162 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:25.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:25 smithi080 bash[24237]: cluster 2024-02-13T00:26:24.709034+0000 mgr.y (mgr.14146) 162 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:28.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:27 smithi106 bash[18459]: cluster 2024-02-13T00:26:26.709580+0000 mgr.y (mgr.14146) 163 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:28.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:27 smithi080 bash[17386]: cluster 2024-02-13T00:26:26.709580+0000 mgr.y (mgr.14146) 163 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:28.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:27 smithi080 bash[24237]: cluster 2024-02-13T00:26:26.709580+0000 mgr.y (mgr.14146) 163 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:30.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:29 smithi106 bash[18459]: cluster 2024-02-13T00:26:28.710153+0000 mgr.y (mgr.14146) 164 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:30.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:29 smithi080 bash[17386]: cluster 2024-02-13T00:26:28.710153+0000 mgr.y (mgr.14146) 164 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:30.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:29 smithi080 bash[24237]: cluster 2024-02-13T00:26:28.710153+0000 mgr.y (mgr.14146) 164 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:31.924 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:31 smithi080 bash[17386]: cluster 2024-02-13T00:26:30.710611+0000 mgr.y (mgr.14146) 165 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:31.924 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:31 smithi080 bash[24237]: cluster 2024-02-13T00:26:30.710611+0000 mgr.y (mgr.14146) 165 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:32.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:31 smithi106 bash[18459]: cluster 2024-02-13T00:26:30.710611+0000 mgr.y (mgr.14146) 165 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:34.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:33 smithi106 bash[18459]: cluster 2024-02-13T00:26:32.711157+0000 mgr.y (mgr.14146) 166 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:34.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:33 smithi080 bash[17386]: cluster 2024-02-13T00:26:32.711157+0000 mgr.y (mgr.14146) 166 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:34.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:33 smithi080 bash[24237]: cluster 2024-02-13T00:26:32.711157+0000 mgr.y (mgr.14146) 166 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:35.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:35 smithi080 bash[17386]: audit 2024-02-13T00:26:34.512646+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-13T00:26:35.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:35 smithi080 bash[17386]: audit 2024-02-13T00:26:34.514142+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:26:35.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:35 smithi080 bash[17386]: cephadm 2024-02-13T00:26:34.515379+0000 mgr.y (mgr.14146) 167 : cephadm [INF] Deploying daemon osd.3 on smithi080 2024-02-13T00:26:35.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:35 smithi080 bash[17386]: cluster 2024-02-13T00:26:34.711513+0000 mgr.y (mgr.14146) 168 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:35.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:35 smithi080 bash[24237]: audit 2024-02-13T00:26:34.512646+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-13T00:26:35.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:35 smithi080 bash[24237]: audit 2024-02-13T00:26:34.514142+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:26:35.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:35 smithi080 bash[24237]: cephadm 2024-02-13T00:26:34.515379+0000 mgr.y (mgr.14146) 167 : cephadm [INF] Deploying daemon osd.3 on smithi080 2024-02-13T00:26:35.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:35 smithi080 bash[24237]: cluster 2024-02-13T00:26:34.711513+0000 mgr.y (mgr.14146) 168 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:35.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:35 smithi106 bash[18459]: audit 2024-02-13T00:26:34.512646+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-13T00:26:35.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:35 smithi106 bash[18459]: audit 2024-02-13T00:26:34.514142+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:26:35.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:35 smithi106 bash[18459]: cephadm 2024-02-13T00:26:34.515379+0000 mgr.y (mgr.14146) 167 : cephadm [INF] Deploying daemon osd.3 on smithi080 2024-02-13T00:26:35.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:35 smithi106 bash[18459]: cluster 2024-02-13T00:26:34.711513+0000 mgr.y (mgr.14146) 168 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:38.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:37 smithi080 bash[24237]: cluster 2024-02-13T00:26:36.712063+0000 mgr.y (mgr.14146) 169 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:38.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:37 smithi080 bash[17386]: cluster 2024-02-13T00:26:36.712063+0000 mgr.y (mgr.14146) 169 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:38.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:37 smithi106 bash[18459]: cluster 2024-02-13T00:26:36.712063+0000 mgr.y (mgr.14146) 169 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:40.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:39 smithi106 bash[18459]: cluster 2024-02-13T00:26:38.712440+0000 mgr.y (mgr.14146) 170 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:40.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:39 smithi106 bash[18459]: audit 2024-02-13T00:26:38.891143+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:40.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:39 smithi106 bash[18459]: audit 2024-02-13T00:26:38.927211+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:26:40.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:39 smithi080 bash[17386]: cluster 2024-02-13T00:26:38.712440+0000 mgr.y (mgr.14146) 170 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:40.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:39 smithi080 bash[17386]: audit 2024-02-13T00:26:38.891143+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:40.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:39 smithi080 bash[17386]: audit 2024-02-13T00:26:38.927211+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:26:40.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:39 smithi080 bash[24237]: cluster 2024-02-13T00:26:38.712440+0000 mgr.y (mgr.14146) 170 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:40.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:39 smithi080 bash[24237]: audit 2024-02-13T00:26:38.891143+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:40.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:39 smithi080 bash[24237]: audit 2024-02-13T00:26:38.927211+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:26:42.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:41 smithi106 bash[18459]: cluster 2024-02-13T00:26:40.712752+0000 mgr.y (mgr.14146) 171 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:42.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:41 smithi080 bash[17386]: cluster 2024-02-13T00:26:40.712752+0000 mgr.y (mgr.14146) 171 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:42.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:41 smithi080 bash[24237]: cluster 2024-02-13T00:26:40.712752+0000 mgr.y (mgr.14146) 171 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:44.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:43 smithi106 bash[18459]: cluster 2024-02-13T00:26:42.713214+0000 mgr.y (mgr.14146) 172 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:44.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:43 smithi080 bash[24237]: cluster 2024-02-13T00:26:42.713214+0000 mgr.y (mgr.14146) 172 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:44.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:43 smithi080 bash[17386]: cluster 2024-02-13T00:26:42.713214+0000 mgr.y (mgr.14146) 172 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:46.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:46 smithi080 bash[17386]: cluster 2024-02-13T00:26:44.713637+0000 mgr.y (mgr.14146) 173 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:46.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:46 smithi080 bash[17386]: audit 2024-02-13T00:26:45.128441+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:46.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:46 smithi080 bash[17386]: audit 2024-02-13T00:26:45.129801+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:26:46.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:46 smithi080 bash[17386]: audit 2024-02-13T00:26:45.130817+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:26:46.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:46 smithi080 bash[17386]: audit 2024-02-13T00:26:45.137017+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:46.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:46 smithi080 bash[17386]: audit 2024-02-13T00:26:45.614538+0000 mon.a (mon.0) 354 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/3260371152,v1:172.21.15.80:6827/3260371152]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-13T00:26:46.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:46 smithi080 bash[24237]: cluster 2024-02-13T00:26:44.713637+0000 mgr.y (mgr.14146) 173 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:46.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:46 smithi080 bash[24237]: audit 2024-02-13T00:26:45.128441+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:46.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:46 smithi080 bash[24237]: audit 2024-02-13T00:26:45.129801+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:26:46.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:46 smithi080 bash[24237]: audit 2024-02-13T00:26:45.130817+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:26:46.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:46 smithi080 bash[24237]: audit 2024-02-13T00:26:45.137017+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:46.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:46 smithi080 bash[24237]: audit 2024-02-13T00:26:45.614538+0000 mon.a (mon.0) 354 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/3260371152,v1:172.21.15.80:6827/3260371152]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-13T00:26:46.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:46 smithi106 bash[18459]: cluster 2024-02-13T00:26:44.713637+0000 mgr.y (mgr.14146) 173 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:46.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:46 smithi106 bash[18459]: audit 2024-02-13T00:26:45.128441+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:46.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:46 smithi106 bash[18459]: audit 2024-02-13T00:26:45.129801+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:26:46.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:46 smithi106 bash[18459]: audit 2024-02-13T00:26:45.130817+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:26:46.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:46 smithi106 bash[18459]: audit 2024-02-13T00:26:45.137017+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:46.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:46 smithi106 bash[18459]: audit 2024-02-13T00:26:45.614538+0000 mon.a (mon.0) 354 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/3260371152,v1:172.21.15.80:6827/3260371152]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-13T00:26:47.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:47 smithi106 bash[18459]: audit 2024-02-13T00:26:46.254598+0000 mon.a (mon.0) 355 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/3260371152,v1:172.21.15.80:6827/3260371152]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-13T00:26:47.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:47 smithi106 bash[18459]: cluster 2024-02-13T00:26:46.254685+0000 mon.a (mon.0) 356 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-02-13T00:26:47.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:47 smithi106 bash[18459]: audit 2024-02-13T00:26:46.254864+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T00:26:47.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:47 smithi106 bash[18459]: audit 2024-02-13T00:26:46.255478+0000 mon.a (mon.0) 358 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/3260371152,v1:172.21.15.80:6827/3260371152]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-13T00:26:47.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:47 smithi106 bash[18459]: cluster 2024-02-13T00:26:46.714085+0000 mgr.y (mgr.14146) 174 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:47.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:47 smithi080 bash[24237]: audit 2024-02-13T00:26:46.254598+0000 mon.a (mon.0) 355 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/3260371152,v1:172.21.15.80:6827/3260371152]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-13T00:26:47.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:47 smithi080 bash[24237]: cluster 2024-02-13T00:26:46.254685+0000 mon.a (mon.0) 356 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-02-13T00:26:47.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:47 smithi080 bash[24237]: audit 2024-02-13T00:26:46.254864+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T00:26:47.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:47 smithi080 bash[24237]: audit 2024-02-13T00:26:46.255478+0000 mon.a (mon.0) 358 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/3260371152,v1:172.21.15.80:6827/3260371152]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-13T00:26:47.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:47 smithi080 bash[24237]: cluster 2024-02-13T00:26:46.714085+0000 mgr.y (mgr.14146) 174 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:47.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:47 smithi080 bash[17386]: audit 2024-02-13T00:26:46.254598+0000 mon.a (mon.0) 355 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/3260371152,v1:172.21.15.80:6827/3260371152]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-13T00:26:47.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:47 smithi080 bash[17386]: cluster 2024-02-13T00:26:46.254685+0000 mon.a (mon.0) 356 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-02-13T00:26:47.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:47 smithi080 bash[17386]: audit 2024-02-13T00:26:46.254864+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T00:26:47.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:47 smithi080 bash[17386]: audit 2024-02-13T00:26:46.255478+0000 mon.a (mon.0) 358 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/3260371152,v1:172.21.15.80:6827/3260371152]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-13T00:26:47.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:47 smithi080 bash[17386]: cluster 2024-02-13T00:26:46.714085+0000 mgr.y (mgr.14146) 174 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-13T00:26:48.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:48 smithi080 bash[17386]: audit 2024-02-13T00:26:47.263370+0000 mon.a (mon.0) 359 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/3260371152,v1:172.21.15.80:6827/3260371152]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-13T00:26:48.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:48 smithi080 bash[17386]: cluster 2024-02-13T00:26:47.263429+0000 mon.a (mon.0) 360 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-02-13T00:26:48.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:48 smithi080 bash[17386]: audit 2024-02-13T00:26:47.263771+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T00:26:48.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:48 smithi080 bash[17386]: audit 2024-02-13T00:26:47.268234+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T00:26:48.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:48 smithi080 bash[24237]: audit 2024-02-13T00:26:47.263370+0000 mon.a (mon.0) 359 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/3260371152,v1:172.21.15.80:6827/3260371152]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-13T00:26:48.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:48 smithi080 bash[24237]: cluster 2024-02-13T00:26:47.263429+0000 mon.a (mon.0) 360 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-02-13T00:26:48.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:48 smithi080 bash[24237]: audit 2024-02-13T00:26:47.263771+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T00:26:48.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:48 smithi080 bash[24237]: audit 2024-02-13T00:26:47.268234+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T00:26:48.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:48.574+0000 7fddf97fa700 1 -- 172.21.15.80:0/805223089 <== mgr.14146 v2:172.21.15.80:6800/461193090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fdde8000bf0 con 0x7fdde4061280 2024-02-13T00:26:48.584 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 3 on host 'smithi080' 2024-02-13T00:26:48.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:48.578+0000 7fde024cb700 1 -- 172.21.15.80:0/805223089 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fdde4061280 msgr2=0x7fdde4063740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:26:48.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:48.578+0000 7fde024cb700 1 --2- 172.21.15.80:0/805223089 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fdde4061280 0x7fdde4063740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fddfc108100 tx=0x7fddec00b040).stop 2024-02-13T00:26:48.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:48.578+0000 7fde024cb700 1 -- 172.21.15.80:0/805223089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddfc0f8620 msgr2=0x7fddfc10e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:26:48.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:48.578+0000 7fde024cb700 1 --2- 172.21.15.80:0/805223089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddfc0f8620 0x7fddfc10e1a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fddf40049a0 tx=0x7fddf4004c50).stop 2024-02-13T00:26:48.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:48.578+0000 7fde024cb700 1 -- 172.21.15.80:0/805223089 shutdown_connections 2024-02-13T00:26:48.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:48.578+0000 7fde024cb700 1 --2- 172.21.15.80:0/805223089 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fdde4061280 0x7fdde4063740 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:26:48.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:48.578+0000 7fde024cb700 1 --2- 172.21.15.80:0/805223089 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddfc0f6a30 0x7fddfc106c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:26:48.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:48.578+0000 7fde024cb700 1 --2- 172.21.15.80:0/805223089 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fddfc0f8620 0x7fddfc10e1a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:26:48.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:48.578+0000 7fde024cb700 1 --2- 172.21.15.80:0/805223089 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fddfc0f7cd0 0x7fddfc107100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:26:48.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:48.578+0000 7fde024cb700 1 -- 172.21.15.80:0/805223089 >> 172.21.15.80:0/805223089 conn(0x7fddfc0f2230 msgr2=0x7fddfc0faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:26:48.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:48.578+0000 7fde024cb700 1 -- 172.21.15.80:0/805223089 shutdown_connections 2024-02-13T00:26:48.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:26:48.578+0000 7fde024cb700 1 -- 172.21.15.80:0/805223089 wait complete. 2024-02-13T00:26:48.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:48 smithi106 bash[18459]: audit 2024-02-13T00:26:47.263370+0000 mon.a (mon.0) 359 : audit [INF] from='osd.3 [v2:172.21.15.80:6826/3260371152,v1:172.21.15.80:6827/3260371152]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-13T00:26:48.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:48 smithi106 bash[18459]: cluster 2024-02-13T00:26:47.263429+0000 mon.a (mon.0) 360 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-02-13T00:26:48.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:48 smithi106 bash[18459]: audit 2024-02-13T00:26:47.263771+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T00:26:48.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:48 smithi106 bash[18459]: audit 2024-02-13T00:26:47.268234+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T00:26:49.426 DEBUG:teuthology.orchestra.run.smithi080:osd.3> sudo journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.3.service 2024-02-13T00:26:49.428 INFO:tasks.cephadm:Deploying osd.4 on smithi106 with /dev/vg_nvme/lv_4... 2024-02-13T00:26:49.429 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-13T00:26:49.489 INFO:journalctl@ceph.osd.3.smithi080.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-13T00:26:49.623 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:49 smithi106 bash[18459]: cluster 2024-02-13T00:26:46.567131+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:26:49.624 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:49 smithi106 bash[18459]: cluster 2024-02-13T00:26:46.567222+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:26:49.624 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:49 smithi106 bash[18459]: cluster 2024-02-13T00:26:48.266040+0000 mon.a (mon.0) 363 : cluster [INF] osd.3 [v2:172.21.15.80:6826/3260371152,v1:172.21.15.80:6827/3260371152] boot 2024-02-13T00:26:49.624 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:49 smithi106 bash[18459]: cluster 2024-02-13T00:26:48.266120+0000 mon.a (mon.0) 364 : cluster [DBG] osdmap e25: 4 total, 4 up, 4 in 2024-02-13T00:26:49.624 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:49 smithi106 bash[18459]: audit 2024-02-13T00:26:48.266881+0000 mon.a (mon.0) 365 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T00:26:49.624 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:49 smithi106 bash[18459]: audit 2024-02-13T00:26:48.578264+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:49.624 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:49 smithi106 bash[18459]: audit 2024-02-13T00:26:48.612814+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:26:49.624 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:49 smithi106 bash[18459]: cluster 2024-02-13T00:26:48.714603+0000 mgr.y (mgr.14146) 175 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:26:49.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:49 smithi080 bash[24237]: cluster 2024-02-13T00:26:46.567131+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:26:49.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:49 smithi080 bash[24237]: cluster 2024-02-13T00:26:46.567222+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:26:49.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:49 smithi080 bash[24237]: cluster 2024-02-13T00:26:48.266040+0000 mon.a (mon.0) 363 : cluster [INF] osd.3 [v2:172.21.15.80:6826/3260371152,v1:172.21.15.80:6827/3260371152] boot 2024-02-13T00:26:49.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:49 smithi080 bash[24237]: cluster 2024-02-13T00:26:48.266120+0000 mon.a (mon.0) 364 : cluster [DBG] osdmap e25: 4 total, 4 up, 4 in 2024-02-13T00:26:49.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:49 smithi080 bash[24237]: audit 2024-02-13T00:26:48.266881+0000 mon.a (mon.0) 365 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T00:26:49.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:49 smithi080 bash[24237]: audit 2024-02-13T00:26:48.578264+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:49.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:49 smithi080 bash[24237]: audit 2024-02-13T00:26:48.612814+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:26:49.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:49 smithi080 bash[24237]: cluster 2024-02-13T00:26:48.714603+0000 mgr.y (mgr.14146) 175 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:26:49.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:49 smithi080 bash[17386]: cluster 2024-02-13T00:26:46.567131+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:26:49.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:49 smithi080 bash[17386]: cluster 2024-02-13T00:26:46.567222+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:26:49.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:49 smithi080 bash[17386]: cluster 2024-02-13T00:26:48.266040+0000 mon.a (mon.0) 363 : cluster [INF] osd.3 [v2:172.21.15.80:6826/3260371152,v1:172.21.15.80:6827/3260371152] boot 2024-02-13T00:26:49.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:49 smithi080 bash[17386]: cluster 2024-02-13T00:26:48.266120+0000 mon.a (mon.0) 364 : cluster [DBG] osdmap e25: 4 total, 4 up, 4 in 2024-02-13T00:26:49.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:49 smithi080 bash[17386]: audit 2024-02-13T00:26:48.266881+0000 mon.a (mon.0) 365 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T00:26:49.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:49 smithi080 bash[17386]: audit 2024-02-13T00:26:48.578264+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:49.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:49 smithi080 bash[17386]: audit 2024-02-13T00:26:48.612814+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:26:49.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:49 smithi080 bash[17386]: cluster 2024-02-13T00:26:48.714603+0000 mgr.y (mgr.14146) 175 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:26:50.754 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:50 smithi106 bash[18459]: cluster 2024-02-13T00:26:49.587815+0000 mon.a (mon.0) 368 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-13T00:26:51.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:50 smithi080 bash[24237]: cluster 2024-02-13T00:26:49.587815+0000 mon.a (mon.0) 368 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-13T00:26:51.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:50 smithi080 bash[17386]: cluster 2024-02-13T00:26:49.587815+0000 mon.a (mon.0) 368 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-13T00:26:51.865 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:51 smithi106 bash[18459]: cluster 2024-02-13T00:26:50.715093+0000 mgr.y (mgr.14146) 176 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:26:52.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:51 smithi080 bash[17386]: cluster 2024-02-13T00:26:50.715093+0000 mgr.y (mgr.14146) 176 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:26:52.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:51 smithi080 bash[24237]: cluster 2024-02-13T00:26:50.715093+0000 mgr.y (mgr.14146) 176 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:26:52.563 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-13T00:26:52.564 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-13T00:26:52.564 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10+0 records in 2024-02-13T00:26:52.564 INFO:teuthology.orchestra.run.smithi106.stderr:10+0 records out 2024-02-13T00:26:52.564 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0172331 s, 608 MB/s 2024-02-13T00:26:52.564 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping successful for: 2024-02-13T00:26:53.252 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi106:vg_nvme/lv_4 2024-02-13T00:26:54.180 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:53 smithi106 bash[18459]: cluster 2024-02-13T00:26:52.715614+0000 mgr.y (mgr.14146) 177 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:26:54.220 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:53 smithi080 bash[17386]: cluster 2024-02-13T00:26:52.715614+0000 mgr.y (mgr.14146) 177 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:26:54.221 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:53 smithi080 bash[24237]: cluster 2024-02-13T00:26:52.715614+0000 mgr.y (mgr.14146) 177 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:26:55.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:55 smithi080 bash[17386]: cluster 2024-02-13T00:26:54.716176+0000 mgr.y (mgr.14146) 178 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:26:55.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:55 smithi080 bash[24237]: cluster 2024-02-13T00:26:54.716176+0000 mgr.y (mgr.14146) 178 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:26:55.614 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:55 smithi106 bash[18459]: cluster 2024-02-13T00:26:54.716176+0000 mgr.y (mgr.14146) 178 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:26:55.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.772+0000 7fa1e2b59700 1 -- 172.21.15.106:0/1637783548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1dc0fac70 msgr2=0x7fa1dc0fd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:26:55.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.772+0000 7fa1e2b59700 1 --2- 172.21.15.106:0/1637783548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1dc0fac70 0x7fa1dc0fd060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fa1d0004870 tx=0x7fa1d0009cb0).stop 2024-02-13T00:26:55.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.772+0000 7fa1e2b59700 1 -- 172.21.15.106:0/1637783548 shutdown_connections 2024-02-13T00:26:55.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.772+0000 7fa1e2b59700 1 --2- 172.21.15.106:0/1637783548 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1dc0fd720 0x7fa1dc0ffb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:26:55.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.772+0000 7fa1e2b59700 1 --2- 172.21.15.106:0/1637783548 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1dc061c60 0x7fa1dc0fa780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:26:55.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.772+0000 7fa1e2b59700 1 --2- 172.21.15.106:0/1637783548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1dc0fac70 0x7fa1dc0fd060 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:26:55.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.772+0000 7fa1e2b59700 1 -- 172.21.15.106:0/1637783548 >> 172.21.15.106:0/1637783548 conn(0x7fa1dc0f2220 msgr2=0x7fa1dc0f4640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:26:55.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.772+0000 7fa1e2b59700 1 -- 172.21.15.106:0/1637783548 shutdown_connections 2024-02-13T00:26:55.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.772+0000 7fa1e2b59700 1 -- 172.21.15.106:0/1637783548 wait complete. 2024-02-13T00:26:55.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1e2b59700 1 Processor -- start 2024-02-13T00:26:55.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1e2b59700 1 -- start start 2024-02-13T00:26:55.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1e2b59700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1dc061c60 0x7fa1dc107f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:26:55.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1e2b59700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1dc0fac70 0x7fa1dc108480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:26:55.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1e2b59700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1dc0fd720 0x7fa1dc10f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:26:55.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1e2b59700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc10fa50 con 0x7fa1dc0fac70 2024-02-13T00:26:55.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1e2b59700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc10fb90 con 0x7fa1dc0fd720 2024-02-13T00:26:55.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1e2b59700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc10fcd0 con 0x7fa1dc061c60 2024-02-13T00:26:55.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1e10f6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1dc0fd720 0x7fa1dc10f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:26:55.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1dbfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1dc0fac70 0x7fa1dc108480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:26:55.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1e10f6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1dc0fd720 0x7fa1dc10f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37552/0 (socket says 172.21.15.106:37552) 2024-02-13T00:26:55.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1e08f5700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1dc061c60 0x7fa1dc107f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:26:55.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1e10f6700 1 -- 172.21.15.106:0/2911026367 learned_addr learned my addr 172.21.15.106:0/2911026367 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-02-13T00:26:55.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1e10f6700 1 -- 172.21.15.106:0/2911026367 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1dc061c60 msgr2=0x7fa1dc107f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:26:55.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1e10f6700 1 --2- 172.21.15.106:0/2911026367 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1dc061c60 0x7fa1dc107f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:26:55.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1e10f6700 1 -- 172.21.15.106:0/2911026367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1dc0fac70 msgr2=0x7fa1dc108480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:26:55.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1e10f6700 1 --2- 172.21.15.106:0/2911026367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1dc0fac70 0x7fa1dc108480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:26:55.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1e10f6700 1 -- 172.21.15.106:0/2911026367 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d0005040 con 0x7fa1dc0fd720 2024-02-13T00:26:55.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1e08f5700 1 --2- 172.21.15.106:0/2911026367 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1dc061c60 0x7fa1dc107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:26:55.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1dbfff700 1 --2- 172.21.15.106:0/2911026367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1dc0fac70 0x7fa1dc108480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:26:55.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1e10f6700 1 --2- 172.21.15.106:0/2911026367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1dc0fd720 0x7fa1dc10f560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fa1d400e910 tx=0x7fa1d400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:26:55.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1d9ffb700 1 -- 172.21.15.106:0/2911026367 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4004680 con 0x7fa1dc0fd720 2024-02-13T00:26:55.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1d9ffb700 1 -- 172.21.15.106:0/2911026367 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fa1d400f040 con 0x7fa1dc0fd720 2024-02-13T00:26:55.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1e2b59700 1 -- 172.21.15.106:0/2911026367 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1dc10ff50 con 0x7fa1dc0fd720 2024-02-13T00:26:55.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1d9ffb700 1 -- 172.21.15.106:0/2911026367 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d40146f0 con 0x7fa1dc0fd720 2024-02-13T00:26:55.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.776+0000 7fa1e2b59700 1 -- 172.21.15.106:0/2911026367 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1dc110480 con 0x7fa1dc0fd720 2024-02-13T00:26:55.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.780+0000 7fa1d9ffb700 1 -- 172.21.15.106:0/2911026367 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 14) v1 ==== 77064+0+0 (secure 0 0 0) 0x7fa1d40090d0 con 0x7fa1dc0fd720 2024-02-13T00:26:55.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.780+0000 7fa1e2b59700 1 -- 172.21.15.106:0/2911026367 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1dc060070 con 0x7fa1dc0fd720 2024-02-13T00:26:55.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.780+0000 7fa1d9ffb700 1 --2- 172.21.15.106:0/2911026367 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fa1c4061120 0x7fa1c40635e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:26:55.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.780+0000 7fa1d9ffb700 1 -- 172.21.15.106:0/2911026367 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 3422+0+0 (secure 0 0 0) 0x7fa1d407f120 con 0x7fa1dc0fd720 2024-02-13T00:26:55.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.780+0000 7fa1e08f5700 1 --2- 172.21.15.106:0/2911026367 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fa1c4061120 0x7fa1c40635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:26:55.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.780+0000 7fa1e08f5700 1 --2- 172.21.15.106:0/2911026367 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fa1c4061120 0x7fa1c40635e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fa1cc007fd0 tx=0x7fa1cc007d70).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:26:55.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.788+0000 7fa1d9ffb700 1 -- 172.21.15.106:0/2911026367 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa1d4081060 con 0x7fa1dc0fd720 2024-02-13T00:26:55.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:26:55.976+0000 7fa1e2b59700 1 -- 172.21.15.106:0/2911026367 --> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1dc1027e0 con 0x7fa1c4061120 2024-02-13T00:26:56.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:56 smithi080 bash[17386]: audit 2024-02-13T00:26:55.979877+0000 mgr.y (mgr.14146) 179 : audit [DBG] from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:26:56.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:56 smithi080 bash[17386]: audit 2024-02-13T00:26:55.983445+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:26:56.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:56 smithi080 bash[17386]: audit 2024-02-13T00:26:55.987654+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:26:56.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:56 smithi080 bash[17386]: audit 2024-02-13T00:26:55.989124+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:26:56.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:56 smithi080 bash[24237]: audit 2024-02-13T00:26:55.979877+0000 mgr.y (mgr.14146) 179 : audit [DBG] from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:26:56.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:56 smithi080 bash[24237]: audit 2024-02-13T00:26:55.983445+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:26:56.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:56 smithi080 bash[24237]: audit 2024-02-13T00:26:55.987654+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:26:56.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:56 smithi080 bash[24237]: audit 2024-02-13T00:26:55.989124+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:26:56.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:56 smithi106 bash[18459]: audit 2024-02-13T00:26:55.979877+0000 mgr.y (mgr.14146) 179 : audit [DBG] from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:26:56.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:56 smithi106 bash[18459]: audit 2024-02-13T00:26:55.983445+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:26:56.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:56 smithi106 bash[18459]: audit 2024-02-13T00:26:55.987654+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:26:56.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:56 smithi106 bash[18459]: audit 2024-02-13T00:26:55.989124+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:26:57.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:57 smithi080 bash[17386]: cluster 2024-02-13T00:26:56.716718+0000 mgr.y (mgr.14146) 180 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:26:57.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:57 smithi080 bash[24237]: cluster 2024-02-13T00:26:56.716718+0000 mgr.y (mgr.14146) 180 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:26:57.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:57 smithi106 bash[18459]: cluster 2024-02-13T00:26:56.716718+0000 mgr.y (mgr.14146) 180 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:26:59.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:59 smithi106 bash[18459]: cephadm 2024-02-13T00:26:58.048093+0000 mgr.y (mgr.14146) 181 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-13T00:26:59.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:59 smithi106 bash[18459]: audit 2024-02-13T00:26:58.058240+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:59.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:59 smithi106 bash[18459]: audit 2024-02-13T00:26:58.059783+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:26:59.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:59 smithi106 bash[18459]: audit 2024-02-13T00:26:58.061024+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:26:59.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:59 smithi106 bash[18459]: audit 2024-02-13T00:26:58.062205+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:26:59.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:59 smithi106 bash[18459]: audit 2024-02-13T00:26:58.063279+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:26:59.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:59 smithi106 bash[18459]: cephadm 2024-02-13T00:26:58.064003+0000 mgr.y (mgr.14146) 182 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 4060M 2024-02-13T00:26:59.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:59 smithi106 bash[18459]: audit 2024-02-13T00:26:58.068758+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:59.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:59 smithi106 bash[18459]: audit 2024-02-13T00:26:58.071434+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:26:59.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:59 smithi106 bash[18459]: audit 2024-02-13T00:26:58.072679+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:26:59.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:26:59 smithi106 bash[18459]: audit 2024-02-13T00:26:58.078755+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:59.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:59 smithi080 bash[17386]: cephadm 2024-02-13T00:26:58.048093+0000 mgr.y (mgr.14146) 181 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-13T00:26:59.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:59 smithi080 bash[17386]: audit 2024-02-13T00:26:58.058240+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:59.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:59 smithi080 bash[17386]: audit 2024-02-13T00:26:58.059783+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:26:59.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:59 smithi080 bash[17386]: audit 2024-02-13T00:26:58.061024+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:26:59.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:59 smithi080 bash[17386]: audit 2024-02-13T00:26:58.062205+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:26:59.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:59 smithi080 bash[17386]: audit 2024-02-13T00:26:58.063279+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:26:59.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:59 smithi080 bash[17386]: cephadm 2024-02-13T00:26:58.064003+0000 mgr.y (mgr.14146) 182 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 4060M 2024-02-13T00:26:59.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:59 smithi080 bash[17386]: audit 2024-02-13T00:26:58.068758+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:59.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:59 smithi080 bash[17386]: audit 2024-02-13T00:26:58.071434+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:26:59.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:59 smithi080 bash[17386]: audit 2024-02-13T00:26:58.072679+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:26:59.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:26:59 smithi080 bash[17386]: audit 2024-02-13T00:26:58.078755+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:59.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:59 smithi080 bash[24237]: cephadm 2024-02-13T00:26:58.048093+0000 mgr.y (mgr.14146) 181 : cephadm [INF] Detected new or changed devices on smithi080 2024-02-13T00:26:59.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:59 smithi080 bash[24237]: audit 2024-02-13T00:26:58.058240+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:59.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:59 smithi080 bash[24237]: audit 2024-02-13T00:26:58.059783+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:26:59.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:59 smithi080 bash[24237]: audit 2024-02-13T00:26:58.061024+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:26:59.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:59 smithi080 bash[24237]: audit 2024-02-13T00:26:58.062205+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:26:59.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:59 smithi080 bash[24237]: audit 2024-02-13T00:26:58.063279+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:26:59.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:59 smithi080 bash[24237]: cephadm 2024-02-13T00:26:58.064003+0000 mgr.y (mgr.14146) 182 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 4060M 2024-02-13T00:26:59.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:59 smithi080 bash[24237]: audit 2024-02-13T00:26:58.068758+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:26:59.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:59 smithi080 bash[24237]: audit 2024-02-13T00:26:58.071434+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:26:59.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:59 smithi080 bash[24237]: audit 2024-02-13T00:26:58.072679+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:26:59.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:26:59 smithi080 bash[24237]: audit 2024-02-13T00:26:58.078755+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:27:00.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:00 smithi106 bash[18459]: cluster 2024-02-13T00:26:58.717339+0000 mgr.y (mgr.14146) 183 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:00.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:00 smithi080 bash[17386]: cluster 2024-02-13T00:26:58.717339+0000 mgr.y (mgr.14146) 183 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:00.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:00 smithi080 bash[24237]: cluster 2024-02-13T00:26:58.717339+0000 mgr.y (mgr.14146) 183 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:02.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:02 smithi106 bash[18459]: cluster 2024-02-13T00:27:00.717990+0000 mgr.y (mgr.14146) 184 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:02.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:02 smithi080 bash[17386]: cluster 2024-02-13T00:27:00.717990+0000 mgr.y (mgr.14146) 184 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:02.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:02 smithi080 bash[24237]: cluster 2024-02-13T00:27:00.717990+0000 mgr.y (mgr.14146) 184 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:04.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:04 smithi106 bash[18459]: cluster 2024-02-13T00:27:02.718682+0000 mgr.y (mgr.14146) 185 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:04 smithi106 bash[18459]: audit 2024-02-13T00:27:03.968793+0000 mon.a (mon.0) 381 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "51181b93-78b9-4cb8-954e-1f25ef19518d"}]: dispatch 2024-02-13T00:27:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:04 smithi106 bash[18459]: audit 2024-02-13T00:27:03.970304+0000 mon.b (mon.1) 7 : audit [INF] from='client.? 172.21.15.106:0/2596354430' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "51181b93-78b9-4cb8-954e-1f25ef19518d"}]: dispatch 2024-02-13T00:27:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:04 smithi106 bash[18459]: audit 2024-02-13T00:27:03.978085+0000 mon.a (mon.0) 382 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "51181b93-78b9-4cb8-954e-1f25ef19518d"}]': finished 2024-02-13T00:27:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:04 smithi106 bash[18459]: cluster 2024-02-13T00:27:03.978427+0000 mon.a (mon.0) 383 : cluster [DBG] osdmap e27: 5 total, 4 up, 5 in 2024-02-13T00:27:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:04 smithi106 bash[18459]: audit 2024-02-13T00:27:03.978687+0000 mon.a (mon.0) 384 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T00:27:04.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:04 smithi080 bash[17386]: cluster 2024-02-13T00:27:02.718682+0000 mgr.y (mgr.14146) 185 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:04.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:04 smithi080 bash[17386]: audit 2024-02-13T00:27:03.968793+0000 mon.a (mon.0) 381 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "51181b93-78b9-4cb8-954e-1f25ef19518d"}]: dispatch 2024-02-13T00:27:04.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:04 smithi080 bash[17386]: audit 2024-02-13T00:27:03.970304+0000 mon.b (mon.1) 7 : audit [INF] from='client.? 172.21.15.106:0/2596354430' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "51181b93-78b9-4cb8-954e-1f25ef19518d"}]: dispatch 2024-02-13T00:27:04.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:04 smithi080 bash[17386]: audit 2024-02-13T00:27:03.978085+0000 mon.a (mon.0) 382 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "51181b93-78b9-4cb8-954e-1f25ef19518d"}]': finished 2024-02-13T00:27:04.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:04 smithi080 bash[17386]: cluster 2024-02-13T00:27:03.978427+0000 mon.a (mon.0) 383 : cluster [DBG] osdmap e27: 5 total, 4 up, 5 in 2024-02-13T00:27:04.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:04 smithi080 bash[17386]: audit 2024-02-13T00:27:03.978687+0000 mon.a (mon.0) 384 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T00:27:04.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:04 smithi080 bash[24237]: cluster 2024-02-13T00:27:02.718682+0000 mgr.y (mgr.14146) 185 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:04.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:04 smithi080 bash[24237]: audit 2024-02-13T00:27:03.968793+0000 mon.a (mon.0) 381 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "51181b93-78b9-4cb8-954e-1f25ef19518d"}]: dispatch 2024-02-13T00:27:04.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:04 smithi080 bash[24237]: audit 2024-02-13T00:27:03.970304+0000 mon.b (mon.1) 7 : audit [INF] from='client.? 172.21.15.106:0/2596354430' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "51181b93-78b9-4cb8-954e-1f25ef19518d"}]: dispatch 2024-02-13T00:27:04.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:04 smithi080 bash[24237]: audit 2024-02-13T00:27:03.978085+0000 mon.a (mon.0) 382 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "51181b93-78b9-4cb8-954e-1f25ef19518d"}]': finished 2024-02-13T00:27:04.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:04 smithi080 bash[24237]: cluster 2024-02-13T00:27:03.978427+0000 mon.a (mon.0) 383 : cluster [DBG] osdmap e27: 5 total, 4 up, 5 in 2024-02-13T00:27:04.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:04 smithi080 bash[24237]: audit 2024-02-13T00:27:03.978687+0000 mon.a (mon.0) 384 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T00:27:05.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:05 smithi106 bash[18459]: audit 2024-02-13T00:27:04.645592+0000 mon.b (mon.1) 8 : audit [DBG] from='client.? 172.21.15.106:0/494119735' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:27:05.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:05 smithi106 bash[18459]: cluster 2024-02-13T00:27:04.719276+0000 mgr.y (mgr.14146) 186 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:05.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:05 smithi080 bash[17386]: audit 2024-02-13T00:27:04.645592+0000 mon.b (mon.1) 8 : audit [DBG] from='client.? 172.21.15.106:0/494119735' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:27:05.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:05 smithi080 bash[17386]: cluster 2024-02-13T00:27:04.719276+0000 mgr.y (mgr.14146) 186 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:05.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:05 smithi080 bash[24237]: audit 2024-02-13T00:27:04.645592+0000 mon.b (mon.1) 8 : audit [DBG] from='client.? 172.21.15.106:0/494119735' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:27:05.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:05 smithi080 bash[24237]: cluster 2024-02-13T00:27:04.719276+0000 mgr.y (mgr.14146) 186 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:08.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:07 smithi106 bash[18459]: cluster 2024-02-13T00:27:06.719820+0000 mgr.y (mgr.14146) 187 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:08.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:07 smithi080 bash[17386]: cluster 2024-02-13T00:27:06.719820+0000 mgr.y (mgr.14146) 187 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:08.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:07 smithi080 bash[24237]: cluster 2024-02-13T00:27:06.719820+0000 mgr.y (mgr.14146) 187 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:10.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:09 smithi106 bash[18459]: cluster 2024-02-13T00:27:08.720370+0000 mgr.y (mgr.14146) 188 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:10.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:09 smithi080 bash[24237]: cluster 2024-02-13T00:27:08.720370+0000 mgr.y (mgr.14146) 188 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:10.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:09 smithi080 bash[17386]: cluster 2024-02-13T00:27:08.720370+0000 mgr.y (mgr.14146) 188 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:12.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:11 smithi106 bash[18459]: cluster 2024-02-13T00:27:10.720917+0000 mgr.y (mgr.14146) 189 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:12.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:11 smithi080 bash[24237]: cluster 2024-02-13T00:27:10.720917+0000 mgr.y (mgr.14146) 189 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:12.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:11 smithi080 bash[17386]: cluster 2024-02-13T00:27:10.720917+0000 mgr.y (mgr.14146) 189 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:13 smithi106 bash[18459]: cluster 2024-02-13T00:27:12.721459+0000 mgr.y (mgr.14146) 190 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:14.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:13 smithi080 bash[24237]: cluster 2024-02-13T00:27:12.721459+0000 mgr.y (mgr.14146) 190 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:14.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:13 smithi080 bash[17386]: cluster 2024-02-13T00:27:12.721459+0000 mgr.y (mgr.14146) 190 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:15.634 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:15 smithi106 bash[18459]: cluster 2024-02-13T00:27:14.722025+0000 mgr.y (mgr.14146) 191 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:15.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:15 smithi080 bash[17386]: cluster 2024-02-13T00:27:14.722025+0000 mgr.y (mgr.14146) 191 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:15.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:15 smithi080 bash[24237]: cluster 2024-02-13T00:27:14.722025+0000 mgr.y (mgr.14146) 191 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:16.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:16 smithi106 bash[18459]: audit 2024-02-13T00:27:16.127345+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-13T00:27:16.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:16 smithi106 bash[18459]: audit 2024-02-13T00:27:16.129068+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:27:16.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:16 smithi106 bash[18459]: cephadm 2024-02-13T00:27:16.130529+0000 mgr.y (mgr.14146) 192 : cephadm [INF] Deploying daemon osd.4 on smithi106 2024-02-13T00:27:16.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:16 smithi080 bash[17386]: audit 2024-02-13T00:27:16.127345+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-13T00:27:16.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:16 smithi080 bash[17386]: audit 2024-02-13T00:27:16.129068+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:27:16.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:16 smithi080 bash[17386]: cephadm 2024-02-13T00:27:16.130529+0000 mgr.y (mgr.14146) 192 : cephadm [INF] Deploying daemon osd.4 on smithi106 2024-02-13T00:27:16.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:16 smithi080 bash[24237]: audit 2024-02-13T00:27:16.127345+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-13T00:27:16.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:16 smithi080 bash[24237]: audit 2024-02-13T00:27:16.129068+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:27:16.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:16 smithi080 bash[24237]: cephadm 2024-02-13T00:27:16.130529+0000 mgr.y (mgr.14146) 192 : cephadm [INF] Deploying daemon osd.4 on smithi106 2024-02-13T00:27:17.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:17 smithi106 bash[18459]: cluster 2024-02-13T00:27:16.722577+0000 mgr.y (mgr.14146) 193 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:17.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:17 smithi080 bash[17386]: cluster 2024-02-13T00:27:16.722577+0000 mgr.y (mgr.14146) 193 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:17.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:17 smithi080 bash[24237]: cluster 2024-02-13T00:27:16.722577+0000 mgr.y (mgr.14146) 193 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:19.908 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:19 smithi106 bash[18459]: cluster 2024-02-13T00:27:18.723085+0000 mgr.y (mgr.14146) 194 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:20.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:19 smithi080 bash[24237]: cluster 2024-02-13T00:27:18.723085+0000 mgr.y (mgr.14146) 194 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:20.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:19 smithi080 bash[17386]: cluster 2024-02-13T00:27:18.723085+0000 mgr.y (mgr.14146) 194 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:21.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:21 smithi106 bash[18459]: audit 2024-02-13T00:27:20.151359+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:27:21.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:21 smithi106 bash[18459]: audit 2024-02-13T00:27:20.161837+0000 mon.a (mon.0) 388 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:27:21.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:21 smithi080 bash[17386]: audit 2024-02-13T00:27:20.151359+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:27:21.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:21 smithi080 bash[17386]: audit 2024-02-13T00:27:20.161837+0000 mon.a (mon.0) 388 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:27:21.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:21 smithi080 bash[24237]: audit 2024-02-13T00:27:20.151359+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:27:21.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:21 smithi080 bash[24237]: audit 2024-02-13T00:27:20.161837+0000 mon.a (mon.0) 388 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:27:22.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:22 smithi106 bash[18459]: cluster 2024-02-13T00:27:20.723621+0000 mgr.y (mgr.14146) 195 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:22.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:22 smithi080 bash[17386]: cluster 2024-02-13T00:27:20.723621+0000 mgr.y (mgr.14146) 195 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:22.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:22 smithi080 bash[24237]: cluster 2024-02-13T00:27:20.723621+0000 mgr.y (mgr.14146) 195 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:23.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:23 smithi106 bash[18459]: cluster 2024-02-13T00:27:22.724166+0000 mgr.y (mgr.14146) 196 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:23.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:23 smithi080 bash[17386]: cluster 2024-02-13T00:27:22.724166+0000 mgr.y (mgr.14146) 196 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:23.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:23 smithi080 bash[24237]: cluster 2024-02-13T00:27:22.724166+0000 mgr.y (mgr.14146) 196 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:25.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:25 smithi106 bash[18459]: cluster 2024-02-13T00:27:24.724658+0000 mgr.y (mgr.14146) 197 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:25.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:25 smithi106 bash[18459]: audit 2024-02-13T00:27:25.205598+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:27:25.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:25 smithi080 bash[17386]: cluster 2024-02-13T00:27:24.724658+0000 mgr.y (mgr.14146) 197 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:25.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:25 smithi080 bash[17386]: audit 2024-02-13T00:27:25.205598+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:27:25.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:25 smithi080 bash[24237]: cluster 2024-02-13T00:27:24.724658+0000 mgr.y (mgr.14146) 197 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:25.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:25 smithi080 bash[24237]: audit 2024-02-13T00:27:25.205598+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:27:26.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:26 smithi106 bash[18459]: audit 2024-02-13T00:27:25.480734+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:27:26.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:26 smithi106 bash[18459]: audit 2024-02-13T00:27:25.482657+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:27:26.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:26 smithi106 bash[18459]: audit 2024-02-13T00:27:25.491084+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:27:26.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:26 smithi080 bash[24237]: audit 2024-02-13T00:27:25.480734+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:27:26.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:26 smithi080 bash[24237]: audit 2024-02-13T00:27:25.482657+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:27:26.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:26 smithi080 bash[24237]: audit 2024-02-13T00:27:25.491084+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:27:26.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:26 smithi080 bash[17386]: audit 2024-02-13T00:27:25.480734+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:27:26.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:26 smithi080 bash[17386]: audit 2024-02-13T00:27:25.482657+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:27:26.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:26 smithi080 bash[17386]: audit 2024-02-13T00:27:25.491084+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:27:27.559 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:27 smithi106 bash[18459]: cluster 2024-02-13T00:27:26.725162+0000 mgr.y (mgr.14146) 198 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:27.559 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:27 smithi106 bash[18459]: audit 2024-02-13T00:27:26.754326+0000 mon.a (mon.0) 393 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-13T00:27:27.560 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:27 smithi106 bash[18459]: audit 2024-02-13T00:27:26.755872+0000 mon.b (mon.1) 9 : audit [INF] from='osd.4 [v2:172.21.15.106:6800/2755922963,v1:172.21.15.106:6801/2755922963]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-13T00:27:27.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:27 smithi080 bash[17386]: cluster 2024-02-13T00:27:26.725162+0000 mgr.y (mgr.14146) 198 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:27.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:27 smithi080 bash[17386]: audit 2024-02-13T00:27:26.754326+0000 mon.a (mon.0) 393 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-13T00:27:27.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:27 smithi080 bash[17386]: audit 2024-02-13T00:27:26.755872+0000 mon.b (mon.1) 9 : audit [INF] from='osd.4 [v2:172.21.15.106:6800/2755922963,v1:172.21.15.106:6801/2755922963]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-13T00:27:27.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:27 smithi080 bash[24237]: cluster 2024-02-13T00:27:26.725162+0000 mgr.y (mgr.14146) 198 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:27.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:27 smithi080 bash[24237]: audit 2024-02-13T00:27:26.754326+0000 mon.a (mon.0) 393 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-13T00:27:27.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:27 smithi080 bash[24237]: audit 2024-02-13T00:27:26.755872+0000 mon.b (mon.1) 9 : audit [INF] from='osd.4 [v2:172.21.15.106:6800/2755922963,v1:172.21.15.106:6801/2755922963]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-13T00:27:28.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:28 smithi106 bash[18459]: audit 2024-02-13T00:27:27.286125+0000 mon.a (mon.0) 394 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-13T00:27:28.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:28 smithi106 bash[18459]: cluster 2024-02-13T00:27:27.286244+0000 mon.a (mon.0) 395 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-02-13T00:27:28.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:28 smithi106 bash[18459]: audit 2024-02-13T00:27:27.286405+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T00:27:28.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:28 smithi106 bash[18459]: audit 2024-02-13T00:27:27.289909+0000 mon.a (mon.0) 397 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:27:28.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:28 smithi106 bash[18459]: audit 2024-02-13T00:27:27.291734+0000 mon.b (mon.1) 10 : audit [INF] from='osd.4 [v2:172.21.15.106:6800/2755922963,v1:172.21.15.106:6801/2755922963]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:27:28.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:28.643+0000 7fa1d9ffb700 1 -- 172.21.15.106:0/2911026367 <== mgr.14146 v2:172.21.15.80:6800/461193090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa1dc1027e0 con 0x7fa1c4061120 2024-02-13T00:27:28.649 INFO:teuthology.orchestra.run.smithi106.stdout:Created osd(s) 4 on host 'smithi106' 2024-02-13T00:27:28.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:28.647+0000 7fa1e2b59700 1 -- 172.21.15.106:0/2911026367 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fa1c4061120 msgr2=0x7fa1c40635e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:27:28.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:28.647+0000 7fa1e2b59700 1 --2- 172.21.15.106:0/2911026367 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fa1c4061120 0x7fa1c40635e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fa1cc007fd0 tx=0x7fa1cc007d70).stop 2024-02-13T00:27:28.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:28.647+0000 7fa1e2b59700 1 -- 172.21.15.106:0/2911026367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1dc0fd720 msgr2=0x7fa1dc10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:27:28.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:28.647+0000 7fa1e2b59700 1 --2- 172.21.15.106:0/2911026367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1dc0fd720 0x7fa1dc10f560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fa1d400e910 tx=0x7fa1d400b040).stop 2024-02-13T00:27:28.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:28.647+0000 7fa1e2b59700 1 -- 172.21.15.106:0/2911026367 shutdown_connections 2024-02-13T00:27:28.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:28.647+0000 7fa1e2b59700 1 --2- 172.21.15.106:0/2911026367 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fa1c4061120 0x7fa1c40635e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:27:28.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:28.647+0000 7fa1e2b59700 1 --2- 172.21.15.106:0/2911026367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1dc0fd720 0x7fa1dc10f560 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:27:28.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:28.647+0000 7fa1e2b59700 1 --2- 172.21.15.106:0/2911026367 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa1dc061c60 0x7fa1dc107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:27:28.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:28.647+0000 7fa1e2b59700 1 --2- 172.21.15.106:0/2911026367 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa1dc0fac70 0x7fa1dc108480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:27:28.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:28.647+0000 7fa1e2b59700 1 -- 172.21.15.106:0/2911026367 >> 172.21.15.106:0/2911026367 conn(0x7fa1dc0f2220 msgr2=0x7fa1dc0fa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:27:28.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:28.647+0000 7fa1e2b59700 1 -- 172.21.15.106:0/2911026367 shutdown_connections 2024-02-13T00:27:28.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:28.647+0000 7fa1e2b59700 1 -- 172.21.15.106:0/2911026367 wait complete. 2024-02-13T00:27:28.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:28 smithi080 bash[24237]: audit 2024-02-13T00:27:27.286125+0000 mon.a (mon.0) 394 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-13T00:27:28.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:28 smithi080 bash[24237]: cluster 2024-02-13T00:27:27.286244+0000 mon.a (mon.0) 395 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-02-13T00:27:28.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:28 smithi080 bash[24237]: audit 2024-02-13T00:27:27.286405+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T00:27:28.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:28 smithi080 bash[24237]: audit 2024-02-13T00:27:27.289909+0000 mon.a (mon.0) 397 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:27:28.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:28 smithi080 bash[24237]: audit 2024-02-13T00:27:27.291734+0000 mon.b (mon.1) 10 : audit [INF] from='osd.4 [v2:172.21.15.106:6800/2755922963,v1:172.21.15.106:6801/2755922963]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:27:28.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:28 smithi080 bash[17386]: audit 2024-02-13T00:27:27.286125+0000 mon.a (mon.0) 394 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-13T00:27:28.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:28 smithi080 bash[17386]: cluster 2024-02-13T00:27:27.286244+0000 mon.a (mon.0) 395 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-02-13T00:27:28.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:28 smithi080 bash[17386]: audit 2024-02-13T00:27:27.286405+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T00:27:28.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:28 smithi080 bash[17386]: audit 2024-02-13T00:27:27.289909+0000 mon.a (mon.0) 397 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:27:28.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:28 smithi080 bash[17386]: audit 2024-02-13T00:27:27.291734+0000 mon.b (mon.1) 10 : audit [INF] from='osd.4 [v2:172.21.15.106:6800/2755922963,v1:172.21.15.106:6801/2755922963]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:27:29.345 DEBUG:teuthology.orchestra.run.smithi106:osd.4> sudo journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.4.service 2024-02-13T00:27:29.347 INFO:tasks.cephadm:Deploying osd.5 on smithi106 with /dev/vg_nvme/lv_3... 2024-02-13T00:27:29.347 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-13T00:27:29.586 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:29 smithi106 bash[18459]: audit 2024-02-13T00:27:28.290200+0000 mon.a (mon.0) 398 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-02-13T00:27:29.586 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:29 smithi106 bash[18459]: cluster 2024-02-13T00:27:28.290323+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-02-13T00:27:29.587 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:29 smithi106 bash[18459]: audit 2024-02-13T00:27:28.291066+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T00:27:29.587 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:29 smithi106 bash[18459]: audit 2024-02-13T00:27:28.296964+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T00:27:29.587 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:29 smithi106 bash[18459]: audit 2024-02-13T00:27:28.643097+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:27:29.587 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:29 smithi106 bash[18459]: audit 2024-02-13T00:27:28.667946+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:27:29.587 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:29 smithi106 bash[18459]: cluster 2024-02-13T00:27:28.725782+0000 mgr.y (mgr.14146) 199 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:29.587 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:29 smithi106 bash[18459]: cluster 2024-02-13T00:27:29.265706+0000 mon.a (mon.0) 404 : cluster [INF] osd.4 [v2:172.21.15.106:6800/2755922963,v1:172.21.15.106:6801/2755922963] boot 2024-02-13T00:27:29.587 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:29 smithi106 bash[18459]: cluster 2024-02-13T00:27:29.265781+0000 mon.a (mon.0) 405 : cluster [DBG] osdmap e30: 5 total, 5 up, 5 in 2024-02-13T00:27:29.587 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:29 smithi106 bash[18459]: audit 2024-02-13T00:27:29.266487+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T00:27:29.626 INFO:journalctl@ceph.osd.4.smithi106.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-13T00:27:29.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:29 smithi080 bash[17386]: audit 2024-02-13T00:27:28.290200+0000 mon.a (mon.0) 398 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-02-13T00:27:29.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:29 smithi080 bash[17386]: cluster 2024-02-13T00:27:28.290323+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-02-13T00:27:29.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:29 smithi080 bash[17386]: audit 2024-02-13T00:27:28.291066+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T00:27:29.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:29 smithi080 bash[17386]: audit 2024-02-13T00:27:28.296964+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T00:27:29.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:29 smithi080 bash[17386]: audit 2024-02-13T00:27:28.643097+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:27:29.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:29 smithi080 bash[17386]: audit 2024-02-13T00:27:28.667946+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:27:29.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:29 smithi080 bash[17386]: cluster 2024-02-13T00:27:28.725782+0000 mgr.y (mgr.14146) 199 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:29.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:29 smithi080 bash[17386]: cluster 2024-02-13T00:27:29.265706+0000 mon.a (mon.0) 404 : cluster [INF] osd.4 [v2:172.21.15.106:6800/2755922963,v1:172.21.15.106:6801/2755922963] boot 2024-02-13T00:27:29.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:29 smithi080 bash[17386]: cluster 2024-02-13T00:27:29.265781+0000 mon.a (mon.0) 405 : cluster [DBG] osdmap e30: 5 total, 5 up, 5 in 2024-02-13T00:27:29.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:29 smithi080 bash[17386]: audit 2024-02-13T00:27:29.266487+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T00:27:29.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:29 smithi080 bash[24237]: audit 2024-02-13T00:27:28.290200+0000 mon.a (mon.0) 398 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-02-13T00:27:29.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:29 smithi080 bash[24237]: cluster 2024-02-13T00:27:28.290323+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-02-13T00:27:29.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:29 smithi080 bash[24237]: audit 2024-02-13T00:27:28.291066+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T00:27:29.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:29 smithi080 bash[24237]: audit 2024-02-13T00:27:28.296964+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T00:27:29.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:29 smithi080 bash[24237]: audit 2024-02-13T00:27:28.643097+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:27:29.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:29 smithi080 bash[24237]: audit 2024-02-13T00:27:28.667946+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:27:29.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:29 smithi080 bash[24237]: cluster 2024-02-13T00:27:28.725782+0000 mgr.y (mgr.14146) 199 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-13T00:27:29.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:29 smithi080 bash[24237]: cluster 2024-02-13T00:27:29.265706+0000 mon.a (mon.0) 404 : cluster [INF] osd.4 [v2:172.21.15.106:6800/2755922963,v1:172.21.15.106:6801/2755922963] boot 2024-02-13T00:27:29.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:29 smithi080 bash[24237]: cluster 2024-02-13T00:27:29.265781+0000 mon.a (mon.0) 405 : cluster [DBG] osdmap e30: 5 total, 5 up, 5 in 2024-02-13T00:27:29.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:29 smithi080 bash[24237]: audit 2024-02-13T00:27:29.266487+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T00:27:30.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:30 smithi106 bash[18459]: cluster 2024-02-13T00:27:27.731061+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:27:30.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:30 smithi106 bash[18459]: cluster 2024-02-13T00:27:27.731143+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:27:30.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:30 smithi106 bash[18459]: cluster 2024-02-13T00:27:30.267375+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-02-13T00:27:31.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:30 smithi080 bash[17386]: cluster 2024-02-13T00:27:27.731061+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:27:31.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:30 smithi080 bash[17386]: cluster 2024-02-13T00:27:27.731143+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:27:31.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:30 smithi080 bash[17386]: cluster 2024-02-13T00:27:30.267375+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-02-13T00:27:31.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:30 smithi080 bash[24237]: cluster 2024-02-13T00:27:27.731061+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:27:31.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:30 smithi080 bash[24237]: cluster 2024-02-13T00:27:27.731143+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:27:31.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:30 smithi080 bash[24237]: cluster 2024-02-13T00:27:30.267375+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-02-13T00:27:32.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:31 smithi106 bash[18459]: cluster 2024-02-13T00:27:30.726326+0000 mgr.y (mgr.14146) 200 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:32.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:31 smithi106 bash[18459]: cluster 2024-02-13T00:27:31.270380+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-13T00:27:32.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:31 smithi080 bash[17386]: cluster 2024-02-13T00:27:30.726326+0000 mgr.y (mgr.14146) 200 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:32.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:31 smithi080 bash[17386]: cluster 2024-02-13T00:27:31.270380+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-13T00:27:32.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:31 smithi080 bash[24237]: cluster 2024-02-13T00:27:30.726326+0000 mgr.y (mgr.14146) 200 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:32.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:31 smithi080 bash[24237]: cluster 2024-02-13T00:27:31.270380+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-13T00:27:32.803 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-13T00:27:32.803 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-13T00:27:32.803 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10+0 records in 2024-02-13T00:27:32.803 INFO:teuthology.orchestra.run.smithi106.stderr:10+0 records out 2024-02-13T00:27:32.803 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0182677 s, 574 MB/s 2024-02-13T00:27:32.804 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping successful for: 2024-02-13T00:27:33.490 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi106:vg_nvme/lv_3 2024-02-13T00:27:33.998 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:33 smithi106 bash[18459]: cluster 2024-02-13T00:27:32.726873+0000 mgr.y (mgr.14146) 201 : cluster [DBG] pgmap v185: 1 pgs: 1 peering; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:34.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:33 smithi080 bash[17386]: cluster 2024-02-13T00:27:32.726873+0000 mgr.y (mgr.14146) 201 : cluster [DBG] pgmap v185: 1 pgs: 1 peering; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:34.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:33 smithi080 bash[24237]: cluster 2024-02-13T00:27:32.726873+0000 mgr.y (mgr.14146) 201 : cluster [DBG] pgmap v185: 1 pgs: 1 peering; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:35.543 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:35 smithi106 bash[18459]: cluster 2024-02-13T00:27:34.727403+0000 mgr.y (mgr.14146) 202 : cluster [DBG] pgmap v186: 1 pgs: 1 peering; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:35.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:35 smithi080 bash[17386]: cluster 2024-02-13T00:27:34.727403+0000 mgr.y (mgr.14146) 202 : cluster [DBG] pgmap v186: 1 pgs: 1 peering; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:35.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:35 smithi080 bash[24237]: cluster 2024-02-13T00:27:34.727403+0000 mgr.y (mgr.14146) 202 : cluster [DBG] pgmap v186: 1 pgs: 1 peering; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:37.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.271+0000 7efc2d0e7700 1 -- 172.21.15.106:0/1295216067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc2806f250 msgr2=0x7efc2806fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:27:37.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.271+0000 7efc2d0e7700 1 --2- 172.21.15.106:0/1295216067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc2806f250 0x7efc2806fb20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7efc18004870 tx=0x7efc18009cb0).stop 2024-02-13T00:27:37.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.271+0000 7efc2d0e7700 1 -- 172.21.15.106:0/1295216067 shutdown_connections 2024-02-13T00:27:37.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.271+0000 7efc2d0e7700 1 --2- 172.21.15.106:0/1295216067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc2806f250 0x7efc2806fb20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:27:37.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.271+0000 7efc2d0e7700 1 --2- 172.21.15.106:0/1295216067 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc2806d5f0 0x7efc2806da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:27:37.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.271+0000 7efc2d0e7700 1 --2- 172.21.15.106:0/1295216067 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc2806e8e0 0x7efc2806ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:27:37.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.271+0000 7efc2d0e7700 1 -- 172.21.15.106:0/1295216067 >> 172.21.15.106:0/1295216067 conn(0x7efc280f5710 msgr2=0x7efc280f7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:27:37.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.271+0000 7efc2d0e7700 1 -- 172.21.15.106:0/1295216067 shutdown_connections 2024-02-13T00:27:37.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.271+0000 7efc2d0e7700 1 -- 172.21.15.106:0/1295216067 wait complete. 2024-02-13T00:27:37.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc2d0e7700 1 Processor -- start 2024-02-13T00:27:37.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc2d0e7700 1 -- start start 2024-02-13T00:27:37.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc2d0e7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc2806d5f0 0x7efc2810e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:27:37.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc2d0e7700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc2806e8e0 0x7efc2810e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:27:37.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc2d0e7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc2806f250 0x7efc28115870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:27:37.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc2d0e7700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc28115d60 con 0x7efc2806f250 2024-02-13T00:27:37.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc2d0e7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc28115ea0 con 0x7efc2806d5f0 2024-02-13T00:27:37.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc2d0e7700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc28115fe0 con 0x7efc2806e8e0 2024-02-13T00:27:37.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc26d9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc2806d5f0 0x7efc2810e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:27:37.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc2659c700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc2806e8e0 0x7efc2810e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:27:37.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc26d9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc2806d5f0 0x7efc2810e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37126/0 (socket says 172.21.15.106:37126) 2024-02-13T00:27:37.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc2659c700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc2806e8e0 0x7efc2810e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.106:43622/0 (socket says 172.21.15.106:43622) 2024-02-13T00:27:37.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc26d9d700 1 -- 172.21.15.106:0/2279909361 learned_addr learned my addr 172.21.15.106:0/2279909361 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-02-13T00:27:37.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc2759e700 1 --2- 172.21.15.106:0/2279909361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc2806f250 0x7efc28115870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:27:37.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc26d9d700 1 -- 172.21.15.106:0/2279909361 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc2806e8e0 msgr2=0x7efc2810e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:27:37.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc26d9d700 1 --2- 172.21.15.106:0/2279909361 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc2806e8e0 0x7efc2810e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:27:37.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc26d9d700 1 -- 172.21.15.106:0/2279909361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc2806f250 msgr2=0x7efc28115870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:27:37.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc26d9d700 1 --2- 172.21.15.106:0/2279909361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc2806f250 0x7efc28115870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:27:37.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc26d9d700 1 -- 172.21.15.106:0/2279909361 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc18005040 con 0x7efc2806d5f0 2024-02-13T00:27:37.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc2659c700 1 --2- 172.21.15.106:0/2279909361 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc2806e8e0 0x7efc2810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:27:37.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc2759e700 1 --2- 172.21.15.106:0/2279909361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc2806f250 0x7efc28115870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:27:37.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc26d9d700 1 --2- 172.21.15.106:0/2279909361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc2806d5f0 0x7efc2810e2a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7efc1c00e970 tx=0x7efc1c00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:27:37.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc0ffff700 1 -- 172.21.15.106:0/2279909361 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c004660 con 0x7efc2806d5f0 2024-02-13T00:27:37.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc2d0e7700 1 -- 172.21.15.106:0/2279909361 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc281162c0 con 0x7efc2806d5f0 2024-02-13T00:27:37.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc0ffff700 1 -- 172.21.15.106:0/2279909361 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7efc1c00f040 con 0x7efc2806d5f0 2024-02-13T00:27:37.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc0ffff700 1 -- 172.21.15.106:0/2279909361 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c0146f0 con 0x7efc2806d5f0 2024-02-13T00:27:37.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.275+0000 7efc2d0e7700 1 -- 172.21.15.106:0/2279909361 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc28116880 con 0x7efc2806d5f0 2024-02-13T00:27:37.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.279+0000 7efc2d0e7700 1 -- 172.21.15.106:0/2279909361 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2805f400 con 0x7efc2806d5f0 2024-02-13T00:27:37.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.279+0000 7efc0ffff700 1 -- 172.21.15.106:0/2279909361 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 14) v1 ==== 77064+0+0 (secure 0 0 0) 0x7efc1c007b40 con 0x7efc2806d5f0 2024-02-13T00:27:37.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.279+0000 7efc0ffff700 1 --2- 172.21.15.106:0/2279909361 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7efc10061250 0x7efc10063710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:27:37.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.279+0000 7efc0ffff700 1 -- 172.21.15.106:0/2279909361 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 3964+0+0 (secure 0 0 0) 0x7efc1c07bc00 con 0x7efc2806d5f0 2024-02-13T00:27:37.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.279+0000 7efc2659c700 1 --2- 172.21.15.106:0/2279909361 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7efc10061250 0x7efc10063710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:27:37.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.279+0000 7efc2659c700 1 --2- 172.21.15.106:0/2279909361 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7efc10061250 0x7efc10063710 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7efc20009fd0 tx=0x7efc2000b040).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:27:37.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.283+0000 7efc0ffff700 1 -- 172.21.15.106:0/2279909361 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7efc1c04c6d0 con 0x7efc2806d5f0 2024-02-13T00:27:37.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:27:37.471+0000 7efc2d0e7700 1 -- 172.21.15.106:0/2279909361 --> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7efc281068f0 con 0x7efc10061250 2024-02-13T00:27:38.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:37 smithi080 bash[24237]: cluster 2024-02-13T00:27:36.727934+0000 mgr.y (mgr.14146) 203 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:38.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:37 smithi080 bash[24237]: audit 2024-02-13T00:27:37.482001+0000 mon.a (mon.0) 409 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:27:38.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:37 smithi080 bash[24237]: audit 2024-02-13T00:27:37.487395+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:27:38.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:37 smithi080 bash[24237]: audit 2024-02-13T00:27:37.488873+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:27:38.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:37 smithi080 bash[17386]: cluster 2024-02-13T00:27:36.727934+0000 mgr.y (mgr.14146) 203 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:38.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:37 smithi080 bash[17386]: audit 2024-02-13T00:27:37.482001+0000 mon.a (mon.0) 409 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:27:38.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:37 smithi080 bash[17386]: audit 2024-02-13T00:27:37.487395+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:27:38.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:37 smithi080 bash[17386]: audit 2024-02-13T00:27:37.488873+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:27:38.040 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:37 smithi106 bash[18459]: cluster 2024-02-13T00:27:36.727934+0000 mgr.y (mgr.14146) 203 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:38.040 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:37 smithi106 bash[18459]: audit 2024-02-13T00:27:37.482001+0000 mon.a (mon.0) 409 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:27:38.040 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:37 smithi106 bash[18459]: audit 2024-02-13T00:27:37.487395+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:27:38.040 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:37 smithi106 bash[18459]: audit 2024-02-13T00:27:37.488873+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:27:39.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:38 smithi106 bash[18459]: audit 2024-02-13T00:27:37.475326+0000 mgr.y (mgr.14146) 204 : audit [DBG] from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:27:39.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:38 smithi080 bash[17386]: audit 2024-02-13T00:27:37.475326+0000 mgr.y (mgr.14146) 204 : audit [DBG] from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:27:39.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:38 smithi080 bash[24237]: audit 2024-02-13T00:27:37.475326+0000 mgr.y (mgr.14146) 204 : audit [DBG] from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:27:40.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:39 smithi106 bash[18459]: cluster 2024-02-13T00:27:38.728572+0000 mgr.y (mgr.14146) 205 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:40.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:39 smithi106 bash[18459]: cephadm 2024-02-13T00:27:38.890887+0000 mgr.y (mgr.14146) 206 : cephadm [INF] Detected new or changed devices on smithi106 2024-02-13T00:27:40.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:39 smithi106 bash[18459]: audit 2024-02-13T00:27:38.900945+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:27:40.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:39 smithi106 bash[18459]: audit 2024-02-13T00:27:38.902440+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:27:40.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:39 smithi106 bash[18459]: cephadm 2024-02-13T00:27:38.903491+0000 mgr.y (mgr.14146) 207 : cephadm [INF] Adjusting osd_memory_target on smithi106 to 17265M 2024-02-13T00:27:40.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:39 smithi106 bash[18459]: audit 2024-02-13T00:27:38.908932+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:27:40.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:39 smithi106 bash[18459]: audit 2024-02-13T00:27:38.910460+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:27:40.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:39 smithi106 bash[18459]: audit 2024-02-13T00:27:38.911577+0000 mon.a (mon.0) 416 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:27:40.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:39 smithi106 bash[18459]: audit 2024-02-13T00:27:38.917637+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:27:40.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:39 smithi080 bash[17386]: cluster 2024-02-13T00:27:38.728572+0000 mgr.y (mgr.14146) 205 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:40.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:39 smithi080 bash[17386]: cephadm 2024-02-13T00:27:38.890887+0000 mgr.y (mgr.14146) 206 : cephadm [INF] Detected new or changed devices on smithi106 2024-02-13T00:27:40.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:39 smithi080 bash[17386]: audit 2024-02-13T00:27:38.900945+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:27:40.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:39 smithi080 bash[17386]: audit 2024-02-13T00:27:38.902440+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:27:40.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:39 smithi080 bash[17386]: cephadm 2024-02-13T00:27:38.903491+0000 mgr.y (mgr.14146) 207 : cephadm [INF] Adjusting osd_memory_target on smithi106 to 17265M 2024-02-13T00:27:40.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:39 smithi080 bash[17386]: audit 2024-02-13T00:27:38.908932+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:27:40.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:39 smithi080 bash[17386]: audit 2024-02-13T00:27:38.910460+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:27:40.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:39 smithi080 bash[17386]: audit 2024-02-13T00:27:38.911577+0000 mon.a (mon.0) 416 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:27:40.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:39 smithi080 bash[17386]: audit 2024-02-13T00:27:38.917637+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:27:40.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:39 smithi080 bash[24237]: cluster 2024-02-13T00:27:38.728572+0000 mgr.y (mgr.14146) 205 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:40.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:39 smithi080 bash[24237]: cephadm 2024-02-13T00:27:38.890887+0000 mgr.y (mgr.14146) 206 : cephadm [INF] Detected new or changed devices on smithi106 2024-02-13T00:27:40.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:39 smithi080 bash[24237]: audit 2024-02-13T00:27:38.900945+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:27:40.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:39 smithi080 bash[24237]: audit 2024-02-13T00:27:38.902440+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:27:40.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:39 smithi080 bash[24237]: cephadm 2024-02-13T00:27:38.903491+0000 mgr.y (mgr.14146) 207 : cephadm [INF] Adjusting osd_memory_target on smithi106 to 17265M 2024-02-13T00:27:40.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:39 smithi080 bash[24237]: audit 2024-02-13T00:27:38.908932+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:27:40.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:39 smithi080 bash[24237]: audit 2024-02-13T00:27:38.910460+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:27:40.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:39 smithi080 bash[24237]: audit 2024-02-13T00:27:38.911577+0000 mon.a (mon.0) 416 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:27:40.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:39 smithi080 bash[24237]: audit 2024-02-13T00:27:38.917637+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:27:42.254 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:41 smithi106 bash[18459]: cluster 2024-02-13T00:27:40.729174+0000 mgr.y (mgr.14146) 208 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:42.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:41 smithi080 bash[17386]: cluster 2024-02-13T00:27:40.729174+0000 mgr.y (mgr.14146) 208 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:42.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:41 smithi080 bash[24237]: cluster 2024-02-13T00:27:40.729174+0000 mgr.y (mgr.14146) 208 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:44.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:43 smithi106 bash[18459]: cluster 2024-02-13T00:27:42.729751+0000 mgr.y (mgr.14146) 209 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:44.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:43 smithi080 bash[17386]: cluster 2024-02-13T00:27:42.729751+0000 mgr.y (mgr.14146) 209 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:44.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:43 smithi080 bash[24237]: cluster 2024-02-13T00:27:42.729751+0000 mgr.y (mgr.14146) 209 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:45.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:45 smithi106 bash[18459]: cluster 2024-02-13T00:27:44.730289+0000 mgr.y (mgr.14146) 210 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:45.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:45 smithi080 bash[17386]: cluster 2024-02-13T00:27:44.730289+0000 mgr.y (mgr.14146) 210 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:45.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:45 smithi080 bash[24237]: cluster 2024-02-13T00:27:44.730289+0000 mgr.y (mgr.14146) 210 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:46.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:46 smithi106 bash[18459]: audit 2024-02-13T00:27:45.352174+0000 mon.a (mon.0) 418 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d335acec-df11-42a6-8454-f6933e209d5d"}]: dispatch 2024-02-13T00:27:46.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:46 smithi106 bash[18459]: audit 2024-02-13T00:27:45.353545+0000 mon.b (mon.1) 11 : audit [INF] from='client.? 172.21.15.106:0/1505506855' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d335acec-df11-42a6-8454-f6933e209d5d"}]: dispatch 2024-02-13T00:27:46.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:46 smithi106 bash[18459]: audit 2024-02-13T00:27:45.360023+0000 mon.a (mon.0) 419 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d335acec-df11-42a6-8454-f6933e209d5d"}]': finished 2024-02-13T00:27:46.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:46 smithi106 bash[18459]: cluster 2024-02-13T00:27:45.360208+0000 mon.a (mon.0) 420 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2024-02-13T00:27:46.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:46 smithi106 bash[18459]: audit 2024-02-13T00:27:45.360474+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T00:27:46.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:46 smithi106 bash[18459]: audit 2024-02-13T00:27:46.073798+0000 mon.b (mon.1) 12 : audit [DBG] from='client.? 172.21.15.106:0/2839975070' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:27:46.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:46 smithi080 bash[17386]: audit 2024-02-13T00:27:45.352174+0000 mon.a (mon.0) 418 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d335acec-df11-42a6-8454-f6933e209d5d"}]: dispatch 2024-02-13T00:27:46.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:46 smithi080 bash[17386]: audit 2024-02-13T00:27:45.353545+0000 mon.b (mon.1) 11 : audit [INF] from='client.? 172.21.15.106:0/1505506855' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d335acec-df11-42a6-8454-f6933e209d5d"}]: dispatch 2024-02-13T00:27:46.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:46 smithi080 bash[17386]: audit 2024-02-13T00:27:45.360023+0000 mon.a (mon.0) 419 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d335acec-df11-42a6-8454-f6933e209d5d"}]': finished 2024-02-13T00:27:46.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:46 smithi080 bash[17386]: cluster 2024-02-13T00:27:45.360208+0000 mon.a (mon.0) 420 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2024-02-13T00:27:46.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:46 smithi080 bash[17386]: audit 2024-02-13T00:27:45.360474+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T00:27:46.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:46 smithi080 bash[17386]: audit 2024-02-13T00:27:46.073798+0000 mon.b (mon.1) 12 : audit [DBG] from='client.? 172.21.15.106:0/2839975070' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:27:46.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:46 smithi080 bash[24237]: audit 2024-02-13T00:27:45.352174+0000 mon.a (mon.0) 418 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d335acec-df11-42a6-8454-f6933e209d5d"}]: dispatch 2024-02-13T00:27:46.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:46 smithi080 bash[24237]: audit 2024-02-13T00:27:45.353545+0000 mon.b (mon.1) 11 : audit [INF] from='client.? 172.21.15.106:0/1505506855' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d335acec-df11-42a6-8454-f6933e209d5d"}]: dispatch 2024-02-13T00:27:46.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:46 smithi080 bash[24237]: audit 2024-02-13T00:27:45.360023+0000 mon.a (mon.0) 419 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d335acec-df11-42a6-8454-f6933e209d5d"}]': finished 2024-02-13T00:27:46.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:46 smithi080 bash[24237]: cluster 2024-02-13T00:27:45.360208+0000 mon.a (mon.0) 420 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2024-02-13T00:27:46.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:46 smithi080 bash[24237]: audit 2024-02-13T00:27:45.360474+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T00:27:46.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:46 smithi080 bash[24237]: audit 2024-02-13T00:27:46.073798+0000 mon.b (mon.1) 12 : audit [DBG] from='client.? 172.21.15.106:0/2839975070' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:27:47.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:47 smithi106 bash[18459]: cluster 2024-02-13T00:27:46.730850+0000 mgr.y (mgr.14146) 211 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:47.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:47 smithi080 bash[17386]: cluster 2024-02-13T00:27:46.730850+0000 mgr.y (mgr.14146) 211 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:47.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:47 smithi080 bash[24237]: cluster 2024-02-13T00:27:46.730850+0000 mgr.y (mgr.14146) 211 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:50.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:49 smithi106 bash[18459]: cluster 2024-02-13T00:27:48.731431+0000 mgr.y (mgr.14146) 212 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:50.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:49 smithi080 bash[17386]: cluster 2024-02-13T00:27:48.731431+0000 mgr.y (mgr.14146) 212 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:50.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:49 smithi080 bash[24237]: cluster 2024-02-13T00:27:48.731431+0000 mgr.y (mgr.14146) 212 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:52.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:51 smithi106 bash[18459]: cluster 2024-02-13T00:27:50.731967+0000 mgr.y (mgr.14146) 213 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:52.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:51 smithi080 bash[17386]: cluster 2024-02-13T00:27:50.731967+0000 mgr.y (mgr.14146) 213 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:52.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:51 smithi080 bash[24237]: cluster 2024-02-13T00:27:50.731967+0000 mgr.y (mgr.14146) 213 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:54.122 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:53 smithi106 bash[18459]: cluster 2024-02-13T00:27:52.732597+0000 mgr.y (mgr.14146) 214 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:54.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:53 smithi080 bash[17386]: cluster 2024-02-13T00:27:52.732597+0000 mgr.y (mgr.14146) 214 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:54.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:53 smithi080 bash[24237]: cluster 2024-02-13T00:27:52.732597+0000 mgr.y (mgr.14146) 214 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:55.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:55 smithi106 bash[18459]: cluster 2024-02-13T00:27:54.733158+0000 mgr.y (mgr.14146) 215 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:55.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:55 smithi080 bash[17386]: cluster 2024-02-13T00:27:54.733158+0000 mgr.y (mgr.14146) 215 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:55.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:55 smithi080 bash[24237]: cluster 2024-02-13T00:27:54.733158+0000 mgr.y (mgr.14146) 215 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:57 smithi106 bash[18459]: cluster 2024-02-13T00:27:56.733722+0000 mgr.y (mgr.14146) 216 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:58.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:57 smithi106 bash[18459]: audit 2024-02-13T00:27:57.736668+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-13T00:27:58.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:57 smithi106 bash[18459]: audit 2024-02-13T00:27:57.738456+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:27:58.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:57 smithi080 bash[17386]: cluster 2024-02-13T00:27:56.733722+0000 mgr.y (mgr.14146) 216 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:58.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:57 smithi080 bash[17386]: audit 2024-02-13T00:27:57.736668+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-13T00:27:58.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:57 smithi080 bash[17386]: audit 2024-02-13T00:27:57.738456+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:27:58.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:57 smithi080 bash[24237]: cluster 2024-02-13T00:27:56.733722+0000 mgr.y (mgr.14146) 216 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:27:58.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:57 smithi080 bash[24237]: audit 2024-02-13T00:27:57.736668+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-13T00:27:58.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:57 smithi080 bash[24237]: audit 2024-02-13T00:27:57.738456+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:27:59.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:58 smithi106 bash[18459]: cephadm 2024-02-13T00:27:57.740064+0000 mgr.y (mgr.14146) 217 : cephadm [INF] Deploying daemon osd.5 on smithi106 2024-02-13T00:27:59.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:58 smithi080 bash[17386]: cephadm 2024-02-13T00:27:57.740064+0000 mgr.y (mgr.14146) 217 : cephadm [INF] Deploying daemon osd.5 on smithi106 2024-02-13T00:27:59.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:58 smithi080 bash[24237]: cephadm 2024-02-13T00:27:57.740064+0000 mgr.y (mgr.14146) 217 : cephadm [INF] Deploying daemon osd.5 on smithi106 2024-02-13T00:28:00.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:27:59 smithi106 bash[18459]: cluster 2024-02-13T00:27:58.734263+0000 mgr.y (mgr.14146) 218 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:28:00.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:27:59 smithi080 bash[17386]: cluster 2024-02-13T00:27:58.734263+0000 mgr.y (mgr.14146) 218 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:28:00.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:27:59 smithi080 bash[24237]: cluster 2024-02-13T00:27:58.734263+0000 mgr.y (mgr.14146) 218 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:28:02.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:01 smithi106 bash[18459]: cluster 2024-02-13T00:28:00.734782+0000 mgr.y (mgr.14146) 219 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:28:02.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:01 smithi106 bash[18459]: audit 2024-02-13T00:28:01.735293+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:02.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:01 smithi106 bash[18459]: audit 2024-02-13T00:28:01.749761+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:28:02.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:01 smithi080 bash[24237]: cluster 2024-02-13T00:28:00.734782+0000 mgr.y (mgr.14146) 219 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:28:02.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:01 smithi080 bash[24237]: audit 2024-02-13T00:28:01.735293+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:02.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:01 smithi080 bash[24237]: audit 2024-02-13T00:28:01.749761+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:28:02.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:01 smithi080 bash[17386]: cluster 2024-02-13T00:28:00.734782+0000 mgr.y (mgr.14146) 219 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:28:02.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:01 smithi080 bash[17386]: audit 2024-02-13T00:28:01.735293+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:02.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:01 smithi080 bash[17386]: audit 2024-02-13T00:28:01.749761+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:28:04.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:03 smithi106 bash[18459]: cluster 2024-02-13T00:28:02.735285+0000 mgr.y (mgr.14146) 220 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:28:04.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:03 smithi080 bash[24237]: cluster 2024-02-13T00:28:02.735285+0000 mgr.y (mgr.14146) 220 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:28:04.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:03 smithi080 bash[17386]: cluster 2024-02-13T00:28:02.735285+0000 mgr.y (mgr.14146) 220 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:28:05.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:05 smithi106 bash[18459]: cluster 2024-02-13T00:28:04.735800+0000 mgr.y (mgr.14146) 221 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:28:05.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:05 smithi080 bash[24237]: cluster 2024-02-13T00:28:04.735800+0000 mgr.y (mgr.14146) 221 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:28:05.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:05 smithi080 bash[17386]: cluster 2024-02-13T00:28:04.735800+0000 mgr.y (mgr.14146) 221 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:28:08.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:08 smithi106 bash[18459]: cluster 2024-02-13T00:28:06.736156+0000 mgr.y (mgr.14146) 222 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:28:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:08 smithi106 bash[18459]: audit 2024-02-13T00:28:07.012900+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:08 smithi106 bash[18459]: audit 2024-02-13T00:28:07.014301+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:28:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:08 smithi106 bash[18459]: audit 2024-02-13T00:28:07.015597+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:28:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:08 smithi106 bash[18459]: audit 2024-02-13T00:28:07.025310+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:08.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:08 smithi080 bash[24237]: cluster 2024-02-13T00:28:06.736156+0000 mgr.y (mgr.14146) 222 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:28:08.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:08 smithi080 bash[24237]: audit 2024-02-13T00:28:07.012900+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:08.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:08 smithi080 bash[24237]: audit 2024-02-13T00:28:07.014301+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:28:08.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:08 smithi080 bash[24237]: audit 2024-02-13T00:28:07.015597+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:28:08.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:08 smithi080 bash[24237]: audit 2024-02-13T00:28:07.025310+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:08.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:08 smithi080 bash[17386]: cluster 2024-02-13T00:28:06.736156+0000 mgr.y (mgr.14146) 222 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:28:08.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:08 smithi080 bash[17386]: audit 2024-02-13T00:28:07.012900+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:08.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:08 smithi080 bash[17386]: audit 2024-02-13T00:28:07.014301+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:28:08.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:08 smithi080 bash[17386]: audit 2024-02-13T00:28:07.015597+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:28:08.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:08 smithi080 bash[17386]: audit 2024-02-13T00:28:07.025310+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:09.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:09 smithi106 bash[18459]: audit 2024-02-13T00:28:08.196157+0000 mon.a (mon.0) 430 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-13T00:28:09.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:09 smithi106 bash[18459]: audit 2024-02-13T00:28:08.197282+0000 mon.b (mon.1) 13 : audit [INF] from='osd.5 [v2:172.21.15.106:6808/3712665601,v1:172.21.15.106:6809/3712665601]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-13T00:28:09.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:09 smithi080 bash[17386]: audit 2024-02-13T00:28:08.196157+0000 mon.a (mon.0) 430 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-13T00:28:09.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:09 smithi080 bash[17386]: audit 2024-02-13T00:28:08.197282+0000 mon.b (mon.1) 13 : audit [INF] from='osd.5 [v2:172.21.15.106:6808/3712665601,v1:172.21.15.106:6809/3712665601]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-13T00:28:09.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:09 smithi080 bash[24237]: audit 2024-02-13T00:28:08.196157+0000 mon.a (mon.0) 430 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-13T00:28:09.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:09 smithi080 bash[24237]: audit 2024-02-13T00:28:08.197282+0000 mon.b (mon.1) 13 : audit [INF] from='osd.5 [v2:172.21.15.106:6808/3712665601,v1:172.21.15.106:6809/3712665601]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-13T00:28:10.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:10.231+0000 7efc0ffff700 1 -- 172.21.15.106:0/2279909361 <== mgr.14146 v2:172.21.15.80:6800/461193090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7efc281068f0 con 0x7efc10061250 2024-02-13T00:28:10.236 INFO:teuthology.orchestra.run.smithi106.stdout:Created osd(s) 5 on host 'smithi106' 2024-02-13T00:28:10.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:10.231+0000 7efc2d0e7700 1 -- 172.21.15.106:0/2279909361 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7efc10061250 msgr2=0x7efc10063710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:28:10.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:10.231+0000 7efc2d0e7700 1 --2- 172.21.15.106:0/2279909361 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7efc10061250 0x7efc10063710 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7efc20009fd0 tx=0x7efc2000b040).stop 2024-02-13T00:28:10.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:10.231+0000 7efc2d0e7700 1 -- 172.21.15.106:0/2279909361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc2806d5f0 msgr2=0x7efc2810e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:28:10.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:10.231+0000 7efc2d0e7700 1 --2- 172.21.15.106:0/2279909361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc2806d5f0 0x7efc2810e2a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7efc1c00e970 tx=0x7efc1c00b040).stop 2024-02-13T00:28:10.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:10.231+0000 7efc2d0e7700 1 -- 172.21.15.106:0/2279909361 shutdown_connections 2024-02-13T00:28:10.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:10.231+0000 7efc2d0e7700 1 --2- 172.21.15.106:0/2279909361 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7efc10061250 0x7efc10063710 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:28:10.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:10.231+0000 7efc2d0e7700 1 --2- 172.21.15.106:0/2279909361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc2806d5f0 0x7efc2810e2a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:28:10.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:10.235+0000 7efc2d0e7700 1 --2- 172.21.15.106:0/2279909361 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efc2806f250 0x7efc28115870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:28:10.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:10.235+0000 7efc2d0e7700 1 --2- 172.21.15.106:0/2279909361 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efc2806e8e0 0x7efc2810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:28:10.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:10.235+0000 7efc2d0e7700 1 -- 172.21.15.106:0/2279909361 >> 172.21.15.106:0/2279909361 conn(0x7efc280f5710 msgr2=0x7efc280f8730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:28:10.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:10.235+0000 7efc2d0e7700 1 -- 172.21.15.106:0/2279909361 shutdown_connections 2024-02-13T00:28:10.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:10.235+0000 7efc2d0e7700 1 -- 172.21.15.106:0/2279909361 wait complete. 2024-02-13T00:28:10.302 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:10 smithi106 bash[18459]: cluster 2024-02-13T00:28:08.736644+0000 mgr.y (mgr.14146) 223 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:28:10.302 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:10 smithi106 bash[18459]: audit 2024-02-13T00:28:09.024707+0000 mon.a (mon.0) 431 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-13T00:28:10.302 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:10 smithi106 bash[18459]: cluster 2024-02-13T00:28:09.024819+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2024-02-13T00:28:10.302 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:10 smithi106 bash[18459]: audit 2024-02-13T00:28:09.025234+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T00:28:10.302 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:10 smithi106 bash[18459]: audit 2024-02-13T00:28:09.028708+0000 mon.a (mon.0) 434 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:28:10.302 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:10 smithi106 bash[18459]: audit 2024-02-13T00:28:09.030386+0000 mon.b (mon.1) 14 : audit [INF] from='osd.5 [v2:172.21.15.106:6808/3712665601,v1:172.21.15.106:6809/3712665601]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:28:10.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:10 smithi080 bash[17386]: cluster 2024-02-13T00:28:08.736644+0000 mgr.y (mgr.14146) 223 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:28:10.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:10 smithi080 bash[17386]: audit 2024-02-13T00:28:09.024707+0000 mon.a (mon.0) 431 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-13T00:28:10.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:10 smithi080 bash[17386]: cluster 2024-02-13T00:28:09.024819+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2024-02-13T00:28:10.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:10 smithi080 bash[17386]: audit 2024-02-13T00:28:09.025234+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T00:28:10.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:10 smithi080 bash[17386]: audit 2024-02-13T00:28:09.028708+0000 mon.a (mon.0) 434 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:28:10.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:10 smithi080 bash[17386]: audit 2024-02-13T00:28:09.030386+0000 mon.b (mon.1) 14 : audit [INF] from='osd.5 [v2:172.21.15.106:6808/3712665601,v1:172.21.15.106:6809/3712665601]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:28:10.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:10 smithi080 bash[24237]: cluster 2024-02-13T00:28:08.736644+0000 mgr.y (mgr.14146) 223 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:28:10.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:10 smithi080 bash[24237]: audit 2024-02-13T00:28:09.024707+0000 mon.a (mon.0) 431 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-13T00:28:10.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:10 smithi080 bash[24237]: cluster 2024-02-13T00:28:09.024819+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2024-02-13T00:28:10.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:10 smithi080 bash[24237]: audit 2024-02-13T00:28:09.025234+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T00:28:10.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:10 smithi080 bash[24237]: audit 2024-02-13T00:28:09.028708+0000 mon.a (mon.0) 434 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:28:10.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:10 smithi080 bash[24237]: audit 2024-02-13T00:28:09.030386+0000 mon.b (mon.1) 14 : audit [INF] from='osd.5 [v2:172.21.15.106:6808/3712665601,v1:172.21.15.106:6809/3712665601]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:28:10.934 DEBUG:teuthology.orchestra.run.smithi106:osd.5> sudo journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.5.service 2024-02-13T00:28:10.937 INFO:tasks.cephadm:Deploying osd.6 on smithi106 with /dev/vg_nvme/lv_2... 2024-02-13T00:28:10.937 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-13T00:28:11.117 INFO:journalctl@ceph.osd.5.smithi106.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-13T00:28:11.187 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:11 smithi106 bash[18459]: audit 2024-02-13T00:28:10.028134+0000 mon.a (mon.0) 435 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-02-13T00:28:11.187 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:11 smithi106 bash[18459]: cluster 2024-02-13T00:28:10.028248+0000 mon.a (mon.0) 436 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-02-13T00:28:11.187 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:11 smithi106 bash[18459]: audit 2024-02-13T00:28:10.028923+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T00:28:11.187 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:11 smithi106 bash[18459]: audit 2024-02-13T00:28:10.036363+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T00:28:11.187 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:11 smithi106 bash[18459]: audit 2024-02-13T00:28:10.229698+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:11.187 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:11 smithi106 bash[18459]: audit 2024-02-13T00:28:10.252663+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:28:11.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:11 smithi080 bash[17386]: audit 2024-02-13T00:28:10.028134+0000 mon.a (mon.0) 435 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-02-13T00:28:11.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:11 smithi080 bash[17386]: cluster 2024-02-13T00:28:10.028248+0000 mon.a (mon.0) 436 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-02-13T00:28:11.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:11 smithi080 bash[17386]: audit 2024-02-13T00:28:10.028923+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T00:28:11.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:11 smithi080 bash[17386]: audit 2024-02-13T00:28:10.036363+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T00:28:11.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:11 smithi080 bash[17386]: audit 2024-02-13T00:28:10.229698+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:11.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:11 smithi080 bash[17386]: audit 2024-02-13T00:28:10.252663+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:28:11.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:11 smithi080 bash[24237]: audit 2024-02-13T00:28:10.028134+0000 mon.a (mon.0) 435 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-02-13T00:28:11.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:11 smithi080 bash[24237]: cluster 2024-02-13T00:28:10.028248+0000 mon.a (mon.0) 436 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-02-13T00:28:11.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:11 smithi080 bash[24237]: audit 2024-02-13T00:28:10.028923+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T00:28:11.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:11 smithi080 bash[24237]: audit 2024-02-13T00:28:10.036363+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T00:28:11.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:11 smithi080 bash[24237]: audit 2024-02-13T00:28:10.229698+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:11.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:11 smithi080 bash[24237]: audit 2024-02-13T00:28:10.252663+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:28:12.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:12 smithi106 bash[18459]: cluster 2024-02-13T00:28:09.145449+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:28:12.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:12 smithi106 bash[18459]: cluster 2024-02-13T00:28:09.145519+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:28:12.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:12 smithi106 bash[18459]: cluster 2024-02-13T00:28:10.737211+0000 mgr.y (mgr.14146) 224 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:28:12.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:12 smithi106 bash[18459]: cluster 2024-02-13T00:28:11.039528+0000 mon.a (mon.0) 441 : cluster [INF] osd.5 [v2:172.21.15.106:6808/3712665601,v1:172.21.15.106:6809/3712665601] boot 2024-02-13T00:28:12.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:12 smithi106 bash[18459]: cluster 2024-02-13T00:28:11.039612+0000 mon.a (mon.0) 442 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2024-02-13T00:28:12.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:12 smithi106 bash[18459]: audit 2024-02-13T00:28:11.040612+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T00:28:12.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:12 smithi106 bash[18459]: cluster 2024-02-13T00:28:12.040917+0000 mon.a (mon.0) 444 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-02-13T00:28:12.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:12 smithi080 bash[24237]: cluster 2024-02-13T00:28:09.145449+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:28:12.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:12 smithi080 bash[24237]: cluster 2024-02-13T00:28:09.145519+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:28:12.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:12 smithi080 bash[24237]: cluster 2024-02-13T00:28:10.737211+0000 mgr.y (mgr.14146) 224 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:28:12.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:12 smithi080 bash[24237]: cluster 2024-02-13T00:28:11.039528+0000 mon.a (mon.0) 441 : cluster [INF] osd.5 [v2:172.21.15.106:6808/3712665601,v1:172.21.15.106:6809/3712665601] boot 2024-02-13T00:28:12.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:12 smithi080 bash[24237]: cluster 2024-02-13T00:28:11.039612+0000 mon.a (mon.0) 442 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2024-02-13T00:28:12.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:12 smithi080 bash[24237]: audit 2024-02-13T00:28:11.040612+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T00:28:12.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:12 smithi080 bash[24237]: cluster 2024-02-13T00:28:12.040917+0000 mon.a (mon.0) 444 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-02-13T00:28:12.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:12 smithi080 bash[17386]: cluster 2024-02-13T00:28:09.145449+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:28:12.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:12 smithi080 bash[17386]: cluster 2024-02-13T00:28:09.145519+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:28:12.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:12 smithi080 bash[17386]: cluster 2024-02-13T00:28:10.737211+0000 mgr.y (mgr.14146) 224 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-13T00:28:12.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:12 smithi080 bash[17386]: cluster 2024-02-13T00:28:11.039528+0000 mon.a (mon.0) 441 : cluster [INF] osd.5 [v2:172.21.15.106:6808/3712665601,v1:172.21.15.106:6809/3712665601] boot 2024-02-13T00:28:12.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:12 smithi080 bash[17386]: cluster 2024-02-13T00:28:11.039612+0000 mon.a (mon.0) 442 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2024-02-13T00:28:12.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:12 smithi080 bash[17386]: audit 2024-02-13T00:28:11.040612+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T00:28:12.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:12 smithi080 bash[17386]: cluster 2024-02-13T00:28:12.040917+0000 mon.a (mon.0) 444 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-02-13T00:28:14.153 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-13T00:28:14.153 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-13T00:28:14.153 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10+0 records in 2024-02-13T00:28:14.153 INFO:teuthology.orchestra.run.smithi106.stderr:10+0 records out 2024-02-13T00:28:14.153 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0172642 s, 607 MB/s 2024-02-13T00:28:14.153 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping successful for: 2024-02-13T00:28:14.369 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:14 smithi106 bash[18459]: cluster 2024-02-13T00:28:12.737781+0000 mgr.y (mgr.14146) 225 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:14.369 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:14 smithi106 bash[18459]: cluster 2024-02-13T00:28:13.055767+0000 mon.a (mon.0) 445 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-02-13T00:28:14.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:14 smithi080 bash[24237]: cluster 2024-02-13T00:28:12.737781+0000 mgr.y (mgr.14146) 225 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:14.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:14 smithi080 bash[24237]: cluster 2024-02-13T00:28:13.055767+0000 mon.a (mon.0) 445 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-02-13T00:28:14.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:14 smithi080 bash[17386]: cluster 2024-02-13T00:28:12.737781+0000 mgr.y (mgr.14146) 225 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:14.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:14 smithi080 bash[17386]: cluster 2024-02-13T00:28:13.055767+0000 mon.a (mon.0) 445 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-02-13T00:28:14.863 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi106:vg_nvme/lv_2 2024-02-13T00:28:15.364 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:15 smithi106 bash[18459]: cluster 2024-02-13T00:28:14.738317+0000 mgr.y (mgr.14146) 226 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:15.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:15 smithi080 bash[17386]: cluster 2024-02-13T00:28:14.738317+0000 mgr.y (mgr.14146) 226 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:15.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:15 smithi080 bash[24237]: cluster 2024-02-13T00:28:14.738317+0000 mgr.y (mgr.14146) 226 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:18.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:17 smithi106 bash[18459]: cluster 2024-02-13T00:28:16.738845+0000 mgr.y (mgr.14146) 227 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:18.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:17 smithi080 bash[24237]: cluster 2024-02-13T00:28:16.738845+0000 mgr.y (mgr.14146) 227 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:18.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:17 smithi080 bash[17386]: cluster 2024-02-13T00:28:16.738845+0000 mgr.y (mgr.14146) 227 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:19.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.070+0000 7fad5eb00700 1 -- 172.21.15.106:0/530289375 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad580f7e20 msgr2=0x7fad580fe720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:28:19.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.070+0000 7fad5eb00700 1 --2- 172.21.15.106:0/530289375 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad580f7e20 0x7fad580fe720 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fad50009c10 tx=0x7fad50004d10).stop 2024-02-13T00:28:19.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.070+0000 7fad5eb00700 1 -- 172.21.15.106:0/530289375 shutdown_connections 2024-02-13T00:28:19.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.070+0000 7fad5eb00700 1 --2- 172.21.15.106:0/530289375 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad580f7e20 0x7fad580fe720 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:28:19.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.070+0000 7fad5eb00700 1 --2- 172.21.15.106:0/530289375 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fad580f6230 0x7fad580f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:28:19.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.070+0000 7fad5eb00700 1 --2- 172.21.15.106:0/530289375 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad580f74d0 0x7fad580f7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:28:19.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.070+0000 7fad5eb00700 1 -- 172.21.15.106:0/530289375 >> 172.21.15.106:0/530289375 conn(0x7fad580f1a30 msgr2=0x7fad580f3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:28:19.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.070+0000 7fad5eb00700 1 -- 172.21.15.106:0/530289375 shutdown_connections 2024-02-13T00:28:19.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.070+0000 7fad5eb00700 1 -- 172.21.15.106:0/530289375 wait complete. 2024-02-13T00:28:19.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.070+0000 7fad5eb00700 1 Processor -- start 2024-02-13T00:28:19.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.070+0000 7fad5eb00700 1 -- start start 2024-02-13T00:28:19.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.070+0000 7fad5eb00700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad580f6230 0x7fad58106b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:28:19.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.070+0000 7fad5eb00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad580f74d0 0x7fad58107020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:28:19.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.070+0000 7fad5eb00700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fad580f7e20 0x7fad5810e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:28:19.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.070+0000 7fad5eb00700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad580fef40 con 0x7fad580f74d0 2024-02-13T00:28:19.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.070+0000 7fad5eb00700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad580ff0b0 con 0x7fad580f6230 2024-02-13T00:28:19.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.070+0000 7fad5eb00700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad580ff270 con 0x7fad580f7e20 2024-02-13T00:28:19.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.070+0000 7fad5c89c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad580f6230 0x7fad58106b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:28:19.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.070+0000 7fad5c89c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad580f6230 0x7fad58106b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59144/0 (socket says 172.21.15.106:59144) 2024-02-13T00:28:19.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.070+0000 7fad5c89c700 1 -- 172.21.15.106:0/3053296007 learned_addr learned my addr 172.21.15.106:0/3053296007 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-02-13T00:28:19.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.074+0000 7fad5d09d700 1 --2- 172.21.15.106:0/3053296007 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fad580f7e20 0x7fad5810e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:28:19.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.074+0000 7fad57fff700 1 --2- 172.21.15.106:0/3053296007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad580f74d0 0x7fad58107020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:28:19.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.074+0000 7fad5c89c700 1 -- 172.21.15.106:0/3053296007 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fad580f7e20 msgr2=0x7fad5810e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:28:19.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.074+0000 7fad5c89c700 1 --2- 172.21.15.106:0/3053296007 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fad580f7e20 0x7fad5810e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:28:19.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.074+0000 7fad5c89c700 1 -- 172.21.15.106:0/3053296007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad580f74d0 msgr2=0x7fad58107020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:28:19.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.074+0000 7fad5c89c700 1 --2- 172.21.15.106:0/3053296007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad580f74d0 0x7fad58107020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:28:19.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.074+0000 7fad5c89c700 1 -- 172.21.15.106:0/3053296007 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad500097c0 con 0x7fad580f6230 2024-02-13T00:28:19.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.074+0000 7fad5d09d700 1 --2- 172.21.15.106:0/3053296007 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fad580f7e20 0x7fad5810e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-13T00:28:19.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.074+0000 7fad5c89c700 1 --2- 172.21.15.106:0/3053296007 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad580f6230 0x7fad58106b30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fad4c00e990 tx=0x7fad4c00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:28:19.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.074+0000 7fad55ffb700 1 -- 172.21.15.106:0/3053296007 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c00eed0 con 0x7fad580f6230 2024-02-13T00:28:19.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.074+0000 7fad55ffb700 1 -- 172.21.15.106:0/3053296007 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fad4c00f040 con 0x7fad580f6230 2024-02-13T00:28:19.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.074+0000 7fad5eb00700 1 -- 172.21.15.106:0/3053296007 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad580ff550 con 0x7fad580f6230 2024-02-13T00:28:19.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.074+0000 7fad55ffb700 1 -- 172.21.15.106:0/3053296007 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c00c5d0 con 0x7fad580f6230 2024-02-13T00:28:19.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.074+0000 7fad5eb00700 1 -- 172.21.15.106:0/3053296007 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad580ffa70 con 0x7fad580f6230 2024-02-13T00:28:19.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.074+0000 7fad55ffb700 1 -- 172.21.15.106:0/3053296007 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 14) v1 ==== 77064+0+0 (secure 0 0 0) 0x7fad4c007b40 con 0x7fad580f6230 2024-02-13T00:28:19.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.074+0000 7fad55ffb700 1 --2- 172.21.15.106:0/3053296007 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fad48061250 0x7fad48063710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:28:19.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.074+0000 7fad5eb00700 1 -- 172.21.15.106:0/3053296007 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad58060070 con 0x7fad580f6230 2024-02-13T00:28:19.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.074+0000 7fad55ffb700 1 -- 172.21.15.106:0/3053296007 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4396+0+0 (secure 0 0 0) 0x7fad4c07bff0 con 0x7fad580f6230 2024-02-13T00:28:19.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.074+0000 7fad57fff700 1 --2- 172.21.15.106:0/3053296007 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fad48061250 0x7fad48063710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:28:19.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.078+0000 7fad57fff700 1 --2- 172.21.15.106:0/3053296007 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fad48061250 0x7fad48063710 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fad44009250 tx=0x7fad4400b040).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:28:19.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.082+0000 7fad55ffb700 1 -- 172.21.15.106:0/3053296007 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fad4c022020 con 0x7fad580f6230 2024-02-13T00:28:19.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:19.278+0000 7fad5eb00700 1 -- 172.21.15.106:0/3053296007 --> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fad580fd510 con 0x7fad48061250 2024-02-13T00:28:20.085 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:19 smithi106 bash[18459]: cluster 2024-02-13T00:28:18.739379+0000 mgr.y (mgr.14146) 228 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:20.085 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:19 smithi106 bash[18459]: audit 2024-02-13T00:28:19.287126+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:28:20.085 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:19 smithi106 bash[18459]: audit 2024-02-13T00:28:19.292437+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:28:20.085 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:19 smithi106 bash[18459]: audit 2024-02-13T00:28:19.293723+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:28:20.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:19 smithi080 bash[24237]: cluster 2024-02-13T00:28:18.739379+0000 mgr.y (mgr.14146) 228 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:20.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:19 smithi080 bash[24237]: audit 2024-02-13T00:28:19.287126+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:28:20.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:19 smithi080 bash[24237]: audit 2024-02-13T00:28:19.292437+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:28:20.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:19 smithi080 bash[24237]: audit 2024-02-13T00:28:19.293723+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:28:20.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:19 smithi080 bash[17386]: cluster 2024-02-13T00:28:18.739379+0000 mgr.y (mgr.14146) 228 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:20.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:19 smithi080 bash[17386]: audit 2024-02-13T00:28:19.287126+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:28:20.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:19 smithi080 bash[17386]: audit 2024-02-13T00:28:19.292437+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:28:20.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:19 smithi080 bash[17386]: audit 2024-02-13T00:28:19.293723+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:28:21.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:20 smithi106 bash[18459]: audit 2024-02-13T00:28:19.281880+0000 mgr.y (mgr.14146) 229 : audit [DBG] from='client.24274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:28:21.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:20 smithi080 bash[17386]: audit 2024-02-13T00:28:19.281880+0000 mgr.y (mgr.14146) 229 : audit [DBG] from='client.24274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:28:21.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:20 smithi080 bash[24237]: audit 2024-02-13T00:28:19.281880+0000 mgr.y (mgr.14146) 229 : audit [DBG] from='client.24274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:28:22.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:21 smithi106 bash[18459]: cluster 2024-02-13T00:28:20.739937+0000 mgr.y (mgr.14146) 230 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:22.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:21 smithi106 bash[18459]: cephadm 2024-02-13T00:28:20.838643+0000 mgr.y (mgr.14146) 231 : cephadm [INF] Detected new or changed devices on smithi106 2024-02-13T00:28:22.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:21 smithi106 bash[18459]: audit 2024-02-13T00:28:20.847330+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:22.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:21 smithi106 bash[18459]: audit 2024-02-13T00:28:20.849083+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:28:22.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:21 smithi106 bash[18459]: audit 2024-02-13T00:28:20.850479+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:28:22.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:21 smithi106 bash[18459]: cephadm 2024-02-13T00:28:20.851319+0000 mgr.y (mgr.14146) 232 : cephadm [INF] Adjusting osd_memory_target on smithi106 to 8632M 2024-02-13T00:28:22.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:21 smithi106 bash[18459]: audit 2024-02-13T00:28:20.856423+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:22.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:21 smithi106 bash[18459]: audit 2024-02-13T00:28:20.857961+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:28:22.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:21 smithi106 bash[18459]: audit 2024-02-13T00:28:20.859047+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:28:22.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:21 smithi106 bash[18459]: audit 2024-02-13T00:28:20.864980+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:22.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:21 smithi080 bash[24237]: cluster 2024-02-13T00:28:20.739937+0000 mgr.y (mgr.14146) 230 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:22.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:21 smithi080 bash[24237]: cephadm 2024-02-13T00:28:20.838643+0000 mgr.y (mgr.14146) 231 : cephadm [INF] Detected new or changed devices on smithi106 2024-02-13T00:28:22.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:21 smithi080 bash[24237]: audit 2024-02-13T00:28:20.847330+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:22.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:21 smithi080 bash[24237]: audit 2024-02-13T00:28:20.849083+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:28:22.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:21 smithi080 bash[24237]: audit 2024-02-13T00:28:20.850479+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:28:22.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:21 smithi080 bash[24237]: cephadm 2024-02-13T00:28:20.851319+0000 mgr.y (mgr.14146) 232 : cephadm [INF] Adjusting osd_memory_target on smithi106 to 8632M 2024-02-13T00:28:22.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:21 smithi080 bash[24237]: audit 2024-02-13T00:28:20.856423+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:22.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:21 smithi080 bash[24237]: audit 2024-02-13T00:28:20.857961+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:28:22.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:21 smithi080 bash[24237]: audit 2024-02-13T00:28:20.859047+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:28:22.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:21 smithi080 bash[24237]: audit 2024-02-13T00:28:20.864980+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:22.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:21 smithi080 bash[17386]: cluster 2024-02-13T00:28:20.739937+0000 mgr.y (mgr.14146) 230 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:22.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:21 smithi080 bash[17386]: cephadm 2024-02-13T00:28:20.838643+0000 mgr.y (mgr.14146) 231 : cephadm [INF] Detected new or changed devices on smithi106 2024-02-13T00:28:22.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:21 smithi080 bash[17386]: audit 2024-02-13T00:28:20.847330+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:22.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:21 smithi080 bash[17386]: audit 2024-02-13T00:28:20.849083+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:28:22.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:21 smithi080 bash[17386]: audit 2024-02-13T00:28:20.850479+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:28:22.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:21 smithi080 bash[17386]: cephadm 2024-02-13T00:28:20.851319+0000 mgr.y (mgr.14146) 232 : cephadm [INF] Adjusting osd_memory_target on smithi106 to 8632M 2024-02-13T00:28:22.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:21 smithi080 bash[17386]: audit 2024-02-13T00:28:20.856423+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:22.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:21 smithi080 bash[17386]: audit 2024-02-13T00:28:20.857961+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:28:22.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:21 smithi080 bash[17386]: audit 2024-02-13T00:28:20.859047+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:28:22.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:21 smithi080 bash[17386]: audit 2024-02-13T00:28:20.864980+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:24.177 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:23 smithi106 bash[18459]: cluster 2024-02-13T00:28:22.740507+0000 mgr.y (mgr.14146) 233 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:24.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:23 smithi080 bash[24237]: cluster 2024-02-13T00:28:22.740507+0000 mgr.y (mgr.14146) 233 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:24.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:23 smithi080 bash[17386]: cluster 2024-02-13T00:28:22.740507+0000 mgr.y (mgr.14146) 233 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:25.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:25 smithi106 bash[18459]: cluster 2024-02-13T00:28:24.741092+0000 mgr.y (mgr.14146) 234 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:25.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:25 smithi080 bash[24237]: cluster 2024-02-13T00:28:24.741092+0000 mgr.y (mgr.14146) 234 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:25.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:25 smithi080 bash[17386]: cluster 2024-02-13T00:28:24.741092+0000 mgr.y (mgr.14146) 234 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:28.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:27 smithi106 bash[18459]: cluster 2024-02-13T00:28:26.741597+0000 mgr.y (mgr.14146) 235 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:28.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:27 smithi106 bash[18459]: audit 2024-02-13T00:28:27.350415+0000 mon.a (mon.0) 456 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6440f04-f935-4d72-aebd-9593038549f8"}]: dispatch 2024-02-13T00:28:28.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:27 smithi106 bash[18459]: audit 2024-02-13T00:28:27.351703+0000 mon.b (mon.1) 15 : audit [INF] from='client.? 172.21.15.106:0/98298707' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6440f04-f935-4d72-aebd-9593038549f8"}]: dispatch 2024-02-13T00:28:28.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:27 smithi106 bash[18459]: audit 2024-02-13T00:28:27.359959+0000 mon.a (mon.0) 457 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6440f04-f935-4d72-aebd-9593038549f8"}]': finished 2024-02-13T00:28:28.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:27 smithi106 bash[18459]: cluster 2024-02-13T00:28:27.360127+0000 mon.a (mon.0) 458 : cluster [DBG] osdmap e39: 7 total, 6 up, 7 in 2024-02-13T00:28:28.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:27 smithi106 bash[18459]: audit 2024-02-13T00:28:27.360336+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T00:28:28.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:27 smithi080 bash[24237]: cluster 2024-02-13T00:28:26.741597+0000 mgr.y (mgr.14146) 235 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:28.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:27 smithi080 bash[24237]: audit 2024-02-13T00:28:27.350415+0000 mon.a (mon.0) 456 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6440f04-f935-4d72-aebd-9593038549f8"}]: dispatch 2024-02-13T00:28:28.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:27 smithi080 bash[24237]: audit 2024-02-13T00:28:27.351703+0000 mon.b (mon.1) 15 : audit [INF] from='client.? 172.21.15.106:0/98298707' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6440f04-f935-4d72-aebd-9593038549f8"}]: dispatch 2024-02-13T00:28:28.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:27 smithi080 bash[24237]: audit 2024-02-13T00:28:27.359959+0000 mon.a (mon.0) 457 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6440f04-f935-4d72-aebd-9593038549f8"}]': finished 2024-02-13T00:28:28.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:27 smithi080 bash[24237]: cluster 2024-02-13T00:28:27.360127+0000 mon.a (mon.0) 458 : cluster [DBG] osdmap e39: 7 total, 6 up, 7 in 2024-02-13T00:28:28.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:27 smithi080 bash[24237]: audit 2024-02-13T00:28:27.360336+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T00:28:28.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:27 smithi080 bash[17386]: cluster 2024-02-13T00:28:26.741597+0000 mgr.y (mgr.14146) 235 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:28.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:27 smithi080 bash[17386]: audit 2024-02-13T00:28:27.350415+0000 mon.a (mon.0) 456 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6440f04-f935-4d72-aebd-9593038549f8"}]: dispatch 2024-02-13T00:28:28.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:27 smithi080 bash[17386]: audit 2024-02-13T00:28:27.351703+0000 mon.b (mon.1) 15 : audit [INF] from='client.? 172.21.15.106:0/98298707' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6440f04-f935-4d72-aebd-9593038549f8"}]: dispatch 2024-02-13T00:28:28.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:27 smithi080 bash[17386]: audit 2024-02-13T00:28:27.359959+0000 mon.a (mon.0) 457 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6440f04-f935-4d72-aebd-9593038549f8"}]': finished 2024-02-13T00:28:28.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:27 smithi080 bash[17386]: cluster 2024-02-13T00:28:27.360127+0000 mon.a (mon.0) 458 : cluster [DBG] osdmap e39: 7 total, 6 up, 7 in 2024-02-13T00:28:28.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:27 smithi080 bash[17386]: audit 2024-02-13T00:28:27.360336+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T00:28:29.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:28 smithi106 bash[18459]: audit 2024-02-13T00:28:28.092012+0000 mon.b (mon.1) 16 : audit [DBG] from='client.? 172.21.15.106:0/2967293647' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:28:29.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:28 smithi080 bash[17386]: audit 2024-02-13T00:28:28.092012+0000 mon.b (mon.1) 16 : audit [DBG] from='client.? 172.21.15.106:0/2967293647' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:28:29.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:28 smithi080 bash[24237]: audit 2024-02-13T00:28:28.092012+0000 mon.b (mon.1) 16 : audit [DBG] from='client.? 172.21.15.106:0/2967293647' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:28:30.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:29 smithi106 bash[18459]: cluster 2024-02-13T00:28:28.742109+0000 mgr.y (mgr.14146) 236 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:30.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:29 smithi080 bash[17386]: cluster 2024-02-13T00:28:28.742109+0000 mgr.y (mgr.14146) 236 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:30.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:29 smithi080 bash[24237]: cluster 2024-02-13T00:28:28.742109+0000 mgr.y (mgr.14146) 236 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:32.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:31 smithi106 bash[18459]: cluster 2024-02-13T00:28:30.742715+0000 mgr.y (mgr.14146) 237 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:32.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:31 smithi080 bash[17386]: cluster 2024-02-13T00:28:30.742715+0000 mgr.y (mgr.14146) 237 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:32.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:31 smithi080 bash[24237]: cluster 2024-02-13T00:28:30.742715+0000 mgr.y (mgr.14146) 237 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:34.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:33 smithi106 bash[18459]: cluster 2024-02-13T00:28:32.743245+0000 mgr.y (mgr.14146) 238 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:34.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:33 smithi080 bash[17386]: cluster 2024-02-13T00:28:32.743245+0000 mgr.y (mgr.14146) 238 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:34.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:33 smithi080 bash[24237]: cluster 2024-02-13T00:28:32.743245+0000 mgr.y (mgr.14146) 238 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:35.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:35 smithi106 bash[18459]: cluster 2024-02-13T00:28:34.743799+0000 mgr.y (mgr.14146) 239 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:35.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:35 smithi080 bash[17386]: cluster 2024-02-13T00:28:34.743799+0000 mgr.y (mgr.14146) 239 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:35.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:35 smithi080 bash[24237]: cluster 2024-02-13T00:28:34.743799+0000 mgr.y (mgr.14146) 239 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:38.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:37 smithi106 bash[18459]: cluster 2024-02-13T00:28:36.744369+0000 mgr.y (mgr.14146) 240 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:38.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:37 smithi080 bash[17386]: cluster 2024-02-13T00:28:36.744369+0000 mgr.y (mgr.14146) 240 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:38.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:37 smithi080 bash[24237]: cluster 2024-02-13T00:28:36.744369+0000 mgr.y (mgr.14146) 240 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:40.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:39 smithi106 bash[18459]: cluster 2024-02-13T00:28:38.744922+0000 mgr.y (mgr.14146) 241 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:40.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:39 smithi080 bash[17386]: cluster 2024-02-13T00:28:38.744922+0000 mgr.y (mgr.14146) 241 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:40.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:39 smithi080 bash[24237]: cluster 2024-02-13T00:28:38.744922+0000 mgr.y (mgr.14146) 241 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:41.091 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:40 smithi106 bash[18459]: audit 2024-02-13T00:28:40.006315+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-13T00:28:41.091 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:40 smithi106 bash[18459]: audit 2024-02-13T00:28:40.008091+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:28:41.091 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:40 smithi106 bash[18459]: cephadm 2024-02-13T00:28:40.009411+0000 mgr.y (mgr.14146) 242 : cephadm [INF] Deploying daemon osd.6 on smithi106 2024-02-13T00:28:41.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:40 smithi080 bash[17386]: audit 2024-02-13T00:28:40.006315+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-13T00:28:41.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:40 smithi080 bash[17386]: audit 2024-02-13T00:28:40.008091+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:28:41.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:40 smithi080 bash[17386]: cephadm 2024-02-13T00:28:40.009411+0000 mgr.y (mgr.14146) 242 : cephadm [INF] Deploying daemon osd.6 on smithi106 2024-02-13T00:28:41.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:40 smithi080 bash[24237]: audit 2024-02-13T00:28:40.006315+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-13T00:28:41.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:40 smithi080 bash[24237]: audit 2024-02-13T00:28:40.008091+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:28:41.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:40 smithi080 bash[24237]: cephadm 2024-02-13T00:28:40.009411+0000 mgr.y (mgr.14146) 242 : cephadm [INF] Deploying daemon osd.6 on smithi106 2024-02-13T00:28:42.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:41 smithi106 bash[18459]: cluster 2024-02-13T00:28:40.745450+0000 mgr.y (mgr.14146) 243 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:42.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:41 smithi080 bash[17386]: cluster 2024-02-13T00:28:40.745450+0000 mgr.y (mgr.14146) 243 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:42.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:41 smithi080 bash[24237]: cluster 2024-02-13T00:28:40.745450+0000 mgr.y (mgr.14146) 243 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:44.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:43 smithi106 bash[18459]: cluster 2024-02-13T00:28:42.746015+0000 mgr.y (mgr.14146) 244 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:44.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:43 smithi080 bash[17386]: cluster 2024-02-13T00:28:42.746015+0000 mgr.y (mgr.14146) 244 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:44.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:43 smithi080 bash[24237]: cluster 2024-02-13T00:28:42.746015+0000 mgr.y (mgr.14146) 244 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:45.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:45 smithi106 bash[18459]: audit 2024-02-13T00:28:44.181624+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:45.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:45 smithi106 bash[18459]: audit 2024-02-13T00:28:44.198945+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:28:45.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:45 smithi106 bash[18459]: cluster 2024-02-13T00:28:44.746563+0000 mgr.y (mgr.14146) 245 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:45.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:45 smithi080 bash[17386]: audit 2024-02-13T00:28:44.181624+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:45.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:45 smithi080 bash[17386]: audit 2024-02-13T00:28:44.198945+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:28:45.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:45 smithi080 bash[17386]: cluster 2024-02-13T00:28:44.746563+0000 mgr.y (mgr.14146) 245 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:45.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:45 smithi080 bash[24237]: audit 2024-02-13T00:28:44.181624+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:45.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:45 smithi080 bash[24237]: audit 2024-02-13T00:28:44.198945+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:28:45.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:45 smithi080 bash[24237]: cluster 2024-02-13T00:28:44.746563+0000 mgr.y (mgr.14146) 245 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:48.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:47 smithi106 bash[18459]: cluster 2024-02-13T00:28:46.747120+0000 mgr.y (mgr.14146) 246 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:48.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:47 smithi080 bash[24237]: cluster 2024-02-13T00:28:46.747120+0000 mgr.y (mgr.14146) 246 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:48.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:47 smithi080 bash[17386]: cluster 2024-02-13T00:28:46.747120+0000 mgr.y (mgr.14146) 246 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:50.080 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:49 smithi106 bash[18459]: cluster 2024-02-13T00:28:48.747715+0000 mgr.y (mgr.14146) 247 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:50.081 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:49 smithi106 bash[18459]: audit 2024-02-13T00:28:49.300187+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:50.081 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:49 smithi106 bash[18459]: audit 2024-02-13T00:28:49.590259+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:28:50.081 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:49 smithi106 bash[18459]: audit 2024-02-13T00:28:49.592212+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:28:50.081 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:49 smithi106 bash[18459]: audit 2024-02-13T00:28:49.602974+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:50.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:49 smithi080 bash[17386]: cluster 2024-02-13T00:28:48.747715+0000 mgr.y (mgr.14146) 247 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:50.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:49 smithi080 bash[17386]: audit 2024-02-13T00:28:49.300187+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:50.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:49 smithi080 bash[17386]: audit 2024-02-13T00:28:49.590259+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:28:50.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:49 smithi080 bash[17386]: audit 2024-02-13T00:28:49.592212+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:28:50.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:49 smithi080 bash[17386]: audit 2024-02-13T00:28:49.602974+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:50.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:49 smithi080 bash[24237]: cluster 2024-02-13T00:28:48.747715+0000 mgr.y (mgr.14146) 247 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:50.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:49 smithi080 bash[24237]: audit 2024-02-13T00:28:49.300187+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:50.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:49 smithi080 bash[24237]: audit 2024-02-13T00:28:49.590259+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:28:50.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:49 smithi080 bash[24237]: audit 2024-02-13T00:28:49.592212+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:28:50.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:49 smithi080 bash[24237]: audit 2024-02-13T00:28:49.602974+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:51.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:50 smithi106 bash[18459]: audit 2024-02-13T00:28:50.679375+0000 mon.a (mon.0) 468 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-13T00:28:51.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:50 smithi106 bash[18459]: audit 2024-02-13T00:28:50.680625+0000 mon.b (mon.1) 17 : audit [INF] from='osd.6 [v2:172.21.15.106:6816/626618901,v1:172.21.15.106:6817/626618901]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-13T00:28:51.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:50 smithi080 bash[17386]: audit 2024-02-13T00:28:50.679375+0000 mon.a (mon.0) 468 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-13T00:28:51.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:50 smithi080 bash[17386]: audit 2024-02-13T00:28:50.680625+0000 mon.b (mon.1) 17 : audit [INF] from='osd.6 [v2:172.21.15.106:6816/626618901,v1:172.21.15.106:6817/626618901]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-13T00:28:51.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:50 smithi080 bash[24237]: audit 2024-02-13T00:28:50.679375+0000 mon.a (mon.0) 468 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-13T00:28:51.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:50 smithi080 bash[24237]: audit 2024-02-13T00:28:50.680625+0000 mon.b (mon.1) 17 : audit [INF] from='osd.6 [v2:172.21.15.106:6816/626618901,v1:172.21.15.106:6817/626618901]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-13T00:28:52.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:51 smithi106 bash[18459]: cluster 2024-02-13T00:28:50.748245+0000 mgr.y (mgr.14146) 248 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:52.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:51 smithi106 bash[18459]: audit 2024-02-13T00:28:50.820758+0000 mon.a (mon.0) 469 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-13T00:28:52.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:51 smithi106 bash[18459]: cluster 2024-02-13T00:28:50.820845+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e40: 7 total, 6 up, 7 in 2024-02-13T00:28:52.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:51 smithi106 bash[18459]: audit 2024-02-13T00:28:50.821030+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T00:28:52.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:51 smithi106 bash[18459]: audit 2024-02-13T00:28:50.822498+0000 mon.a (mon.0) 472 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:28:52.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:51 smithi106 bash[18459]: audit 2024-02-13T00:28:50.823685+0000 mon.b (mon.1) 18 : audit [INF] from='osd.6 [v2:172.21.15.106:6816/626618901,v1:172.21.15.106:6817/626618901]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:28:52.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:51 smithi080 bash[17386]: cluster 2024-02-13T00:28:50.748245+0000 mgr.y (mgr.14146) 248 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:52.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:51 smithi080 bash[17386]: audit 2024-02-13T00:28:50.820758+0000 mon.a (mon.0) 469 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-13T00:28:52.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:51 smithi080 bash[17386]: cluster 2024-02-13T00:28:50.820845+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e40: 7 total, 6 up, 7 in 2024-02-13T00:28:52.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:51 smithi080 bash[17386]: audit 2024-02-13T00:28:50.821030+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T00:28:52.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:51 smithi080 bash[17386]: audit 2024-02-13T00:28:50.822498+0000 mon.a (mon.0) 472 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:28:52.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:51 smithi080 bash[17386]: audit 2024-02-13T00:28:50.823685+0000 mon.b (mon.1) 18 : audit [INF] from='osd.6 [v2:172.21.15.106:6816/626618901,v1:172.21.15.106:6817/626618901]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:28:52.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:51 smithi080 bash[24237]: cluster 2024-02-13T00:28:50.748245+0000 mgr.y (mgr.14146) 248 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:52.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:51 smithi080 bash[24237]: audit 2024-02-13T00:28:50.820758+0000 mon.a (mon.0) 469 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-13T00:28:52.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:51 smithi080 bash[24237]: cluster 2024-02-13T00:28:50.820845+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e40: 7 total, 6 up, 7 in 2024-02-13T00:28:52.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:51 smithi080 bash[24237]: audit 2024-02-13T00:28:50.821030+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T00:28:52.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:51 smithi080 bash[24237]: audit 2024-02-13T00:28:50.822498+0000 mon.a (mon.0) 472 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:28:52.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:51 smithi080 bash[24237]: audit 2024-02-13T00:28:50.823685+0000 mon.b (mon.1) 18 : audit [INF] from='osd.6 [v2:172.21.15.106:6816/626618901,v1:172.21.15.106:6817/626618901]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:28:52.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:52.594+0000 7fad55ffb700 1 -- 172.21.15.106:0/3053296007 <== mgr.14146 v2:172.21.15.80:6800/461193090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fad580fd510 con 0x7fad48061250 2024-02-13T00:28:52.602 INFO:teuthology.orchestra.run.smithi106.stdout:Created osd(s) 6 on host 'smithi106' 2024-02-13T00:28:52.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:52.598+0000 7fad5eb00700 1 -- 172.21.15.106:0/3053296007 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fad48061250 msgr2=0x7fad48063710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:28:52.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:52.598+0000 7fad5eb00700 1 --2- 172.21.15.106:0/3053296007 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fad48061250 0x7fad48063710 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fad44009250 tx=0x7fad4400b040).stop 2024-02-13T00:28:52.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:52.598+0000 7fad5eb00700 1 -- 172.21.15.106:0/3053296007 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad580f6230 msgr2=0x7fad58106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:28:52.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:52.598+0000 7fad5eb00700 1 --2- 172.21.15.106:0/3053296007 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad580f6230 0x7fad58106b30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fad4c00e990 tx=0x7fad4c00b040).stop 2024-02-13T00:28:52.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:52.598+0000 7fad5eb00700 1 -- 172.21.15.106:0/3053296007 shutdown_connections 2024-02-13T00:28:52.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:52.598+0000 7fad5eb00700 1 --2- 172.21.15.106:0/3053296007 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fad48061250 0x7fad48063710 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:28:52.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:52.598+0000 7fad5eb00700 1 --2- 172.21.15.106:0/3053296007 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad580f6230 0x7fad58106b30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:28:52.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:52.598+0000 7fad5eb00700 1 --2- 172.21.15.106:0/3053296007 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fad580f7e20 0x7fad5810e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:28:52.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:52.598+0000 7fad5eb00700 1 --2- 172.21.15.106:0/3053296007 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fad580f74d0 0x7fad58107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:28:52.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:52.598+0000 7fad5eb00700 1 -- 172.21.15.106:0/3053296007 >> 172.21.15.106:0/3053296007 conn(0x7fad580f1a30 msgr2=0x7fad580fa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:28:52.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:52.598+0000 7fad5eb00700 1 -- 172.21.15.106:0/3053296007 shutdown_connections 2024-02-13T00:28:52.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:28:52.598+0000 7fad5eb00700 1 -- 172.21.15.106:0/3053296007 wait complete. 2024-02-13T00:28:53.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:52 smithi106 bash[18459]: audit 2024-02-13T00:28:51.828715+0000 mon.a (mon.0) 473 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-02-13T00:28:53.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:52 smithi106 bash[18459]: cluster 2024-02-13T00:28:51.828847+0000 mon.a (mon.0) 474 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2024-02-13T00:28:53.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:52 smithi106 bash[18459]: audit 2024-02-13T00:28:51.829340+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T00:28:53.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:52 smithi106 bash[18459]: audit 2024-02-13T00:28:51.834981+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T00:28:53.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:52 smithi106 bash[18459]: audit 2024-02-13T00:28:52.596812+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:53.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:52 smithi106 bash[18459]: audit 2024-02-13T00:28:52.629382+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:28:53.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:52 smithi080 bash[17386]: audit 2024-02-13T00:28:51.828715+0000 mon.a (mon.0) 473 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-02-13T00:28:53.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:52 smithi080 bash[17386]: cluster 2024-02-13T00:28:51.828847+0000 mon.a (mon.0) 474 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2024-02-13T00:28:53.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:52 smithi080 bash[17386]: audit 2024-02-13T00:28:51.829340+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T00:28:53.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:52 smithi080 bash[17386]: audit 2024-02-13T00:28:51.834981+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T00:28:53.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:52 smithi080 bash[17386]: audit 2024-02-13T00:28:52.596812+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:53.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:52 smithi080 bash[17386]: audit 2024-02-13T00:28:52.629382+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:28:53.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:52 smithi080 bash[24237]: audit 2024-02-13T00:28:51.828715+0000 mon.a (mon.0) 473 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-02-13T00:28:53.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:52 smithi080 bash[24237]: cluster 2024-02-13T00:28:51.828847+0000 mon.a (mon.0) 474 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2024-02-13T00:28:53.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:52 smithi080 bash[24237]: audit 2024-02-13T00:28:51.829340+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T00:28:53.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:52 smithi080 bash[24237]: audit 2024-02-13T00:28:51.834981+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T00:28:53.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:52 smithi080 bash[24237]: audit 2024-02-13T00:28:52.596812+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:28:53.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:52 smithi080 bash[24237]: audit 2024-02-13T00:28:52.629382+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:28:53.409 DEBUG:teuthology.orchestra.run.smithi106:osd.6> sudo journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.6.service 2024-02-13T00:28:53.411 INFO:tasks.cephadm:Deploying osd.7 on smithi106 with /dev/vg_nvme/lv_1... 2024-02-13T00:28:53.411 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-13T00:28:53.620 INFO:journalctl@ceph.osd.6.smithi106.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-13T00:28:54.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:53 smithi106 bash[18459]: cluster 2024-02-13T00:28:51.627663+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:28:54.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:53 smithi106 bash[18459]: cluster 2024-02-13T00:28:51.627740+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:28:54.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:53 smithi106 bash[18459]: cluster 2024-02-13T00:28:52.748736+0000 mgr.y (mgr.14146) 249 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:54.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:53 smithi106 bash[18459]: cluster 2024-02-13T00:28:52.830408+0000 mon.a (mon.0) 479 : cluster [INF] osd.6 [v2:172.21.15.106:6816/626618901,v1:172.21.15.106:6817/626618901] boot 2024-02-13T00:28:54.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:53 smithi106 bash[18459]: cluster 2024-02-13T00:28:52.830494+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2024-02-13T00:28:54.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:53 smithi106 bash[18459]: audit 2024-02-13T00:28:52.830718+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T00:28:54.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:53 smithi080 bash[24237]: cluster 2024-02-13T00:28:51.627663+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:28:54.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:53 smithi080 bash[24237]: cluster 2024-02-13T00:28:51.627740+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:28:54.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:53 smithi080 bash[24237]: cluster 2024-02-13T00:28:52.748736+0000 mgr.y (mgr.14146) 249 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:54.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:53 smithi080 bash[24237]: cluster 2024-02-13T00:28:52.830408+0000 mon.a (mon.0) 479 : cluster [INF] osd.6 [v2:172.21.15.106:6816/626618901,v1:172.21.15.106:6817/626618901] boot 2024-02-13T00:28:54.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:53 smithi080 bash[24237]: cluster 2024-02-13T00:28:52.830494+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2024-02-13T00:28:54.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:53 smithi080 bash[24237]: audit 2024-02-13T00:28:52.830718+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T00:28:54.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:53 smithi080 bash[17386]: cluster 2024-02-13T00:28:51.627663+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:28:54.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:53 smithi080 bash[17386]: cluster 2024-02-13T00:28:51.627740+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:28:54.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:53 smithi080 bash[17386]: cluster 2024-02-13T00:28:52.748736+0000 mgr.y (mgr.14146) 249 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-13T00:28:54.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:53 smithi080 bash[17386]: cluster 2024-02-13T00:28:52.830408+0000 mon.a (mon.0) 479 : cluster [INF] osd.6 [v2:172.21.15.106:6816/626618901,v1:172.21.15.106:6817/626618901] boot 2024-02-13T00:28:54.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:53 smithi080 bash[17386]: cluster 2024-02-13T00:28:52.830494+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2024-02-13T00:28:54.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:53 smithi080 bash[17386]: audit 2024-02-13T00:28:52.830718+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T00:28:55.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:54 smithi106 bash[18459]: cluster 2024-02-13T00:28:53.833957+0000 mon.a (mon.0) 482 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2024-02-13T00:28:55.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:54 smithi080 bash[24237]: cluster 2024-02-13T00:28:53.833957+0000 mon.a (mon.0) 482 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2024-02-13T00:28:55.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:54 smithi080 bash[17386]: cluster 2024-02-13T00:28:53.833957+0000 mon.a (mon.0) 482 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2024-02-13T00:28:56.117 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:55 smithi106 bash[18459]: cluster 2024-02-13T00:28:54.749321+0000 mgr.y (mgr.14146) 250 : cluster [DBG] pgmap v237: 1 pgs: 1 remapped+peering; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:28:56.117 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:55 smithi106 bash[18459]: cluster 2024-02-13T00:28:54.843844+0000 mon.a (mon.0) 483 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2024-02-13T00:28:56.117 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:55 smithi106 bash[18459]: cluster 2024-02-13T00:28:55.284424+0000 mon.a (mon.0) 484 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-13T00:28:56.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:55 smithi080 bash[17386]: cluster 2024-02-13T00:28:54.749321+0000 mgr.y (mgr.14146) 250 : cluster [DBG] pgmap v237: 1 pgs: 1 remapped+peering; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:28:56.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:55 smithi080 bash[17386]: cluster 2024-02-13T00:28:54.843844+0000 mon.a (mon.0) 483 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2024-02-13T00:28:56.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:55 smithi080 bash[17386]: cluster 2024-02-13T00:28:55.284424+0000 mon.a (mon.0) 484 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-13T00:28:56.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:55 smithi080 bash[24237]: cluster 2024-02-13T00:28:54.749321+0000 mgr.y (mgr.14146) 250 : cluster [DBG] pgmap v237: 1 pgs: 1 remapped+peering; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:28:56.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:55 smithi080 bash[24237]: cluster 2024-02-13T00:28:54.843844+0000 mon.a (mon.0) 483 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2024-02-13T00:28:56.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:55 smithi080 bash[24237]: cluster 2024-02-13T00:28:55.284424+0000 mon.a (mon.0) 484 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-13T00:28:56.851 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-13T00:28:56.851 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-13T00:28:56.851 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10+0 records in 2024-02-13T00:28:56.852 INFO:teuthology.orchestra.run.smithi106.stderr:10+0 records out 2024-02-13T00:28:56.852 INFO:teuthology.orchestra.run.smithi106.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0184477 s, 568 MB/s 2024-02-13T00:28:56.852 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping successful for: 2024-02-13T00:28:57.684 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi106:vg_nvme/lv_1 2024-02-13T00:28:58.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:57 smithi106 bash[18459]: cluster 2024-02-13T00:28:56.749946+0000 mgr.y (mgr.14146) 251 : cluster [DBG] pgmap v239: 1 pgs: 1 remapped+peering; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:28:58.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:57 smithi080 bash[17386]: cluster 2024-02-13T00:28:56.749946+0000 mgr.y (mgr.14146) 251 : cluster [DBG] pgmap v239: 1 pgs: 1 remapped+peering; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:28:58.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:57 smithi080 bash[24237]: cluster 2024-02-13T00:28:56.749946+0000 mgr.y (mgr.14146) 251 : cluster [DBG] pgmap v239: 1 pgs: 1 remapped+peering; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:28:59.189 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:58 smithi106 bash[18459]: cluster 2024-02-13T00:28:58.853449+0000 mon.a (mon.0) 485 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-13T00:28:59.189 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:58 smithi106 bash[18459]: cluster 2024-02-13T00:28:58.853514+0000 mon.a (mon.0) 486 : cluster [INF] Cluster is now healthy 2024-02-13T00:28:59.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:58 smithi080 bash[24237]: cluster 2024-02-13T00:28:58.853449+0000 mon.a (mon.0) 485 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-13T00:28:59.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:58 smithi080 bash[24237]: cluster 2024-02-13T00:28:58.853514+0000 mon.a (mon.0) 486 : cluster [INF] Cluster is now healthy 2024-02-13T00:28:59.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:58 smithi080 bash[17386]: cluster 2024-02-13T00:28:58.853449+0000 mon.a (mon.0) 485 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-13T00:28:59.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:58 smithi080 bash[17386]: cluster 2024-02-13T00:28:58.853514+0000 mon.a (mon.0) 486 : cluster [INF] Cluster is now healthy 2024-02-13T00:29:00.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:28:59 smithi106 bash[18459]: cluster 2024-02-13T00:28:58.750527+0000 mgr.y (mgr.14146) 252 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:00.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:28:59 smithi080 bash[24237]: cluster 2024-02-13T00:28:58.750527+0000 mgr.y (mgr.14146) 252 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:00.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:28:59 smithi080 bash[17386]: cluster 2024-02-13T00:28:58.750527+0000 mgr.y (mgr.14146) 252 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:00.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.853+0000 7fcc040cc700 1 -- 172.21.15.106:0/592393713 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbfc0f9520 msgr2=0x7fcbfc100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:00.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.853+0000 7fcc040cc700 1 --2- 172.21.15.106:0/592393713 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbfc0f9520 0x7fcbfc100090 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fcbf4009be0 tx=0x7fcbf4004d10).stop 2024-02-13T00:29:00.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.853+0000 7fcc040cc700 1 -- 172.21.15.106:0/592393713 shutdown_connections 2024-02-13T00:29:00.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.853+0000 7fcc040cc700 1 --2- 172.21.15.106:0/592393713 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbfc0f9520 0x7fcbfc100090 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:00.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.853+0000 7fcc040cc700 1 --2- 172.21.15.106:0/592393713 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcbfc0f7b00 0x7fcbfc0f7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:00.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.853+0000 7fcc040cc700 1 --2- 172.21.15.106:0/592393713 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbfc0f8410 0x7fcbfc0f8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:00.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.853+0000 7fcc040cc700 1 -- 172.21.15.106:0/592393713 >> 172.21.15.106:0/592393713 conn(0x7fcbfc0f3340 msgr2=0x7fcbfc0f5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:29:00.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.853+0000 7fcc040cc700 1 -- 172.21.15.106:0/592393713 shutdown_connections 2024-02-13T00:29:00.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.853+0000 7fcc040cc700 1 -- 172.21.15.106:0/592393713 wait complete. 2024-02-13T00:29:00.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.853+0000 7fcc040cc700 1 Processor -- start 2024-02-13T00:29:00.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.853+0000 7fcc040cc700 1 -- start start 2024-02-13T00:29:00.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.853+0000 7fcc040cc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbfc0f7b00 0x7fcbfc06ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:00.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.853+0000 7fcc040cc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbfc0f8410 0x7fcbfc06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:00.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.857+0000 7fcc040cc700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcbfc0f9520 0x7fcbfc06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:00.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.857+0000 7fcc040cc700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc06bbe0 con 0x7fcbfc0f8410 2024-02-13T00:29:00.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.857+0000 7fcc040cc700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc06bd50 con 0x7fcbfc0f7b00 2024-02-13T00:29:00.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.857+0000 7fcc040cc700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc06bf10 con 0x7fcbfc0f9520 2024-02-13T00:29:00.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.857+0000 7fcc01e68700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbfc0f7b00 0x7fcbfc06ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:00.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.857+0000 7fcc01e68700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbfc0f7b00 0x7fcbfc06ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:43166/0 (socket says 172.21.15.106:43166) 2024-02-13T00:29:00.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.857+0000 7fcc01e68700 1 -- 172.21.15.106:0/1586440687 learned_addr learned my addr 172.21.15.106:0/1586440687 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-02-13T00:29:00.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.857+0000 7fcc01667700 1 --2- 172.21.15.106:0/1586440687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbfc0f8410 0x7fcbfc06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:00.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.857+0000 7fcc02669700 1 --2- 172.21.15.106:0/1586440687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcbfc0f9520 0x7fcbfc06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:00.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.857+0000 7fcc01e68700 1 -- 172.21.15.106:0/1586440687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcbfc0f9520 msgr2=0x7fcbfc06b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:00.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.857+0000 7fcc01e68700 1 --2- 172.21.15.106:0/1586440687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcbfc0f9520 0x7fcbfc06b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:00.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.857+0000 7fcc01e68700 1 -- 172.21.15.106:0/1586440687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbfc0f8410 msgr2=0x7fcbfc06b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:00.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.857+0000 7fcc01e68700 1 --2- 172.21.15.106:0/1586440687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbfc0f8410 0x7fcbfc06b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:00.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.857+0000 7fcc01e68700 1 -- 172.21.15.106:0/1586440687 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf40097c0 con 0x7fcbfc0f7b00 2024-02-13T00:29:00.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.857+0000 7fcc01e68700 1 --2- 172.21.15.106:0/1586440687 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbfc0f7b00 0x7fcbfc06ca70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fcbec002820 tx=0x7fcbec002b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:29:00.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.857+0000 7fcbf2ffd700 1 -- 172.21.15.106:0/1586440687 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec002d80 con 0x7fcbfc0f7b00 2024-02-13T00:29:00.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.857+0000 7fcbf2ffd700 1 -- 172.21.15.106:0/1586440687 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fcbec00f040 con 0x7fcbfc0f7b00 2024-02-13T00:29:00.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.857+0000 7fcbf2ffd700 1 -- 172.21.15.106:0/1586440687 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec00d830 con 0x7fcbfc0f7b00 2024-02-13T00:29:00.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.857+0000 7fcc040cc700 1 -- 172.21.15.106:0/1586440687 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbfc111ef0 con 0x7fcbfc0f7b00 2024-02-13T00:29:00.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.857+0000 7fcc040cc700 1 -- 172.21.15.106:0/1586440687 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbfc112320 con 0x7fcbfc0f7b00 2024-02-13T00:29:00.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.857+0000 7fcc040cc700 1 -- 172.21.15.106:0/1586440687 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbfc060070 con 0x7fcbfc0f7b00 2024-02-13T00:29:00.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.857+0000 7fcbf2ffd700 1 -- 172.21.15.106:0/1586440687 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 14) v1 ==== 77064+0+0 (secure 0 0 0) 0x7fcbec009110 con 0x7fcbfc0f7b00 2024-02-13T00:29:00.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.861+0000 7fcbf2ffd700 1 --2- 172.21.15.106:0/1586440687 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fcbe8061250 0x7fcbe8063710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:00.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.861+0000 7fcbf2ffd700 1 -- 172.21.15.106:0/1586440687 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4828+0+0 (secure 0 0 0) 0x7fcbec07c230 con 0x7fcbfc0f7b00 2024-02-13T00:29:00.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.861+0000 7fcc01667700 1 --2- 172.21.15.106:0/1586440687 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fcbe8061250 0x7fcbe8063710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:00.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.861+0000 7fcc01667700 1 --2- 172.21.15.106:0/1586440687 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fcbe8061250 0x7fcbe8063710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fcbf80048b0 tx=0x7fcbf800b040).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:29:00.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:00.865+0000 7fcbf2ffd700 1 -- 172.21.15.106:0/1586440687 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fcbec04c970 con 0x7fcbfc0f7b00 2024-02-13T00:29:01.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:01.061+0000 7fcc040cc700 1 -- 172.21.15.106:0/1586440687 --> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbfc0591c0 con 0x7fcbe8061250 2024-02-13T00:29:02.248 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:01 smithi106 bash[18459]: cluster 2024-02-13T00:29:00.751097+0000 mgr.y (mgr.14146) 253 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:02.249 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:01 smithi106 bash[18459]: audit 2024-02-13T00:29:01.065649+0000 mgr.y (mgr.14146) 254 : audit [DBG] from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:29:02.249 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:01 smithi106 bash[18459]: audit 2024-02-13T00:29:01.072727+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:29:02.249 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:01 smithi106 bash[18459]: audit 2024-02-13T00:29:01.077435+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:29:02.249 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:01 smithi106 bash[18459]: audit 2024-02-13T00:29:01.078723+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:29:02.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:01 smithi080 bash[17386]: cluster 2024-02-13T00:29:00.751097+0000 mgr.y (mgr.14146) 253 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:02.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:01 smithi080 bash[17386]: audit 2024-02-13T00:29:01.065649+0000 mgr.y (mgr.14146) 254 : audit [DBG] from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:29:02.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:01 smithi080 bash[17386]: audit 2024-02-13T00:29:01.072727+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:29:02.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:01 smithi080 bash[17386]: audit 2024-02-13T00:29:01.077435+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:29:02.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:01 smithi080 bash[17386]: audit 2024-02-13T00:29:01.078723+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:29:02.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:01 smithi080 bash[24237]: cluster 2024-02-13T00:29:00.751097+0000 mgr.y (mgr.14146) 253 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:02.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:01 smithi080 bash[24237]: audit 2024-02-13T00:29:01.065649+0000 mgr.y (mgr.14146) 254 : audit [DBG] from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:29:02.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:01 smithi080 bash[24237]: audit 2024-02-13T00:29:01.072727+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T00:29:02.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:01 smithi080 bash[24237]: audit 2024-02-13T00:29:01.077435+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T00:29:02.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:01 smithi080 bash[24237]: audit 2024-02-13T00:29:01.078723+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:29:04.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:03 smithi106 bash[18459]: cluster 2024-02-13T00:29:02.751703+0000 mgr.y (mgr.14146) 255 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:04.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:03 smithi080 bash[17386]: cluster 2024-02-13T00:29:02.751703+0000 mgr.y (mgr.14146) 255 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:04.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:03 smithi080 bash[24237]: cluster 2024-02-13T00:29:02.751703+0000 mgr.y (mgr.14146) 255 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:05.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:05 smithi106 bash[18459]: cephadm 2024-02-13T00:29:04.161213+0000 mgr.y (mgr.14146) 256 : cephadm [INF] Detected new or changed devices on smithi106 2024-02-13T00:29:05.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:05 smithi106 bash[18459]: audit 2024-02-13T00:29:04.170976+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:05.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:05 smithi106 bash[18459]: audit 2024-02-13T00:29:04.172813+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:29:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:05 smithi106 bash[18459]: audit 2024-02-13T00:29:04.174082+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:29:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:05 smithi106 bash[18459]: audit 2024-02-13T00:29:04.175080+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:29:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:05 smithi106 bash[18459]: cephadm 2024-02-13T00:29:04.175834+0000 mgr.y (mgr.14146) 257 : cephadm [INF] Adjusting osd_memory_target on smithi106 to 5755M 2024-02-13T00:29:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:05 smithi106 bash[18459]: audit 2024-02-13T00:29:04.183723+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:05 smithi106 bash[18459]: audit 2024-02-13T00:29:04.185162+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:29:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:05 smithi106 bash[18459]: audit 2024-02-13T00:29:04.186344+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:29:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:05 smithi106 bash[18459]: audit 2024-02-13T00:29:04.192624+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:05 smithi080 bash[24237]: cephadm 2024-02-13T00:29:04.161213+0000 mgr.y (mgr.14146) 256 : cephadm [INF] Detected new or changed devices on smithi106 2024-02-13T00:29:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:05 smithi080 bash[24237]: audit 2024-02-13T00:29:04.170976+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:05 smithi080 bash[24237]: audit 2024-02-13T00:29:04.172813+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:29:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:05 smithi080 bash[24237]: audit 2024-02-13T00:29:04.174082+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:29:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:05 smithi080 bash[24237]: audit 2024-02-13T00:29:04.175080+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:29:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:05 smithi080 bash[24237]: cephadm 2024-02-13T00:29:04.175834+0000 mgr.y (mgr.14146) 257 : cephadm [INF] Adjusting osd_memory_target on smithi106 to 5755M 2024-02-13T00:29:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:05 smithi080 bash[24237]: audit 2024-02-13T00:29:04.183723+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:05 smithi080 bash[24237]: audit 2024-02-13T00:29:04.185162+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:29:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:05 smithi080 bash[24237]: audit 2024-02-13T00:29:04.186344+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:29:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:05 smithi080 bash[24237]: audit 2024-02-13T00:29:04.192624+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:05.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:05 smithi080 bash[17386]: cephadm 2024-02-13T00:29:04.161213+0000 mgr.y (mgr.14146) 256 : cephadm [INF] Detected new or changed devices on smithi106 2024-02-13T00:29:05.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:05 smithi080 bash[17386]: audit 2024-02-13T00:29:04.170976+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:05.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:05 smithi080 bash[17386]: audit 2024-02-13T00:29:04.172813+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:29:05.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:05 smithi080 bash[17386]: audit 2024-02-13T00:29:04.174082+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:29:05.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:05 smithi080 bash[17386]: audit 2024-02-13T00:29:04.175080+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:29:05.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:05 smithi080 bash[17386]: cephadm 2024-02-13T00:29:04.175834+0000 mgr.y (mgr.14146) 257 : cephadm [INF] Adjusting osd_memory_target on smithi106 to 5755M 2024-02-13T00:29:05.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:05 smithi080 bash[17386]: audit 2024-02-13T00:29:04.183723+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:05.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:05 smithi080 bash[17386]: audit 2024-02-13T00:29:04.185162+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:29:05.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:05 smithi080 bash[17386]: audit 2024-02-13T00:29:04.186344+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:29:05.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:05 smithi080 bash[17386]: audit 2024-02-13T00:29:04.192624+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:06.483 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:06 smithi106 bash[18459]: cluster 2024-02-13T00:29:04.752339+0000 mgr.y (mgr.14146) 258 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:06 smithi080 bash[24237]: cluster 2024-02-13T00:29:04.752339+0000 mgr.y (mgr.14146) 258 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:06.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:06 smithi080 bash[17386]: cluster 2024-02-13T00:29:04.752339+0000 mgr.y (mgr.14146) 258 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:08.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:08 smithi106 bash[18459]: cluster 2024-02-13T00:29:06.752861+0000 mgr.y (mgr.14146) 259 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:08.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:08 smithi080 bash[24237]: cluster 2024-02-13T00:29:06.752861+0000 mgr.y (mgr.14146) 259 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:08.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:08 smithi080 bash[17386]: cluster 2024-02-13T00:29:06.752861+0000 mgr.y (mgr.14146) 259 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:09.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:09 smithi106 bash[18459]: cluster 2024-02-13T00:29:08.753436+0000 mgr.y (mgr.14146) 260 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:09.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:09 smithi080 bash[24237]: cluster 2024-02-13T00:29:08.753436+0000 mgr.y (mgr.14146) 260 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:09.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:09 smithi080 bash[17386]: cluster 2024-02-13T00:29:08.753436+0000 mgr.y (mgr.14146) 260 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:10.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:10 smithi106 bash[18459]: audit 2024-02-13T00:29:09.949203+0000 mon.a (mon.0) 498 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ced0927-8fb9-4c30-8a8b-0d1b7d49ad39"}]: dispatch 2024-02-13T00:29:10.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:10 smithi106 bash[18459]: audit 2024-02-13T00:29:09.950126+0000 mon.b (mon.1) 19 : audit [INF] from='client.? 172.21.15.106:0/409585611' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ced0927-8fb9-4c30-8a8b-0d1b7d49ad39"}]: dispatch 2024-02-13T00:29:10.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:10 smithi106 bash[18459]: audit 2024-02-13T00:29:09.957487+0000 mon.a (mon.0) 499 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ced0927-8fb9-4c30-8a8b-0d1b7d49ad39"}]': finished 2024-02-13T00:29:10.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:10 smithi106 bash[18459]: cluster 2024-02-13T00:29:09.957660+0000 mon.a (mon.0) 500 : cluster [DBG] osdmap e45: 8 total, 7 up, 8 in 2024-02-13T00:29:10.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:10 smithi106 bash[18459]: audit 2024-02-13T00:29:09.957866+0000 mon.a (mon.0) 501 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T00:29:10.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:10 smithi080 bash[24237]: audit 2024-02-13T00:29:09.949203+0000 mon.a (mon.0) 498 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ced0927-8fb9-4c30-8a8b-0d1b7d49ad39"}]: dispatch 2024-02-13T00:29:10.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:10 smithi080 bash[24237]: audit 2024-02-13T00:29:09.950126+0000 mon.b (mon.1) 19 : audit [INF] from='client.? 172.21.15.106:0/409585611' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ced0927-8fb9-4c30-8a8b-0d1b7d49ad39"}]: dispatch 2024-02-13T00:29:10.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:10 smithi080 bash[24237]: audit 2024-02-13T00:29:09.957487+0000 mon.a (mon.0) 499 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ced0927-8fb9-4c30-8a8b-0d1b7d49ad39"}]': finished 2024-02-13T00:29:10.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:10 smithi080 bash[24237]: cluster 2024-02-13T00:29:09.957660+0000 mon.a (mon.0) 500 : cluster [DBG] osdmap e45: 8 total, 7 up, 8 in 2024-02-13T00:29:10.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:10 smithi080 bash[24237]: audit 2024-02-13T00:29:09.957866+0000 mon.a (mon.0) 501 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T00:29:10.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:10 smithi080 bash[17386]: audit 2024-02-13T00:29:09.949203+0000 mon.a (mon.0) 498 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ced0927-8fb9-4c30-8a8b-0d1b7d49ad39"}]: dispatch 2024-02-13T00:29:10.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:10 smithi080 bash[17386]: audit 2024-02-13T00:29:09.950126+0000 mon.b (mon.1) 19 : audit [INF] from='client.? 172.21.15.106:0/409585611' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ced0927-8fb9-4c30-8a8b-0d1b7d49ad39"}]: dispatch 2024-02-13T00:29:10.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:10 smithi080 bash[17386]: audit 2024-02-13T00:29:09.957487+0000 mon.a (mon.0) 499 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ced0927-8fb9-4c30-8a8b-0d1b7d49ad39"}]': finished 2024-02-13T00:29:10.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:10 smithi080 bash[17386]: cluster 2024-02-13T00:29:09.957660+0000 mon.a (mon.0) 500 : cluster [DBG] osdmap e45: 8 total, 7 up, 8 in 2024-02-13T00:29:10.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:10 smithi080 bash[17386]: audit 2024-02-13T00:29:09.957866+0000 mon.a (mon.0) 501 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T00:29:11.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:11 smithi106 bash[18459]: audit 2024-02-13T00:29:10.702986+0000 mon.b (mon.1) 20 : audit [DBG] from='client.? 172.21.15.106:0/3711832549' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:29:11.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:11 smithi106 bash[18459]: cluster 2024-02-13T00:29:10.753976+0000 mgr.y (mgr.14146) 261 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:11.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:11 smithi080 bash[24237]: audit 2024-02-13T00:29:10.702986+0000 mon.b (mon.1) 20 : audit [DBG] from='client.? 172.21.15.106:0/3711832549' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:29:11.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:11 smithi080 bash[24237]: cluster 2024-02-13T00:29:10.753976+0000 mgr.y (mgr.14146) 261 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:11.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:11 smithi080 bash[17386]: audit 2024-02-13T00:29:10.702986+0000 mon.b (mon.1) 20 : audit [DBG] from='client.? 172.21.15.106:0/3711832549' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T00:29:11.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:11 smithi080 bash[17386]: cluster 2024-02-13T00:29:10.753976+0000 mgr.y (mgr.14146) 261 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:13 smithi106 bash[18459]: cluster 2024-02-13T00:29:12.754535+0000 mgr.y (mgr.14146) 262 : cluster [DBG] pgmap v248: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:14.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:13 smithi080 bash[17386]: cluster 2024-02-13T00:29:12.754535+0000 mgr.y (mgr.14146) 262 : cluster [DBG] pgmap v248: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:14.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:13 smithi080 bash[24237]: cluster 2024-02-13T00:29:12.754535+0000 mgr.y (mgr.14146) 262 : cluster [DBG] pgmap v248: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:15.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:15 smithi106 bash[18459]: cluster 2024-02-13T00:29:14.755130+0000 mgr.y (mgr.14146) 263 : cluster [DBG] pgmap v249: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:15.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:15 smithi080 bash[17386]: cluster 2024-02-13T00:29:14.755130+0000 mgr.y (mgr.14146) 263 : cluster [DBG] pgmap v249: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:15.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:15 smithi080 bash[24237]: cluster 2024-02-13T00:29:14.755130+0000 mgr.y (mgr.14146) 263 : cluster [DBG] pgmap v249: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:18.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:17 smithi106 bash[18459]: cluster 2024-02-13T00:29:16.755655+0000 mgr.y (mgr.14146) 264 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:18.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:17 smithi080 bash[17386]: cluster 2024-02-13T00:29:16.755655+0000 mgr.y (mgr.14146) 264 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:18.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:17 smithi080 bash[24237]: cluster 2024-02-13T00:29:16.755655+0000 mgr.y (mgr.14146) 264 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:20.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:19 smithi106 bash[18459]: cluster 2024-02-13T00:29:18.756220+0000 mgr.y (mgr.14146) 265 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:20.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:19 smithi080 bash[17386]: cluster 2024-02-13T00:29:18.756220+0000 mgr.y (mgr.14146) 265 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:20.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:19 smithi080 bash[24237]: cluster 2024-02-13T00:29:18.756220+0000 mgr.y (mgr.14146) 265 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:22.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:21 smithi106 bash[18459]: cluster 2024-02-13T00:29:20.756728+0000 mgr.y (mgr.14146) 266 : cluster [DBG] pgmap v252: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:22.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:21 smithi080 bash[17386]: cluster 2024-02-13T00:29:20.756728+0000 mgr.y (mgr.14146) 266 : cluster [DBG] pgmap v252: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:22.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:21 smithi080 bash[24237]: cluster 2024-02-13T00:29:20.756728+0000 mgr.y (mgr.14146) 266 : cluster [DBG] pgmap v252: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:23.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:22 smithi106 bash[18459]: audit 2024-02-13T00:29:22.326975+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-13T00:29:23.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:22 smithi106 bash[18459]: audit 2024-02-13T00:29:22.328731+0000 mon.a (mon.0) 503 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:29:23.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:22 smithi080 bash[17386]: audit 2024-02-13T00:29:22.326975+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-13T00:29:23.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:22 smithi080 bash[17386]: audit 2024-02-13T00:29:22.328731+0000 mon.a (mon.0) 503 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:29:23.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:22 smithi080 bash[24237]: audit 2024-02-13T00:29:22.326975+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-13T00:29:23.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:22 smithi080 bash[24237]: audit 2024-02-13T00:29:22.328731+0000 mon.a (mon.0) 503 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:29:24.178 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:23 smithi106 bash[18459]: cephadm 2024-02-13T00:29:22.329922+0000 mgr.y (mgr.14146) 267 : cephadm [INF] Deploying daemon osd.7 on smithi106 2024-02-13T00:29:24.178 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:23 smithi106 bash[18459]: cluster 2024-02-13T00:29:22.757232+0000 mgr.y (mgr.14146) 268 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:24.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:23 smithi080 bash[17386]: cephadm 2024-02-13T00:29:22.329922+0000 mgr.y (mgr.14146) 267 : cephadm [INF] Deploying daemon osd.7 on smithi106 2024-02-13T00:29:24.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:23 smithi080 bash[17386]: cluster 2024-02-13T00:29:22.757232+0000 mgr.y (mgr.14146) 268 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:24.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:23 smithi080 bash[24237]: cephadm 2024-02-13T00:29:22.329922+0000 mgr.y (mgr.14146) 267 : cephadm [INF] Deploying daemon osd.7 on smithi106 2024-02-13T00:29:24.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:23 smithi080 bash[24237]: cluster 2024-02-13T00:29:22.757232+0000 mgr.y (mgr.14146) 268 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:25.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:25 smithi106 bash[18459]: cluster 2024-02-13T00:29:24.757809+0000 mgr.y (mgr.14146) 269 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:25.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:25 smithi080 bash[17386]: cluster 2024-02-13T00:29:24.757809+0000 mgr.y (mgr.14146) 269 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:25.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:25 smithi080 bash[24237]: cluster 2024-02-13T00:29:24.757809+0000 mgr.y (mgr.14146) 269 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:27.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:27 smithi106 bash[18459]: audit 2024-02-13T00:29:26.547635+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:27.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:27 smithi106 bash[18459]: audit 2024-02-13T00:29:26.572357+0000 mon.a (mon.0) 505 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:29:27.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:27 smithi106 bash[18459]: cluster 2024-02-13T00:29:26.758326+0000 mgr.y (mgr.14146) 270 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:28.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:27 smithi080 bash[17386]: audit 2024-02-13T00:29:26.547635+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:28.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:27 smithi080 bash[17386]: audit 2024-02-13T00:29:26.572357+0000 mon.a (mon.0) 505 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:29:28.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:27 smithi080 bash[17386]: cluster 2024-02-13T00:29:26.758326+0000 mgr.y (mgr.14146) 270 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:28.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:27 smithi080 bash[24237]: audit 2024-02-13T00:29:26.547635+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:28.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:27 smithi080 bash[24237]: audit 2024-02-13T00:29:26.572357+0000 mon.a (mon.0) 505 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:29:28.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:27 smithi080 bash[24237]: cluster 2024-02-13T00:29:26.758326+0000 mgr.y (mgr.14146) 270 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:30.138 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:29 smithi106 bash[18459]: cluster 2024-02-13T00:29:28.758879+0000 mgr.y (mgr.14146) 271 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:30.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:29 smithi080 bash[17386]: cluster 2024-02-13T00:29:28.758879+0000 mgr.y (mgr.14146) 271 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:30.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:29 smithi080 bash[24237]: cluster 2024-02-13T00:29:28.758879+0000 mgr.y (mgr.14146) 271 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:32.225 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:31 smithi106 bash[18459]: cluster 2024-02-13T00:29:30.759432+0000 mgr.y (mgr.14146) 272 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:32.225 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:31 smithi106 bash[18459]: audit 2024-02-13T00:29:31.730939+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:32.225 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:31 smithi106 bash[18459]: audit 2024-02-13T00:29:31.732394+0000 mon.a (mon.0) 507 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:29:32.225 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:31 smithi106 bash[18459]: audit 2024-02-13T00:29:31.733713+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:29:32.225 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:31 smithi106 bash[18459]: audit 2024-02-13T00:29:31.740357+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:32.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:31 smithi080 bash[24237]: cluster 2024-02-13T00:29:30.759432+0000 mgr.y (mgr.14146) 272 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:32.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:31 smithi080 bash[24237]: audit 2024-02-13T00:29:31.730939+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:32.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:31 smithi080 bash[24237]: audit 2024-02-13T00:29:31.732394+0000 mon.a (mon.0) 507 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:29:32.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:31 smithi080 bash[24237]: audit 2024-02-13T00:29:31.733713+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:29:32.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:31 smithi080 bash[24237]: audit 2024-02-13T00:29:31.740357+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:32.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:31 smithi080 bash[17386]: cluster 2024-02-13T00:29:30.759432+0000 mgr.y (mgr.14146) 272 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:32.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:31 smithi080 bash[17386]: audit 2024-02-13T00:29:31.730939+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:32.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:31 smithi080 bash[17386]: audit 2024-02-13T00:29:31.732394+0000 mon.a (mon.0) 507 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:29:32.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:31 smithi080 bash[17386]: audit 2024-02-13T00:29:31.733713+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:29:32.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:31 smithi080 bash[17386]: audit 2024-02-13T00:29:31.740357+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:34.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:33 smithi106 bash[18459]: cluster 2024-02-13T00:29:32.760036+0000 mgr.y (mgr.14146) 273 : cluster [DBG] pgmap v258: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:34.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:33 smithi106 bash[18459]: audit 2024-02-13T00:29:33.160608+0000 mon.a (mon.0) 510 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-13T00:29:34.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:33 smithi106 bash[18459]: audit 2024-02-13T00:29:33.161356+0000 mon.b (mon.1) 21 : audit [INF] from='osd.7 [v2:172.21.15.106:6824/2273586184,v1:172.21.15.106:6825/2273586184]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-13T00:29:34.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:33 smithi080 bash[17386]: cluster 2024-02-13T00:29:32.760036+0000 mgr.y (mgr.14146) 273 : cluster [DBG] pgmap v258: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:34.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:33 smithi080 bash[17386]: audit 2024-02-13T00:29:33.160608+0000 mon.a (mon.0) 510 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-13T00:29:34.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:33 smithi080 bash[17386]: audit 2024-02-13T00:29:33.161356+0000 mon.b (mon.1) 21 : audit [INF] from='osd.7 [v2:172.21.15.106:6824/2273586184,v1:172.21.15.106:6825/2273586184]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-13T00:29:34.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:33 smithi080 bash[24237]: cluster 2024-02-13T00:29:32.760036+0000 mgr.y (mgr.14146) 273 : cluster [DBG] pgmap v258: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:34.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:33 smithi080 bash[24237]: audit 2024-02-13T00:29:33.160608+0000 mon.a (mon.0) 510 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-13T00:29:34.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:33 smithi080 bash[24237]: audit 2024-02-13T00:29:33.161356+0000 mon.b (mon.1) 21 : audit [INF] from='osd.7 [v2:172.21.15.106:6824/2273586184,v1:172.21.15.106:6825/2273586184]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-13T00:29:35.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:35.085+0000 7fcbf2ffd700 1 -- 172.21.15.106:0/1586440687 <== mgr.14146 v2:172.21.15.80:6800/461193090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fcbfc0591c0 con 0x7fcbe8061250 2024-02-13T00:29:35.089 INFO:teuthology.orchestra.run.smithi106.stdout:Created osd(s) 7 on host 'smithi106' 2024-02-13T00:29:35.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:35.089+0000 7fcc040cc700 1 -- 172.21.15.106:0/1586440687 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fcbe8061250 msgr2=0x7fcbe8063710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:35.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:35.089+0000 7fcc040cc700 1 --2- 172.21.15.106:0/1586440687 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fcbe8061250 0x7fcbe8063710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fcbf80048b0 tx=0x7fcbf800b040).stop 2024-02-13T00:29:35.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:35.089+0000 7fcc040cc700 1 -- 172.21.15.106:0/1586440687 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbfc0f7b00 msgr2=0x7fcbfc06ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:35.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:35.089+0000 7fcc040cc700 1 --2- 172.21.15.106:0/1586440687 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbfc0f7b00 0x7fcbfc06ca70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fcbec002820 tx=0x7fcbec002b30).stop 2024-02-13T00:29:35.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:35.089+0000 7fcc040cc700 1 -- 172.21.15.106:0/1586440687 shutdown_connections 2024-02-13T00:29:35.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:35.089+0000 7fcc040cc700 1 --2- 172.21.15.106:0/1586440687 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fcbe8061250 0x7fcbe8063710 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:35.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:35.089+0000 7fcc040cc700 1 --2- 172.21.15.106:0/1586440687 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbfc0f7b00 0x7fcbfc06ca70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:35.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:35.089+0000 7fcc040cc700 1 --2- 172.21.15.106:0/1586440687 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcbfc0f9520 0x7fcbfc06b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:35.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:35.089+0000 7fcc040cc700 1 --2- 172.21.15.106:0/1586440687 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcbfc0f8410 0x7fcbfc06b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:35.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:35.089+0000 7fcc040cc700 1 -- 172.21.15.106:0/1586440687 >> 172.21.15.106:0/1586440687 conn(0x7fcbfc0f3340 msgr2=0x7fcbfc0fc070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:29:35.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:35.089+0000 7fcc040cc700 1 -- 172.21.15.106:0/1586440687 shutdown_connections 2024-02-13T00:29:35.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:35.089+0000 7fcc040cc700 1 -- 172.21.15.106:0/1586440687 wait complete. 2024-02-13T00:29:35.123 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:34 smithi106 bash[18459]: audit 2024-02-13T00:29:33.835503+0000 mon.a (mon.0) 511 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-13T00:29:35.123 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:34 smithi106 bash[18459]: cluster 2024-02-13T00:29:33.835603+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e46: 8 total, 7 up, 8 in 2024-02-13T00:29:35.123 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:34 smithi106 bash[18459]: audit 2024-02-13T00:29:33.835788+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T00:29:35.123 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:34 smithi106 bash[18459]: audit 2024-02-13T00:29:33.837200+0000 mon.a (mon.0) 514 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:29:35.124 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:34 smithi106 bash[18459]: audit 2024-02-13T00:29:33.838293+0000 mon.b (mon.1) 22 : audit [INF] from='osd.7 [v2:172.21.15.106:6824/2273586184,v1:172.21.15.106:6825/2273586184]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:29:35.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:34 smithi080 bash[17386]: audit 2024-02-13T00:29:33.835503+0000 mon.a (mon.0) 511 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-13T00:29:35.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:34 smithi080 bash[17386]: cluster 2024-02-13T00:29:33.835603+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e46: 8 total, 7 up, 8 in 2024-02-13T00:29:35.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:34 smithi080 bash[17386]: audit 2024-02-13T00:29:33.835788+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T00:29:35.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:34 smithi080 bash[17386]: audit 2024-02-13T00:29:33.837200+0000 mon.a (mon.0) 514 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:29:35.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:34 smithi080 bash[17386]: audit 2024-02-13T00:29:33.838293+0000 mon.b (mon.1) 22 : audit [INF] from='osd.7 [v2:172.21.15.106:6824/2273586184,v1:172.21.15.106:6825/2273586184]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:29:35.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:34 smithi080 bash[24237]: audit 2024-02-13T00:29:33.835503+0000 mon.a (mon.0) 511 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-13T00:29:35.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:34 smithi080 bash[24237]: cluster 2024-02-13T00:29:33.835603+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e46: 8 total, 7 up, 8 in 2024-02-13T00:29:35.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:34 smithi080 bash[24237]: audit 2024-02-13T00:29:33.835788+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T00:29:35.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:34 smithi080 bash[24237]: audit 2024-02-13T00:29:33.837200+0000 mon.a (mon.0) 514 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:29:35.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:34 smithi080 bash[24237]: audit 2024-02-13T00:29:33.838293+0000 mon.b (mon.1) 22 : audit [INF] from='osd.7 [v2:172.21.15.106:6824/2273586184,v1:172.21.15.106:6825/2273586184]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-02-13T00:29:35.770 DEBUG:teuthology.orchestra.run.smithi106:osd.7> sudo journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.7.service 2024-02-13T00:29:35.772 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-02-13T00:29:35.773 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph osd stat -f json 2024-02-13T00:29:35.969 INFO:journalctl@ceph.osd.7.smithi106.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-13T00:29:36.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:35 smithi106 bash[18459]: cluster 2024-02-13T00:29:34.760631+0000 mgr.y (mgr.14146) 274 : cluster [DBG] pgmap v260: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:36.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:35 smithi106 bash[18459]: audit 2024-02-13T00:29:34.839770+0000 mon.a (mon.0) 515 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-02-13T00:29:36.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:35 smithi106 bash[18459]: cluster 2024-02-13T00:29:34.840009+0000 mon.a (mon.0) 516 : cluster [DBG] osdmap e47: 8 total, 7 up, 8 in 2024-02-13T00:29:36.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:35 smithi106 bash[18459]: audit 2024-02-13T00:29:34.840651+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T00:29:36.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:35 smithi106 bash[18459]: audit 2024-02-13T00:29:34.845949+0000 mon.a (mon.0) 518 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T00:29:36.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:35 smithi106 bash[18459]: audit 2024-02-13T00:29:35.084362+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:36.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:35 smithi106 bash[18459]: audit 2024-02-13T00:29:35.117925+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:29:36.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:35 smithi080 bash[17386]: cluster 2024-02-13T00:29:34.760631+0000 mgr.y (mgr.14146) 274 : cluster [DBG] pgmap v260: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:36.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:35 smithi080 bash[17386]: audit 2024-02-13T00:29:34.839770+0000 mon.a (mon.0) 515 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-02-13T00:29:36.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:35 smithi080 bash[17386]: cluster 2024-02-13T00:29:34.840009+0000 mon.a (mon.0) 516 : cluster [DBG] osdmap e47: 8 total, 7 up, 8 in 2024-02-13T00:29:36.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:35 smithi080 bash[17386]: audit 2024-02-13T00:29:34.840651+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T00:29:36.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:35 smithi080 bash[17386]: audit 2024-02-13T00:29:34.845949+0000 mon.a (mon.0) 518 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T00:29:36.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:35 smithi080 bash[17386]: audit 2024-02-13T00:29:35.084362+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:36.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:35 smithi080 bash[17386]: audit 2024-02-13T00:29:35.117925+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:29:36.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:35 smithi080 bash[24237]: cluster 2024-02-13T00:29:34.760631+0000 mgr.y (mgr.14146) 274 : cluster [DBG] pgmap v260: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:36.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:35 smithi080 bash[24237]: audit 2024-02-13T00:29:34.839770+0000 mon.a (mon.0) 515 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-02-13T00:29:36.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:35 smithi080 bash[24237]: cluster 2024-02-13T00:29:34.840009+0000 mon.a (mon.0) 516 : cluster [DBG] osdmap e47: 8 total, 7 up, 8 in 2024-02-13T00:29:36.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:35 smithi080 bash[24237]: audit 2024-02-13T00:29:34.840651+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T00:29:36.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:35 smithi080 bash[24237]: audit 2024-02-13T00:29:34.845949+0000 mon.a (mon.0) 518 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T00:29:36.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:35 smithi080 bash[24237]: audit 2024-02-13T00:29:35.084362+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:36.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:35 smithi080 bash[24237]: audit 2024-02-13T00:29:35.117925+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:29:37.238 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:36 smithi080 bash[17386]: cluster 2024-02-13T00:29:34.158328+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:29:37.238 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:36 smithi080 bash[17386]: cluster 2024-02-13T00:29:34.158409+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:29:37.238 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:36 smithi080 bash[17386]: audit 2024-02-13T00:29:35.849251+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T00:29:37.238 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:36 smithi080 bash[17386]: cluster 2024-02-13T00:29:35.855292+0000 mon.a (mon.0) 522 : cluster [INF] osd.7 [v2:172.21.15.106:6824/2273586184,v1:172.21.15.106:6825/2273586184] boot 2024-02-13T00:29:37.239 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:36 smithi080 bash[17386]: cluster 2024-02-13T00:29:35.855346+0000 mon.a (mon.0) 523 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2024-02-13T00:29:37.239 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:36 smithi080 bash[17386]: audit 2024-02-13T00:29:35.855546+0000 mon.a (mon.0) 524 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T00:29:37.239 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:36 smithi080 bash[24237]: cluster 2024-02-13T00:29:34.158328+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:29:37.239 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:36 smithi080 bash[24237]: cluster 2024-02-13T00:29:34.158409+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:29:37.239 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:36 smithi080 bash[24237]: audit 2024-02-13T00:29:35.849251+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T00:29:37.239 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:36 smithi080 bash[24237]: cluster 2024-02-13T00:29:35.855292+0000 mon.a (mon.0) 522 : cluster [INF] osd.7 [v2:172.21.15.106:6824/2273586184,v1:172.21.15.106:6825/2273586184] boot 2024-02-13T00:29:37.239 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:36 smithi080 bash[24237]: cluster 2024-02-13T00:29:35.855346+0000 mon.a (mon.0) 523 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2024-02-13T00:29:37.239 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:36 smithi080 bash[24237]: audit 2024-02-13T00:29:35.855546+0000 mon.a (mon.0) 524 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T00:29:37.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:36 smithi106 bash[18459]: cluster 2024-02-13T00:29:34.158328+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-13T00:29:37.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:36 smithi106 bash[18459]: cluster 2024-02-13T00:29:34.158409+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-13T00:29:37.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:36 smithi106 bash[18459]: audit 2024-02-13T00:29:35.849251+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T00:29:37.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:36 smithi106 bash[18459]: cluster 2024-02-13T00:29:35.855292+0000 mon.a (mon.0) 522 : cluster [INF] osd.7 [v2:172.21.15.106:6824/2273586184,v1:172.21.15.106:6825/2273586184] boot 2024-02-13T00:29:37.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:36 smithi106 bash[18459]: cluster 2024-02-13T00:29:35.855346+0000 mon.a (mon.0) 523 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2024-02-13T00:29:37.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:36 smithi106 bash[18459]: audit 2024-02-13T00:29:35.855546+0000 mon.a (mon.0) 524 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T00:29:38.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:37 smithi106 bash[18459]: cluster 2024-02-13T00:29:36.761143+0000 mgr.y (mgr.14146) 275 : cluster [DBG] pgmap v263: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:38.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:37 smithi106 bash[18459]: cluster 2024-02-13T00:29:36.859713+0000 mon.a (mon.0) 525 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-02-13T00:29:38.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:37 smithi080 bash[17386]: cluster 2024-02-13T00:29:36.761143+0000 mgr.y (mgr.14146) 275 : cluster [DBG] pgmap v263: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:38.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:37 smithi080 bash[17386]: cluster 2024-02-13T00:29:36.859713+0000 mon.a (mon.0) 525 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-02-13T00:29:38.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:37 smithi080 bash[24237]: cluster 2024-02-13T00:29:36.761143+0000 mgr.y (mgr.14146) 275 : cluster [DBG] pgmap v263: 1 pgs: 1 active+clean; 0 B data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-02-13T00:29:38.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:37 smithi080 bash[24237]: cluster 2024-02-13T00:29:36.859713+0000 mon.a (mon.0) 525 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-02-13T00:29:39.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.112+0000 7f6d9b579700 1 -- 172.21.15.80:0/2603053524 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d940f6a50 msgr2=0x7f6d940f6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:39.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.112+0000 7f6d9b579700 1 --2- 172.21.15.80:0/2603053524 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d940f6a50 0x7f6d940f6e70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f6d90004870 tx=0x7f6d90009cb0).stop 2024-02-13T00:29:39.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.112+0000 7f6d9b579700 1 -- 172.21.15.80:0/2603053524 shutdown_connections 2024-02-13T00:29:39.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.112+0000 7f6d9b579700 1 --2- 172.21.15.80:0/2603053524 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6d940f8640 0x7f6d940fef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:39.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.112+0000 7f6d9b579700 1 --2- 172.21.15.80:0/2603053524 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d940f6a50 0x7f6d940f6e70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:39.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.112+0000 7f6d9b579700 1 --2- 172.21.15.80:0/2603053524 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d940f7cf0 0x7f6d940f8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:39.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.112+0000 7f6d9b579700 1 -- 172.21.15.80:0/2603053524 >> 172.21.15.80:0/2603053524 conn(0x7f6d940f2230 msgr2=0x7f6d940f4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:29:39.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d9b579700 1 -- 172.21.15.80:0/2603053524 shutdown_connections 2024-02-13T00:29:39.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d9b579700 1 -- 172.21.15.80:0/2603053524 wait complete. 2024-02-13T00:29:39.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d9b579700 1 Processor -- start 2024-02-13T00:29:39.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d9b579700 1 -- start start 2024-02-13T00:29:39.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d9b579700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d940f6a50 0x7f6d94107e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:39.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d9b579700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6d940f7cf0 0x7f6d94108380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:39.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d9b579700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d940f8640 0x7f6d9410f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:39.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d9b579700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9410f950 con 0x7f6d940f8640 2024-02-13T00:29:39.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d9b579700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9410fa90 con 0x7f6d940f6a50 2024-02-13T00:29:39.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d9b579700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9410fbd0 con 0x7f6d940f7cf0 2024-02-13T00:29:39.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d98b14700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6d940f7cf0 0x7f6d94108380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:39.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d98b14700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6d940f7cf0 0x7f6d94108380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:40464/0 (socket says 172.21.15.80:40464) 2024-02-13T00:29:39.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d99b16700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d940f8640 0x7f6d9410f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:39.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d98b14700 1 -- 172.21.15.80:0/2055253781 learned_addr learned my addr 172.21.15.80:0/2055253781 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:29:39.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d99315700 1 --2- 172.21.15.80:0/2055253781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d940f6a50 0x7f6d94107e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:39.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d98b14700 1 -- 172.21.15.80:0/2055253781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d940f6a50 msgr2=0x7f6d94107e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:39.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d98b14700 1 --2- 172.21.15.80:0/2055253781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d940f6a50 0x7f6d94107e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:39.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d98b14700 1 -- 172.21.15.80:0/2055253781 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d940f8640 msgr2=0x7f6d9410f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:39.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d98b14700 1 --2- 172.21.15.80:0/2055253781 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d940f8640 0x7f6d9410f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:39.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d98b14700 1 -- 172.21.15.80:0/2055253781 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d90005040 con 0x7f6d940f7cf0 2024-02-13T00:29:39.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d99b16700 1 --2- 172.21.15.80:0/2055253781 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d940f8640 0x7f6d9410f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:29:39.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d98b14700 1 --2- 172.21.15.80:0/2055253781 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6d940f7cf0 0x7f6d94108380 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f6d8400c7c0 tx=0x7f6d84007ef0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:29:39.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d8a7fc700 1 -- 172.21.15.80:0/2055253781 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d84004430 con 0x7f6d940f7cf0 2024-02-13T00:29:39.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d8a7fc700 1 -- 172.21.15.80:0/2055253781 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f6d8400e930 con 0x7f6d940f7cf0 2024-02-13T00:29:39.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d9b579700 1 -- 172.21.15.80:0/2055253781 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d940f8f70 con 0x7f6d940f7cf0 2024-02-13T00:29:39.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d8a7fc700 1 -- 172.21.15.80:0/2055253781 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d84013880 con 0x7f6d940f7cf0 2024-02-13T00:29:39.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.116+0000 7f6d9b579700 1 -- 172.21.15.80:0/2055253781 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d940f9530 con 0x7f6d940f7cf0 2024-02-13T00:29:39.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.120+0000 7f6d9b579700 1 -- 172.21.15.80:0/2055253781 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d941016c0 con 0x7f6d940f7cf0 2024-02-13T00:29:39.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.120+0000 7f6d8a7fc700 1 -- 172.21.15.80:0/2055253781 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 14) v1 ==== 77064+0+0 (secure 0 0 0) 0x7f6d8400eaa0 con 0x7f6d940f7cf0 2024-02-13T00:29:39.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.120+0000 7f6d8a7fc700 1 --2- 172.21.15.80:0/2055253781 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f6d80061250 0x7f6d80063710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:39.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.120+0000 7f6d8a7fc700 1 -- 172.21.15.80:0/2055253781 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5260+0+0 (secure 0 0 0) 0x7f6d8407c740 con 0x7f6d940f7cf0 2024-02-13T00:29:39.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.120+0000 7f6d99315700 1 --2- 172.21.15.80:0/2055253781 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f6d80061250 0x7f6d80063710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:39.125 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.120+0000 7f6d99315700 1 --2- 172.21.15.80:0/2055253781 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f6d80061250 0x7f6d80063710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f6d90004ee0 tx=0x7f6d90009cb0).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:29:39.131 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.128+0000 7f6d8a7fc700 1 -- 172.21.15.80:0/2055253781 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f6d8404cdb0 con 0x7f6d940f7cf0 2024-02-13T00:29:39.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:38 smithi106 bash[18459]: cluster 2024-02-13T00:29:37.867659+0000 mon.a (mon.0) 526 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-02-13T00:29:39.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:38 smithi080 bash[17386]: cluster 2024-02-13T00:29:37.867659+0000 mon.a (mon.0) 526 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-02-13T00:29:39.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:38 smithi080 bash[24237]: cluster 2024-02-13T00:29:37.867659+0000 mon.a (mon.0) 526 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-02-13T00:29:39.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.312+0000 7f6d9b579700 1 -- 172.21.15.80:0/2055253781 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f6d940f97e0 con 0x7f6d940f7cf0 2024-02-13T00:29:39.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.312+0000 7f6d8a7fc700 1 -- 172.21.15.80:0/2055253781 <== mon.2 v2:172.21.15.80:3301/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v50) v1 ==== 74+0+130 (secure 0 0 0) 0x7f6d840171b0 con 0x7f6d940f7cf0 2024-02-13T00:29:39.317 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-13T00:29:39.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.316+0000 7f6d9b579700 1 -- 172.21.15.80:0/2055253781 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f6d80061250 msgr2=0x7f6d80063710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:39.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.316+0000 7f6d9b579700 1 --2- 172.21.15.80:0/2055253781 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f6d80061250 0x7f6d80063710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f6d90004ee0 tx=0x7f6d90009cb0).stop 2024-02-13T00:29:39.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.316+0000 7f6d9b579700 1 -- 172.21.15.80:0/2055253781 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6d940f7cf0 msgr2=0x7f6d94108380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:39.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.316+0000 7f6d9b579700 1 --2- 172.21.15.80:0/2055253781 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6d940f7cf0 0x7f6d94108380 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f6d8400c7c0 tx=0x7f6d84007ef0).stop 2024-02-13T00:29:39.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.316+0000 7f6d9b579700 1 -- 172.21.15.80:0/2055253781 shutdown_connections 2024-02-13T00:29:39.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.316+0000 7f6d9b579700 1 --2- 172.21.15.80:0/2055253781 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f6d80061250 0x7f6d80063710 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:39.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.316+0000 7f6d9b579700 1 --2- 172.21.15.80:0/2055253781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d940f6a50 0x7f6d94107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:39.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.316+0000 7f6d9b579700 1 --2- 172.21.15.80:0/2055253781 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6d940f8640 0x7f6d9410f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:39.320 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.316+0000 7f6d9b579700 1 --2- 172.21.15.80:0/2055253781 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6d940f7cf0 0x7f6d94108380 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:39.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.316+0000 7f6d9b579700 1 -- 172.21.15.80:0/2055253781 >> 172.21.15.80:0/2055253781 conn(0x7f6d940f2230 msgr2=0x7f6d94060b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:29:39.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.316+0000 7f6d9b579700 1 -- 172.21.15.80:0/2055253781 shutdown_connections 2024-02-13T00:29:39.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:29:39.316+0000 7f6d9b579700 1 -- 172.21.15.80:0/2055253781 wait complete. 2024-02-13T00:29:40.088 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":50,"num_osds":8,"num_up_osds":8,"osd_up_since":1707784175,"num_in_osds":8,"osd_in_since":1707784149,"num_remapped_pgs":0} 2024-02-13T00:29:40.089 INFO:tasks.cephadm:Adding ceph.rgw.foo.a on smithi080 2024-02-13T00:29:40.089 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph orch apply rgw foo.a --placement '1;smithi080=foo.a' 2024-02-13T00:29:40.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:39 smithi106 bash[18459]: cluster 2024-02-13T00:29:38.761786+0000 mgr.y (mgr.14146) 276 : cluster [DBG] pgmap v266: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:40.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:39 smithi106 bash[18459]: audit 2024-02-13T00:29:39.313418+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? 172.21.15.80:0/2055253781' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-13T00:29:40.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:39 smithi080 bash[17386]: cluster 2024-02-13T00:29:38.761786+0000 mgr.y (mgr.14146) 276 : cluster [DBG] pgmap v266: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:40.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:39 smithi080 bash[17386]: audit 2024-02-13T00:29:39.313418+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? 172.21.15.80:0/2055253781' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-13T00:29:40.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:39 smithi080 bash[24237]: cluster 2024-02-13T00:29:38.761786+0000 mgr.y (mgr.14146) 276 : cluster [DBG] pgmap v266: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:40.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:39 smithi080 bash[24237]: audit 2024-02-13T00:29:39.313418+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? 172.21.15.80:0/2055253781' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-13T00:29:42.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:41 smithi106 bash[18459]: cluster 2024-02-13T00:29:40.762379+0000 mgr.y (mgr.14146) 277 : cluster [DBG] pgmap v267: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:42.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:41 smithi080 bash[17386]: cluster 2024-02-13T00:29:40.762379+0000 mgr.y (mgr.14146) 277 : cluster [DBG] pgmap v267: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:42.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:41 smithi080 bash[24237]: cluster 2024-02-13T00:29:40.762379+0000 mgr.y (mgr.14146) 277 : cluster [DBG] pgmap v267: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:44.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:43 smithi106 bash[18459]: cluster 2024-02-13T00:29:42.762961+0000 mgr.y (mgr.14146) 278 : cluster [DBG] pgmap v268: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:44.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:43 smithi080 bash[17386]: cluster 2024-02-13T00:29:42.762961+0000 mgr.y (mgr.14146) 278 : cluster [DBG] pgmap v268: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:44.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:43 smithi080 bash[24237]: cluster 2024-02-13T00:29:42.762961+0000 mgr.y (mgr.14146) 278 : cluster [DBG] pgmap v268: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:44.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f91f86700 1 -- 172.21.15.106:0/2785271588 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f8c0f6250 msgr2=0x7f1f8c0f66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:44.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f91f86700 1 --2- 172.21.15.106:0/2785271588 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f8c0f6250 0x7f1f8c0f66d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f1f84009be0 tx=0x7f1f84004d10).stop 2024-02-13T00:29:44.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f91f86700 1 -- 172.21.15.106:0/2785271588 shutdown_connections 2024-02-13T00:29:44.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f91f86700 1 --2- 172.21.15.106:0/2785271588 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f8c0f6250 0x7f1f8c0f66d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:44.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f91f86700 1 --2- 172.21.15.106:0/2785271588 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1f8c0f9160 0x7f1f8c0f9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:44.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f91f86700 1 --2- 172.21.15.106:0/2785271588 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f8c0f9a70 0x7f1f8c0f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:44.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f91f86700 1 -- 172.21.15.106:0/2785271588 >> 172.21.15.106:0/2785271588 conn(0x7f1f8c0f19a0 msgr2=0x7f1f8c0f3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:29:44.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f91f86700 1 -- 172.21.15.106:0/2785271588 shutdown_connections 2024-02-13T00:29:44.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f91f86700 1 -- 172.21.15.106:0/2785271588 wait complete. 2024-02-13T00:29:44.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f91f86700 1 Processor -- start 2024-02-13T00:29:44.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f91f86700 1 -- start start 2024-02-13T00:29:44.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f91f86700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f8c0f6250 0x7f1f8c0f8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:44.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f91f86700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f8c0f9160 0x7f1f8c0f6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:44.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f91f86700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1f8c0f9a70 0x7f1f8c0f73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:44.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f91f86700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0f79c0 con 0x7f1f8c0f6250 2024-02-13T00:29:44.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f91f86700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0f7b30 con 0x7f1f8c0f9160 2024-02-13T00:29:44.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f91f86700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0f7cf0 con 0x7f1f8c0f9a70 2024-02-13T00:29:44.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f8affd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f8c0f9160 0x7f1f8c0f6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:44.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f8affd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f8c0f9160 0x7f1f8c0f6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59608/0 (socket says 172.21.15.106:59608) 2024-02-13T00:29:44.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f8affd700 1 -- 172.21.15.106:0/2607623264 learned_addr learned my addr 172.21.15.106:0/2607623264 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-02-13T00:29:44.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f8b7fe700 1 --2- 172.21.15.106:0/2607623264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f8c0f6250 0x7f1f8c0f8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:44.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f8bfff700 1 --2- 172.21.15.106:0/2607623264 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1f8c0f9a70 0x7f1f8c0f73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:44.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f8affd700 1 -- 172.21.15.106:0/2607623264 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1f8c0f9a70 msgr2=0x7f1f8c0f73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:44.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f8affd700 1 --2- 172.21.15.106:0/2607623264 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1f8c0f9a70 0x7f1f8c0f73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:44.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f8affd700 1 -- 172.21.15.106:0/2607623264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f8c0f6250 msgr2=0x7f1f8c0f8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:44.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f8affd700 1 --2- 172.21.15.106:0/2607623264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f8c0f6250 0x7f1f8c0f8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:44.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f8affd700 1 -- 172.21.15.106:0/2607623264 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f840097c0 con 0x7f1f8c0f9160 2024-02-13T00:29:44.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f8affd700 1 --2- 172.21.15.106:0/2607623264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f8c0f9160 0x7f1f8c0f6eb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1f740028a0 tx=0x7f1f74009f60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:29:44.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.336+0000 7f1f88ff9700 1 -- 172.21.15.106:0/2607623264 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f74007b40 con 0x7f1f8c0f9160 2024-02-13T00:29:44.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.340+0000 7f1f88ff9700 1 -- 172.21.15.106:0/2607623264 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f1f7400f040 con 0x7f1f8c0f9160 2024-02-13T00:29:44.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.340+0000 7f1f91f86700 1 -- 172.21.15.106:0/2607623264 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8c111ba0 con 0x7f1f8c0f9160 2024-02-13T00:29:44.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.340+0000 7f1f88ff9700 1 -- 172.21.15.106:0/2607623264 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f74014690 con 0x7f1f8c0f9160 2024-02-13T00:29:44.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.340+0000 7f1f91f86700 1 -- 172.21.15.106:0/2607623264 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8c112090 con 0x7f1f8c0f9160 2024-02-13T00:29:44.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.340+0000 7f1f827fc700 1 -- 172.21.15.106:0/2607623264 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f70004f20 con 0x7f1f8c0f9160 2024-02-13T00:29:44.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.340+0000 7f1f88ff9700 1 -- 172.21.15.106:0/2607623264 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 14) v1 ==== 77064+0+0 (secure 0 0 0) 0x7f1f74009110 con 0x7f1f8c0f9160 2024-02-13T00:29:44.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.340+0000 7f1f88ff9700 1 --2- 172.21.15.106:0/2607623264 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f1f78061250 0x7f1f78063710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:44.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.340+0000 7f1f88ff9700 1 -- 172.21.15.106:0/2607623264 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5260+0+0 (secure 0 0 0) 0x7f1f7407c5a0 con 0x7f1f8c0f9160 2024-02-13T00:29:44.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.340+0000 7f1f8b7fe700 1 --2- 172.21.15.106:0/2607623264 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f1f78061250 0x7f1f78063710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:44.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.340+0000 7f1f8b7fe700 1 --2- 172.21.15.106:0/2607623264 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f1f78061250 0x7f1f78063710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f1f7c004dc0 tx=0x7f1f7c00b040).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:29:44.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.348+0000 7f1f88ff9700 1 -- 172.21.15.106:0/2607623264 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1f7404cb70 con 0x7f1f8c0f9160 2024-02-13T00:29:44.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.544+0000 7f1f827fc700 1 -- 172.21.15.106:0/2607623264 --> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] -- mgr_command(tid 0: {"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi080=foo.a", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f70000bc0 con 0x7f1f78061250 2024-02-13T00:29:44.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.556+0000 7f1f88ff9700 1 -- 172.21.15.106:0/2607623264 <== mgr.14146 v2:172.21.15.80:6800/461193090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+30 (secure 0 0 0) 0x7f1f70000bc0 con 0x7f1f78061250 2024-02-13T00:29:44.561 INFO:teuthology.orchestra.run.smithi106.stdout:Scheduled rgw.foo.a update... 2024-02-13T00:29:44.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.560+0000 7f1f827fc700 1 -- 172.21.15.106:0/2607623264 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f1f78061250 msgr2=0x7f1f78063710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:44.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.560+0000 7f1f827fc700 1 --2- 172.21.15.106:0/2607623264 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f1f78061250 0x7f1f78063710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f1f7c004dc0 tx=0x7f1f7c00b040).stop 2024-02-13T00:29:44.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.560+0000 7f1f827fc700 1 -- 172.21.15.106:0/2607623264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f8c0f9160 msgr2=0x7f1f8c0f6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:44.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.560+0000 7f1f827fc700 1 --2- 172.21.15.106:0/2607623264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f8c0f9160 0x7f1f8c0f6eb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1f740028a0 tx=0x7f1f74009f60).stop 2024-02-13T00:29:44.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.560+0000 7f1f827fc700 1 -- 172.21.15.106:0/2607623264 shutdown_connections 2024-02-13T00:29:44.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.560+0000 7f1f827fc700 1 --2- 172.21.15.106:0/2607623264 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1f8c0f9a70 0x7f1f8c0f73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:44.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.560+0000 7f1f827fc700 1 --2- 172.21.15.106:0/2607623264 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1f8c0f6250 0x7f1f8c0f8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:44.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.560+0000 7f1f827fc700 1 --2- 172.21.15.106:0/2607623264 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f1f78061250 0x7f1f78063710 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:44.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.560+0000 7f1f827fc700 1 --2- 172.21.15.106:0/2607623264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f8c0f9160 0x7f1f8c0f6eb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:44.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.560+0000 7f1f827fc700 1 -- 172.21.15.106:0/2607623264 >> 172.21.15.106:0/2607623264 conn(0x7f1f8c0f19a0 msgr2=0x7f1f8c0f3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:29:44.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.560+0000 7f1f827fc700 1 -- 172.21.15.106:0/2607623264 shutdown_connections 2024-02-13T00:29:44.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:44.560+0000 7f1f827fc700 1 -- 172.21.15.106:0/2607623264 wait complete. 2024-02-13T00:29:45.567 DEBUG:teuthology.orchestra.run.smithi080:rgw.foo.a> sudo journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@rgw.foo.a.service 2024-02-13T00:29:45.569 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi106 2024-02-13T00:29:45.569 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph osd pool create iscsi 3 3 replicated 2024-02-13T00:29:45.709 INFO:journalctl@ceph.rgw.foo.a.smithi080.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-13T00:29:45.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:45 smithi106 bash[18459]: audit 2024-02-13T00:29:44.546071+0000 mgr.y (mgr.14146) 279 : audit [DBG] from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi080=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:29:45.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:45 smithi106 bash[18459]: cephadm 2024-02-13T00:29:44.549737+0000 mgr.y (mgr.14146) 280 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi080=foo.a;count:1 2024-02-13T00:29:45.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:45 smithi106 bash[18459]: audit 2024-02-13T00:29:44.556324+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:45.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:45 smithi106 bash[18459]: cluster 2024-02-13T00:29:44.763453+0000 mgr.y (mgr.14146) 281 : cluster [DBG] pgmap v269: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:46.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:45 smithi080 bash[17386]: audit 2024-02-13T00:29:44.546071+0000 mgr.y (mgr.14146) 279 : audit [DBG] from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi080=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:29:46.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:45 smithi080 bash[17386]: cephadm 2024-02-13T00:29:44.549737+0000 mgr.y (mgr.14146) 280 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi080=foo.a;count:1 2024-02-13T00:29:46.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:45 smithi080 bash[17386]: audit 2024-02-13T00:29:44.556324+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:46.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:45 smithi080 bash[17386]: cluster 2024-02-13T00:29:44.763453+0000 mgr.y (mgr.14146) 281 : cluster [DBG] pgmap v269: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:46.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:45 smithi080 bash[24237]: audit 2024-02-13T00:29:44.546071+0000 mgr.y (mgr.14146) 279 : audit [DBG] from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi080=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:29:46.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:45 smithi080 bash[24237]: cephadm 2024-02-13T00:29:44.549737+0000 mgr.y (mgr.14146) 280 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi080=foo.a;count:1 2024-02-13T00:29:46.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:45 smithi080 bash[24237]: audit 2024-02-13T00:29:44.556324+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:46.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:45 smithi080 bash[24237]: cluster 2024-02-13T00:29:44.763453+0000 mgr.y (mgr.14146) 281 : cluster [DBG] pgmap v269: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:47.842 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[24237]: cephadm 2024-02-13T00:29:46.551359+0000 mgr.y (mgr.14146) 282 : cephadm [INF] Detected new or changed devices on smithi106 2024-02-13T00:29:47.842 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[24237]: audit 2024-02-13T00:29:46.560881+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:47.842 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[24237]: audit 2024-02-13T00:29:46.562980+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:29:47.842 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[24237]: audit 2024-02-13T00:29:46.564300+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:29:47.842 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[24237]: audit 2024-02-13T00:29:46.565502+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:29:47.842 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[24237]: audit 2024-02-13T00:29:46.566647+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:29:47.842 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[24237]: cephadm 2024-02-13T00:29:46.567545+0000 mgr.y (mgr.14146) 283 : cephadm [INF] Adjusting osd_memory_target on smithi106 to 4316M 2024-02-13T00:29:47.842 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[24237]: audit 2024-02-13T00:29:46.572644+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:47.843 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[24237]: audit 2024-02-13T00:29:46.574137+0000 mon.a (mon.0) 534 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:29:47.843 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[24237]: audit 2024-02-13T00:29:46.575302+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:29:47.843 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[24237]: audit 2024-02-13T00:29:46.581536+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:47.843 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[24237]: cephadm 2024-02-13T00:29:46.585717+0000 mgr.y (mgr.14146) 284 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi080=foo.a;count:1 2024-02-13T00:29:47.843 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[24237]: audit 2024-02-13T00:29:46.590111+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:47.843 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[24237]: audit 2024-02-13T00:29:46.591105+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-13T00:29:47.843 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[24237]: audit 2024-02-13T00:29:46.595710+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-13T00:29:47.843 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[24237]: audit 2024-02-13T00:29:46.601805+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:47.843 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[24237]: audit 2024-02-13T00:29:46.603084+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:29:47.843 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[24237]: cephadm 2024-02-13T00:29:46.604132+0000 mgr.y (mgr.14146) 285 : cephadm [INF] Deploying daemon rgw.foo.a on smithi080 2024-02-13T00:29:47.843 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[24237]: cluster 2024-02-13T00:29:46.764027+0000 mgr.y (mgr.14146) 286 : cluster [DBG] pgmap v270: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:47.843 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[17386]: cephadm 2024-02-13T00:29:46.551359+0000 mgr.y (mgr.14146) 282 : cephadm [INF] Detected new or changed devices on smithi106 2024-02-13T00:29:47.843 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[17386]: audit 2024-02-13T00:29:46.560881+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:47.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[17386]: audit 2024-02-13T00:29:46.562980+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:29:47.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[17386]: audit 2024-02-13T00:29:46.564300+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:29:47.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[17386]: audit 2024-02-13T00:29:46.565502+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:29:47.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[17386]: audit 2024-02-13T00:29:46.566647+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:29:47.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[17386]: cephadm 2024-02-13T00:29:46.567545+0000 mgr.y (mgr.14146) 283 : cephadm [INF] Adjusting osd_memory_target on smithi106 to 4316M 2024-02-13T00:29:47.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[17386]: audit 2024-02-13T00:29:46.572644+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:47.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[17386]: audit 2024-02-13T00:29:46.574137+0000 mon.a (mon.0) 534 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:29:47.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[17386]: audit 2024-02-13T00:29:46.575302+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:29:47.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[17386]: audit 2024-02-13T00:29:46.581536+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:47.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[17386]: cephadm 2024-02-13T00:29:46.585717+0000 mgr.y (mgr.14146) 284 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi080=foo.a;count:1 2024-02-13T00:29:47.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[17386]: audit 2024-02-13T00:29:46.590111+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:47.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[17386]: audit 2024-02-13T00:29:46.591105+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-13T00:29:47.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[17386]: audit 2024-02-13T00:29:46.595710+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-13T00:29:47.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[17386]: audit 2024-02-13T00:29:46.601805+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:47.844 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[17386]: audit 2024-02-13T00:29:46.603084+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:29:47.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[17386]: cephadm 2024-02-13T00:29:46.604132+0000 mgr.y (mgr.14146) 285 : cephadm [INF] Deploying daemon rgw.foo.a on smithi080 2024-02-13T00:29:47.845 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:47 smithi080 bash[17386]: cluster 2024-02-13T00:29:46.764027+0000 mgr.y (mgr.14146) 286 : cluster [DBG] pgmap v270: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:47 smithi106 bash[18459]: cephadm 2024-02-13T00:29:46.551359+0000 mgr.y (mgr.14146) 282 : cephadm [INF] Detected new or changed devices on smithi106 2024-02-13T00:29:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:47 smithi106 bash[18459]: audit 2024-02-13T00:29:46.560881+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:47 smithi106 bash[18459]: audit 2024-02-13T00:29:46.562980+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:29:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:47 smithi106 bash[18459]: audit 2024-02-13T00:29:46.564300+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:29:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:47 smithi106 bash[18459]: audit 2024-02-13T00:29:46.565502+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:29:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:47 smithi106 bash[18459]: audit 2024-02-13T00:29:46.566647+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:29:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:47 smithi106 bash[18459]: cephadm 2024-02-13T00:29:46.567545+0000 mgr.y (mgr.14146) 283 : cephadm [INF] Adjusting osd_memory_target on smithi106 to 4316M 2024-02-13T00:29:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:47 smithi106 bash[18459]: audit 2024-02-13T00:29:46.572644+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:47 smithi106 bash[18459]: audit 2024-02-13T00:29:46.574137+0000 mon.a (mon.0) 534 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:29:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:47 smithi106 bash[18459]: audit 2024-02-13T00:29:46.575302+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:29:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:47 smithi106 bash[18459]: audit 2024-02-13T00:29:46.581536+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:47 smithi106 bash[18459]: cephadm 2024-02-13T00:29:46.585717+0000 mgr.y (mgr.14146) 284 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi080=foo.a;count:1 2024-02-13T00:29:48.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:47 smithi106 bash[18459]: audit 2024-02-13T00:29:46.590111+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:48.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:47 smithi106 bash[18459]: audit 2024-02-13T00:29:46.591105+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-13T00:29:48.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:47 smithi106 bash[18459]: audit 2024-02-13T00:29:46.595710+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-13T00:29:48.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:47 smithi106 bash[18459]: audit 2024-02-13T00:29:46.601805+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:48.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:47 smithi106 bash[18459]: audit 2024-02-13T00:29:46.603084+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:29:48.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:47 smithi106 bash[18459]: cephadm 2024-02-13T00:29:46.604132+0000 mgr.y (mgr.14146) 285 : cephadm [INF] Deploying daemon rgw.foo.a on smithi080 2024-02-13T00:29:48.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:47 smithi106 bash[18459]: cluster 2024-02-13T00:29:46.764027+0000 mgr.y (mgr.14146) 286 : cluster [DBG] pgmap v270: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:48.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f2981618700 1 -- 172.21.15.106:0/1680478148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f297c0f7b00 msgr2=0x7f297c0f7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f2981618700 1 --2- 172.21.15.106:0/1680478148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f297c0f7b00 0x7f297c0f7f20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2964004870 tx=0x7f2964009cb0).stop 2024-02-13T00:29:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f2981618700 1 -- 172.21.15.106:0/1680478148 shutdown_connections 2024-02-13T00:29:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f2981618700 1 --2- 172.21.15.106:0/1680478148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f297c0f7b00 0x7f297c0f7f20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f2981618700 1 --2- 172.21.15.106:0/1680478148 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f297c0f9520 0x7f297c100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f2981618700 1 --2- 172.21.15.106:0/1680478148 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f297c0f8410 0x7f297c0f8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f2981618700 1 -- 172.21.15.106:0/1680478148 >> 172.21.15.106:0/1680478148 conn(0x7f297c0f3340 msgr2=0x7f297c0f5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:29:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f2981618700 1 -- 172.21.15.106:0/1680478148 shutdown_connections 2024-02-13T00:29:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f2981618700 1 -- 172.21.15.106:0/1680478148 wait complete. 2024-02-13T00:29:48.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f2981618700 1 Processor -- start 2024-02-13T00:29:48.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f2981618700 1 -- start start 2024-02-13T00:29:48.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f2981618700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f297c0f7b00 0x7f297c06ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f2981618700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f297c0f8410 0x7f297c06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f2981618700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f297c0f9520 0x7f297c06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f2981618700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297c06bbe0 con 0x7f297c0f9520 2024-02-13T00:29:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f2981618700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297c06bd50 con 0x7f297c0f7b00 2024-02-13T00:29:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f2981618700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297c06bf10 con 0x7f297c0f8410 2024-02-13T00:29:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f297affd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f297c0f7b00 0x7f297c06ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f297affd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f297c0f7b00 0x7f297c06ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41050/0 (socket says 172.21.15.106:41050) 2024-02-13T00:29:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f297affd700 1 -- 172.21.15.106:0/4139534156 learned_addr learned my addr 172.21.15.106:0/4139534156 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-02-13T00:29:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f297a7fc700 1 --2- 172.21.15.106:0/4139534156 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f297c0f8410 0x7f297c06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f297b7fe700 1 --2- 172.21.15.106:0/4139534156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f297c0f9520 0x7f297c06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f297affd700 1 -- 172.21.15.106:0/4139534156 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f297c0f8410 msgr2=0x7f297c06b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f297affd700 1 --2- 172.21.15.106:0/4139534156 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f297c0f8410 0x7f297c06b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f297affd700 1 -- 172.21.15.106:0/4139534156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f297c0f9520 msgr2=0x7f297c06b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f297affd700 1 --2- 172.21.15.106:0/4139534156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f297c0f9520 0x7f297c06b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:48.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f297affd700 1 -- 172.21.15.106:0/4139534156 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2964005040 con 0x7f297c0f7b00 2024-02-13T00:29:48.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.788+0000 7f297affd700 1 --2- 172.21.15.106:0/4139534156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f297c0f7b00 0x7f297c06ca70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f2964013730 tx=0x7f2964009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:29:48.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.792+0000 7f2973fff700 1 -- 172.21.15.106:0/4139534156 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296400e030 con 0x7f297c0f7b00 2024-02-13T00:29:48.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.792+0000 7f2973fff700 1 -- 172.21.15.106:0/4139534156 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f29640096d0 con 0x7f297c0f7b00 2024-02-13T00:29:48.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.792+0000 7f2981618700 1 -- 172.21.15.106:0/4139534156 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f297c111f90 con 0x7f297c0f7b00 2024-02-13T00:29:48.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.792+0000 7f2981618700 1 -- 172.21.15.106:0/4139534156 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f297c1122e0 con 0x7f297c0f7b00 2024-02-13T00:29:48.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.792+0000 7f2973fff700 1 -- 172.21.15.106:0/4139534156 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2964018070 con 0x7f297c0f7b00 2024-02-13T00:29:48.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.792+0000 7f2981618700 1 -- 172.21.15.106:0/4139534156 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297c060070 con 0x7f297c0f7b00 2024-02-13T00:29:48.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.792+0000 7f2973fff700 1 -- 172.21.15.106:0/4139534156 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 14) v1 ==== 77064+0+0 (secure 0 0 0) 0x7f2964027440 con 0x7f297c0f7b00 2024-02-13T00:29:48.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.792+0000 7f2973fff700 1 --2- 172.21.15.106:0/4139534156 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2968061250 0x7f2968063710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:48.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.792+0000 7f2973fff700 1 -- 172.21.15.106:0/4139534156 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5260+0+0 (secure 0 0 0) 0x7f296407db60 con 0x7f297c0f7b00 2024-02-13T00:29:48.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.792+0000 7f297a7fc700 1 --2- 172.21.15.106:0/4139534156 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2968061250 0x7f2968063710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.796+0000 7f297a7fc700 1 --2- 172.21.15.106:0/4139534156 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2968061250 0x7f2968063710 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f296c009a00 tx=0x7f296c00b040).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:29:48.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.800+0000 7f2973fff700 1 -- 172.21.15.106:0/4139534156 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f296404e220 con 0x7f297c0f7b00 2024-02-13T00:29:48.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:48.980+0000 7f2981618700 1 -- 172.21.15.106:0/4139534156 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} v 0) v1 -- 0x7f297c102700 con 0x7f297c0f7b00 2024-02-13T00:29:49.258 INFO:journalctl@ceph.rgw.foo.a.smithi080.stdout:Feb 13 00:29:49 smithi080 systemd[1]: Started Ceph rgw.foo.a for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:29:49.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:49.828+0000 7f2973fff700 1 -- 172.21.15.106:0/4139534156 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]=0 pool 'iscsi' created v51) v1 ==== 154+0+0 (secure 0 0 0) 0x7f2964051840 con 0x7f297c0f7b00 2024-02-13T00:29:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:49.828+0000 7f2981618700 1 -- 172.21.15.106:0/4139534156 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2968061250 msgr2=0x7f2968063710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:49.828+0000 7f2981618700 1 --2- 172.21.15.106:0/4139534156 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2968061250 0x7f2968063710 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f296c009a00 tx=0x7f296c00b040).stop 2024-02-13T00:29:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:49.828+0000 7f2981618700 1 -- 172.21.15.106:0/4139534156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f297c0f7b00 msgr2=0x7f297c06ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:49.828+0000 7f2981618700 1 --2- 172.21.15.106:0/4139534156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f297c0f7b00 0x7f297c06ca70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f2964013730 tx=0x7f2964009cb0).stop 2024-02-13T00:29:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:49.832+0000 7f2981618700 1 -- 172.21.15.106:0/4139534156 shutdown_connections 2024-02-13T00:29:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:49.832+0000 7f2981618700 1 --2- 172.21.15.106:0/4139534156 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2968061250 0x7f2968063710 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:49.832+0000 7f2981618700 1 --2- 172.21.15.106:0/4139534156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f297c0f7b00 0x7f297c06ca70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:49.832+0000 7f2981618700 1 --2- 172.21.15.106:0/4139534156 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f297c0f9520 0x7f297c06b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:49.832+0000 7f2981618700 1 --2- 172.21.15.106:0/4139534156 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f297c0f8410 0x7f297c06b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:49.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:49.832+0000 7f2981618700 1 -- 172.21.15.106:0/4139534156 >> 172.21.15.106:0/4139534156 conn(0x7f297c0f3340 msgr2=0x7f297c0f56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:29:49.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:49.832+0000 7f2981618700 1 -- 172.21.15.106:0/4139534156 shutdown_connections 2024-02-13T00:29:49.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:49.832+0000 7f2981618700 1 -- 172.21.15.106:0/4139534156 wait complete. 2024-02-13T00:29:49.836 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'iscsi' created 2024-02-13T00:29:50.073 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:49 smithi106 bash[18459]: cluster 2024-02-13T00:29:48.764498+0000 mgr.y (mgr.14146) 287 : cluster [DBG] pgmap v271: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:50.074 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:49 smithi106 bash[18459]: audit 2024-02-13T00:29:48.984729+0000 mon.a (mon.0) 542 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-13T00:29:50.074 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:49 smithi106 bash[18459]: audit 2024-02-13T00:29:48.985619+0000 mon.b (mon.1) 23 : audit [INF] from='client.? 172.21.15.106:0/4139534156' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-13T00:29:50.074 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:49 smithi106 bash[18459]: audit 2024-02-13T00:29:49.461291+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:50.074 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:49 smithi106 bash[18459]: audit 2024-02-13T00:29:49.462728+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:29:50.131 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:49 smithi080 bash[24237]: cluster 2024-02-13T00:29:48.764498+0000 mgr.y (mgr.14146) 287 : cluster [DBG] pgmap v271: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:50.131 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:49 smithi080 bash[24237]: audit 2024-02-13T00:29:48.984729+0000 mon.a (mon.0) 542 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-13T00:29:50.131 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:49 smithi080 bash[24237]: audit 2024-02-13T00:29:48.985619+0000 mon.b (mon.1) 23 : audit [INF] from='client.? 172.21.15.106:0/4139534156' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-13T00:29:50.131 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:49 smithi080 bash[24237]: audit 2024-02-13T00:29:49.461291+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:50.131 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:49 smithi080 bash[24237]: audit 2024-02-13T00:29:49.462728+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:29:50.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:49 smithi080 bash[17386]: cluster 2024-02-13T00:29:48.764498+0000 mgr.y (mgr.14146) 287 : cluster [DBG] pgmap v271: 1 pgs: 1 active+clean; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:50.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:49 smithi080 bash[17386]: audit 2024-02-13T00:29:48.984729+0000 mon.a (mon.0) 542 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-13T00:29:50.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:49 smithi080 bash[17386]: audit 2024-02-13T00:29:48.985619+0000 mon.b (mon.1) 23 : audit [INF] from='client.? 172.21.15.106:0/4139534156' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-13T00:29:50.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:49 smithi080 bash[17386]: audit 2024-02-13T00:29:49.461291+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:50.131 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:49 smithi080 bash[17386]: audit 2024-02-13T00:29:49.462728+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:29:50.603 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph osd pool application enable iscsi rbd 2024-02-13T00:29:51.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:50 smithi106 bash[18459]: audit 2024-02-13T00:29:49.828151+0000 mon.a (mon.0) 545 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-02-13T00:29:51.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:50 smithi106 bash[18459]: cluster 2024-02-13T00:29:49.828241+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-02-13T00:29:51.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:50 smithi080 bash[17386]: audit 2024-02-13T00:29:49.828151+0000 mon.a (mon.0) 545 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-02-13T00:29:51.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:50 smithi080 bash[17386]: cluster 2024-02-13T00:29:49.828241+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-02-13T00:29:51.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:50 smithi080 bash[24237]: audit 2024-02-13T00:29:49.828151+0000 mon.a (mon.0) 545 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-02-13T00:29:51.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:50 smithi080 bash[24237]: cluster 2024-02-13T00:29:49.828241+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-02-13T00:29:52.097 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:51 smithi106 bash[18459]: cluster 2024-02-13T00:29:50.765028+0000 mgr.y (mgr.14146) 288 : cluster [DBG] pgmap v273: 4 pgs: 1 creating+peering, 1 active+clean, 2 unknown; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:52.097 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:51 smithi106 bash[18459]: cluster 2024-02-13T00:29:50.839389+0000 mon.a (mon.0) 547 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-02-13T00:29:52.097 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:51 smithi106 bash[18459]: audit 2024-02-13T00:29:50.842725+0000 mon.a (mon.0) 548 : audit [INF] from='client.? 172.21.15.80:0/663750837' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-13T00:29:52.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:51 smithi080 bash[17386]: cluster 2024-02-13T00:29:50.765028+0000 mgr.y (mgr.14146) 288 : cluster [DBG] pgmap v273: 4 pgs: 1 creating+peering, 1 active+clean, 2 unknown; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:52.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:51 smithi080 bash[17386]: cluster 2024-02-13T00:29:50.839389+0000 mon.a (mon.0) 547 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-02-13T00:29:52.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:51 smithi080 bash[17386]: audit 2024-02-13T00:29:50.842725+0000 mon.a (mon.0) 548 : audit [INF] from='client.? 172.21.15.80:0/663750837' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-13T00:29:52.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:51 smithi080 bash[24237]: cluster 2024-02-13T00:29:50.765028+0000 mgr.y (mgr.14146) 288 : cluster [DBG] pgmap v273: 4 pgs: 1 creating+peering, 1 active+clean, 2 unknown; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:52.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:51 smithi080 bash[24237]: cluster 2024-02-13T00:29:50.839389+0000 mon.a (mon.0) 547 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-02-13T00:29:52.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:51 smithi080 bash[24237]: audit 2024-02-13T00:29:50.842725+0000 mon.a (mon.0) 548 : audit [INF] from='client.? 172.21.15.80:0/663750837' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-13T00:29:53.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:52 smithi106 bash[18459]: audit 2024-02-13T00:29:51.844179+0000 mon.a (mon.0) 549 : audit [INF] from='client.? 172.21.15.80:0/663750837' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-13T00:29:53.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:52 smithi106 bash[18459]: cluster 2024-02-13T00:29:51.844500+0000 mon.a (mon.0) 550 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-02-13T00:29:53.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:52 smithi080 bash[17386]: audit 2024-02-13T00:29:51.844179+0000 mon.a (mon.0) 549 : audit [INF] from='client.? 172.21.15.80:0/663750837' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-13T00:29:53.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:52 smithi080 bash[17386]: cluster 2024-02-13T00:29:51.844500+0000 mon.a (mon.0) 550 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-02-13T00:29:53.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:52 smithi080 bash[24237]: audit 2024-02-13T00:29:51.844179+0000 mon.a (mon.0) 549 : audit [INF] from='client.? 172.21.15.80:0/663750837' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-13T00:29:53.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:52 smithi080 bash[24237]: cluster 2024-02-13T00:29:51.844500+0000 mon.a (mon.0) 550 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-02-13T00:29:53.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.532+0000 7f21610e8700 1 -- 172.21.15.106:0/2787600294 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f215c0f7db0 msgr2=0x7f215c0fe6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:53.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.532+0000 7f21610e8700 1 --2- 172.21.15.106:0/2787600294 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f215c0f7db0 0x7f215c0fe6b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2154009c10 tx=0x7f2154004d10).stop 2024-02-13T00:29:53.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.532+0000 7f21610e8700 1 -- 172.21.15.106:0/2787600294 shutdown_connections 2024-02-13T00:29:53.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.532+0000 7f21610e8700 1 --2- 172.21.15.106:0/2787600294 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f215c0f7db0 0x7f215c0fe6b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:53.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.532+0000 7f21610e8700 1 --2- 172.21.15.106:0/2787600294 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f215c0f61c0 0x7f215c0f65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:53.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.532+0000 7f21610e8700 1 --2- 172.21.15.106:0/2787600294 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f215c0f7460 0x7f215c0f78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:53.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.532+0000 7f21610e8700 1 -- 172.21.15.106:0/2787600294 >> 172.21.15.106:0/2787600294 conn(0x7f215c0f19a0 msgr2=0x7f215c0f3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:29:53.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.532+0000 7f21610e8700 1 -- 172.21.15.106:0/2787600294 shutdown_connections 2024-02-13T00:29:53.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.532+0000 7f21610e8700 1 -- 172.21.15.106:0/2787600294 wait complete. 2024-02-13T00:29:53.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f21610e8700 1 Processor -- start 2024-02-13T00:29:53.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f21610e8700 1 -- start start 2024-02-13T00:29:53.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f21610e8700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f215c0f61c0 0x7f215c107e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:53.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f21610e8700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f215c0f7460 0x7f215c1082f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:53.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f21610e8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f215c0f7db0 0x7f215c10f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:53.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f21610e8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c10f8c0 con 0x7f215c0f7db0 2024-02-13T00:29:53.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f21610e8700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c10fa00 con 0x7f215c0f7460 2024-02-13T00:29:53.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f21610e8700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215c10fb40 con 0x7f215c0f61c0 2024-02-13T00:29:53.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f215a59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f215c0f7460 0x7f215c1082f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:53.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f215a59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f215c0f7460 0x7f215c1082f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41070/0 (socket says 172.21.15.106:41070) 2024-02-13T00:29:53.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f215a59c700 1 -- 172.21.15.106:0/712951839 learned_addr learned my addr 172.21.15.106:0/712951839 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-02-13T00:29:53.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f215ad9d700 1 --2- 172.21.15.106:0/712951839 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f215c0f61c0 0x7f215c107e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:53.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f215a59c700 1 -- 172.21.15.106:0/712951839 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f215c0f61c0 msgr2=0x7f215c107e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:53.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f215b59e700 1 --2- 172.21.15.106:0/712951839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f215c0f7db0 0x7f215c10f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:53.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f215a59c700 1 --2- 172.21.15.106:0/712951839 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f215c0f61c0 0x7f215c107e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f215a59c700 1 -- 172.21.15.106:0/712951839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f215c0f7db0 msgr2=0x7f215c10f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f215a59c700 1 --2- 172.21.15.106:0/712951839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f215c0f7db0 0x7f215c10f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f215a59c700 1 -- 172.21.15.106:0/712951839 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21540097c0 con 0x7f215c0f7460 2024-02-13T00:29:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f215b59e700 1 --2- 172.21.15.106:0/712951839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f215c0f7db0 0x7f215c10f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-13T00:29:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f215a59c700 1 --2- 172.21.15.106:0/712951839 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f215c0f7460 0x7f215c1082f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f214c00e990 tx=0x7f214c00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:29:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f2153fff700 1 -- 172.21.15.106:0/712951839 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c004680 con 0x7f215c0f7460 2024-02-13T00:29:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f2153fff700 1 -- 172.21.15.106:0/712951839 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f214c00f040 con 0x7f215c0f7460 2024-02-13T00:29:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f2153fff700 1 -- 172.21.15.106:0/712951839 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c00c840 con 0x7f215c0f7460 2024-02-13T00:29:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f21610e8700 1 -- 172.21.15.106:0/712951839 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f215c10fdc0 con 0x7f215c0f7460 2024-02-13T00:29:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f21610e8700 1 -- 172.21.15.106:0/712951839 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215c110280 con 0x7f215c0f7460 2024-02-13T00:29:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.536+0000 7f21610e8700 1 -- 172.21.15.106:0/712951839 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f215c060070 con 0x7f215c0f7460 2024-02-13T00:29:53.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.540+0000 7f2153fff700 1 -- 172.21.15.106:0/712951839 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 14) v1 ==== 77064+0+0 (secure 0 0 0) 0x7f214c00cc70 con 0x7f215c0f7460 2024-02-13T00:29:53.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.540+0000 7f2153fff700 1 --2- 172.21.15.106:0/712951839 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2148061250 0x7f2148063710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:53.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.540+0000 7f2153fff700 1 -- 172.21.15.106:0/712951839 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6317+0+0 (secure 0 0 0) 0x7f214c07c5c0 con 0x7f215c0f7460 2024-02-13T00:29:53.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.540+0000 7f215ad9d700 1 --2- 172.21.15.106:0/712951839 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2148061250 0x7f2148063710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:53.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.540+0000 7f215ad9d700 1 --2- 172.21.15.106:0/712951839 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2148061250 0x7f2148063710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f215c0f72c0 tx=0x7f214400b040).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:29:53.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.548+0000 7f2153fff700 1 -- 172.21.15.106:0/712951839 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f214c049f60 con 0x7f215c0f7460 2024-02-13T00:29:53.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.732+0000 7f21610e8700 1 -- 172.21.15.106:0/712951839 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"} v 0) v1 -- 0x7f215c1028b0 con 0x7f215c0f7460 2024-02-13T00:29:53.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.872+0000 7f2153fff700 1 -- 172.21.15.106:0/712951839 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]=0 enabled application 'rbd' on pool 'iscsi' v55) v1 ==== 147+0+0 (secure 0 0 0) 0x7f214c04c770 con 0x7f215c0f7460 2024-02-13T00:29:53.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.876+0000 7f21610e8700 1 -- 172.21.15.106:0/712951839 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2148061250 msgr2=0x7f2148063710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:53.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.876+0000 7f21610e8700 1 --2- 172.21.15.106:0/712951839 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2148061250 0x7f2148063710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f215c0f72c0 tx=0x7f214400b040).stop 2024-02-13T00:29:53.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.876+0000 7f21610e8700 1 -- 172.21.15.106:0/712951839 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f215c0f7460 msgr2=0x7f215c1082f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:53.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.876+0000 7f21610e8700 1 --2- 172.21.15.106:0/712951839 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f215c0f7460 0x7f215c1082f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f214c00e990 tx=0x7f214c00b040).stop 2024-02-13T00:29:53.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.876+0000 7f21610e8700 1 -- 172.21.15.106:0/712951839 shutdown_connections 2024-02-13T00:29:53.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.876+0000 7f21610e8700 1 --2- 172.21.15.106:0/712951839 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f215c0f7db0 0x7f215c10f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:53.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.876+0000 7f21610e8700 1 --2- 172.21.15.106:0/712951839 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f215c0f61c0 0x7f215c107e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:53.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.876+0000 7f21610e8700 1 --2- 172.21.15.106:0/712951839 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f2148061250 0x7f2148063710 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0x7f215c0f72c0 tx=0x7f214400b040).stop 2024-02-13T00:29:53.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.876+0000 7f21610e8700 1 --2- 172.21.15.106:0/712951839 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f215c0f7460 0x7f215c1082f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:53.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.876+0000 7f21610e8700 1 -- 172.21.15.106:0/712951839 >> 172.21.15.106:0/712951839 conn(0x7f215c0f19a0 msgr2=0x7f215c0fa690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:29:53.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.876+0000 7f21610e8700 1 -- 172.21.15.106:0/712951839 shutdown_connections 2024-02-13T00:29:53.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:53.876+0000 7f21610e8700 1 -- 172.21.15.106:0/712951839 wait complete. 2024-02-13T00:29:53.883 INFO:teuthology.orchestra.run.smithi106.stderr:enabled application 'rbd' on pool 'iscsi' 2024-02-13T00:29:54.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:53 smithi106 bash[18459]: cluster 2024-02-13T00:29:52.765719+0000 mgr.y (mgr.14146) 289 : cluster [DBG] pgmap v276: 36 pgs: 7 active+clean, 1 creating+activating, 10 creating+peering, 18 unknown; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:54.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:53 smithi106 bash[18459]: cluster 2024-02-13T00:29:52.861966+0000 mon.a (mon.0) 551 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-02-13T00:29:54.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:53 smithi106 bash[18459]: audit 2024-02-13T00:29:52.866133+0000 mon.a (mon.0) 552 : audit [INF] from='client.? 172.21.15.80:0/663750837' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-13T00:29:54.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:53 smithi106 bash[18459]: audit 2024-02-13T00:29:53.126919+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:54.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:53 smithi106 bash[18459]: audit 2024-02-13T00:29:53.735054+0000 mon.a (mon.0) 554 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-13T00:29:54.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:53 smithi106 bash[18459]: audit 2024-02-13T00:29:53.735568+0000 mon.b (mon.1) 24 : audit [INF] from='client.? 172.21.15.106:0/712951839' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-13T00:29:54.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:53 smithi080 bash[17386]: cluster 2024-02-13T00:29:52.765719+0000 mgr.y (mgr.14146) 289 : cluster [DBG] pgmap v276: 36 pgs: 7 active+clean, 1 creating+activating, 10 creating+peering, 18 unknown; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:54.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:53 smithi080 bash[17386]: cluster 2024-02-13T00:29:52.861966+0000 mon.a (mon.0) 551 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-02-13T00:29:54.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:53 smithi080 bash[17386]: audit 2024-02-13T00:29:52.866133+0000 mon.a (mon.0) 552 : audit [INF] from='client.? 172.21.15.80:0/663750837' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-13T00:29:54.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:53 smithi080 bash[17386]: audit 2024-02-13T00:29:53.126919+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:54.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:53 smithi080 bash[17386]: audit 2024-02-13T00:29:53.735054+0000 mon.a (mon.0) 554 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-13T00:29:54.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:53 smithi080 bash[17386]: audit 2024-02-13T00:29:53.735568+0000 mon.b (mon.1) 24 : audit [INF] from='client.? 172.21.15.106:0/712951839' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-13T00:29:54.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:53 smithi080 bash[24237]: cluster 2024-02-13T00:29:52.765719+0000 mgr.y (mgr.14146) 289 : cluster [DBG] pgmap v276: 36 pgs: 7 active+clean, 1 creating+activating, 10 creating+peering, 18 unknown; 0 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:54.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:53 smithi080 bash[24237]: cluster 2024-02-13T00:29:52.861966+0000 mon.a (mon.0) 551 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-02-13T00:29:54.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:53 smithi080 bash[24237]: audit 2024-02-13T00:29:52.866133+0000 mon.a (mon.0) 552 : audit [INF] from='client.? 172.21.15.80:0/663750837' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-13T00:29:54.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:53 smithi080 bash[24237]: audit 2024-02-13T00:29:53.126919+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:54.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:53 smithi080 bash[24237]: audit 2024-02-13T00:29:53.735054+0000 mon.a (mon.0) 554 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-13T00:29:54.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:53 smithi080 bash[24237]: audit 2024-02-13T00:29:53.735568+0000 mon.b (mon.1) 24 : audit [INF] from='client.? 172.21.15.106:0/712951839' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2024-02-13T00:29:54.610 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph orch apply iscsi iscsi user password --placement '1;smithi106=iscsi.a' 2024-02-13T00:29:55.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:54 smithi106 bash[18459]: audit 2024-02-13T00:29:53.867109+0000 mon.a (mon.0) 555 : audit [INF] from='client.? 172.21.15.80:0/663750837' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-13T00:29:55.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:54 smithi106 bash[18459]: audit 2024-02-13T00:29:53.867557+0000 mon.a (mon.0) 556 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2024-02-13T00:29:55.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:54 smithi106 bash[18459]: cluster 2024-02-13T00:29:53.867697+0000 mon.a (mon.0) 557 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-13T00:29:55.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:54 smithi106 bash[18459]: audit 2024-02-13T00:29:54.724107+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:55.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:54 smithi080 bash[17386]: audit 2024-02-13T00:29:53.867109+0000 mon.a (mon.0) 555 : audit [INF] from='client.? 172.21.15.80:0/663750837' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-13T00:29:55.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:54 smithi080 bash[17386]: audit 2024-02-13T00:29:53.867557+0000 mon.a (mon.0) 556 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2024-02-13T00:29:55.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:54 smithi080 bash[17386]: cluster 2024-02-13T00:29:53.867697+0000 mon.a (mon.0) 557 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-13T00:29:55.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:54 smithi080 bash[17386]: audit 2024-02-13T00:29:54.724107+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:55.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:54 smithi080 bash[24237]: audit 2024-02-13T00:29:53.867109+0000 mon.a (mon.0) 555 : audit [INF] from='client.? 172.21.15.80:0/663750837' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-13T00:29:55.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:54 smithi080 bash[24237]: audit 2024-02-13T00:29:53.867557+0000 mon.a (mon.0) 556 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2024-02-13T00:29:55.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:54 smithi080 bash[24237]: cluster 2024-02-13T00:29:53.867697+0000 mon.a (mon.0) 557 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-13T00:29:55.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:54 smithi080 bash[24237]: audit 2024-02-13T00:29:54.724107+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:56.081 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:55 smithi106 bash[18459]: cluster 2024-02-13T00:29:54.766328+0000 mgr.y (mgr.14146) 290 : cluster [DBG] pgmap v279: 68 pgs: 34 active+clean, 1 creating+activating, 25 creating+peering, 8 unknown; 873 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:56.081 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:55 smithi106 bash[18459]: cluster 2024-02-13T00:29:54.880868+0000 mon.a (mon.0) 559 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-13T00:29:56.081 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:55 smithi106 bash[18459]: audit 2024-02-13T00:29:54.885699+0000 mon.a (mon.0) 560 : audit [INF] from='client.? 172.21.15.80:0/663750837' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-13T00:29:56.081 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:55 smithi106 bash[18459]: audit 2024-02-13T00:29:55.000253+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:29:56.081 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:55 smithi106 bash[18459]: audit 2024-02-13T00:29:55.001287+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:29:56.081 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:55 smithi106 bash[18459]: cephadm 2024-02-13T00:29:55.008538+0000 mgr.y (mgr.14146) 291 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-02-13T00:29:56.081 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:55 smithi106 bash[18459]: audit 2024-02-13T00:29:55.883328+0000 mon.a (mon.0) 563 : audit [INF] from='client.? 172.21.15.80:0/663750837' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-13T00:29:56.082 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:55 smithi106 bash[18459]: cluster 2024-02-13T00:29:55.883518+0000 mon.a (mon.0) 564 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-13T00:29:56.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:55 smithi080 bash[17386]: cluster 2024-02-13T00:29:54.766328+0000 mgr.y (mgr.14146) 290 : cluster [DBG] pgmap v279: 68 pgs: 34 active+clean, 1 creating+activating, 25 creating+peering, 8 unknown; 873 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:56.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:55 smithi080 bash[17386]: cluster 2024-02-13T00:29:54.880868+0000 mon.a (mon.0) 559 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-13T00:29:56.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:55 smithi080 bash[17386]: audit 2024-02-13T00:29:54.885699+0000 mon.a (mon.0) 560 : audit [INF] from='client.? 172.21.15.80:0/663750837' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-13T00:29:56.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:55 smithi080 bash[17386]: audit 2024-02-13T00:29:55.000253+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:29:56.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:55 smithi080 bash[17386]: audit 2024-02-13T00:29:55.001287+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:29:56.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:55 smithi080 bash[17386]: cephadm 2024-02-13T00:29:55.008538+0000 mgr.y (mgr.14146) 291 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-02-13T00:29:56.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:55 smithi080 bash[17386]: audit 2024-02-13T00:29:55.883328+0000 mon.a (mon.0) 563 : audit [INF] from='client.? 172.21.15.80:0/663750837' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-13T00:29:56.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:55 smithi080 bash[17386]: cluster 2024-02-13T00:29:55.883518+0000 mon.a (mon.0) 564 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-13T00:29:56.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:55 smithi080 bash[24237]: cluster 2024-02-13T00:29:54.766328+0000 mgr.y (mgr.14146) 290 : cluster [DBG] pgmap v279: 68 pgs: 34 active+clean, 1 creating+activating, 25 creating+peering, 8 unknown; 873 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:56.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:55 smithi080 bash[24237]: cluster 2024-02-13T00:29:54.880868+0000 mon.a (mon.0) 559 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-13T00:29:56.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:55 smithi080 bash[24237]: audit 2024-02-13T00:29:54.885699+0000 mon.a (mon.0) 560 : audit [INF] from='client.? 172.21.15.80:0/663750837' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-13T00:29:56.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:55 smithi080 bash[24237]: audit 2024-02-13T00:29:55.000253+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:29:56.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:55 smithi080 bash[24237]: audit 2024-02-13T00:29:55.001287+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:29:56.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:55 smithi080 bash[24237]: cephadm 2024-02-13T00:29:55.008538+0000 mgr.y (mgr.14146) 291 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-02-13T00:29:56.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:55 smithi080 bash[24237]: audit 2024-02-13T00:29:55.883328+0000 mon.a (mon.0) 563 : audit [INF] from='client.? 172.21.15.80:0/663750837' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-13T00:29:56.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:55 smithi080 bash[24237]: cluster 2024-02-13T00:29:55.883518+0000 mon.a (mon.0) 564 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-13T00:29:57.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.564+0000 7f21ed817700 1 -- 172.21.15.106:0/998172270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21e80f7440 msgr2=0x7f21e80f78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:57.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.564+0000 7f21ed817700 1 --2- 172.21.15.106:0/998172270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21e80f7440 0x7f21e80f78c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f21e0009be0 tx=0x7f21e0004d10).stop 2024-02-13T00:29:57.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.564+0000 7f21ed817700 1 -- 172.21.15.106:0/998172270 shutdown_connections 2024-02-13T00:29:57.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.564+0000 7f21ed817700 1 --2- 172.21.15.106:0/998172270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21e80f7440 0x7f21e80f78c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:57.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.564+0000 7f21ed817700 1 --2- 172.21.15.106:0/998172270 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21e80f8040 0x7f21e80f8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:57.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.564+0000 7f21ed817700 1 --2- 172.21.15.106:0/998172270 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e80f89e0 0x7f21e80f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:57.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.564+0000 7f21ed817700 1 -- 172.21.15.106:0/998172270 >> 172.21.15.106:0/998172270 conn(0x7f21e80f19d0 msgr2=0x7f21e80f3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:29:57.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.564+0000 7f21ed817700 1 -- 172.21.15.106:0/998172270 shutdown_connections 2024-02-13T00:29:57.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.564+0000 7f21ed817700 1 -- 172.21.15.106:0/998172270 wait complete. 2024-02-13T00:29:57.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21ed817700 1 Processor -- start 2024-02-13T00:29:57.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21ed817700 1 -- start start 2024-02-13T00:29:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21ed817700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e80f7440 0x7f21e8107ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21ed817700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21e80f8040 0x7f21e81081d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21ed817700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21e80f89e0 0x7f21e810f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21ed817700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e810f760 con 0x7f21e80f7440 2024-02-13T00:29:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21ed817700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e810f8a0 con 0x7f21e80f89e0 2024-02-13T00:29:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21ed817700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e810fa30 con 0x7f21e80f8040 2024-02-13T00:29:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21e77fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21e80f89e0 0x7f21e810f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21e77fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21e80f89e0 0x7f21e810f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60964/0 (socket says 172.21.15.106:60964) 2024-02-13T00:29:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21e77fe700 1 -- 172.21.15.106:0/2937412232 learned_addr learned my addr 172.21.15.106:0/2937412232 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-02-13T00:29:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21e6ffd700 1 --2- 172.21.15.106:0/2937412232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e80f7440 0x7f21e8107ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21e67fc700 1 --2- 172.21.15.106:0/2937412232 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21e80f8040 0x7f21e81081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21e77fe700 1 -- 172.21.15.106:0/2937412232 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21e80f8040 msgr2=0x7f21e81081d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21e77fe700 1 --2- 172.21.15.106:0/2937412232 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21e80f8040 0x7f21e81081d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21e77fe700 1 -- 172.21.15.106:0/2937412232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e80f7440 msgr2=0x7f21e8107ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:57.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21e77fe700 1 --2- 172.21.15.106:0/2937412232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e80f7440 0x7f21e8107ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:57.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21e77fe700 1 -- 172.21.15.106:0/2937412232 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e00097c0 con 0x7f21e80f89e0 2024-02-13T00:29:57.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21e77fe700 1 --2- 172.21.15.106:0/2937412232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21e80f89e0 0x7f21e810f270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f21e000b460 tx=0x7f21e0004d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:29:57.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21cffff700 1 -- 172.21.15.106:0/2937412232 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e000e070 con 0x7f21e80f89e0 2024-02-13T00:29:57.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21cffff700 1 -- 172.21.15.106:0/2937412232 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f21e0007bf0 con 0x7f21e80f89e0 2024-02-13T00:29:57.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21ed817700 1 -- 172.21.15.106:0/2937412232 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e810fcb0 con 0x7f21e80f89e0 2024-02-13T00:29:57.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21cffff700 1 -- 172.21.15.106:0/2937412232 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0018070 con 0x7f21e80f89e0 2024-02-13T00:29:57.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.568+0000 7f21ed817700 1 -- 172.21.15.106:0/2937412232 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e80f9140 con 0x7f21e80f89e0 2024-02-13T00:29:57.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.572+0000 7f21cffff700 1 -- 172.21.15.106:0/2937412232 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 14) v1 ==== 77064+0+0 (secure 0 0 0) 0x7f21e0013630 con 0x7f21e80f89e0 2024-02-13T00:29:57.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.572+0000 7f21cffff700 1 --2- 172.21.15.106:0/2937412232 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f21d0065690 0x7f21d0067b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:29:57.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.572+0000 7f21cffff700 1 -- 172.21.15.106:0/2937412232 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 7063+0+0 (secure 0 0 0) 0x7f21e007eff0 con 0x7f21e80f89e0 2024-02-13T00:29:57.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.572+0000 7f21ed817700 1 -- 172.21.15.106:0/2937412232 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e8060070 con 0x7f21e80f89e0 2024-02-13T00:29:57.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.572+0000 7f21e6ffd700 1 --2- 172.21.15.106:0/2937412232 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f21d0065690 0x7f21d0067b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:29:57.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.572+0000 7f21e6ffd700 1 --2- 172.21.15.106:0/2937412232 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f21d0065690 0x7f21d0067b50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f21e81091d0 tx=0x7f21d800b040).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:29:57.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.580+0000 7f21cffff700 1 -- 172.21.15.106:0/2937412232 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f21e004ee10 con 0x7f21e80f89e0 2024-02-13T00:29:57.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.776+0000 7f21ed817700 1 -- 172.21.15.106:0/2937412232 --> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] -- mgr_command(tid 0: {"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi106=iscsi.a", "target": ["mon-mgr", ""]}) v1 -- 0x7f21e80feaa0 con 0x7f21d0065690 2024-02-13T00:29:57.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.792+0000 7f21cffff700 1 -- 172.21.15.106:0/2937412232 <== mgr.14146 v2:172.21.15.80:6800/461193090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f21e80feaa0 con 0x7f21d0065690 2024-02-13T00:29:57.797 INFO:teuthology.orchestra.run.smithi106.stdout:Scheduled iscsi.iscsi update... 2024-02-13T00:29:57.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.792+0000 7f21ed817700 1 -- 172.21.15.106:0/2937412232 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f21d0065690 msgr2=0x7f21d0067b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:57.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.792+0000 7f21ed817700 1 --2- 172.21.15.106:0/2937412232 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f21d0065690 0x7f21d0067b50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f21e81091d0 tx=0x7f21d800b040).stop 2024-02-13T00:29:57.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.792+0000 7f21ed817700 1 -- 172.21.15.106:0/2937412232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21e80f89e0 msgr2=0x7f21e810f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:29:57.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.792+0000 7f21ed817700 1 --2- 172.21.15.106:0/2937412232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21e80f89e0 0x7f21e810f270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f21e000b460 tx=0x7f21e0004d10).stop 2024-02-13T00:29:57.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.792+0000 7f21ed817700 1 -- 172.21.15.106:0/2937412232 shutdown_connections 2024-02-13T00:29:57.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.792+0000 7f21ed817700 1 --2- 172.21.15.106:0/2937412232 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f21d0065690 0x7f21d0067b50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:57.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.792+0000 7f21ed817700 1 --2- 172.21.15.106:0/2937412232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f21e80f89e0 0x7f21e810f270 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:57.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.792+0000 7f21ed817700 1 --2- 172.21.15.106:0/2937412232 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f21e80f7440 0x7f21e8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:57.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.792+0000 7f21ed817700 1 --2- 172.21.15.106:0/2937412232 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f21e80f8040 0x7f21e81081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:29:57.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.792+0000 7f21ed817700 1 -- 172.21.15.106:0/2937412232 >> 172.21.15.106:0/2937412232 conn(0x7f21e80f19d0 msgr2=0x7f21e80f49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:29:57.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.796+0000 7f21ed817700 1 -- 172.21.15.106:0/2937412232 shutdown_connections 2024-02-13T00:29:57.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:29:57.796+0000 7f21ed817700 1 -- 172.21.15.106:0/2937412232 wait complete. 2024-02-13T00:29:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:57 smithi106 bash[18459]: cluster 2024-02-13T00:29:56.767197+0000 mgr.y (mgr.14146) 292 : cluster [DBG] pgmap v282: 100 pgs: 47 active+clean, 2 creating+activating, 26 creating+peering, 25 unknown; 873 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:57 smithi106 bash[18459]: cluster 2024-02-13T00:29:56.911045+0000 mon.a (mon.0) 565 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-13T00:29:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:57 smithi106 bash[18459]: audit 2024-02-13T00:29:56.915438+0000 mon.a (mon.0) 566 : audit [INF] from='client.? 172.21.15.80:0/2043048888' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-13T00:29:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:57 smithi106 bash[18459]: audit 2024-02-13T00:29:56.917635+0000 mon.a (mon.0) 567 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-13T00:29:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:57 smithi106 bash[18459]: audit 2024-02-13T00:29:56.918219+0000 mon.b (mon.1) 25 : audit [INF] from='client.? 172.21.15.80:0/2057131335' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-13T00:29:58.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:57 smithi106 bash[18459]: audit 2024-02-13T00:29:57.792336+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:58.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:57 smithi080 bash[24237]: cluster 2024-02-13T00:29:56.767197+0000 mgr.y (mgr.14146) 292 : cluster [DBG] pgmap v282: 100 pgs: 47 active+clean, 2 creating+activating, 26 creating+peering, 25 unknown; 873 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:58.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:57 smithi080 bash[24237]: cluster 2024-02-13T00:29:56.911045+0000 mon.a (mon.0) 565 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-13T00:29:58.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:57 smithi080 bash[24237]: audit 2024-02-13T00:29:56.915438+0000 mon.a (mon.0) 566 : audit [INF] from='client.? 172.21.15.80:0/2043048888' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-13T00:29:58.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:57 smithi080 bash[24237]: audit 2024-02-13T00:29:56.917635+0000 mon.a (mon.0) 567 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-13T00:29:58.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:57 smithi080 bash[24237]: audit 2024-02-13T00:29:56.918219+0000 mon.b (mon.1) 25 : audit [INF] from='client.? 172.21.15.80:0/2057131335' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-13T00:29:58.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:57 smithi080 bash[24237]: audit 2024-02-13T00:29:57.792336+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:58.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:57 smithi080 bash[17386]: cluster 2024-02-13T00:29:56.767197+0000 mgr.y (mgr.14146) 292 : cluster [DBG] pgmap v282: 100 pgs: 47 active+clean, 2 creating+activating, 26 creating+peering, 25 unknown; 873 B data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:29:58.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:57 smithi080 bash[17386]: cluster 2024-02-13T00:29:56.911045+0000 mon.a (mon.0) 565 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-13T00:29:58.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:57 smithi080 bash[17386]: audit 2024-02-13T00:29:56.915438+0000 mon.a (mon.0) 566 : audit [INF] from='client.? 172.21.15.80:0/2043048888' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-13T00:29:58.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:57 smithi080 bash[17386]: audit 2024-02-13T00:29:56.917635+0000 mon.a (mon.0) 567 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-13T00:29:58.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:57 smithi080 bash[17386]: audit 2024-02-13T00:29:56.918219+0000 mon.b (mon.1) 25 : audit [INF] from='client.? 172.21.15.80:0/2057131335' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-13T00:29:58.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:57 smithi080 bash[17386]: audit 2024-02-13T00:29:57.792336+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:29:58.504 DEBUG:teuthology.orchestra.run.smithi106:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@iscsi.iscsi.a.service 2024-02-13T00:29:58.507 INFO:tasks.cephadm:Adding prometheus.a on smithi106 2024-02-13T00:29:58.507 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph orch apply prometheus '1;smithi106=a' 2024-02-13T00:29:58.541 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-13T00:29:59.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:58 smithi106 bash[18459]: audit 2024-02-13T00:29:57.779251+0000 mgr.y (mgr.14146) 293 : audit [DBG] from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi106=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:29:59.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:58 smithi106 bash[18459]: cephadm 2024-02-13T00:29:57.785535+0000 mgr.y (mgr.14146) 294 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi106=iscsi.a;count:1 2024-02-13T00:29:59.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:58 smithi106 bash[18459]: audit 2024-02-13T00:29:57.916209+0000 mon.a (mon.0) 569 : audit [INF] from='client.? 172.21.15.80:0/2043048888' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-13T00:29:59.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:58 smithi106 bash[18459]: audit 2024-02-13T00:29:57.916539+0000 mon.a (mon.0) 570 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-13T00:29:59.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:58 smithi106 bash[18459]: cluster 2024-02-13T00:29:57.916752+0000 mon.a (mon.0) 571 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-13T00:29:59.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:58 smithi106 bash[18459]: audit 2024-02-13T00:29:57.943283+0000 mon.a (mon.0) 572 : audit [INF] from='client.? 172.21.15.80:0/2043048888' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-13T00:29:59.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:58 smithi106 bash[18459]: audit 2024-02-13T00:29:57.944498+0000 mon.a (mon.0) 573 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-13T00:29:59.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:58 smithi106 bash[18459]: audit 2024-02-13T00:29:57.944516+0000 mon.b (mon.1) 26 : audit [INF] from='client.? 172.21.15.80:0/2057131335' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-13T00:29:59.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:58 smithi080 bash[17386]: audit 2024-02-13T00:29:57.779251+0000 mgr.y (mgr.14146) 293 : audit [DBG] from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi106=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:29:59.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:58 smithi080 bash[17386]: cephadm 2024-02-13T00:29:57.785535+0000 mgr.y (mgr.14146) 294 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi106=iscsi.a;count:1 2024-02-13T00:29:59.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:58 smithi080 bash[17386]: audit 2024-02-13T00:29:57.916209+0000 mon.a (mon.0) 569 : audit [INF] from='client.? 172.21.15.80:0/2043048888' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-13T00:29:59.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:58 smithi080 bash[17386]: audit 2024-02-13T00:29:57.916539+0000 mon.a (mon.0) 570 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-13T00:29:59.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:58 smithi080 bash[17386]: cluster 2024-02-13T00:29:57.916752+0000 mon.a (mon.0) 571 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-13T00:29:59.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:58 smithi080 bash[17386]: audit 2024-02-13T00:29:57.943283+0000 mon.a (mon.0) 572 : audit [INF] from='client.? 172.21.15.80:0/2043048888' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-13T00:29:59.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:58 smithi080 bash[17386]: audit 2024-02-13T00:29:57.944498+0000 mon.a (mon.0) 573 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-13T00:29:59.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:58 smithi080 bash[17386]: audit 2024-02-13T00:29:57.944516+0000 mon.b (mon.1) 26 : audit [INF] from='client.? 172.21.15.80:0/2057131335' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-13T00:29:59.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:58 smithi080 bash[24237]: audit 2024-02-13T00:29:57.779251+0000 mgr.y (mgr.14146) 293 : audit [DBG] from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi106=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:29:59.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:58 smithi080 bash[24237]: cephadm 2024-02-13T00:29:57.785535+0000 mgr.y (mgr.14146) 294 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi106=iscsi.a;count:1 2024-02-13T00:29:59.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:58 smithi080 bash[24237]: audit 2024-02-13T00:29:57.916209+0000 mon.a (mon.0) 569 : audit [INF] from='client.? 172.21.15.80:0/2043048888' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-13T00:29:59.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:58 smithi080 bash[24237]: audit 2024-02-13T00:29:57.916539+0000 mon.a (mon.0) 570 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-13T00:29:59.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:58 smithi080 bash[24237]: cluster 2024-02-13T00:29:57.916752+0000 mon.a (mon.0) 571 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-13T00:29:59.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:58 smithi080 bash[24237]: audit 2024-02-13T00:29:57.943283+0000 mon.a (mon.0) 572 : audit [INF] from='client.? 172.21.15.80:0/2043048888' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-13T00:29:59.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:58 smithi080 bash[24237]: audit 2024-02-13T00:29:57.944498+0000 mon.a (mon.0) 573 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-13T00:29:59.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:58 smithi080 bash[24237]: audit 2024-02-13T00:29:57.944516+0000 mon.b (mon.1) 26 : audit [INF] from='client.? 172.21.15.80:0/2057131335' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-13T00:30:00.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:59 smithi106 bash[18459]: cluster 2024-02-13T00:29:58.768338+0000 mgr.y (mgr.14146) 295 : cluster [DBG] pgmap v285: 132 pgs: 102 active+clean, 1 creating+activating, 9 creating+peering, 20 unknown; 1.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-02-13T00:30:00.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:59 smithi106 bash[18459]: audit 2024-02-13T00:29:58.930919+0000 mon.a (mon.0) 574 : audit [INF] from='client.? 172.21.15.80:0/2043048888' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-13T00:30:00.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:59 smithi106 bash[18459]: audit 2024-02-13T00:29:58.931040+0000 mon.a (mon.0) 575 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-13T00:30:00.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:59 smithi106 bash[18459]: cluster 2024-02-13T00:29:58.931169+0000 mon.a (mon.0) 576 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-13T00:30:00.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:59 smithi106 bash[18459]: audit 2024-02-13T00:29:59.267015+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:00.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:59 smithi106 bash[18459]: audit 2024-02-13T00:29:59.275546+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:00.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:59 smithi106 bash[18459]: audit 2024-02-13T00:29:59.282625+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:00.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:59 smithi106 bash[18459]: audit 2024-02-13T00:29:59.306601+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-13T00:30:00.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:59 smithi106 bash[18459]: audit 2024-02-13T00:29:59.311023+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-02-13T00:30:00.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:29:59 smithi106 bash[18459]: audit 2024-02-13T00:29:59.327476+0000 mon.a (mon.0) 582 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:30:00.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:59 smithi080 bash[24237]: cluster 2024-02-13T00:29:58.768338+0000 mgr.y (mgr.14146) 295 : cluster [DBG] pgmap v285: 132 pgs: 102 active+clean, 1 creating+activating, 9 creating+peering, 20 unknown; 1.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-02-13T00:30:00.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:59 smithi080 bash[24237]: audit 2024-02-13T00:29:58.930919+0000 mon.a (mon.0) 574 : audit [INF] from='client.? 172.21.15.80:0/2043048888' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-13T00:30:00.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:59 smithi080 bash[24237]: audit 2024-02-13T00:29:58.931040+0000 mon.a (mon.0) 575 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-13T00:30:00.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:59 smithi080 bash[24237]: cluster 2024-02-13T00:29:58.931169+0000 mon.a (mon.0) 576 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-13T00:30:00.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:59 smithi080 bash[24237]: audit 2024-02-13T00:29:59.267015+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:00.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:59 smithi080 bash[24237]: audit 2024-02-13T00:29:59.275546+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:00.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:59 smithi080 bash[24237]: audit 2024-02-13T00:29:59.282625+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:00.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:59 smithi080 bash[24237]: audit 2024-02-13T00:29:59.306601+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-13T00:30:00.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:59 smithi080 bash[24237]: audit 2024-02-13T00:29:59.311023+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-02-13T00:30:00.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:29:59 smithi080 bash[24237]: audit 2024-02-13T00:29:59.327476+0000 mon.a (mon.0) 582 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:30:00.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:59 smithi080 bash[17386]: cluster 2024-02-13T00:29:58.768338+0000 mgr.y (mgr.14146) 295 : cluster [DBG] pgmap v285: 132 pgs: 102 active+clean, 1 creating+activating, 9 creating+peering, 20 unknown; 1.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-02-13T00:30:00.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:59 smithi080 bash[17386]: audit 2024-02-13T00:29:58.930919+0000 mon.a (mon.0) 574 : audit [INF] from='client.? 172.21.15.80:0/2043048888' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-13T00:30:00.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:59 smithi080 bash[17386]: audit 2024-02-13T00:29:58.931040+0000 mon.a (mon.0) 575 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-13T00:30:00.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:59 smithi080 bash[17386]: cluster 2024-02-13T00:29:58.931169+0000 mon.a (mon.0) 576 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-13T00:30:00.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:59 smithi080 bash[17386]: audit 2024-02-13T00:29:59.267015+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:00.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:59 smithi080 bash[17386]: audit 2024-02-13T00:29:59.275546+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:00.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:59 smithi080 bash[17386]: audit 2024-02-13T00:29:59.282625+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:00.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:59 smithi080 bash[17386]: audit 2024-02-13T00:29:59.306601+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-13T00:30:00.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:59 smithi080 bash[17386]: audit 2024-02-13T00:29:59.311023+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-02-13T00:30:00.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:29:59 smithi080 bash[17386]: audit 2024-02-13T00:29:59.327476+0000 mon.a (mon.0) 582 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:30:01.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:00 smithi106 bash[18459]: cephadm 2024-02-13T00:29:59.292854+0000 mgr.y (mgr.14146) 296 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2024-02-13T00:30:01.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:00 smithi106 bash[18459]: cephadm 2024-02-13T00:29:59.328646+0000 mgr.y (mgr.14146) 297 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi106 2024-02-13T00:30:01.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:00 smithi106 bash[18459]: cluster 2024-02-13T00:30:00.000181+0000 mon.a (mon.0) 583 : cluster [INF] overall HEALTH_OK 2024-02-13T00:30:01.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:00 smithi080 bash[17386]: cephadm 2024-02-13T00:29:59.292854+0000 mgr.y (mgr.14146) 296 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2024-02-13T00:30:01.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:00 smithi080 bash[17386]: cephadm 2024-02-13T00:29:59.328646+0000 mgr.y (mgr.14146) 297 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi106 2024-02-13T00:30:01.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:00 smithi080 bash[17386]: cluster 2024-02-13T00:30:00.000181+0000 mon.a (mon.0) 583 : cluster [INF] overall HEALTH_OK 2024-02-13T00:30:01.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:00 smithi080 bash[24237]: cephadm 2024-02-13T00:29:59.292854+0000 mgr.y (mgr.14146) 296 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2024-02-13T00:30:01.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:00 smithi080 bash[24237]: cephadm 2024-02-13T00:29:59.328646+0000 mgr.y (mgr.14146) 297 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi106 2024-02-13T00:30:01.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:00 smithi080 bash[24237]: cluster 2024-02-13T00:30:00.000181+0000 mon.a (mon.0) 583 : cluster [INF] overall HEALTH_OK 2024-02-13T00:30:02.037 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:01 smithi106 bash[18459]: cluster 2024-02-13T00:30:00.769413+0000 mgr.y (mgr.14146) 298 : cluster [DBG] pgmap v287: 132 pgs: 118 active+clean, 1 creating+activating, 4 creating+peering, 9 unknown; 2.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 24 KiB/s rd, 2.7 KiB/s wr, 56 op/s 2024-02-13T00:30:02.037 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:01 smithi106 bash[18459]: cluster 2024-02-13T00:30:00.955885+0000 mon.a (mon.0) 584 : cluster [DBG] mgrmap e15: y(active, since 7m), standbys: x 2024-02-13T00:30:02.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:01 smithi080 bash[17386]: cluster 2024-02-13T00:30:00.769413+0000 mgr.y (mgr.14146) 298 : cluster [DBG] pgmap v287: 132 pgs: 118 active+clean, 1 creating+activating, 4 creating+peering, 9 unknown; 2.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 24 KiB/s rd, 2.7 KiB/s wr, 56 op/s 2024-02-13T00:30:02.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:01 smithi080 bash[17386]: cluster 2024-02-13T00:30:00.955885+0000 mon.a (mon.0) 584 : cluster [DBG] mgrmap e15: y(active, since 7m), standbys: x 2024-02-13T00:30:02.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:01 smithi080 bash[24237]: cluster 2024-02-13T00:30:00.769413+0000 mgr.y (mgr.14146) 298 : cluster [DBG] pgmap v287: 132 pgs: 118 active+clean, 1 creating+activating, 4 creating+peering, 9 unknown; 2.4 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 24 KiB/s rd, 2.7 KiB/s wr, 56 op/s 2024-02-13T00:30:02.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:01 smithi080 bash[24237]: cluster 2024-02-13T00:30:00.955885+0000 mon.a (mon.0) 584 : cluster [DBG] mgrmap e15: y(active, since 7m), standbys: x 2024-02-13T00:30:02.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.972+0000 7f0ead3e8700 1 -- 172.21.15.106:0/3995333796 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ea80f74d0 msgr2=0x7f0ea80f7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.972+0000 7f0ead3e8700 1 --2- 172.21.15.106:0/3995333796 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ea80f74d0 0x7f0ea80f7930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f0e9c0048a0 tx=0x7f0e9c009cb0).stop 2024-02-13T00:30:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.972+0000 7f0ead3e8700 1 -- 172.21.15.106:0/3995333796 shutdown_connections 2024-02-13T00:30:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.972+0000 7f0ead3e8700 1 --2- 172.21.15.106:0/3995333796 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0ea80f7e20 0x7f0ea80fe720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.972+0000 7f0ead3e8700 1 --2- 172.21.15.106:0/3995333796 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ea80f6230 0x7f0ea80f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.972+0000 7f0ead3e8700 1 --2- 172.21.15.106:0/3995333796 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ea80f74d0 0x7f0ea80f7930 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.972+0000 7f0ead3e8700 1 -- 172.21.15.106:0/3995333796 >> 172.21.15.106:0/3995333796 conn(0x7f0ea80f1a30 msgr2=0x7f0ea80f3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:30:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.972+0000 7f0ead3e8700 1 -- 172.21.15.106:0/3995333796 shutdown_connections 2024-02-13T00:30:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.972+0000 7f0ead3e8700 1 -- 172.21.15.106:0/3995333796 wait complete. 2024-02-13T00:30:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0ead3e8700 1 Processor -- start 2024-02-13T00:30:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0ead3e8700 1 -- start start 2024-02-13T00:30:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0ead3e8700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0ea80f6230 0x7f0ea80fa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0ead3e8700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ea80f74d0 0x7f0ea80f8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0ead3e8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ea80f7e20 0x7f0ea80f8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0ead3e8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea80f9320 con 0x7f0ea80f7e20 2024-02-13T00:30:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0ead3e8700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea80f9490 con 0x7f0ea80f74d0 2024-02-13T00:30:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0ead3e8700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea80f9650 con 0x7f0ea80f6230 2024-02-13T00:30:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0ea67fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ea80f74d0 0x7f0ea80f8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0ea67fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ea80f74d0 0x7f0ea80f8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60972/0 (socket says 172.21.15.106:60972) 2024-02-13T00:30:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0ea67fc700 1 -- 172.21.15.106:0/4158535920 learned_addr learned my addr 172.21.15.106:0/4158535920 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-02-13T00:30:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0ea6ffd700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0ea80f6230 0x7f0ea80fa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0ea77fe700 1 --2- 172.21.15.106:0/4158535920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ea80f7e20 0x7f0ea80f8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0ea67fc700 1 -- 172.21.15.106:0/4158535920 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0ea80f6230 msgr2=0x7f0ea80fa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0ea67fc700 1 --2- 172.21.15.106:0/4158535920 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0ea80f6230 0x7f0ea80fa1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0ea67fc700 1 -- 172.21.15.106:0/4158535920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ea80f7e20 msgr2=0x7f0ea80f8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0ea67fc700 1 --2- 172.21.15.106:0/4158535920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ea80f7e20 0x7f0ea80f8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0ea67fc700 1 -- 172.21.15.106:0/4158535920 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9c005040 con 0x7f0ea80f74d0 2024-02-13T00:30:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0ea67fc700 1 --2- 172.21.15.106:0/4158535920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ea80f74d0 0x7f0ea80f8810 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f0e9c013620 tx=0x7f0e9c009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:30:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0e8ffff700 1 -- 172.21.15.106:0/4158535920 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c00e030 con 0x7f0ea80f74d0 2024-02-13T00:30:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0e8ffff700 1 -- 172.21.15.106:0/4158535920 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f0e9c01d420 con 0x7f0ea80f74d0 2024-02-13T00:30:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0ead3e8700 1 -- 172.21.15.106:0/4158535920 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea8111f50 con 0x7f0ea80f74d0 2024-02-13T00:30:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0e8ffff700 1 -- 172.21.15.106:0/4158535920 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c018070 con 0x7f0ea80f74d0 2024-02-13T00:30:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0ead3e8700 1 -- 172.21.15.106:0/4158535920 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea81123d0 con 0x7f0ea80f74d0 2024-02-13T00:30:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.976+0000 7f0ead3e8700 1 -- 172.21.15.106:0/4158535920 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea8060070 con 0x7f0ea80f74d0 2024-02-13T00:30:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.980+0000 7f0e8ffff700 1 -- 172.21.15.106:0/4158535920 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 15) v1 ==== 77115+0+0 (secure 0 0 0) 0x7f0e9c009450 con 0x7f0ea80f74d0 2024-02-13T00:30:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.980+0000 7f0e8ffff700 1 --2- 172.21.15.106:0/4158535920 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f0e900612e0 0x7f0e900637a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.980+0000 7f0e8ffff700 1 -- 172.21.15.106:0/4158535920 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7090+0+0 (secure 0 0 0) 0x7f0e9c07dea0 con 0x7f0ea80f74d0 2024-02-13T00:30:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.980+0000 7f0ea6ffd700 1 --2- 172.21.15.106:0/4158535920 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f0e900612e0 0x7f0e900637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.980+0000 7f0ea6ffd700 1 --2- 172.21.15.106:0/4158535920 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f0e900612e0 0x7f0e900637a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f0ea80f7330 tx=0x7f0e98009040).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:30:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:02.988+0000 7f0e8ffff700 1 -- 172.21.15.106:0/4158535920 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0e9c04dbf0 con 0x7f0ea80f74d0 2024-02-13T00:30:03.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:03.192+0000 7f0ead3e8700 1 -- 172.21.15.106:0/4158535920 --> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi106=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ea80ff630 con 0x7f0e900612e0 2024-02-13T00:30:03.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:03.208+0000 7f0e8ffff700 1 -- 172.21.15.106:0/4158535920 <== mgr.14146 v2:172.21.15.80:6800/461193090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f0ea80ff630 con 0x7f0e900612e0 2024-02-13T00:30:03.213 INFO:teuthology.orchestra.run.smithi106.stdout:Scheduled prometheus update... 2024-02-13T00:30:03.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:03.212+0000 7f0ead3e8700 1 -- 172.21.15.106:0/4158535920 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f0e900612e0 msgr2=0x7f0e900637a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:03.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:03.212+0000 7f0ead3e8700 1 --2- 172.21.15.106:0/4158535920 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f0e900612e0 0x7f0e900637a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f0ea80f7330 tx=0x7f0e98009040).stop 2024-02-13T00:30:03.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:03.212+0000 7f0ead3e8700 1 -- 172.21.15.106:0/4158535920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ea80f74d0 msgr2=0x7f0ea80f8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:03.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:03.212+0000 7f0ead3e8700 1 --2- 172.21.15.106:0/4158535920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ea80f74d0 0x7f0ea80f8810 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f0e9c013620 tx=0x7f0e9c009cb0).stop 2024-02-13T00:30:03.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:03.212+0000 7f0ead3e8700 1 -- 172.21.15.106:0/4158535920 shutdown_connections 2024-02-13T00:30:03.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:03.212+0000 7f0ead3e8700 1 --2- 172.21.15.106:0/4158535920 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0ea80f7e20 0x7f0ea80f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:03.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:03.212+0000 7f0ead3e8700 1 --2- 172.21.15.106:0/4158535920 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0ea80f6230 0x7f0ea80fa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:03.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:03.212+0000 7f0ead3e8700 1 --2- 172.21.15.106:0/4158535920 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f0e900612e0 0x7f0e900637a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:03.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:03.212+0000 7f0ead3e8700 1 --2- 172.21.15.106:0/4158535920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ea80f74d0 0x7f0ea80f8810 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:03.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:03.212+0000 7f0ead3e8700 1 -- 172.21.15.106:0/4158535920 >> 172.21.15.106:0/4158535920 conn(0x7f0ea80f1a30 msgr2=0x7f0ea80fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:30:03.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:03.212+0000 7f0ead3e8700 1 -- 172.21.15.106:0/4158535920 shutdown_connections 2024-02-13T00:30:03.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:03.212+0000 7f0ead3e8700 1 -- 172.21.15.106:0/4158535920 wait complete. 2024-02-13T00:30:03.328 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:30:03 smithi106 systemd[1]: Started Ceph iscsi.iscsi.a for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:30:04.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:03 smithi106 bash[18459]: cluster 2024-02-13T00:30:02.770508+0000 mgr.y (mgr.14146) 299 : cluster [DBG] pgmap v288: 132 pgs: 132 active+clean; 3.9 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 44 KiB/s rd, 4.3 KiB/s wr, 102 op/s 2024-02-13T00:30:04.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:03 smithi106 bash[18459]: audit 2024-02-13T00:30:03.208801+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:04.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:03 smithi106 bash[18459]: audit 2024-02-13T00:30:03.307258+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:04.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:03 smithi106 bash[18459]: audit 2024-02-13T00:30:03.309552+0000 mon.a (mon.0) 587 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:30:04.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:03 smithi080 bash[17386]: cluster 2024-02-13T00:30:02.770508+0000 mgr.y (mgr.14146) 299 : cluster [DBG] pgmap v288: 132 pgs: 132 active+clean; 3.9 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 44 KiB/s rd, 4.3 KiB/s wr, 102 op/s 2024-02-13T00:30:04.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:03 smithi080 bash[17386]: audit 2024-02-13T00:30:03.208801+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:04.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:03 smithi080 bash[17386]: audit 2024-02-13T00:30:03.307258+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:04.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:03 smithi080 bash[17386]: audit 2024-02-13T00:30:03.309552+0000 mon.a (mon.0) 587 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:30:04.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:03 smithi080 bash[24237]: cluster 2024-02-13T00:30:02.770508+0000 mgr.y (mgr.14146) 299 : cluster [DBG] pgmap v288: 132 pgs: 132 active+clean; 3.9 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 44 KiB/s rd, 4.3 KiB/s wr, 102 op/s 2024-02-13T00:30:04.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:03 smithi080 bash[24237]: audit 2024-02-13T00:30:03.208801+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:04.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:03 smithi080 bash[24237]: audit 2024-02-13T00:30:03.307258+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:04.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:03 smithi080 bash[24237]: audit 2024-02-13T00:30:03.309552+0000 mon.a (mon.0) 587 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:30:04.841 DEBUG:teuthology.orchestra.run.smithi106:prometheus.a> sudo journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@prometheus.a.service 2024-02-13T00:30:04.843 INFO:tasks.cephadm:Adding node-exporter.a on smithi080 2024-02-13T00:30:04.843 INFO:tasks.cephadm:Adding node-exporter.b on smithi106 2024-02-13T00:30:04.843 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph orch apply node-exporter '2;smithi080=a;smithi106=b' 2024-02-13T00:30:05.206 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-13T00:30:05.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:04 smithi106 bash[18459]: audit 2024-02-13T00:30:03.197959+0000 mgr.y (mgr.14146) 300 : audit [DBG] from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi106=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:30:05.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:04 smithi106 bash[18459]: cephadm 2024-02-13T00:30:03.202130+0000 mgr.y (mgr.14146) 301 : cephadm [INF] Saving service prometheus spec with placement smithi106=a;count:1 2024-02-13T00:30:05.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:04 smithi080 bash[17386]: audit 2024-02-13T00:30:03.197959+0000 mgr.y (mgr.14146) 300 : audit [DBG] from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi106=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:30:05.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:04 smithi080 bash[17386]: cephadm 2024-02-13T00:30:03.202130+0000 mgr.y (mgr.14146) 301 : cephadm [INF] Saving service prometheus spec with placement smithi106=a;count:1 2024-02-13T00:30:05.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:04 smithi080 bash[24237]: audit 2024-02-13T00:30:03.197959+0000 mgr.y (mgr.14146) 300 : audit [DBG] from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi106=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:30:05.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:04 smithi080 bash[24237]: cephadm 2024-02-13T00:30:03.202130+0000 mgr.y (mgr.14146) 301 : cephadm [INF] Saving service prometheus spec with placement smithi106=a;count:1 2024-02-13T00:30:06.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:05 smithi106 bash[18459]: cluster 2024-02-13T00:30:04.771730+0000 mgr.y (mgr.14146) 302 : cluster [DBG] pgmap v289: 132 pgs: 132 active+clean; 5.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 85 KiB/s rd, 4.7 KiB/s wr, 187 op/s 2024-02-13T00:30:06.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:30:06 smithi106 bash[39335]: log file path now is '/var/log/tcmu-runner.log' 2024-02-13T00:30:06.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:05 smithi080 bash[17386]: cluster 2024-02-13T00:30:04.771730+0000 mgr.y (mgr.14146) 302 : cluster [DBG] pgmap v289: 132 pgs: 132 active+clean; 5.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 85 KiB/s rd, 4.7 KiB/s wr, 187 op/s 2024-02-13T00:30:06.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:05 smithi080 bash[24237]: cluster 2024-02-13T00:30:04.771730+0000 mgr.y (mgr.14146) 302 : cluster [DBG] pgmap v289: 132 pgs: 132 active+clean; 5.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 85 KiB/s rd, 4.7 KiB/s wr, 187 op/s 2024-02-13T00:30:06.557 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:30:06 smithi106 bash[39366]: debug Started the configuration object watcher 2024-02-13T00:30:06.557 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:30:06 smithi106 bash[39366]: debug Checking for config object changes every 1s 2024-02-13T00:30:06.557 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:30:06 smithi106 bash[39366]: debug Processing osd blocklist entries for this node 2024-02-13T00:30:06.693 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:30:06 smithi106 bash[39366]: debug Reading the configuration object to update local LIO configuration 2024-02-13T00:30:06.693 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:30:06 smithi106 bash[39366]: debug Configuration does not have an entry for this host(smithi106.front.sepia.ceph.com) - nothing to define to LIO 2024-02-13T00:30:06.973 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:30:06 smithi106 bash[39366]: debug * Running on http://[::]:5000/ (Press CTRL+C to quit) 2024-02-13T00:30:07.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:06 smithi106 bash[18459]: audit 2024-02-13T00:30:06.658936+0000 mon.b (mon.1) 27 : audit [DBG] from='client.? 172.21.15.106:0/2196116618' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-13T00:30:07.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:06 smithi106 bash[18459]: audit 2024-02-13T00:30:06.710061+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-13T00:30:07.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:06 smithi106 bash[18459]: audit 2024-02-13T00:30:06.710535+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-13T00:30:07.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:06 smithi106 bash[18459]: audit 2024-02-13T00:30:06.710946+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-13T00:30:07.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:06 smithi080 bash[17386]: audit 2024-02-13T00:30:06.658936+0000 mon.b (mon.1) 27 : audit [DBG] from='client.? 172.21.15.106:0/2196116618' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-13T00:30:07.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:06 smithi080 bash[17386]: audit 2024-02-13T00:30:06.710061+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-13T00:30:07.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:06 smithi080 bash[17386]: audit 2024-02-13T00:30:06.710535+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-13T00:30:07.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:06 smithi080 bash[17386]: audit 2024-02-13T00:30:06.710946+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-13T00:30:07.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:06 smithi080 bash[24237]: audit 2024-02-13T00:30:06.658936+0000 mon.b (mon.1) 27 : audit [DBG] from='client.? 172.21.15.106:0/2196116618' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-13T00:30:07.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:06 smithi080 bash[24237]: audit 2024-02-13T00:30:06.710061+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-13T00:30:07.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:06 smithi080 bash[24237]: audit 2024-02-13T00:30:06.710535+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-13T00:30:07.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:06 smithi080 bash[24237]: audit 2024-02-13T00:30:06.710946+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-13T00:30:08.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:07 smithi106 bash[18459]: cluster 2024-02-13T00:30:06.772678+0000 mgr.y (mgr.14146) 303 : cluster [DBG] pgmap v290: 132 pgs: 132 active+clean; 5.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 77 KiB/s rd, 4.0 KiB/s wr, 168 op/s 2024-02-13T00:30:08.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:07 smithi106 bash[18459]: audit 2024-02-13T00:30:06.975253+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]': finished 2024-02-13T00:30:08.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:07 smithi106 bash[18459]: audit 2024-02-13T00:30:06.975379+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-02-13T00:30:08.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:07 smithi106 bash[18459]: audit 2024-02-13T00:30:06.975574+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]': finished 2024-02-13T00:30:08.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:07 smithi106 bash[18459]: cluster 2024-02-13T00:30:06.975744+0000 mon.a (mon.0) 594 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-13T00:30:08.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:07 smithi080 bash[17386]: cluster 2024-02-13T00:30:06.772678+0000 mgr.y (mgr.14146) 303 : cluster [DBG] pgmap v290: 132 pgs: 132 active+clean; 5.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 77 KiB/s rd, 4.0 KiB/s wr, 168 op/s 2024-02-13T00:30:08.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:07 smithi080 bash[17386]: audit 2024-02-13T00:30:06.975253+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]': finished 2024-02-13T00:30:08.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:07 smithi080 bash[17386]: audit 2024-02-13T00:30:06.975379+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-02-13T00:30:08.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:07 smithi080 bash[17386]: audit 2024-02-13T00:30:06.975574+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]': finished 2024-02-13T00:30:08.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:07 smithi080 bash[17386]: cluster 2024-02-13T00:30:06.975744+0000 mon.a (mon.0) 594 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-13T00:30:08.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:07 smithi080 bash[24237]: cluster 2024-02-13T00:30:06.772678+0000 mgr.y (mgr.14146) 303 : cluster [DBG] pgmap v290: 132 pgs: 132 active+clean; 5.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 77 KiB/s rd, 4.0 KiB/s wr, 168 op/s 2024-02-13T00:30:08.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:07 smithi080 bash[24237]: audit 2024-02-13T00:30:06.975253+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]': finished 2024-02-13T00:30:08.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:07 smithi080 bash[24237]: audit 2024-02-13T00:30:06.975379+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-02-13T00:30:08.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:07 smithi080 bash[24237]: audit 2024-02-13T00:30:06.975574+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]': finished 2024-02-13T00:30:08.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:07 smithi080 bash[24237]: cluster 2024-02-13T00:30:06.975744+0000 mon.a (mon.0) 594 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-13T00:30:08.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.260+0000 7fb3c0154700 1 -- 172.21.15.106:0/3880235491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3b80f6810 msgr2=0x7fb3b80f8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:08.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.260+0000 7fb3c0154700 1 --2- 172.21.15.106:0/3880235491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3b80f6810 0x7fb3b80f8f90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fb3a8004870 tx=0x7fb3a8009cb0).stop 2024-02-13T00:30:08.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.260+0000 7fb3c0154700 1 -- 172.21.15.106:0/3880235491 shutdown_connections 2024-02-13T00:30:08.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.260+0000 7fb3c0154700 1 --2- 172.21.15.106:0/3880235491 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3b80f95b0 0x7fb3b80f9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:08.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.260+0000 7fb3c0154700 1 --2- 172.21.15.106:0/3880235491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3b80f5e70 0x7fb3b80f6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:08.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.260+0000 7fb3c0154700 1 --2- 172.21.15.106:0/3880235491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3b80f6810 0x7fb3b80f8f90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:08.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.260+0000 7fb3c0154700 1 -- 172.21.15.106:0/3880235491 >> 172.21.15.106:0/3880235491 conn(0x7fb3b80f1a30 msgr2=0x7fb3b80f3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:30:08.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.260+0000 7fb3c0154700 1 -- 172.21.15.106:0/3880235491 shutdown_connections 2024-02-13T00:30:08.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.260+0000 7fb3c0154700 1 -- 172.21.15.106:0/3880235491 wait complete. 2024-02-13T00:30:08.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3c0154700 1 Processor -- start 2024-02-13T00:30:08.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3c0154700 1 -- start start 2024-02-13T00:30:08.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3c0154700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3b80f5e70 0x7fb3b8107f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:08.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3c0154700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3b80f6810 0x7fb3b8108480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:08.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3c0154700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3b80f95b0 0x7fb3b810f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:08.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3c0154700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b810fa50 con 0x7fb3b80f95b0 2024-02-13T00:30:08.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3c0154700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b810fb90 con 0x7fb3b80f5e70 2024-02-13T00:30:08.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3c0154700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b810fcd0 con 0x7fb3b80f6810 2024-02-13T00:30:08.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3bdef0700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3b80f5e70 0x7fb3b8107f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:08.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3bdef0700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3b80f5e70 0x7fb3b8107f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58742/0 (socket says 172.21.15.106:58742) 2024-02-13T00:30:08.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3be6f1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3b80f95b0 0x7fb3b810f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:08.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3bdef0700 1 -- 172.21.15.106:0/2272036438 learned_addr learned my addr 172.21.15.106:0/2272036438 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-02-13T00:30:08.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3bd6ef700 1 --2- 172.21.15.106:0/2272036438 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3b80f6810 0x7fb3b8108480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:08.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3bdef0700 1 -- 172.21.15.106:0/2272036438 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3b80f6810 msgr2=0x7fb3b8108480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:08.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3bdef0700 1 --2- 172.21.15.106:0/2272036438 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3b80f6810 0x7fb3b8108480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:08.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3bdef0700 1 -- 172.21.15.106:0/2272036438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3b80f95b0 msgr2=0x7fb3b810f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:08.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3bdef0700 1 --2- 172.21.15.106:0/2272036438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3b80f95b0 0x7fb3b810f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:08.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3bdef0700 1 -- 172.21.15.106:0/2272036438 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a8005040 con 0x7fb3b80f5e70 2024-02-13T00:30:08.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3bd6ef700 1 --2- 172.21.15.106:0/2272036438 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3b80f6810 0x7fb3b8108480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-13T00:30:08.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3bdef0700 1 --2- 172.21.15.106:0/2272036438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3b80f5e70 0x7fb3b8107f90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb3b400e940 tx=0x7fb3b400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:30:08.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3aeffd700 1 -- 172.21.15.106:0/2272036438 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4004660 con 0x7fb3b80f5e70 2024-02-13T00:30:08.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3aeffd700 1 -- 172.21.15.106:0/2272036438 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fb3b400f040 con 0x7fb3b80f5e70 2024-02-13T00:30:08.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3c0154700 1 -- 172.21.15.106:0/2272036438 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b810ffb0 con 0x7fb3b80f5e70 2024-02-13T00:30:08.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3aeffd700 1 -- 172.21.15.106:0/2272036438 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40146f0 con 0x7fb3b80f5e70 2024-02-13T00:30:08.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.264+0000 7fb3c0154700 1 -- 172.21.15.106:0/2272036438 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b8110440 con 0x7fb3b80f5e70 2024-02-13T00:30:08.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.268+0000 7fb3c0154700 1 -- 172.21.15.106:0/2272036438 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b8060070 con 0x7fb3b80f5e70 2024-02-13T00:30:08.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.268+0000 7fb3aeffd700 1 -- 172.21.15.106:0/2272036438 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 15) v1 ==== 77115+0+0 (secure 0 0 0) 0x7fb3b4007b40 con 0x7fb3b80f5e70 2024-02-13T00:30:08.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.268+0000 7fb3aeffd700 1 --2- 172.21.15.106:0/2272036438 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fb3a40612e0 0x7fb3a40637a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:08.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.268+0000 7fb3aeffd700 1 -- 172.21.15.106:0/2272036438 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7177+0+0 (secure 0 0 0) 0x7fb3b407c9c0 con 0x7fb3b80f5e70 2024-02-13T00:30:08.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.268+0000 7fb3bd6ef700 1 --2- 172.21.15.106:0/2272036438 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fb3a40612e0 0x7fb3a40637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:08.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.268+0000 7fb3bd6ef700 1 --2- 172.21.15.106:0/2272036438 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fb3a40612e0 0x7fb3a40637a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fb3a8009920 tx=0x7fb3a8009cb0).ready entity=mgr.14146 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:30:08.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.276+0000 7fb3aeffd700 1 -- 172.21.15.106:0/2272036438 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb3b404c750 con 0x7fb3b80f5e70 2024-02-13T00:30:08.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.480+0000 7fb3c0154700 1 -- 172.21.15.106:0/2272036438 --> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi080=a;smithi106=b", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3b80fedb0 con 0x7fb3a40612e0 2024-02-13T00:30:08.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.492+0000 7fb3aeffd700 1 -- 172.21.15.106:0/2272036438 <== mgr.14146 v2:172.21.15.80:6800/461193090 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fb3b80fedb0 con 0x7fb3a40612e0 2024-02-13T00:30:08.499 INFO:teuthology.orchestra.run.smithi106.stdout:Scheduled node-exporter update... 2024-02-13T00:30:08.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.496+0000 7fb3c0154700 1 -- 172.21.15.106:0/2272036438 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fb3a40612e0 msgr2=0x7fb3a40637a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:08.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.496+0000 7fb3c0154700 1 --2- 172.21.15.106:0/2272036438 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fb3a40612e0 0x7fb3a40637a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fb3a8009920 tx=0x7fb3a8009cb0).stop 2024-02-13T00:30:08.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.496+0000 7fb3c0154700 1 -- 172.21.15.106:0/2272036438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3b80f5e70 msgr2=0x7fb3b8107f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:08.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.496+0000 7fb3c0154700 1 --2- 172.21.15.106:0/2272036438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3b80f5e70 0x7fb3b8107f90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb3b400e940 tx=0x7fb3b400b040).stop 2024-02-13T00:30:08.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.496+0000 7fb3c0154700 1 -- 172.21.15.106:0/2272036438 shutdown_connections 2024-02-13T00:30:08.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.496+0000 7fb3c0154700 1 --2- 172.21.15.106:0/2272036438 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7fb3a40612e0 0x7fb3a40637a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:08.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.496+0000 7fb3c0154700 1 --2- 172.21.15.106:0/2272036438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3b80f5e70 0x7fb3b8107f90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:08.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.496+0000 7fb3c0154700 1 --2- 172.21.15.106:0/2272036438 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb3b80f95b0 0x7fb3b810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:08.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.496+0000 7fb3c0154700 1 --2- 172.21.15.106:0/2272036438 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb3b80f6810 0x7fb3b8108480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:08.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.496+0000 7fb3c0154700 1 -- 172.21.15.106:0/2272036438 >> 172.21.15.106:0/2272036438 conn(0x7fb3b80f1a30 msgr2=0x7fb3b80f3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:30:08.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.496+0000 7fb3c0154700 1 -- 172.21.15.106:0/2272036438 shutdown_connections 2024-02-13T00:30:08.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:08.496+0000 7fb3c0154700 1 -- 172.21.15.106:0/2272036438 wait complete. 2024-02-13T00:30:09.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:08 smithi106 bash[18459]: cluster 2024-02-13T00:30:07.980276+0000 mon.a (mon.0) 595 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-13T00:30:09.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:08 smithi106 bash[18459]: audit 2024-02-13T00:30:08.145728+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:09.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:08 smithi106 bash[18459]: audit 2024-02-13T00:30:08.494565+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:09.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:08 smithi106 bash[18459]: audit 2024-02-13T00:30:08.744209+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:09.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:08 smithi080 bash[17386]: cluster 2024-02-13T00:30:07.980276+0000 mon.a (mon.0) 595 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-13T00:30:09.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:08 smithi080 bash[17386]: audit 2024-02-13T00:30:08.145728+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:09.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:08 smithi080 bash[17386]: audit 2024-02-13T00:30:08.494565+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:09.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:08 smithi080 bash[17386]: audit 2024-02-13T00:30:08.744209+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:09.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:08 smithi080 bash[24237]: cluster 2024-02-13T00:30:07.980276+0000 mon.a (mon.0) 595 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-13T00:30:09.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:08 smithi080 bash[24237]: audit 2024-02-13T00:30:08.145728+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:09.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:08 smithi080 bash[24237]: audit 2024-02-13T00:30:08.494565+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:09.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:08 smithi080 bash[24237]: audit 2024-02-13T00:30:08.744209+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:09.265 DEBUG:teuthology.orchestra.run.smithi080:node-exporter.a> sudo journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@node-exporter.a.service 2024-02-13T00:30:09.268 DEBUG:teuthology.orchestra.run.smithi106:node-exporter.b> sudo journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@node-exporter.b.service 2024-02-13T00:30:09.270 INFO:tasks.cephadm:Adding alertmanager.a on smithi080 2024-02-13T00:30:09.270 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph orch apply alertmanager '1;smithi080=a' 2024-02-13T00:30:09.385 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-13T00:30:09.408 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-13T00:30:10.255 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:10 smithi106 bash[19299]: ignoring --setuser ceph since I am not root 2024-02-13T00:30:10.255 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:10 smithi106 bash[19299]: ignoring --setgroup ceph since I am not root 2024-02-13T00:30:10.255 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:10 smithi106 bash[19299]: debug 2024-02-13T00:30:10.052+0000 7fa63f1bd700 1 -- 172.21.15.106:0/1225108869 <== mon.1 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55821f1ee4e0 con 0x55821f2e2c00 2024-02-13T00:30:10.255 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:10 smithi106 bash[19299]: debug 2024-02-13T00:30:10.216+0000 7fa64f39b680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-13T00:30:10.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:09 smithi106 bash[18459]: audit 2024-02-13T00:30:08.485017+0000 mgr.y (mgr.14146) 304 : audit [DBG] from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi080=a;smithi106=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:30:10.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:09 smithi106 bash[18459]: cephadm 2024-02-13T00:30:08.486947+0000 mgr.y (mgr.14146) 305 : cephadm [INF] Saving service node-exporter spec with placement smithi080=a;smithi106=b;count:2 2024-02-13T00:30:10.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:09 smithi106 bash[18459]: cluster 2024-02-13T00:30:08.773713+0000 mgr.y (mgr.14146) 306 : cluster [DBG] pgmap v293: 132 pgs: 1 peering, 1 active+recovery_wait+degraded, 130 active+clean; 5.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 83 KiB/s rd, 2.9 KiB/s wr, 169 op/s; 4/639 objects degraded (0.626%) 2024-02-13T00:30:10.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:09 smithi106 bash[18459]: audit 2024-02-13T00:30:08.995354+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:30:10.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:09 smithi106 bash[18459]: audit 2024-02-13T00:30:08.996194+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:30:10.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:09 smithi106 bash[18459]: audit 2024-02-13T00:30:09.001327+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:10.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:09 smithi106 bash[18459]: audit 2024-02-13T00:30:09.007936+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-13T00:30:10.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:09 smithi106 bash[18459]: cluster 2024-02-13T00:30:09.741837+0000 mon.a (mon.0) 603 : cluster [WRN] Health check failed: Degraded data redundancy: 4/639 objects degraded (0.626%), 1 pg degraded (PG_DEGRADED) 2024-02-13T00:30:10.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:09 smithi080 bash[17386]: audit 2024-02-13T00:30:08.485017+0000 mgr.y (mgr.14146) 304 : audit [DBG] from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi080=a;smithi106=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:30:10.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:09 smithi080 bash[17386]: cephadm 2024-02-13T00:30:08.486947+0000 mgr.y (mgr.14146) 305 : cephadm [INF] Saving service node-exporter spec with placement smithi080=a;smithi106=b;count:2 2024-02-13T00:30:10.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:09 smithi080 bash[17386]: cluster 2024-02-13T00:30:08.773713+0000 mgr.y (mgr.14146) 306 : cluster [DBG] pgmap v293: 132 pgs: 1 peering, 1 active+recovery_wait+degraded, 130 active+clean; 5.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 83 KiB/s rd, 2.9 KiB/s wr, 169 op/s; 4/639 objects degraded (0.626%) 2024-02-13T00:30:10.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:09 smithi080 bash[17386]: audit 2024-02-13T00:30:08.995354+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:30:10.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:09 smithi080 bash[17386]: audit 2024-02-13T00:30:08.996194+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:30:10.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:09 smithi080 bash[17386]: audit 2024-02-13T00:30:09.001327+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:10.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:09 smithi080 bash[17386]: audit 2024-02-13T00:30:09.007936+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-13T00:30:10.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:09 smithi080 bash[17386]: cluster 2024-02-13T00:30:09.741837+0000 mon.a (mon.0) 603 : cluster [WRN] Health check failed: Degraded data redundancy: 4/639 objects degraded (0.626%), 1 pg degraded (PG_DEGRADED) 2024-02-13T00:30:10.259 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:10 smithi080 bash[17652]: ignoring --setuser ceph since I am not root 2024-02-13T00:30:10.259 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:10 smithi080 bash[17652]: ignoring --setgroup ceph since I am not root 2024-02-13T00:30:10.259 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:10 smithi080 bash[17652]: debug 2024-02-13T00:30:10.055+0000 7f16aaca2700 1 -- 172.21.15.80:0/606544789 <== mon.0 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a1eb8724e0 con 0x55a1eb966800 2024-02-13T00:30:10.259 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:10 smithi080 bash[17652]: debug 2024-02-13T00:30:10.211+0000 7f16bae80680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-13T00:30:10.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:09 smithi080 bash[24237]: audit 2024-02-13T00:30:08.485017+0000 mgr.y (mgr.14146) 304 : audit [DBG] from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi080=a;smithi106=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:30:10.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:09 smithi080 bash[24237]: cephadm 2024-02-13T00:30:08.486947+0000 mgr.y (mgr.14146) 305 : cephadm [INF] Saving service node-exporter spec with placement smithi080=a;smithi106=b;count:2 2024-02-13T00:30:10.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:09 smithi080 bash[24237]: cluster 2024-02-13T00:30:08.773713+0000 mgr.y (mgr.14146) 306 : cluster [DBG] pgmap v293: 132 pgs: 1 peering, 1 active+recovery_wait+degraded, 130 active+clean; 5.3 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 83 KiB/s rd, 2.9 KiB/s wr, 169 op/s; 4/639 objects degraded (0.626%) 2024-02-13T00:30:10.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:09 smithi080 bash[24237]: audit 2024-02-13T00:30:08.995354+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:30:10.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:09 smithi080 bash[24237]: audit 2024-02-13T00:30:08.996194+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:30:10.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:09 smithi080 bash[24237]: audit 2024-02-13T00:30:09.001327+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' 2024-02-13T00:30:10.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:09 smithi080 bash[24237]: audit 2024-02-13T00:30:09.007936+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-13T00:30:10.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:09 smithi080 bash[24237]: cluster 2024-02-13T00:30:09.741837+0000 mon.a (mon.0) 603 : cluster [WRN] Health check failed: Degraded data redundancy: 4/639 objects degraded (0.626%), 1 pg degraded (PG_DEGRADED) 2024-02-13T00:30:10.711 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:10 smithi106 bash[19299]: debug 2024-02-13T00:30:10.324+0000 7fa64f39b680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-13T00:30:10.758 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:10 smithi080 bash[17652]: debug 2024-02-13T00:30:10.319+0000 7f16bae80680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-13T00:30:11.005 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:10 smithi106 bash[19299]: debug 2024-02-13T00:30:10.816+0000 7fa64f39b680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-13T00:30:11.258 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:10 smithi080 bash[17652]: debug 2024-02-13T00:30:10.787+0000 7f16bae80680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-13T00:30:11.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:11 smithi080 bash[24237]: audit 2024-02-13T00:30:10.009090+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-13T00:30:11.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:11 smithi080 bash[24237]: cluster 2024-02-13T00:30:10.009166+0000 mon.a (mon.0) 605 : cluster [DBG] mgrmap e16: y(active, since 8m), standbys: x 2024-02-13T00:30:11.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:11 smithi080 bash[17386]: audit 2024-02-13T00:30:10.009090+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-13T00:30:11.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:11 smithi080 bash[17386]: cluster 2024-02-13T00:30:10.009166+0000 mon.a (mon.0) 605 : cluster [DBG] mgrmap e16: y(active, since 8m), standbys: x 2024-02-13T00:30:11.320 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:11 smithi106 bash[18459]: audit 2024-02-13T00:30:10.009090+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14146 172.21.15.80:0/2750450209' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-13T00:30:11.320 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:11 smithi106 bash[18459]: cluster 2024-02-13T00:30:10.009166+0000 mon.a (mon.0) 605 : cluster [DBG] mgrmap e16: y(active, since 8m), standbys: x 2024-02-13T00:30:12.008 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:11 smithi080 bash[17652]: debug 2024-02-13T00:30:11.715+0000 7f16bae80680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-13T00:30:12.009 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:11 smithi080 bash[17652]: debug 2024-02-13T00:30:11.815+0000 7f16bae80680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-13T00:30:12.172 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:11 smithi106 bash[19299]: debug 2024-02-13T00:30:11.804+0000 7fa64f39b680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-13T00:30:12.172 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:11 smithi106 bash[19299]: debug 2024-02-13T00:30:11.916+0000 7fa64f39b680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-13T00:30:12.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f505045f700 1 -- 172.21.15.106:0/3629006689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50480fd100 msgr2=0x7f50480ff4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:12.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f505045f700 1 --2- 172.21.15.106:0/3629006689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50480fd100 0x7f50480ff4f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f5044004870 tx=0x7f5044009cb0).stop 2024-02-13T00:30:12.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f505045f700 1 -- 172.21.15.106:0/3629006689 shutdown_connections 2024-02-13T00:30:12.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f505045f700 1 --2- 172.21.15.106:0/3629006689 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f50480ff9e0 0x7f5048101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:12.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f505045f700 1 --2- 172.21.15.106:0/3629006689 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5048061c40 0x7f50480fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:12.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f505045f700 1 --2- 172.21.15.106:0/3629006689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50480fd100 0x7f50480ff4f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:12.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f505045f700 1 -- 172.21.15.106:0/3629006689 >> 172.21.15.106:0/3629006689 conn(0x7f50480f2210 msgr2=0x7f50480f4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:30:12.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f505045f700 1 -- 172.21.15.106:0/3629006689 shutdown_connections 2024-02-13T00:30:12.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f505045f700 1 -- 172.21.15.106:0/3629006689 wait complete. 2024-02-13T00:30:12.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f505045f700 1 Processor -- start 2024-02-13T00:30:12.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f505045f700 1 -- start start 2024-02-13T00:30:12.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f505045f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5048061c40 0x7f504810a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:12.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f505045f700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f50480fd100 0x7f504810a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:12.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f505045f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50480ff9e0 0x7f5048111960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:12.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f505045f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5048111e50 con 0x7f5048061c40 2024-02-13T00:30:12.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f505045f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5048111f90 con 0x7f50480ff9e0 2024-02-13T00:30:12.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f505045f700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50481120d0 con 0x7f50480fd100 2024-02-13T00:30:12.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f504e9fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50480ff9e0 0x7f5048111960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:12.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f504e9fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50480ff9e0 0x7f5048111960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58780/0 (socket says 172.21.15.106:58780) 2024-02-13T00:30:12.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f504e9fc700 1 -- 172.21.15.106:0/1957004511 learned_addr learned my addr 172.21.15.106:0/1957004511 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-02-13T00:30:12.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f504d9fa700 1 --2- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f50480fd100 0x7f504810a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:12.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f504e1fb700 1 --2- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5048061c40 0x7f504810a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:12.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f504d9fa700 1 -- 172.21.15.106:0/1957004511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50480ff9e0 msgr2=0x7f5048111960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:12.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f504d9fa700 1 --2- 172.21.15.106:0/1957004511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50480ff9e0 0x7f5048111960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:12.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f504d9fa700 1 -- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5048061c40 msgr2=0x7f504810a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:12.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f504d9fa700 1 --2- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5048061c40 0x7f504810a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:12.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f504d9fa700 1 -- 172.21.15.106:0/1957004511 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5044005040 con 0x7f50480fd100 2024-02-13T00:30:12.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.432+0000 7f504d9fa700 1 --2- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f50480fd100 0x7f504810a880 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f5044004710 tx=0x7f5044009cb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:30:12.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.436+0000 7f503f7fe700 1 -- 172.21.15.106:0/1957004511 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504400e030 con 0x7f50480fd100 2024-02-13T00:30:12.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.436+0000 7f505045f700 1 -- 172.21.15.106:0/1957004511 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5048112350 con 0x7f50480fd100 2024-02-13T00:30:12.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.436+0000 7f503f7fe700 1 -- 172.21.15.106:0/1957004511 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f5044013db0 con 0x7f50480fd100 2024-02-13T00:30:12.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.436+0000 7f503f7fe700 1 -- 172.21.15.106:0/1957004511 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5044018070 con 0x7f50480fd100 2024-02-13T00:30:12.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.436+0000 7f505045f700 1 -- 172.21.15.106:0/1957004511 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5048112780 con 0x7f50480fd100 2024-02-13T00:30:12.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.436+0000 7f505045f700 1 -- 172.21.15.106:0/1957004511 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5048060070 con 0x7f50480fd100 2024-02-13T00:30:12.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.436+0000 7f503f7fe700 1 -- 172.21.15.106:0/1957004511 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 16) v1 ==== 77129+0+0 (secure 0 0 0) 0x7f5044009240 con 0x7f50480fd100 2024-02-13T00:30:12.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.436+0000 7f503f7fe700 1 --2- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f5034061330 0x7f50340637f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:12.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.436+0000 7f503f7fe700 1 -- 172.21.15.106:0/1957004511 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 7177+0+0 (secure 0 0 0) 0x7f504407e190 con 0x7f50480fd100 2024-02-13T00:30:12.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.436+0000 7f504e1fb700 1 -- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f5034061330 msgr2=0x7f50340637f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/461193090 2024-02-13T00:30:12.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.436+0000 7f504e1fb700 1 --2- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f5034061330 0x7f50340637f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-02-13T00:30:12.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.448+0000 7f503f7fe700 1 -- 172.21.15.106:0/1957004511 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f504404ded0 con 0x7f50480fd100 2024-02-13T00:30:12.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:12 smithi106 bash[19299]: debug 2024-02-13T00:30:12.168+0000 7fa64f39b680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-13T00:30:12.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:12 smithi080 bash[17652]: debug 2024-02-13T00:30:12.075+0000 7f16bae80680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-13T00:30:12.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.640+0000 7f504e1fb700 1 -- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f5034061330 msgr2=0x7f50340637f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/461193090 2024-02-13T00:30:12.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.640+0000 7f504e1fb700 1 --2- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f5034061330 0x7f50340637f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-02-13T00:30:12.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:12.640+0000 7f505045f700 1 -- 172.21.15.106:0/1957004511 --> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi080=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f50480591c0 con 0x7f5034061330 2024-02-13T00:30:13.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:13.044+0000 7f504e1fb700 1 -- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f5034061330 msgr2=0x7f50340637f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/461193090 2024-02-13T00:30:13.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:13.044+0000 7f504e1fb700 1 --2- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f5034061330 0x7f50340637f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-02-13T00:30:13.485 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:13 smithi080 bash[17652]: debug 2024-02-13T00:30:13.215+0000 7f16bae80680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-13T00:30:13.485 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:13 smithi080 bash[17652]: debug 2024-02-13T00:30:13.379+0000 7f16bae80680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-13T00:30:13.593 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:13 smithi106 bash[19299]: debug 2024-02-13T00:30:13.324+0000 7fa64f39b680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-13T00:30:13.593 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:13 smithi106 bash[19299]: debug 2024-02-13T00:30:13.488+0000 7fa64f39b680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-13T00:30:13.759 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:13 smithi080 bash[17652]: debug 2024-02-13T00:30:13.479+0000 7f16bae80680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-13T00:30:13.759 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:13 smithi080 bash[17652]: debug 2024-02-13T00:30:13.591+0000 7f16bae80680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-13T00:30:13.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:13.848+0000 7f504e1fb700 1 -- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f5034061330 msgr2=0x7f50340637f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/461193090 2024-02-13T00:30:13.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:13.848+0000 7f504e1fb700 1 --2- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f5034061330 0x7f50340637f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-02-13T00:30:13.931 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:13 smithi106 bash[19299]: debug 2024-02-13T00:30:13.588+0000 7fa64f39b680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-13T00:30:13.931 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:13 smithi106 bash[19299]: debug 2024-02-13T00:30:13.704+0000 7fa64f39b680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-13T00:30:14.197 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:13 smithi080 bash[17652]: debug 2024-02-13T00:30:13.811+0000 7f16bae80680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-13T00:30:14.255 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:13 smithi106 bash[19299]: debug 2024-02-13T00:30:13.924+0000 7fa64f39b680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-13T00:30:14.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:14 smithi080 bash[17652]: debug 2024-02-13T00:30:14.191+0000 7f16bae80680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-13T00:30:14.509 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:14 smithi080 bash[17652]: debug 2024-02-13T00:30:14.315+0000 7f16bae80680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-13T00:30:14.755 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:14 smithi106 bash[19299]: debug 2024-02-13T00:30:14.300+0000 7fa64f39b680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-13T00:30:14.755 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:14 smithi106 bash[19299]: debug 2024-02-13T00:30:14.424+0000 7fa64f39b680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-13T00:30:15.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:15.452+0000 7f504e1fb700 1 -- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f5034061330 msgr2=0x7f50340637f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.80:6800/461193090 2024-02-13T00:30:15.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:15.452+0000 7f504e1fb700 1 --2- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f5034061330 0x7f50340637f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2024-02-13T00:30:15.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:15 smithi080 bash[17652]: debug 2024-02-13T00:30:15.191+0000 7f16bae80680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-13T00:30:15.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:15 smithi080 bash[17652]: debug 2024-02-13T00:30:15.299+0000 7f16bae80680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-13T00:30:15.509 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:15 smithi080 bash[17652]: debug 2024-02-13T00:30:15.415+0000 7f16bae80680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-13T00:30:15.749 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:15 smithi106 bash[19299]: debug 2024-02-13T00:30:15.296+0000 7fa64f39b680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-13T00:30:15.749 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:15 smithi106 bash[19299]: debug 2024-02-13T00:30:15.400+0000 7fa64f39b680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-13T00:30:15.749 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:15 smithi106 bash[19299]: debug 2024-02-13T00:30:15.516+0000 7fa64f39b680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-13T00:30:15.749 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:15 smithi106 bash[19299]: debug 2024-02-13T00:30:15.744+0000 7fa64f39b680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-13T00:30:15.937 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:15 smithi080 bash[17652]: debug 2024-02-13T00:30:15.639+0000 7f16bae80680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-13T00:30:16.259 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:15 smithi080 bash[17652]: debug 2024-02-13T00:30:15.931+0000 7f16bae80680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-13T00:30:16.259 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17652]: debug 2024-02-13T00:30:16.099+0000 7f16bae80680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-13T00:30:16.384 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[19299]: debug 2024-02-13T00:30:16.036+0000 7fa64f39b680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-13T00:30:16.384 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[19299]: debug 2024-02-13T00:30:16.204+0000 7fa64f39b680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-13T00:30:16.384 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[19299]: debug 2024-02-13T00:30:16.380+0000 7fa64f39b680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-13T00:30:16.613 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17652]: debug 2024-02-13T00:30:16.279+0000 7f16bae80680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-13T00:30:16.613 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17652]: debug 2024-02-13T00:30:16.499+0000 7f16bae80680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-13T00:30:16.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:16.644+0000 7f503f7fe700 1 -- 172.21.15.106:0/1957004511 <== mon.2 v2:172.21.15.80:3301/0 7 ==== mgrmap(e 17) v1 ==== 76859+0+0 (secure 0 0 0) 0x7f504407ba30 con 0x7f50480fd100 2024-02-13T00:30:16.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:16.648+0000 7f503f7fe700 1 -- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f5034061330 msgr2=0x7f50340637f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-13T00:30:16.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:16.648+0000 7f503f7fe700 1 --2- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:6800/461193090,v1:172.21.15.80:6801/461193090] conn(0x7f5034061330 0x7f50340637f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-13T00:30:16.691 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[19299]: debug 2024-02-13T00:30:16.596+0000 7fa64f39b680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-13T00:30:16.866 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17652]: debug 2024-02-13T00:30:16.607+0000 7f16bae80680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-13T00:30:16.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[24237]: cluster 2024-02-13T00:30:16.631519+0000 mon.a (mon.0) 606 : cluster [INF] Active manager daemon y restarted 2024-02-13T00:30:16.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[24237]: cluster 2024-02-13T00:30:16.632155+0000 mon.a (mon.0) 607 : cluster [INF] Activating manager daemon y 2024-02-13T00:30:16.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[24237]: cluster 2024-02-13T00:30:16.643555+0000 mon.a (mon.0) 608 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-13T00:30:16.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[24237]: cluster 2024-02-13T00:30:16.645416+0000 mon.a (mon.0) 609 : cluster [DBG] mgrmap e17: y(active, starting, since 0.0134068s), standbys: x 2024-02-13T00:30:16.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[24237]: audit 2024-02-13T00:30:16.649538+0000 mon.c (mon.2) 7 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T00:30:16.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[24237]: audit 2024-02-13T00:30:16.649691+0000 mon.c (mon.2) 8 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:30:16.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[24237]: audit 2024-02-13T00:30:16.649966+0000 mon.c (mon.2) 9 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:30:16.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[24237]: audit 2024-02-13T00:30:16.650953+0000 mon.c (mon.2) 10 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-13T00:30:16.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[24237]: audit 2024-02-13T00:30:16.651132+0000 mon.c (mon.2) 11 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-13T00:30:16.867 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[24237]: audit 2024-02-13T00:30:16.651424+0000 mon.c (mon.2) 12 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T00:30:16.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[24237]: audit 2024-02-13T00:30:16.651715+0000 mon.c (mon.2) 13 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T00:30:16.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[24237]: audit 2024-02-13T00:30:16.651979+0000 mon.c (mon.2) 14 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T00:30:16.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[24237]: audit 2024-02-13T00:30:16.652245+0000 mon.c (mon.2) 15 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T00:30:16.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[24237]: audit 2024-02-13T00:30:16.652606+0000 mon.c (mon.2) 16 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T00:30:16.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[24237]: audit 2024-02-13T00:30:16.652897+0000 mon.c (mon.2) 17 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T00:30:16.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[24237]: audit 2024-02-13T00:30:16.653121+0000 mon.c (mon.2) 18 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T00:30:16.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[24237]: audit 2024-02-13T00:30:16.653404+0000 mon.c (mon.2) 19 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T00:30:16.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[24237]: audit 2024-02-13T00:30:16.653622+0000 mon.c (mon.2) 20 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-13T00:30:16.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[24237]: audit 2024-02-13T00:30:16.653816+0000 mon.c (mon.2) 21 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-13T00:30:16.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[24237]: audit 2024-02-13T00:30:16.654277+0000 mon.c (mon.2) 22 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-13T00:30:16.868 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[24237]: cluster 2024-02-13T00:30:16.677342+0000 mon.a (mon.0) 610 : cluster [INF] Manager daemon y is now available 2024-02-13T00:30:16.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17386]: cluster 2024-02-13T00:30:16.631519+0000 mon.a (mon.0) 606 : cluster [INF] Active manager daemon y restarted 2024-02-13T00:30:16.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17386]: cluster 2024-02-13T00:30:16.632155+0000 mon.a (mon.0) 607 : cluster [INF] Activating manager daemon y 2024-02-13T00:30:16.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17386]: cluster 2024-02-13T00:30:16.643555+0000 mon.a (mon.0) 608 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-13T00:30:16.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17386]: cluster 2024-02-13T00:30:16.645416+0000 mon.a (mon.0) 609 : cluster [DBG] mgrmap e17: y(active, starting, since 0.0134068s), standbys: x 2024-02-13T00:30:16.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17386]: audit 2024-02-13T00:30:16.649538+0000 mon.c (mon.2) 7 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T00:30:16.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17386]: audit 2024-02-13T00:30:16.649691+0000 mon.c (mon.2) 8 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:30:16.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17386]: audit 2024-02-13T00:30:16.649966+0000 mon.c (mon.2) 9 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:30:16.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17386]: audit 2024-02-13T00:30:16.650953+0000 mon.c (mon.2) 10 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-13T00:30:16.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17386]: audit 2024-02-13T00:30:16.651132+0000 mon.c (mon.2) 11 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-13T00:30:16.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17386]: audit 2024-02-13T00:30:16.651424+0000 mon.c (mon.2) 12 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T00:30:16.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17386]: audit 2024-02-13T00:30:16.651715+0000 mon.c (mon.2) 13 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T00:30:16.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17386]: audit 2024-02-13T00:30:16.651979+0000 mon.c (mon.2) 14 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T00:30:16.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17386]: audit 2024-02-13T00:30:16.652245+0000 mon.c (mon.2) 15 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T00:30:16.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17386]: audit 2024-02-13T00:30:16.652606+0000 mon.c (mon.2) 16 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T00:30:16.869 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17386]: audit 2024-02-13T00:30:16.652897+0000 mon.c (mon.2) 17 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T00:30:16.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17386]: audit 2024-02-13T00:30:16.653121+0000 mon.c (mon.2) 18 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T00:30:16.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17386]: audit 2024-02-13T00:30:16.653404+0000 mon.c (mon.2) 19 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T00:30:16.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17386]: audit 2024-02-13T00:30:16.653622+0000 mon.c (mon.2) 20 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-13T00:30:16.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17386]: audit 2024-02-13T00:30:16.653816+0000 mon.c (mon.2) 21 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-13T00:30:16.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17386]: audit 2024-02-13T00:30:16.654277+0000 mon.c (mon.2) 22 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-13T00:30:16.870 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17386]: cluster 2024-02-13T00:30:16.677342+0000 mon.a (mon.0) 610 : cluster [INF] Manager daemon y is now available 2024-02-13T00:30:16.944 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[19299]: debug 2024-02-13T00:30:16.708+0000 7fa64f39b680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-13T00:30:16.944 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[19299]: [13/Feb/2024:00:30:16] ENGINE Bus STARTING 2024-02-13T00:30:16.944 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[19299]: CherryPy Checker: 2024-02-13T00:30:16.944 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[19299]: The Application mounted at '' has an empty config. 2024-02-13T00:30:16.944 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[19299]: [13/Feb/2024:00:30:16] ENGINE Serving on http://:::9283 2024-02-13T00:30:16.944 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[19299]: [13/Feb/2024:00:30:16] ENGINE Bus STARTED 2024-02-13T00:30:16.944 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[18459]: cluster 2024-02-13T00:30:16.631519+0000 mon.a (mon.0) 606 : cluster [INF] Active manager daemon y restarted 2024-02-13T00:30:16.944 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[18459]: cluster 2024-02-13T00:30:16.632155+0000 mon.a (mon.0) 607 : cluster [INF] Activating manager daemon y 2024-02-13T00:30:16.944 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[18459]: cluster 2024-02-13T00:30:16.643555+0000 mon.a (mon.0) 608 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-13T00:30:16.944 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[18459]: cluster 2024-02-13T00:30:16.645416+0000 mon.a (mon.0) 609 : cluster [DBG] mgrmap e17: y(active, starting, since 0.0134068s), standbys: x 2024-02-13T00:30:16.945 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[18459]: audit 2024-02-13T00:30:16.649538+0000 mon.c (mon.2) 7 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T00:30:16.945 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[18459]: audit 2024-02-13T00:30:16.649691+0000 mon.c (mon.2) 8 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T00:30:16.945 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[18459]: audit 2024-02-13T00:30:16.649966+0000 mon.c (mon.2) 9 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T00:30:16.945 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[18459]: audit 2024-02-13T00:30:16.650953+0000 mon.c (mon.2) 10 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-13T00:30:16.945 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[18459]: audit 2024-02-13T00:30:16.651132+0000 mon.c (mon.2) 11 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-13T00:30:16.945 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[18459]: audit 2024-02-13T00:30:16.651424+0000 mon.c (mon.2) 12 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T00:30:16.945 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[18459]: audit 2024-02-13T00:30:16.651715+0000 mon.c (mon.2) 13 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T00:30:16.945 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[18459]: audit 2024-02-13T00:30:16.651979+0000 mon.c (mon.2) 14 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T00:30:16.945 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[18459]: audit 2024-02-13T00:30:16.652245+0000 mon.c (mon.2) 15 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T00:30:16.945 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[18459]: audit 2024-02-13T00:30:16.652606+0000 mon.c (mon.2) 16 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T00:30:16.945 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[18459]: audit 2024-02-13T00:30:16.652897+0000 mon.c (mon.2) 17 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T00:30:16.945 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[18459]: audit 2024-02-13T00:30:16.653121+0000 mon.c (mon.2) 18 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T00:30:16.945 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[18459]: audit 2024-02-13T00:30:16.653404+0000 mon.c (mon.2) 19 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T00:30:16.945 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[18459]: audit 2024-02-13T00:30:16.653622+0000 mon.c (mon.2) 20 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-13T00:30:16.945 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[18459]: audit 2024-02-13T00:30:16.653816+0000 mon.c (mon.2) 21 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-13T00:30:16.946 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[18459]: audit 2024-02-13T00:30:16.654277+0000 mon.c (mon.2) 22 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-13T00:30:16.946 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:16 smithi106 bash[18459]: cluster 2024-02-13T00:30:16.677342+0000 mon.a (mon.0) 610 : cluster [INF] Manager daemon y is now available 2024-02-13T00:30:17.258 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17652]: Warning: Permanently added '172.21.15.80' (ECDSA) to the list of known hosts. 2024-02-13T00:30:17.259 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17652]: [13/Feb/2024:00:30:16] ENGINE Bus STARTING 2024-02-13T00:30:17.259 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:16 smithi080 bash[17652]: Warning: Permanently added '172.21.15.106' (ECDSA) to the list of known hosts. 2024-02-13T00:30:17.259 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[17652]: CherryPy Checker: 2024-02-13T00:30:17.259 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[17652]: The Application mounted at '' has an empty config. 2024-02-13T00:30:17.259 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[17652]: [13/Feb/2024:00:30:17] ENGINE Serving on http://:::9283 2024-02-13T00:30:17.259 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[17652]: [13/Feb/2024:00:30:17] ENGINE Bus STARTED 2024-02-13T00:30:17.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:17.648+0000 7f503f7fe700 1 -- 172.21.15.106:0/1957004511 <== mon.2 v2:172.21.15.80:3301/0 8 ==== mgrmap(e 18) v1 ==== 76929+0+0 (secure 0 0 0) 0x7f504407bdb0 con 0x7f50480fd100 2024-02-13T00:30:17.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:17.648+0000 7f503f7fe700 1 --2- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5034030de0 0x7f503406ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:17.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:17.648+0000 7f503f7fe700 1 -- 172.21.15.106:0/1957004511 --> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi080=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f50480591c0 con 0x7f5034030de0 2024-02-13T00:30:17.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:17.652+0000 7f504e1fb700 1 --2- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5034030de0 0x7f503406ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:17.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:17.652+0000 7f504e1fb700 1 --2- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5034030de0 0x7f503406ceb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f5048061a10 tx=0x7f5038009e60).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:30:17.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:17.664+0000 7f503f7fe700 1 -- 172.21.15.106:0/1957004511 <== mgr.24461 v2:172.21.15.80:6800/2955905243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f50480591c0 con 0x7f5034030de0 2024-02-13T00:30:17.669 INFO:teuthology.orchestra.run.smithi106.stdout:Scheduled alertmanager update... 2024-02-13T00:30:17.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:17.668+0000 7f505045f700 1 -- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5034030de0 msgr2=0x7f503406ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:17.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:17.668+0000 7f505045f700 1 --2- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5034030de0 0x7f503406ceb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f5048061a10 tx=0x7f5038009e60).stop 2024-02-13T00:30:17.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:17.668+0000 7f505045f700 1 -- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f50480fd100 msgr2=0x7f504810a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:17.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:17.668+0000 7f505045f700 1 --2- 172.21.15.106:0/1957004511 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f50480fd100 0x7f504810a880 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f5044004710 tx=0x7f5044009cb0).stop 2024-02-13T00:30:17.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:17.668+0000 7f504e9fc700 1 -- 172.21.15.106:0/1957004511 reap_dead start 2024-02-13T00:30:17.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:17.668+0000 7f505045f700 1 -- 172.21.15.106:0/1957004511 shutdown_connections 2024-02-13T00:30:17.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:17.668+0000 7f505045f700 1 -- 172.21.15.106:0/1957004511 >> 172.21.15.106:0/1957004511 conn(0x7f50480f2210 msgr2=0x7f50480fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:30:17.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:17.668+0000 7f505045f700 1 -- 172.21.15.106:0/1957004511 shutdown_connections 2024-02-13T00:30:17.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:17.668+0000 7f505045f700 1 -- 172.21.15.106:0/1957004511 wait complete. 2024-02-13T00:30:17.927 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:30:17 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:30:17.927 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:17 smithi106 bash[18459]: cluster 2024-02-13T00:30:16.731202+0000 mon.a (mon.0) 611 : cluster [DBG] Standby manager daemon x restarted 2024-02-13T00:30:17.928 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:17 smithi106 bash[18459]: cluster 2024-02-13T00:30:16.731436+0000 mon.a (mon.0) 612 : cluster [DBG] Standby manager daemon x started 2024-02-13T00:30:17.928 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:17 smithi106 bash[18459]: audit 2024-02-13T00:30:16.737121+0000 mon.b (mon.1) 28 : audit [DBG] from='mgr.? 172.21.15.106:0/276347934' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-13T00:30:17.928 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:17 smithi106 bash[18459]: audit 2024-02-13T00:30:16.738176+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.? 172.21.15.106:0/276347934' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-13T00:30:17.928 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:17 smithi106 bash[18459]: audit 2024-02-13T00:30:16.740097+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.? 172.21.15.106:0/276347934' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-13T00:30:17.928 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:17 smithi106 bash[18459]: audit 2024-02-13T00:30:16.741571+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.106:0/276347934' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-13T00:30:17.928 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:17 smithi106 bash[18459]: audit 2024-02-13T00:30:16.813424+0000 mon.c (mon.2) 23 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:30:17.928 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:17 smithi106 bash[18459]: audit 2024-02-13T00:30:16.816116+0000 mon.c (mon.2) 24 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:30:17.928 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:17 smithi106 bash[18459]: audit 2024-02-13T00:30:16.876231+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:17.928 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:17 smithi106 bash[18459]: audit 2024-02-13T00:30:16.888301+0000 mon.c (mon.2) 25 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-13T00:30:17.928 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:17 smithi106 bash[18459]: audit 2024-02-13T00:30:16.892220+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:17.928 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:17 smithi106 bash[18459]: audit 2024-02-13T00:30:16.894187+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-13T00:30:17.928 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:17 smithi106 bash[18459]: audit 2024-02-13T00:30:16.927067+0000 mon.c (mon.2) 26 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-13T00:30:17.928 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:17 smithi106 bash[18459]: audit 2024-02-13T00:30:16.927529+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-13T00:30:17.928 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:17 smithi106 bash[18459]: cluster 2024-02-13T00:30:17.652451+0000 mon.a (mon.0) 617 : cluster [DBG] mgrmap e18: y(active, since 1.02041s), standbys: x 2024-02-13T00:30:17.929 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:17 smithi106 bash[18459]: audit 2024-02-13T00:30:17.665273+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:18.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[17386]: cluster 2024-02-13T00:30:16.731202+0000 mon.a (mon.0) 611 : cluster [DBG] Standby manager daemon x restarted 2024-02-13T00:30:18.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[17386]: cluster 2024-02-13T00:30:16.731436+0000 mon.a (mon.0) 612 : cluster [DBG] Standby manager daemon x started 2024-02-13T00:30:18.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[17386]: audit 2024-02-13T00:30:16.737121+0000 mon.b (mon.1) 28 : audit [DBG] from='mgr.? 172.21.15.106:0/276347934' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-13T00:30:18.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[17386]: audit 2024-02-13T00:30:16.738176+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.? 172.21.15.106:0/276347934' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-13T00:30:18.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[17386]: audit 2024-02-13T00:30:16.740097+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.? 172.21.15.106:0/276347934' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-13T00:30:18.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[17386]: audit 2024-02-13T00:30:16.741571+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.106:0/276347934' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-13T00:30:18.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[17386]: audit 2024-02-13T00:30:16.813424+0000 mon.c (mon.2) 23 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:30:18.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[17386]: audit 2024-02-13T00:30:16.816116+0000 mon.c (mon.2) 24 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:30:18.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[17386]: audit 2024-02-13T00:30:16.876231+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:18.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[17386]: audit 2024-02-13T00:30:16.888301+0000 mon.c (mon.2) 25 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-13T00:30:18.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[17386]: audit 2024-02-13T00:30:16.892220+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:18.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[17386]: audit 2024-02-13T00:30:16.894187+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-13T00:30:18.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[17386]: audit 2024-02-13T00:30:16.927067+0000 mon.c (mon.2) 26 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-13T00:30:18.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[17386]: audit 2024-02-13T00:30:16.927529+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-13T00:30:18.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[17386]: cluster 2024-02-13T00:30:17.652451+0000 mon.a (mon.0) 617 : cluster [DBG] mgrmap e18: y(active, since 1.02041s), standbys: x 2024-02-13T00:30:18.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[17386]: audit 2024-02-13T00:30:17.665273+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:18.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[24237]: cluster 2024-02-13T00:30:16.731202+0000 mon.a (mon.0) 611 : cluster [DBG] Standby manager daemon x restarted 2024-02-13T00:30:18.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[24237]: cluster 2024-02-13T00:30:16.731436+0000 mon.a (mon.0) 612 : cluster [DBG] Standby manager daemon x started 2024-02-13T00:30:18.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[24237]: audit 2024-02-13T00:30:16.737121+0000 mon.b (mon.1) 28 : audit [DBG] from='mgr.? 172.21.15.106:0/276347934' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-13T00:30:18.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[24237]: audit 2024-02-13T00:30:16.738176+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.? 172.21.15.106:0/276347934' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-13T00:30:18.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[24237]: audit 2024-02-13T00:30:16.740097+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.? 172.21.15.106:0/276347934' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-13T00:30:18.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[24237]: audit 2024-02-13T00:30:16.741571+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.106:0/276347934' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-13T00:30:18.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[24237]: audit 2024-02-13T00:30:16.813424+0000 mon.c (mon.2) 23 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:30:18.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[24237]: audit 2024-02-13T00:30:16.816116+0000 mon.c (mon.2) 24 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:30:18.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[24237]: audit 2024-02-13T00:30:16.876231+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:18.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[24237]: audit 2024-02-13T00:30:16.888301+0000 mon.c (mon.2) 25 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-13T00:30:18.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[24237]: audit 2024-02-13T00:30:16.892220+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:18.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[24237]: audit 2024-02-13T00:30:16.894187+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-13T00:30:18.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[24237]: audit 2024-02-13T00:30:16.927067+0000 mon.c (mon.2) 26 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-13T00:30:18.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[24237]: audit 2024-02-13T00:30:16.927529+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-13T00:30:18.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[24237]: cluster 2024-02-13T00:30:17.652451+0000 mon.a (mon.0) 617 : cluster [DBG] mgrmap e18: y(active, since 1.02041s), standbys: x 2024-02-13T00:30:18.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:17 smithi080 bash[24237]: audit 2024-02-13T00:30:17.665273+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:18.555 DEBUG:teuthology.orchestra.run.smithi080:alertmanager.a> sudo journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@alertmanager.a.service 2024-02-13T00:30:18.558 INFO:tasks.cephadm:Adding grafana.a on smithi106 2024-02-13T00:30:18.558 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph orch apply grafana '1;smithi106=a' 2024-02-13T00:30:18.731 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-13T00:30:19.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:18 smithi106 bash[18459]: cephadm 2024-02-13T00:30:17.659394+0000 mgr.y (mgr.24461) 3 : cephadm [INF] Saving service alertmanager spec with placement smithi080=a;count:1 2024-02-13T00:30:19.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:18 smithi106 bash[18459]: cluster 2024-02-13T00:30:17.659683+0000 mgr.y (mgr.24461) 4 : cluster [DBG] pgmap v3: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:30:19.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:18 smithi106 bash[18459]: cluster 2024-02-13T00:30:18.642998+0000 mon.a (mon.0) 619 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/639 objects degraded (0.626%), 1 pg degraded) 2024-02-13T00:30:19.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:18 smithi106 bash[18459]: cluster 2024-02-13T00:30:18.643058+0000 mon.a (mon.0) 620 : cluster [INF] Cluster is now healthy 2024-02-13T00:30:19.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:18 smithi080 bash[17386]: cephadm 2024-02-13T00:30:17.659394+0000 mgr.y (mgr.24461) 3 : cephadm [INF] Saving service alertmanager spec with placement smithi080=a;count:1 2024-02-13T00:30:19.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:18 smithi080 bash[17386]: cluster 2024-02-13T00:30:17.659683+0000 mgr.y (mgr.24461) 4 : cluster [DBG] pgmap v3: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:30:19.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:18 smithi080 bash[17386]: cluster 2024-02-13T00:30:18.642998+0000 mon.a (mon.0) 619 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/639 objects degraded (0.626%), 1 pg degraded) 2024-02-13T00:30:19.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:18 smithi080 bash[17386]: cluster 2024-02-13T00:30:18.643058+0000 mon.a (mon.0) 620 : cluster [INF] Cluster is now healthy 2024-02-13T00:30:19.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:18 smithi080 bash[24237]: cephadm 2024-02-13T00:30:17.659394+0000 mgr.y (mgr.24461) 3 : cephadm [INF] Saving service alertmanager spec with placement smithi080=a;count:1 2024-02-13T00:30:19.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:18 smithi080 bash[24237]: cluster 2024-02-13T00:30:17.659683+0000 mgr.y (mgr.24461) 4 : cluster [DBG] pgmap v3: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:30:19.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:18 smithi080 bash[24237]: cluster 2024-02-13T00:30:18.642998+0000 mon.a (mon.0) 619 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/639 objects degraded (0.626%), 1 pg degraded) 2024-02-13T00:30:19.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:18 smithi080 bash[24237]: cluster 2024-02-13T00:30:18.643058+0000 mon.a (mon.0) 620 : cluster [INF] Cluster is now healthy 2024-02-13T00:30:19.959 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:19 smithi106 bash[18459]: cluster 2024-02-13T00:30:18.653035+0000 mgr.y (mgr.24461) 5 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:30:19.960 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:19 smithi106 bash[18459]: cluster 2024-02-13T00:30:19.664252+0000 mon.a (mon.0) 621 : cluster [DBG] mgrmap e19: y(active, since 3s), standbys: x 2024-02-13T00:30:20.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:19 smithi080 bash[17386]: cluster 2024-02-13T00:30:18.653035+0000 mgr.y (mgr.24461) 5 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:30:20.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:19 smithi080 bash[17386]: cluster 2024-02-13T00:30:19.664252+0000 mon.a (mon.0) 621 : cluster [DBG] mgrmap e19: y(active, since 3s), standbys: x 2024-02-13T00:30:20.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:19 smithi080 bash[24237]: cluster 2024-02-13T00:30:18.653035+0000 mgr.y (mgr.24461) 5 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:30:20.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:19 smithi080 bash[24237]: cluster 2024-02-13T00:30:19.664252+0000 mon.a (mon.0) 621 : cluster [DBG] mgrmap e19: y(active, since 3s), standbys: x 2024-02-13T00:30:21.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.440+0000 7fd95a1d8700 1 -- 172.21.15.106:0/3274485734 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd95406cbd0 msgr2=0x7fd95406b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:21.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.440+0000 7fd95a1d8700 1 --2- 172.21.15.106:0/3274485734 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd95406cbd0 0x7fd95406b170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fd944009be0 tx=0x7fd944004d10).stop 2024-02-13T00:30:21.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.440+0000 7fd95a1d8700 1 -- 172.21.15.106:0/3274485734 shutdown_connections 2024-02-13T00:30:21.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.440+0000 7fd95a1d8700 1 --2- 172.21.15.106:0/3274485734 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd95406cbd0 0x7fd95406b170 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:21.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.440+0000 7fd95a1d8700 1 --2- 172.21.15.106:0/3274485734 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd9540ffad0 0x7fd954101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-13T00:30:21.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.440+0000 7fd95a1d8700 1 --2- 172.21.15.106:0/3274485734 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd95406b660 0x7fd95406bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-13T00:30:21.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.440+0000 7fd95a1d8700 1 -- 172.21.15.106:0/3274485734 >> 172.21.15.106:0/3274485734 conn(0x7fd9540f3340 msgr2=0x7fd9540f5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:30:21.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.440+0000 7fd95a1d8700 1 -- 172.21.15.106:0/3274485734 shutdown_connections 2024-02-13T00:30:21.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.440+0000 7fd95a1d8700 1 -- 172.21.15.106:0/3274485734 wait complete. 2024-02-13T00:30:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd95a1d8700 1 Processor -- start 2024-02-13T00:30:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd95a1d8700 1 -- start start 2024-02-13T00:30:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd95a1d8700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd95406b660 0x7fd95410a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd95a1d8700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd95406cbd0 0x7fd95410a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd95a1d8700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9540ffad0 0x7fd954111760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd95a1d8700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd954111c50 con 0x7fd95406b660 2024-02-13T00:30:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd95a1d8700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd954111dc0 con 0x7fd9540ffad0 2024-02-13T00:30:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd95a1d8700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd954111f80 con 0x7fd95406cbd0 2024-02-13T00:30:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd952ffd700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd95406cbd0 0x7fd95410a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd953fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9540ffad0 0x7fd954111760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd952ffd700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd95406cbd0 0x7fd95410a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.106:54170/0 (socket says 172.21.15.106:54170) 2024-02-13T00:30:21.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd9537fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd95406b660 0x7fd95410a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:21.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd952ffd700 1 -- 172.21.15.106:0/3282381382 learned_addr learned my addr 172.21.15.106:0/3282381382 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-02-13T00:30:21.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd952ffd700 1 -- 172.21.15.106:0/3282381382 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9540ffad0 msgr2=0x7fd954111760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:21.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd952ffd700 1 --2- 172.21.15.106:0/3282381382 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9540ffad0 0x7fd954111760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd952ffd700 1 -- 172.21.15.106:0/3282381382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd95406b660 msgr2=0x7fd95410a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd952ffd700 1 --2- 172.21.15.106:0/3282381382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd95406b660 0x7fd95410a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd952ffd700 1 -- 172.21.15.106:0/3282381382 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9440097c0 con 0x7fd95406cbd0 2024-02-13T00:30:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd952ffd700 1 --2- 172.21.15.106:0/3282381382 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd95406cbd0 0x7fd95410a680 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd93c00b530 tx=0x7fd93c0090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:30:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd950ff9700 1 -- 172.21.15.106:0/3282381382 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c002320 con 0x7fd95406cbd0 2024-02-13T00:30:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd95a1d8700 1 -- 172.21.15.106:0/3282381382 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd954112260 con 0x7fd95406cbd0 2024-02-13T00:30:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd950ff9700 1 -- 172.21.15.106:0/3282381382 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fd93c002910 con 0x7fd95406cbd0 2024-02-13T00:30:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd950ff9700 1 -- 172.21.15.106:0/3282381382 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c0127c0 con 0x7fd95406cbd0 2024-02-13T00:30:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.444+0000 7fd95a1d8700 1 -- 172.21.15.106:0/3282381382 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9541127a0 con 0x7fd95406cbd0 2024-02-13T00:30:21.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.448+0000 7fd95a1d8700 1 -- 172.21.15.106:0/3282381382 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd954060070 con 0x7fd95406cbd0 2024-02-13T00:30:21.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.448+0000 7fd950ff9700 1 -- 172.21.15.106:0/3282381382 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7fd93c002480 con 0x7fd95406cbd0 2024-02-13T00:30:21.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.448+0000 7fd950ff9700 1 --2- 172.21.15.106:0/3282381382 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fd940061340 0x7fd940063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:21.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.448+0000 7fd950ff9700 1 -- 172.21.15.106:0/3282381382 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7fd93c07ce70 con 0x7fd95406cbd0 2024-02-13T00:30:21.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.448+0000 7fd9537fe700 1 --2- 172.21.15.106:0/3282381382 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fd940061340 0x7fd940063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:21.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.448+0000 7fd9537fe700 1 --2- 172.21.15.106:0/3282381382 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fd940061340 0x7fd940063800 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd944004a60 tx=0x7fd944004d10).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:30:21.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.456+0000 7fd950ff9700 1 -- 172.21.15.106:0/3282381382 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd93c04cbd0 con 0x7fd95406cbd0 2024-02-13T00:30:21.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.652+0000 7fd95a1d8700 1 -- 172.21.15.106:0/3282381382 --> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi106=a", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9540f5660 con 0x7fd940061340 2024-02-13T00:30:21.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.668+0000 7fd950ff9700 1 -- 172.21.15.106:0/3282381382 <== mgr.24461 v2:172.21.15.80:6800/2955905243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fd9540f5660 con 0x7fd940061340 2024-02-13T00:30:21.675 INFO:teuthology.orchestra.run.smithi106.stdout:Scheduled grafana update... 2024-02-13T00:30:21.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.672+0000 7fd95a1d8700 1 -- 172.21.15.106:0/3282381382 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fd940061340 msgr2=0x7fd940063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:21.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.672+0000 7fd95a1d8700 1 --2- 172.21.15.106:0/3282381382 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fd940061340 0x7fd940063800 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd944004a60 tx=0x7fd944004d10).stop 2024-02-13T00:30:21.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.672+0000 7fd95a1d8700 1 -- 172.21.15.106:0/3282381382 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd95406cbd0 msgr2=0x7fd95410a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:21.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.672+0000 7fd95a1d8700 1 --2- 172.21.15.106:0/3282381382 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd95406cbd0 0x7fd95410a680 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd93c00b530 tx=0x7fd93c0090f0).stop 2024-02-13T00:30:21.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.672+0000 7fd95a1d8700 1 -- 172.21.15.106:0/3282381382 shutdown_connections 2024-02-13T00:30:21.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.672+0000 7fd95a1d8700 1 --2- 172.21.15.106:0/3282381382 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fd940061340 0x7fd940063800 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:21.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.672+0000 7fd95a1d8700 1 --2- 172.21.15.106:0/3282381382 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9540ffad0 0x7fd954111760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:21.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.672+0000 7fd95a1d8700 1 --2- 172.21.15.106:0/3282381382 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fd95406b660 0x7fd95410a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:21.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.672+0000 7fd95a1d8700 1 --2- 172.21.15.106:0/3282381382 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fd95406cbd0 0x7fd95410a680 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:21.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.672+0000 7fd95a1d8700 1 -- 172.21.15.106:0/3282381382 >> 172.21.15.106:0/3282381382 conn(0x7fd9540f3340 msgr2=0x7fd9540f3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:30:21.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.672+0000 7fd95a1d8700 1 -- 172.21.15.106:0/3282381382 shutdown_connections 2024-02-13T00:30:21.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:21.672+0000 7fd95a1d8700 1 -- 172.21.15.106:0/3282381382 wait complete. 2024-02-13T00:30:22.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:21 smithi106 bash[18459]: cluster 2024-02-13T00:30:20.653752+0000 mgr.y (mgr.24461) 6 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:30:22.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:21 smithi106 bash[18459]: audit 2024-02-13T00:30:21.669722+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:22.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:21 smithi080 bash[24237]: cluster 2024-02-13T00:30:20.653752+0000 mgr.y (mgr.24461) 6 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:30:22.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:21 smithi080 bash[24237]: audit 2024-02-13T00:30:21.669722+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:22.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:21 smithi080 bash[17386]: cluster 2024-02-13T00:30:20.653752+0000 mgr.y (mgr.24461) 6 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:30:22.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:21 smithi080 bash[17386]: audit 2024-02-13T00:30:21.669722+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:22.480 DEBUG:teuthology.orchestra.run.smithi106:grafana.a> sudo journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@grafana.a.service 2024-02-13T00:30:22.482 INFO:tasks.cephadm:Setting up client nodes... 2024-02-13T00:30:22.482 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-13T00:30:22.626 INFO:journalctl@ceph.grafana.a.smithi106.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-02-13T00:30:22.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:22 smithi106 bash[18459]: audit 2024-02-13T00:30:21.658010+0000 mgr.y (mgr.24461) 7 : audit [DBG] from='client.24482 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi106=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:30:22.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:22 smithi106 bash[18459]: cephadm 2024-02-13T00:30:21.661290+0000 mgr.y (mgr.24461) 8 : cephadm [INF] Saving service grafana spec with placement smithi106=a;count:1 2024-02-13T00:30:22.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:22 smithi106 bash[18459]: audit 2024-02-13T00:30:22.488595+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:22.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:22 smithi080 bash[17386]: audit 2024-02-13T00:30:21.658010+0000 mgr.y (mgr.24461) 7 : audit [DBG] from='client.24482 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi106=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:30:22.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:22 smithi080 bash[17386]: cephadm 2024-02-13T00:30:21.661290+0000 mgr.y (mgr.24461) 8 : cephadm [INF] Saving service grafana spec with placement smithi106=a;count:1 2024-02-13T00:30:22.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:22 smithi080 bash[17386]: audit 2024-02-13T00:30:22.488595+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:22.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:22 smithi080 bash[24237]: audit 2024-02-13T00:30:21.658010+0000 mgr.y (mgr.24461) 7 : audit [DBG] from='client.24482 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi106=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T00:30:22.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:22 smithi080 bash[24237]: cephadm 2024-02-13T00:30:21.661290+0000 mgr.y (mgr.24461) 8 : cephadm [INF] Saving service grafana spec with placement smithi106=a;count:1 2024-02-13T00:30:22.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:22 smithi080 bash[24237]: audit 2024-02-13T00:30:22.488595+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:23.982 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[17386]: cluster 2024-02-13T00:30:22.654249+0000 mgr.y (mgr.24461) 9 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:30:23.982 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[17386]: audit 2024-02-13T00:30:22.775439+0000 mon.c (mon.2) 27 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:23.982 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[17386]: audit 2024-02-13T00:30:22.776135+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:23.982 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[17386]: audit 2024-02-13T00:30:22.777632+0000 mon.c (mon.2) 28 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:23.982 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[17386]: audit 2024-02-13T00:30:22.778145+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:23.982 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[17386]: audit 2024-02-13T00:30:22.779620+0000 mon.c (mon.2) 29 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:23.982 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[17386]: audit 2024-02-13T00:30:22.780143+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:23.983 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[17386]: audit 2024-02-13T00:30:22.781626+0000 mon.c (mon.2) 30 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:23.983 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[17386]: audit 2024-02-13T00:30:22.782018+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:23.983 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[17386]: cephadm 2024-02-13T00:30:22.782973+0000 mgr.y (mgr.24461) 10 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 3804M 2024-02-13T00:30:23.983 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[17386]: audit 2024-02-13T00:30:22.790719+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:23.983 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[17386]: audit 2024-02-13T00:30:23.656373+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:23.983 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[24237]: cluster 2024-02-13T00:30:22.654249+0000 mgr.y (mgr.24461) 9 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:30:23.983 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[24237]: audit 2024-02-13T00:30:22.775439+0000 mon.c (mon.2) 27 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:23.983 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[24237]: audit 2024-02-13T00:30:22.776135+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:23.983 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[24237]: audit 2024-02-13T00:30:22.777632+0000 mon.c (mon.2) 28 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:23.984 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[24237]: audit 2024-02-13T00:30:22.778145+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:23.984 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[24237]: audit 2024-02-13T00:30:22.779620+0000 mon.c (mon.2) 29 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:23.984 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[24237]: audit 2024-02-13T00:30:22.780143+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:23.984 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[24237]: audit 2024-02-13T00:30:22.781626+0000 mon.c (mon.2) 30 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:23.984 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[24237]: audit 2024-02-13T00:30:22.782018+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:23.984 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[24237]: cephadm 2024-02-13T00:30:22.782973+0000 mgr.y (mgr.24461) 10 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 3804M 2024-02-13T00:30:23.984 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[24237]: audit 2024-02-13T00:30:22.790719+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:23.984 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:23 smithi080 bash[24237]: audit 2024-02-13T00:30:23.656373+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:24.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:23 smithi106 bash[18459]: cluster 2024-02-13T00:30:22.654249+0000 mgr.y (mgr.24461) 9 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:30:24.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:23 smithi106 bash[18459]: audit 2024-02-13T00:30:22.775439+0000 mon.c (mon.2) 27 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:23 smithi106 bash[18459]: audit 2024-02-13T00:30:22.776135+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:23 smithi106 bash[18459]: audit 2024-02-13T00:30:22.777632+0000 mon.c (mon.2) 28 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:23 smithi106 bash[18459]: audit 2024-02-13T00:30:22.778145+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:23 smithi106 bash[18459]: audit 2024-02-13T00:30:22.779620+0000 mon.c (mon.2) 29 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:23 smithi106 bash[18459]: audit 2024-02-13T00:30:22.780143+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:23 smithi106 bash[18459]: audit 2024-02-13T00:30:22.781626+0000 mon.c (mon.2) 30 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:23 smithi106 bash[18459]: audit 2024-02-13T00:30:22.782018+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:23 smithi106 bash[18459]: cephadm 2024-02-13T00:30:22.782973+0000 mgr.y (mgr.24461) 10 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 3804M 2024-02-13T00:30:24.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:23 smithi106 bash[18459]: audit 2024-02-13T00:30:22.790719+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:24.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:23 smithi106 bash[18459]: audit 2024-02-13T00:30:23.656373+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:24.824 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[17386]: audit 2024-02-13T00:30:23.947405+0000 mon.c (mon.2) 31 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.824 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[17386]: audit 2024-02-13T00:30:23.948296+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.824 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[17386]: audit 2024-02-13T00:30:23.950674+0000 mon.c (mon.2) 32 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.824 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[17386]: audit 2024-02-13T00:30:23.951292+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[17386]: audit 2024-02-13T00:30:23.952761+0000 mon.c (mon.2) 33 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[17386]: audit 2024-02-13T00:30:23.953115+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[17386]: audit 2024-02-13T00:30:23.954361+0000 mon.c (mon.2) 34 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[17386]: audit 2024-02-13T00:30:23.954685+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[17386]: cephadm 2024-02-13T00:30:23.955515+0000 mgr.y (mgr.24461) 11 : cephadm [INF] Adjusting osd_memory_target on smithi106 to 4060M 2024-02-13T00:30:24.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[17386]: audit 2024-02-13T00:30:23.962085+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:24.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[17386]: audit 2024-02-13T00:30:23.963427+0000 mon.c (mon.2) 35 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:30:24.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[17386]: audit 2024-02-13T00:30:23.964480+0000 mon.c (mon.2) 36 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:30:24.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[17386]: cephadm 2024-02-13T00:30:23.966542+0000 mgr.y (mgr.24461) 12 : cephadm [INF] Updating smithi080:/etc/ceph/ceph.conf 2024-02-13T00:30:24.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[17386]: cephadm 2024-02-13T00:30:23.967004+0000 mgr.y (mgr.24461) 13 : cephadm [INF] Updating smithi106:/etc/ceph/ceph.conf 2024-02-13T00:30:24.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[17386]: cephadm 2024-02-13T00:30:23.980581+0000 mgr.y (mgr.24461) 14 : cephadm [INF] Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2024-02-13T00:30:24.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[17386]: cephadm 2024-02-13T00:30:23.996430+0000 mgr.y (mgr.24461) 15 : cephadm [INF] Updating smithi106:/etc/ceph/ceph.client.admin.keyring 2024-02-13T00:30:24.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[17386]: audit 2024-02-13T00:30:24.024983+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:24.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[17386]: audit 2024-02-13T00:30:24.031056+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:24.825 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[17386]: audit 2024-02-13T00:30:24.039622+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:24.826 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[17386]: cephadm 2024-02-13T00:30:24.043317+0000 mgr.y (mgr.24461) 16 : cephadm [INF] Deploying daemon node-exporter.a on smithi080 2024-02-13T00:30:24.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[24237]: audit 2024-02-13T00:30:23.947405+0000 mon.c (mon.2) 31 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[24237]: audit 2024-02-13T00:30:23.948296+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[24237]: audit 2024-02-13T00:30:23.950674+0000 mon.c (mon.2) 32 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[24237]: audit 2024-02-13T00:30:23.951292+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[24237]: audit 2024-02-13T00:30:23.952761+0000 mon.c (mon.2) 33 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[24237]: audit 2024-02-13T00:30:23.953115+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[24237]: audit 2024-02-13T00:30:23.954361+0000 mon.c (mon.2) 34 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.826 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[24237]: audit 2024-02-13T00:30:23.954685+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:24.827 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[24237]: cephadm 2024-02-13T00:30:23.955515+0000 mgr.y (mgr.24461) 11 : cephadm [INF] Adjusting osd_memory_target on smithi106 to 4060M 2024-02-13T00:30:24.827 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[24237]: audit 2024-02-13T00:30:23.962085+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:24.827 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[24237]: audit 2024-02-13T00:30:23.963427+0000 mon.c (mon.2) 35 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:30:24.827 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[24237]: audit 2024-02-13T00:30:23.964480+0000 mon.c (mon.2) 36 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:30:24.827 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[24237]: cephadm 2024-02-13T00:30:23.966542+0000 mgr.y (mgr.24461) 12 : cephadm [INF] Updating smithi080:/etc/ceph/ceph.conf 2024-02-13T00:30:24.827 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[24237]: cephadm 2024-02-13T00:30:23.967004+0000 mgr.y (mgr.24461) 13 : cephadm [INF] Updating smithi106:/etc/ceph/ceph.conf 2024-02-13T00:30:24.827 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[24237]: cephadm 2024-02-13T00:30:23.980581+0000 mgr.y (mgr.24461) 14 : cephadm [INF] Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2024-02-13T00:30:24.827 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[24237]: cephadm 2024-02-13T00:30:23.996430+0000 mgr.y (mgr.24461) 15 : cephadm [INF] Updating smithi106:/etc/ceph/ceph.client.admin.keyring 2024-02-13T00:30:24.827 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[24237]: audit 2024-02-13T00:30:24.024983+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:24.827 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[24237]: audit 2024-02-13T00:30:24.031056+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:24.827 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[24237]: audit 2024-02-13T00:30:24.039622+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:24.827 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[24237]: cephadm 2024-02-13T00:30:24.043317+0000 mgr.y (mgr.24461) 16 : cephadm [INF] Deploying daemon node-exporter.a on smithi080 2024-02-13T00:30:24.827 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:24 smithi080 systemd[1]: Started Ceph node-exporter.a for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:30:25.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:24 smithi106 bash[18459]: audit 2024-02-13T00:30:23.947405+0000 mon.c (mon.2) 31 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:25.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:24 smithi106 bash[18459]: audit 2024-02-13T00:30:23.948296+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:25.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:24 smithi106 bash[18459]: audit 2024-02-13T00:30:23.950674+0000 mon.c (mon.2) 32 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:25.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:24 smithi106 bash[18459]: audit 2024-02-13T00:30:23.951292+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:25.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:24 smithi106 bash[18459]: audit 2024-02-13T00:30:23.952761+0000 mon.c (mon.2) 33 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:25.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:24 smithi106 bash[18459]: audit 2024-02-13T00:30:23.953115+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:25.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:24 smithi106 bash[18459]: audit 2024-02-13T00:30:23.954361+0000 mon.c (mon.2) 34 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:25.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:24 smithi106 bash[18459]: audit 2024-02-13T00:30:23.954685+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:30:25.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:24 smithi106 bash[18459]: cephadm 2024-02-13T00:30:23.955515+0000 mgr.y (mgr.24461) 11 : cephadm [INF] Adjusting osd_memory_target on smithi106 to 4060M 2024-02-13T00:30:25.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:24 smithi106 bash[18459]: audit 2024-02-13T00:30:23.962085+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:25.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:24 smithi106 bash[18459]: audit 2024-02-13T00:30:23.963427+0000 mon.c (mon.2) 35 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:30:25.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:24 smithi106 bash[18459]: audit 2024-02-13T00:30:23.964480+0000 mon.c (mon.2) 36 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:30:25.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:24 smithi106 bash[18459]: cephadm 2024-02-13T00:30:23.966542+0000 mgr.y (mgr.24461) 12 : cephadm [INF] Updating smithi080:/etc/ceph/ceph.conf 2024-02-13T00:30:25.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:24 smithi106 bash[18459]: cephadm 2024-02-13T00:30:23.967004+0000 mgr.y (mgr.24461) 13 : cephadm [INF] Updating smithi106:/etc/ceph/ceph.conf 2024-02-13T00:30:25.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:24 smithi106 bash[18459]: cephadm 2024-02-13T00:30:23.980581+0000 mgr.y (mgr.24461) 14 : cephadm [INF] Updating smithi080:/etc/ceph/ceph.client.admin.keyring 2024-02-13T00:30:25.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:24 smithi106 bash[18459]: cephadm 2024-02-13T00:30:23.996430+0000 mgr.y (mgr.24461) 15 : cephadm [INF] Updating smithi106:/etc/ceph/ceph.client.admin.keyring 2024-02-13T00:30:25.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:24 smithi106 bash[18459]: audit 2024-02-13T00:30:24.024983+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:25.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:24 smithi106 bash[18459]: audit 2024-02-13T00:30:24.031056+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:25.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:24 smithi106 bash[18459]: audit 2024-02-13T00:30:24.039622+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:25.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:24 smithi106 bash[18459]: cephadm 2024-02-13T00:30:24.043317+0000 mgr.y (mgr.24461) 16 : cephadm [INF] Deploying daemon node-exporter.a on smithi080 2024-02-13T00:30:25.008 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:24 smithi080 bash[45872]: Unable to find image 'quay.io/prometheus/node-exporter:v1.3.1' locally 2024-02-13T00:30:25.803 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:25 smithi106 systemd[1]: Started Ceph node-exporter.b for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:30:25.804 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:25 smithi106 bash[40735]: Unable to find image 'quay.io/prometheus/node-exporter:v1.3.1' locally 2024-02-13T00:30:26.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:25 smithi080 bash[17386]: cluster 2024-02-13T00:30:24.654858+0000 mgr.y (mgr.24461) 17 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 731 B/s rd, 0 op/s 2024-02-13T00:30:26.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:25 smithi080 bash[17386]: audit 2024-02-13T00:30:24.799697+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:26.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:25 smithi080 bash[17386]: cephadm 2024-02-13T00:30:24.802724+0000 mgr.y (mgr.24461) 18 : cephadm [INF] Deploying daemon node-exporter.b on smithi106 2024-02-13T00:30:26.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:25 smithi080 bash[17386]: audit 2024-02-13T00:30:25.558164+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:26.009 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:25 smithi080 bash[45872]: v1.3.1: Pulling from prometheus/node-exporter 2024-02-13T00:30:26.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:25 smithi080 bash[24237]: cluster 2024-02-13T00:30:24.654858+0000 mgr.y (mgr.24461) 17 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 731 B/s rd, 0 op/s 2024-02-13T00:30:26.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:25 smithi080 bash[24237]: audit 2024-02-13T00:30:24.799697+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:26.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:25 smithi080 bash[24237]: cephadm 2024-02-13T00:30:24.802724+0000 mgr.y (mgr.24461) 18 : cephadm [INF] Deploying daemon node-exporter.b on smithi106 2024-02-13T00:30:26.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:25 smithi080 bash[24237]: audit 2024-02-13T00:30:25.558164+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:26.109 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:25 smithi106 bash[18459]: cluster 2024-02-13T00:30:24.654858+0000 mgr.y (mgr.24461) 17 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 731 B/s rd, 0 op/s 2024-02-13T00:30:26.109 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:25 smithi106 bash[18459]: audit 2024-02-13T00:30:24.799697+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:26.110 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:25 smithi106 bash[18459]: cephadm 2024-02-13T00:30:24.802724+0000 mgr.y (mgr.24461) 18 : cephadm [INF] Deploying daemon node-exporter.b on smithi106 2024-02-13T00:30:26.110 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:25 smithi106 bash[18459]: audit 2024-02-13T00:30:25.558164+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:26.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.183+0000 7fccef2ae700 1 -- 172.21.15.80:0/510479098 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcce80fcad0 msgr2=0x7fcce80fceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:26.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.183+0000 7fccef2ae700 1 --2- 172.21.15.80:0/510479098 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcce80fcad0 0x7fcce80fceb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fcce4004870 tx=0x7fcce4009cb0).stop 2024-02-13T00:30:26.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.183+0000 7fccef2ae700 1 -- 172.21.15.80:0/510479098 shutdown_connections 2024-02-13T00:30:26.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.183+0000 7fccef2ae700 1 --2- 172.21.15.80:0/510479098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcce80f7340 0x7fcce8103940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:26.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.183+0000 7fccef2ae700 1 --2- 172.21.15.80:0/510479098 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcce80fcad0 0x7fcce80fceb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:26.190 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.183+0000 7fccef2ae700 1 --2- 172.21.15.80:0/510479098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcce80fd430 0x7fcce80f6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-13T00:30:26.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.183+0000 7fccef2ae700 1 -- 172.21.15.80:0/510479098 >> 172.21.15.80:0/510479098 conn(0x7fcce80f26e0 msgr2=0x7fcce80f4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:30:26.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.183+0000 7fccef2ae700 1 -- 172.21.15.80:0/510479098 shutdown_connections 2024-02-13T00:30:26.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.183+0000 7fccef2ae700 1 -- 172.21.15.80:0/510479098 wait complete. 2024-02-13T00:30:26.191 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.183+0000 7fccef2ae700 1 Processor -- start 2024-02-13T00:30:26.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.183+0000 7fccef2ae700 1 -- start start 2024-02-13T00:30:26.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.183+0000 7fccef2ae700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcce80f7340 0x7fcce810ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:26.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fccef2ae700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcce80fcad0 0x7fcce810d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:26.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fccef2ae700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcce80fd430 0x7fcce8106ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:26.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fccef2ae700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce81074e0 con 0x7fcce80fcad0 2024-02-13T00:30:26.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fccef2ae700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8107650 con 0x7fcce80fd430 2024-02-13T00:30:26.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fccef2ae700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8107810 con 0x7fcce80f7340 2024-02-13T00:30:26.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fcced04a700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcce80f7340 0x7fcce810ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:26.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fcced04a700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcce80f7340 0x7fcce810ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:47278/0 (socket says 172.21.15.80:47278) 2024-02-13T00:30:26.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fcced04a700 1 -- 172.21.15.80:0/3784009481 learned_addr learned my addr 172.21.15.80:0/3784009481 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:30:26.192 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fccec849700 1 --2- 172.21.15.80:0/3784009481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcce80fcad0 0x7fcce810d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:26.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fcced84b700 1 --2- 172.21.15.80:0/3784009481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcce80fd430 0x7fcce8106ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:26.193 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fcced04a700 1 -- 172.21.15.80:0/3784009481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcce80fd430 msgr2=0x7fcce8106ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:26.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fcced04a700 1 --2- 172.21.15.80:0/3784009481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcce80fd430 0x7fcce8106ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:26.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fcced04a700 1 -- 172.21.15.80:0/3784009481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcce80fcad0 msgr2=0x7fcce810d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:26.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fcced04a700 1 --2- 172.21.15.80:0/3784009481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcce80fcad0 0x7fcce810d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:26.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fcced04a700 1 -- 172.21.15.80:0/3784009481 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce4005040 con 0x7fcce80f7340 2024-02-13T00:30:26.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fcced04a700 1 --2- 172.21.15.80:0/3784009481 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcce80f7340 0x7fcce810ce50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fcce4000e50 tx=0x7fcce4009cb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:30:26.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fccde777700 1 -- 172.21.15.80:0/3784009481 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce400e030 con 0x7fcce80f7340 2024-02-13T00:30:26.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fccef2ae700 1 -- 172.21.15.80:0/3784009481 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce8107a90 con 0x7fcce80f7340 2024-02-13T00:30:26.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fccde777700 1 -- 172.21.15.80:0/3784009481 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fcce4009620 con 0x7fcce80f7340 2024-02-13T00:30:26.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fccde777700 1 -- 172.21.15.80:0/3784009481 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce401a070 con 0x7fcce80f7340 2024-02-13T00:30:26.194 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fccef2ae700 1 -- 172.21.15.80:0/3784009481 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce8060a80 con 0x7fcce80f7340 2024-02-13T00:30:26.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fccef2ae700 1 -- 172.21.15.80:0/3784009481 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce805f900 con 0x7fcce80f7340 2024-02-13T00:30:26.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.187+0000 7fccde777700 1 -- 172.21.15.80:0/3784009481 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7fcce401f420 con 0x7fcce80f7340 2024-02-13T00:30:26.195 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.191+0000 7fccde777700 1 --2- 172.21.15.80:0/3784009481 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fccd4061340 0x7fccd4063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:26.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.191+0000 7fccde777700 1 -- 172.21.15.80:0/3784009481 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7fcce4080760 con 0x7fcce80f7340 2024-02-13T00:30:26.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.191+0000 7fccec849700 1 --2- 172.21.15.80:0/3784009481 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fccd4061340 0x7fccd4063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:26.196 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.191+0000 7fccec849700 1 --2- 172.21.15.80:0/3784009481 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fccd4061340 0x7fccd4063800 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fcce8108790 tx=0x7fccd8009060).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:30:26.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.195+0000 7fccde777700 1 -- 172.21.15.80:0/3784009481 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fcce40504e0 con 0x7fcce80f7340 2024-02-13T00:30:26.305 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:26 smithi080 bash[45872]: aa2a8d90b84c: Pulling fs layer 2024-02-13T00:30:26.306 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:26 smithi080 bash[45872]: b45d31ee2d7f: Pulling fs layer 2024-02-13T00:30:26.306 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:26 smithi080 bash[45872]: b5db1e299295: Pulling fs layer 2024-02-13T00:30:26.306 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:26 smithi080 bash[45872]: aa2a8d90b84c: Verifying Checksum 2024-02-13T00:30:26.306 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:26 smithi080 bash[45872]: aa2a8d90b84c: Download complete 2024-02-13T00:30:26.306 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:26 smithi080 bash[45872]: b45d31ee2d7f: Verifying Checksum 2024-02-13T00:30:26.306 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:26 smithi080 bash[45872]: b45d31ee2d7f: Download complete 2024-02-13T00:30:26.482 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.475+0000 7fccef2ae700 1 -- 172.21.15.80:0/3784009481 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fcce805f400 con 0x7fcce80f7340 2024-02-13T00:30:26.491 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.487+0000 7fccde777700 1 -- 172.21.15.80:0/3784009481 <== mon.2 v2:172.21.15.80:3301/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7fcce401b270 con 0x7fcce80f7340 2024-02-13T00:30:26.491 INFO:teuthology.orchestra.run.smithi080.stdout:[client.0] 2024-02-13T00:30:26.492 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQAiuMplzhOkHBAAph1mIN8ajnIE/EsvNLWa4w== 2024-02-13T00:30:26.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.487+0000 7fccef2ae700 1 -- 172.21.15.80:0/3784009481 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fccd4061340 msgr2=0x7fccd4063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:26.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.487+0000 7fccef2ae700 1 --2- 172.21.15.80:0/3784009481 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fccd4061340 0x7fccd4063800 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fcce8108790 tx=0x7fccd8009060).stop 2024-02-13T00:30:26.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.487+0000 7fccef2ae700 1 -- 172.21.15.80:0/3784009481 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcce80f7340 msgr2=0x7fcce810ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:26.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.487+0000 7fccef2ae700 1 --2- 172.21.15.80:0/3784009481 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcce80f7340 0x7fcce810ce50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fcce4000e50 tx=0x7fcce4009cb0).stop 2024-02-13T00:30:26.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.487+0000 7fccef2ae700 1 -- 172.21.15.80:0/3784009481 shutdown_connections 2024-02-13T00:30:26.494 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.487+0000 7fccef2ae700 1 --2- 172.21.15.80:0/3784009481 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fccd4061340 0x7fccd4063800 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:26.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.487+0000 7fccef2ae700 1 --2- 172.21.15.80:0/3784009481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcce80fd430 0x7fcce8106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:26.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.487+0000 7fccef2ae700 1 --2- 172.21.15.80:0/3784009481 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcce80f7340 0x7fcce810ce50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:26.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.487+0000 7fccef2ae700 1 --2- 172.21.15.80:0/3784009481 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcce80fcad0 0x7fcce810d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:26.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.487+0000 7fccef2ae700 1 -- 172.21.15.80:0/3784009481 >> 172.21.15.80:0/3784009481 conn(0x7fcce80f26e0 msgr2=0x7fcce80faf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:30:26.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.487+0000 7fccef2ae700 1 -- 172.21.15.80:0/3784009481 shutdown_connections 2024-02-13T00:30:26.495 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:26.487+0000 7fccef2ae700 1 -- 172.21.15.80:0/3784009481 wait complete. 2024-02-13T00:30:26.505 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:26 smithi106 bash[40735]: v1.3.1: Pulling from prometheus/node-exporter 2024-02-13T00:30:26.505 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:26 smithi106 bash[40735]: aa2a8d90b84c: Pulling fs layer 2024-02-13T00:30:26.505 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:26 smithi106 bash[40735]: b45d31ee2d7f: Pulling fs layer 2024-02-13T00:30:26.505 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:26 smithi106 bash[40735]: b5db1e299295: Pulling fs layer 2024-02-13T00:30:26.573 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:26 smithi080 bash[45872]: b5db1e299295: Verifying Checksum 2024-02-13T00:30:26.573 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:26 smithi080 bash[45872]: b5db1e299295: Download complete 2024-02-13T00:30:26.573 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:26 smithi080 bash[45872]: aa2a8d90b84c: Pull complete 2024-02-13T00:30:26.805 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:26 smithi106 bash[40735]: b45d31ee2d7f: Verifying Checksum 2024-02-13T00:30:26.805 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:26 smithi106 bash[40735]: b45d31ee2d7f: Download complete 2024-02-13T00:30:26.805 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:26 smithi106 bash[40735]: aa2a8d90b84c: Download complete 2024-02-13T00:30:26.805 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:26 smithi106 bash[40735]: b5db1e299295: Verifying Checksum 2024-02-13T00:30:26.805 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:26 smithi106 bash[40735]: b5db1e299295: Download complete 2024-02-13T00:30:26.805 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:26 smithi106 bash[40735]: aa2a8d90b84c: Pull complete 2024-02-13T00:30:26.879 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:26 smithi080 bash[17386]: cephadm 2024-02-13T00:30:25.582241+0000 mgr.y (mgr.24461) 19 : cephadm [INF] Deploying daemon prometheus.a on smithi106 2024-02-13T00:30:26.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:26 smithi080 bash[17386]: audit 2024-02-13T00:30:26.479591+0000 mon.c (mon.2) 37 : audit [INF] from='client.? 172.21.15.80:0/3784009481' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-13T00:30:26.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:26 smithi080 bash[17386]: audit 2024-02-13T00:30:26.480168+0000 mon.a (mon.0) 640 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-13T00:30:26.880 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:26 smithi080 bash[17386]: audit 2024-02-13T00:30:26.488136+0000 mon.a (mon.0) 641 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-13T00:30:26.880 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:26 smithi080 bash[24237]: cephadm 2024-02-13T00:30:25.582241+0000 mgr.y (mgr.24461) 19 : cephadm [INF] Deploying daemon prometheus.a on smithi106 2024-02-13T00:30:26.880 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:26 smithi080 bash[24237]: audit 2024-02-13T00:30:26.479591+0000 mon.c (mon.2) 37 : audit [INF] from='client.? 172.21.15.80:0/3784009481' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-13T00:30:26.880 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:26 smithi080 bash[24237]: audit 2024-02-13T00:30:26.480168+0000 mon.a (mon.0) 640 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-13T00:30:26.880 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:26 smithi080 bash[24237]: audit 2024-02-13T00:30:26.488136+0000 mon.a (mon.0) 641 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-13T00:30:27.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:26 smithi106 bash[18459]: cephadm 2024-02-13T00:30:25.582241+0000 mgr.y (mgr.24461) 19 : cephadm [INF] Deploying daemon prometheus.a on smithi106 2024-02-13T00:30:27.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:26 smithi106 bash[18459]: audit 2024-02-13T00:30:26.479591+0000 mon.c (mon.2) 37 : audit [INF] from='client.? 172.21.15.80:0/3784009481' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-13T00:30:27.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:26 smithi106 bash[18459]: audit 2024-02-13T00:30:26.480168+0000 mon.a (mon.0) 640 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-13T00:30:27.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:26 smithi106 bash[18459]: audit 2024-02-13T00:30:26.488136+0000 mon.a (mon.0) 641 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-13T00:30:27.508 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:27 smithi080 bash[45872]: b45d31ee2d7f: Pull complete 2024-02-13T00:30:27.668 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:27 smithi106 bash[40735]: b45d31ee2d7f: Pull complete 2024-02-13T00:30:27.959 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-13T00:30:27.959 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-13T00:30:27.959 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-13T00:30:27.980 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-13T00:30:27.992 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:30:27 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:30:27.992 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:27 smithi106 bash[18459]: cluster 2024-02-13T00:30:26.655556+0000 mgr.y (mgr.24461) 20 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 569 B/s rd, 0 op/s 2024-02-13T00:30:27.992 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:27 smithi106 bash[18459]: audit 2024-02-13T00:30:26.884399+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:27.992 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:27 smithi106 bash[40735]: b5db1e299295: Pull complete 2024-02-13T00:30:28.180 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:27 smithi080 bash[17386]: cluster 2024-02-13T00:30:26.655556+0000 mgr.y (mgr.24461) 20 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 569 B/s rd, 0 op/s 2024-02-13T00:30:28.180 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:27 smithi080 bash[17386]: audit 2024-02-13T00:30:26.884399+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:28.180 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:27 smithi080 bash[45872]: b5db1e299295: Pull complete 2024-02-13T00:30:28.180 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:28 smithi080 bash[45872]: Digest: sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd 2024-02-13T00:30:28.180 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:27 smithi080 bash[24237]: cluster 2024-02-13T00:30:26.655556+0000 mgr.y (mgr.24461) 20 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 569 B/s rd, 0 op/s 2024-02-13T00:30:28.181 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:27 smithi080 bash[24237]: audit 2024-02-13T00:30:26.884399+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:28.255 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:28 smithi106 bash[40735]: Digest: sha256:f2269e73124dd0f60a7d19a2ce1264d33d08a985aed0ee6b0b89d0be470592cd 2024-02-13T00:30:28.255 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:28 smithi106 bash[40735]: Status: Downloaded newer image for quay.io/prometheus/node-exporter:v1.3.1 2024-02-13T00:30:28.508 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:28 smithi080 bash[45872]: Status: Downloaded newer image for quay.io/prometheus/node-exporter:v1.3.1 2024-02-13T00:30:29.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:28 smithi080 bash[17386]: audit 2024-02-13T00:30:27.664371+0000 mgr.y (mgr.24461) 21 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:30:29.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:28 smithi080 bash[24237]: audit 2024-02-13T00:30:27.664371+0000 mgr.y (mgr.24461) 21 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:30:29.317 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:28 smithi106 bash[18459]: audit 2024-02-13T00:30:27.664371+0000 mgr.y (mgr.24461) 21 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:30:29.759 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.493Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-02-13T00:30:29.759 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.493Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-02-13T00:30:29.759 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.495Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-02-13T00:30:29.760 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.495Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-02-13T00:30:29.760 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-02-13T00:30:29.760 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=arp 2024-02-13T00:30:29.760 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=bcache 2024-02-13T00:30:29.760 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=bonding 2024-02-13T00:30:29.760 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=btrfs 2024-02-13T00:30:29.760 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=conntrack 2024-02-13T00:30:29.760 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=cpu 2024-02-13T00:30:29.760 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-02-13T00:30:29.760 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=diskstats 2024-02-13T00:30:29.760 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=dmi 2024-02-13T00:30:29.760 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=edac 2024-02-13T00:30:29.760 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=entropy 2024-02-13T00:30:29.761 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-02-13T00:30:29.761 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=filefd 2024-02-13T00:30:29.761 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=filesystem 2024-02-13T00:30:29.761 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=hwmon 2024-02-13T00:30:29.761 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=infiniband 2024-02-13T00:30:29.761 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=ipvs 2024-02-13T00:30:29.761 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=loadavg 2024-02-13T00:30:29.761 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=mdadm 2024-02-13T00:30:29.761 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=meminfo 2024-02-13T00:30:29.761 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=netclass 2024-02-13T00:30:29.761 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=netdev 2024-02-13T00:30:29.761 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=netstat 2024-02-13T00:30:29.761 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=nfs 2024-02-13T00:30:29.761 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=nfsd 2024-02-13T00:30:29.761 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=nvme 2024-02-13T00:30:29.761 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=os 2024-02-13T00:30:29.762 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-02-13T00:30:29.762 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=pressure 2024-02-13T00:30:29.762 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=rapl 2024-02-13T00:30:29.762 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=schedstat 2024-02-13T00:30:29.762 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=sockstat 2024-02-13T00:30:29.762 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=softnet 2024-02-13T00:30:29.762 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=stat 2024-02-13T00:30:29.762 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=tapestats 2024-02-13T00:30:29.762 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=textfile 2024-02-13T00:30:29.762 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-02-13T00:30:29.762 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=time 2024-02-13T00:30:29.762 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-02-13T00:30:29.762 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=uname 2024-02-13T00:30:29.762 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=vmstat 2024-02-13T00:30:29.762 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=xfs 2024-02-13T00:30:29.762 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:115 level=info collector=zfs 2024-02-13T00:30:29.763 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.496Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-02-13T00:30:29.763 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[45872]: ts=2024-02-13T00:30:29.497Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-02-13T00:30:30.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[17386]: cluster 2024-02-13T00:30:28.657005+0000 mgr.y (mgr.24461) 22 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 931 B/s rd, 0 op/s 2024-02-13T00:30:30.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:29 smithi080 bash[24237]: cluster 2024-02-13T00:30:28.657005+0000 mgr.y (mgr.24461) 22 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 931 B/s rd, 0 op/s 2024-02-13T00:30:30.271 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:29 smithi106 bash[18459]: cluster 2024-02-13T00:30:28.657005+0000 mgr.y (mgr.24461) 22 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 931 B/s rd, 0 op/s 2024-02-13T00:30:31.903 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.640Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-02-13T00:30:31.903 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.640Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-02-13T00:30:31.903 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-02-13T00:30:31.903 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-02-13T00:30:31.903 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-02-13T00:30:31.903 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=arp 2024-02-13T00:30:31.903 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=bcache 2024-02-13T00:30:31.904 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=bonding 2024-02-13T00:30:31.904 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=btrfs 2024-02-13T00:30:31.904 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=conntrack 2024-02-13T00:30:31.904 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=cpu 2024-02-13T00:30:31.904 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-02-13T00:30:31.904 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=diskstats 2024-02-13T00:30:31.904 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=dmi 2024-02-13T00:30:31.904 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=edac 2024-02-13T00:30:31.904 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=entropy 2024-02-13T00:30:31.904 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-02-13T00:30:31.904 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=filefd 2024-02-13T00:30:31.904 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=filesystem 2024-02-13T00:30:31.904 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=hwmon 2024-02-13T00:30:31.904 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=infiniband 2024-02-13T00:30:31.905 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=ipvs 2024-02-13T00:30:31.905 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=loadavg 2024-02-13T00:30:31.905 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=mdadm 2024-02-13T00:30:31.905 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=meminfo 2024-02-13T00:30:31.905 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=netclass 2024-02-13T00:30:31.905 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=netdev 2024-02-13T00:30:31.905 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=netstat 2024-02-13T00:30:31.905 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=nfs 2024-02-13T00:30:31.905 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=nfsd 2024-02-13T00:30:31.905 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=nvme 2024-02-13T00:30:31.905 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=os 2024-02-13T00:30:31.905 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-02-13T00:30:31.905 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=pressure 2024-02-13T00:30:31.905 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=rapl 2024-02-13T00:30:31.905 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=schedstat 2024-02-13T00:30:31.906 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=sockstat 2024-02-13T00:30:31.906 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=softnet 2024-02-13T00:30:31.906 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=stat 2024-02-13T00:30:31.906 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=tapestats 2024-02-13T00:30:31.906 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=textfile 2024-02-13T00:30:31.906 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-02-13T00:30:31.906 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=time 2024-02-13T00:30:31.906 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-02-13T00:30:31.906 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=uname 2024-02-13T00:30:31.906 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=vmstat 2024-02-13T00:30:31.906 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=xfs 2024-02-13T00:30:31.906 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.642Z caller=node_exporter.go:115 level=info collector=zfs 2024-02-13T00:30:31.906 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.643Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-02-13T00:30:31.906 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[40735]: ts=2024-02-13T00:30:31.643Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-02-13T00:30:32.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:31 smithi106 bash[18459]: cluster 2024-02-13T00:30:30.657752+0000 mgr.y (mgr.24461) 23 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:30:32.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:31 smithi080 bash[17386]: cluster 2024-02-13T00:30:30.657752+0000 mgr.y (mgr.24461) 23 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:30:32.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:31 smithi080 bash[24237]: cluster 2024-02-13T00:30:30.657752+0000 mgr.y (mgr.24461) 23 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:30:33.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:32 smithi106 bash[18459]: audit 2024-02-13T00:30:31.895849+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:33.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:32 smithi080 bash[17386]: audit 2024-02-13T00:30:31.895849+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:33.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:32 smithi080 bash[24237]: audit 2024-02-13T00:30:31.895849+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:34.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:33 smithi106 bash[18459]: cluster 2024-02-13T00:30:32.658710+0000 mgr.y (mgr.24461) 24 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T00:30:34.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:33 smithi080 bash[17386]: cluster 2024-02-13T00:30:32.658710+0000 mgr.y (mgr.24461) 24 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T00:30:34.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:33 smithi080 bash[24237]: cluster 2024-02-13T00:30:32.658710+0000 mgr.y (mgr.24461) 24 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T00:30:35.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.315+0000 7f1c90692700 1 -- 172.21.15.106:0/149900961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c880fc270 msgr2=0x7f1c880fc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:35.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.315+0000 7f1c90692700 1 --2- 172.21.15.106:0/149900961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c880fc270 0x7f1c880fc650 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f1c8400acf0 tx=0x7f1c84004d10).stop 2024-02-13T00:30:35.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.315+0000 7f1c90692700 1 -- 172.21.15.106:0/149900961 shutdown_connections 2024-02-13T00:30:35.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.315+0000 7f1c90692700 1 --2- 172.21.15.106:0/149900961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c880fc270 0x7f1c880fc650 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:35.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.315+0000 7f1c90692700 1 --2- 172.21.15.106:0/149900961 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c880f6b30 0x7f1c881030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:35.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.315+0000 7f1c90692700 1 --2- 172.21.15.106:0/149900961 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1c880fcbd0 0x7f1c880f6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:35.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.315+0000 7f1c90692700 1 -- 172.21.15.106:0/149900961 >> 172.21.15.106:0/149900961 conn(0x7f1c88070060 msgr2=0x7f1c880f4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:30:35.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.315+0000 7f1c90692700 1 -- 172.21.15.106:0/149900961 shutdown_connections 2024-02-13T00:30:35.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.315+0000 7f1c90692700 1 -- 172.21.15.106:0/149900961 wait complete. 2024-02-13T00:30:35.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.315+0000 7f1c90692700 1 Processor -- start 2024-02-13T00:30:35.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.315+0000 7f1c90692700 1 -- start start 2024-02-13T00:30:35.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c90692700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c880f6b30 0x7f1c8810bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:35.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c90692700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c880fc270 0x7f1c8810c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:35.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c90692700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1c880fcbd0 0x7f1c88105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:35.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c90692700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c88106360 con 0x7f1c880fc270 2024-02-13T00:30:35.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c90692700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c881064d0 con 0x7f1c880f6b30 2024-02-13T00:30:35.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c8e42e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c880f6b30 0x7f1c8810bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:35.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c90692700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c88106690 con 0x7f1c880fcbd0 2024-02-13T00:30:35.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c8e42e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c880f6b30 0x7f1c8810bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51894/0 (socket says 172.21.15.106:51894) 2024-02-13T00:30:35.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c8e42e700 1 -- 172.21.15.106:0/1180529626 learned_addr learned my addr 172.21.15.106:0/1180529626 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-02-13T00:30:35.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c8ec2f700 1 --2- 172.21.15.106:0/1180529626 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1c880fcbd0 0x7f1c88105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:35.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c8dc2d700 1 --2- 172.21.15.106:0/1180529626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c880fc270 0x7f1c8810c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:35.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c8e42e700 1 -- 172.21.15.106:0/1180529626 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1c880fcbd0 msgr2=0x7f1c88105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:35.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c8e42e700 1 --2- 172.21.15.106:0/1180529626 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1c880fcbd0 0x7f1c88105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:35.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c8e42e700 1 -- 172.21.15.106:0/1180529626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c880fc270 msgr2=0x7f1c8810c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:35.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c8e42e700 1 --2- 172.21.15.106:0/1180529626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c880fc270 0x7f1c8810c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:35.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c8e42e700 1 -- 172.21.15.106:0/1180529626 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8400a8d0 con 0x7f1c880f6b30 2024-02-13T00:30:35.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c8dc2d700 1 --2- 172.21.15.106:0/1180529626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c880fc270 0x7f1c8810c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-13T00:30:35.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c8e42e700 1 --2- 172.21.15.106:0/1180529626 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c880f6b30 0x7f1c8810bcd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f1c8400a3a0 tx=0x7f1c84004d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:30:35.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c7f7fe700 1 -- 172.21.15.106:0/1180529626 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8400f030 con 0x7f1c880f6b30 2024-02-13T00:30:35.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c7f7fe700 1 -- 172.21.15.106:0/1180529626 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f1c84008d00 con 0x7f1c880f6b30 2024-02-13T00:30:35.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c7f7fe700 1 -- 172.21.15.106:0/1180529626 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c840083f0 con 0x7f1c880f6b30 2024-02-13T00:30:35.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c90692700 1 -- 172.21.15.106:0/1180529626 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c88106910 con 0x7f1c880f6b30 2024-02-13T00:30:35.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c90692700 1 -- 172.21.15.106:0/1180529626 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c88112b00 con 0x7f1c880f6b30 2024-02-13T00:30:35.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c90692700 1 -- 172.21.15.106:0/1180529626 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c88106d50 con 0x7f1c880f6b30 2024-02-13T00:30:35.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c7f7fe700 1 -- 172.21.15.106:0/1180529626 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f1c840077a0 con 0x7f1c880f6b30 2024-02-13T00:30:35.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c7f7fe700 1 --2- 172.21.15.106:0/1180529626 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f1c74061340 0x7f1c74063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:35.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c7f7fe700 1 -- 172.21.15.106:0/1180529626 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f1c8407e490 con 0x7f1c880f6b30 2024-02-13T00:30:35.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.319+0000 7f1c8dc2d700 1 --2- 172.21.15.106:0/1180529626 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f1c74061340 0x7f1c74063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:35.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.323+0000 7f1c8dc2d700 1 --2- 172.21.15.106:0/1180529626 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f1c74061340 0x7f1c74063800 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f1c88107610 tx=0x7f1c78009040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:30:35.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.327+0000 7f1c7f7fe700 1 -- 172.21.15.106:0/1180529626 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1c8404e210 con 0x7f1c880f6b30 2024-02-13T00:30:35.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.579+0000 7f1c90692700 1 -- 172.21.15.106:0/1180529626 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f1c88060ba0 con 0x7f1c880f6b30 2024-02-13T00:30:35.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.591+0000 7f1c7f7fe700 1 -- 172.21.15.106:0/1180529626 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v18) v1 ==== 170+0+59 (secure 0 0 0) 0x7f1c84051830 con 0x7f1c880f6b30 2024-02-13T00:30:35.596 INFO:teuthology.orchestra.run.smithi106.stdout:[client.1] 2024-02-13T00:30:35.596 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAruMpl2OPGIhAAKYJH6/VO4LM/6X6A6Dbh/w== 2024-02-13T00:30:35.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.595+0000 7f1c90692700 1 -- 172.21.15.106:0/1180529626 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f1c74061340 msgr2=0x7f1c74063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:35.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.595+0000 7f1c90692700 1 --2- 172.21.15.106:0/1180529626 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f1c74061340 0x7f1c74063800 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f1c88107610 tx=0x7f1c78009040).stop 2024-02-13T00:30:35.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.595+0000 7f1c90692700 1 -- 172.21.15.106:0/1180529626 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c880f6b30 msgr2=0x7f1c8810bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:35.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.595+0000 7f1c90692700 1 --2- 172.21.15.106:0/1180529626 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c880f6b30 0x7f1c8810bcd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f1c8400a3a0 tx=0x7f1c84004d10).stop 2024-02-13T00:30:35.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.595+0000 7f1c90692700 1 -- 172.21.15.106:0/1180529626 shutdown_connections 2024-02-13T00:30:35.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.595+0000 7f1c90692700 1 --2- 172.21.15.106:0/1180529626 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f1c74061340 0x7f1c74063800 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:35.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.595+0000 7f1c90692700 1 --2- 172.21.15.106:0/1180529626 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c880f6b30 0x7f1c8810bcd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:35.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.595+0000 7f1c90692700 1 --2- 172.21.15.106:0/1180529626 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f1c880fcbd0 0x7f1c88105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:35.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.595+0000 7f1c90692700 1 --2- 172.21.15.106:0/1180529626 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f1c880fc270 0x7f1c8810c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:35.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.595+0000 7f1c90692700 1 -- 172.21.15.106:0/1180529626 >> 172.21.15.106:0/1180529626 conn(0x7f1c88070060 msgr2=0x7f1c8806d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:30:35.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.595+0000 7f1c90692700 1 -- 172.21.15.106:0/1180529626 shutdown_connections 2024-02-13T00:30:35.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-02-13T00:30:35.595+0000 7f1c90692700 1 -- 172.21.15.106:0/1180529626 wait complete. 2024-02-13T00:30:35.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:35 smithi106 bash[18459]: cluster 2024-02-13T00:30:34.659938+0000 mgr.y (mgr.24461) 25 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:30:35.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:35 smithi080 bash[17386]: cluster 2024-02-13T00:30:34.659938+0000 mgr.y (mgr.24461) 25 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:30:35.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:35 smithi080 bash[24237]: cluster 2024-02-13T00:30:34.659938+0000 mgr.y (mgr.24461) 25 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:30:36.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:36 smithi106 bash[18459]: audit 2024-02-13T00:30:35.583018+0000 mon.a (mon.0) 644 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-13T00:30:36.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:36 smithi106 bash[18459]: audit 2024-02-13T00:30:35.583281+0000 mon.b (mon.1) 32 : audit [INF] from='client.? 172.21.15.106:0/1180529626' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-13T00:30:36.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:36 smithi106 bash[18459]: audit 2024-02-13T00:30:35.591813+0000 mon.a (mon.0) 645 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-13T00:30:36.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:36 smithi080 bash[24237]: audit 2024-02-13T00:30:35.583018+0000 mon.a (mon.0) 644 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-13T00:30:36.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:36 smithi080 bash[24237]: audit 2024-02-13T00:30:35.583281+0000 mon.b (mon.1) 32 : audit [INF] from='client.? 172.21.15.106:0/1180529626' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-13T00:30:36.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:36 smithi080 bash[24237]: audit 2024-02-13T00:30:35.591813+0000 mon.a (mon.0) 645 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-13T00:30:36.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:36 smithi080 bash[17386]: audit 2024-02-13T00:30:35.583018+0000 mon.a (mon.0) 644 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-13T00:30:36.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:36 smithi080 bash[17386]: audit 2024-02-13T00:30:35.583281+0000 mon.b (mon.1) 32 : audit [INF] from='client.? 172.21.15.106:0/1180529626' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-13T00:30:36.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:36 smithi080 bash[17386]: audit 2024-02-13T00:30:35.591813+0000 mon.a (mon.0) 645 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-13T00:30:37.177 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-02-13T00:30:37.177 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-13T00:30:37.177 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-13T00:30:37.240 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph osd dump --format=json 2024-02-13T00:30:37.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:37 smithi080 bash[17386]: cluster 2024-02-13T00:30:36.660657+0000 mgr.y (mgr.24461) 26 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:30:37.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:37 smithi080 bash[24237]: cluster 2024-02-13T00:30:36.660657+0000 mgr.y (mgr.24461) 26 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:30:37.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:30:37 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:30:37.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:37 smithi106 bash[18459]: cluster 2024-02-13T00:30:36.660657+0000 mgr.y (mgr.24461) 26 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:30:38.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:38 smithi106 bash[18459]: audit 2024-02-13T00:30:37.672779+0000 mgr.y (mgr.24461) 27 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:30:38.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:38 smithi080 bash[17386]: audit 2024-02-13T00:30:37.672779+0000 mgr.y (mgr.24461) 27 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:30:38.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:38 smithi080 bash[24237]: audit 2024-02-13T00:30:37.672779+0000 mgr.y (mgr.24461) 27 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:30:39.708 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:39 smithi106 bash[18459]: cluster 2024-02-13T00:30:38.662001+0000 mgr.y (mgr.24461) 28 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:30:40.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:39 smithi080 bash[17386]: cluster 2024-02-13T00:30:38.662001+0000 mgr.y (mgr.24461) 28 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:30:40.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:39 smithi080 bash[24237]: cluster 2024-02-13T00:30:38.662001+0000 mgr.y (mgr.24461) 28 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:30:40.755 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:30:40 smithi106 systemd[1]: Started Ceph prometheus.a for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:30:42.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:41 smithi106 bash[18459]: cluster 2024-02-13T00:30:40.662725+0000 mgr.y (mgr.24461) 29 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:30:42.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:41 smithi106 bash[18459]: audit 2024-02-13T00:30:40.749095+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:42.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:41 smithi106 bash[18459]: cephadm 2024-02-13T00:30:40.762242+0000 mgr.y (mgr.24461) 30 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-02-13T00:30:42.006 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:30:41 smithi106 bash[41301]: ts=2024-02-13T00:30:41.658Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-02-13T00:30:42.006 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:30:41 smithi106 bash[41301]: ts=2024-02-13T00:30:41.658Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-02-13T00:30:42.006 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:30:41 smithi106 bash[41301]: ts=2024-02-13T00:30:41.658Z caller=main.go:518 level=info host_details="(Linux 5.15.0-94-generic #104~20.04.1-Ubuntu SMP Tue Jan 16 13:34:09 UTC 2024 x86_64 smithi106 (none))" 2024-02-13T00:30:42.006 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:30:41 smithi106 bash[41301]: ts=2024-02-13T00:30:41.658Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-02-13T00:30:42.006 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:30:41 smithi106 bash[41301]: ts=2024-02-13T00:30:41.658Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-02-13T00:30:42.006 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:30:41 smithi106 bash[41301]: ts=2024-02-13T00:30:41.661Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-02-13T00:30:42.006 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:30:41 smithi106 bash[41301]: ts=2024-02-13T00:30:41.662Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-02-13T00:30:42.006 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:30:41 smithi106 bash[41301]: ts=2024-02-13T00:30:41.663Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-02-13T00:30:42.006 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:30:41 smithi106 bash[41301]: ts=2024-02-13T00:30:41.668Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-02-13T00:30:42.006 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:30:41 smithi106 bash[41301]: ts=2024-02-13T00:30:41.668Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.712µs 2024-02-13T00:30:42.006 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:30:41 smithi106 bash[41301]: ts=2024-02-13T00:30:41.668Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-02-13T00:30:42.006 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:30:41 smithi106 bash[41301]: ts=2024-02-13T00:30:41.668Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-02-13T00:30:42.006 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:30:41 smithi106 bash[41301]: ts=2024-02-13T00:30:41.668Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=41.807µs wal_replay_duration=310.103µs total_replay_duration=377.914µs 2024-02-13T00:30:42.007 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:30:41 smithi106 bash[41301]: ts=2024-02-13T00:30:41.670Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-02-13T00:30:42.007 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:30:41 smithi106 bash[41301]: ts=2024-02-13T00:30:41.670Z caller=main.go:947 level=info msg="TSDB started" 2024-02-13T00:30:42.007 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:30:41 smithi106 bash[41301]: ts=2024-02-13T00:30:41.670Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-13T00:30:42.007 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:30:41 smithi106 bash[41301]: ts=2024-02-13T00:30:41.696Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=25.520846ms db_storage=910ns remote_storage=1.932µs web_handler=532ns query_engine=944ns scrape=436.036µs scrape_sd=37.737µs notify=1.254µs notify_sd=2.24µs rules=24.6666ms 2024-02-13T00:30:42.007 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:30:41 smithi106 bash[41301]: ts=2024-02-13T00:30:41.696Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-02-13T00:30:42.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:41 smithi080 bash[17386]: cluster 2024-02-13T00:30:40.662725+0000 mgr.y (mgr.24461) 29 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:30:42.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:41 smithi080 bash[17386]: audit 2024-02-13T00:30:40.749095+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:42.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:41 smithi080 bash[17386]: cephadm 2024-02-13T00:30:40.762242+0000 mgr.y (mgr.24461) 30 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-02-13T00:30:42.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:41 smithi080 bash[24237]: cluster 2024-02-13T00:30:40.662725+0000 mgr.y (mgr.24461) 29 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:30:42.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:41 smithi080 bash[24237]: audit 2024-02-13T00:30:40.749095+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:42.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:41 smithi080 bash[24237]: cephadm 2024-02-13T00:30:40.762242+0000 mgr.y (mgr.24461) 30 : cephadm [INF] Deploying daemon alertmanager.a on smithi080 2024-02-13T00:30:42.015 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:30:43.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:42 smithi106 bash[18459]: audit 2024-02-13T00:30:41.901408+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:43.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:42 smithi080 bash[17386]: audit 2024-02-13T00:30:41.901408+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:43.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:42 smithi080 bash[24237]: audit 2024-02-13T00:30:41.901408+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:44.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:43 smithi080 bash[17386]: cluster 2024-02-13T00:30:42.663908+0000 mgr.y (mgr.24461) 31 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:30:44.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:43 smithi080 bash[24237]: cluster 2024-02-13T00:30:42.663908+0000 mgr.y (mgr.24461) 31 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:30:44.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:43 smithi106 bash[18459]: cluster 2024-02-13T00:30:42.663908+0000 mgr.y (mgr.24461) 31 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:30:45.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:45 smithi106 bash[18459]: cluster 2024-02-13T00:30:44.664774+0000 mgr.y (mgr.24461) 32 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:30:45.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:45 smithi080 bash[17386]: cluster 2024-02-13T00:30:44.664774+0000 mgr.y (mgr.24461) 32 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:30:45.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:45 smithi080 bash[24237]: cluster 2024-02-13T00:30:44.664774+0000 mgr.y (mgr.24461) 32 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:30:46.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.078+0000 7fb980c3a700 1 -- 172.21.15.80:0/889663368 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb97c0fdcb0 msgr2=0x7fb97c0fe090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:46.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.078+0000 7fb980c3a700 1 --2- 172.21.15.80:0/889663368 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb97c0fdcb0 0x7fb97c0fe090 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fb96c004870 tx=0x7fb96c009cb0).stop 2024-02-13T00:30:46.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.078+0000 7fb980c3a700 1 -- 172.21.15.80:0/889663368 shutdown_connections 2024-02-13T00:30:46.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.078+0000 7fb980c3a700 1 --2- 172.21.15.80:0/889663368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb97c0f68a0 0x7fb97c104b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:46.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.078+0000 7fb980c3a700 1 --2- 172.21.15.80:0/889663368 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb97c0fdcb0 0x7fb97c0fe090 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:46.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.078+0000 7fb980c3a700 1 --2- 172.21.15.80:0/889663368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb97c0fe610 0x7fb97c0f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:46.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.078+0000 7fb980c3a700 1 -- 172.21.15.80:0/889663368 >> 172.21.15.80:0/889663368 conn(0x7fb97c070150 msgr2=0x7fb97c0f44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:30:46.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.078+0000 7fb980c3a700 1 -- 172.21.15.80:0/889663368 shutdown_connections 2024-02-13T00:30:46.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.078+0000 7fb980c3a700 1 -- 172.21.15.80:0/889663368 wait complete. 2024-02-13T00:30:46.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb980c3a700 1 Processor -- start 2024-02-13T00:30:46.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb980c3a700 1 -- start start 2024-02-13T00:30:46.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb980c3a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb97c0f68a0 0x7fb97c10e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:46.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb980c3a700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb97c0fdcb0 0x7fb97c10e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:46.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb980c3a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb97c0fe610 0x7fb97c108280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:46.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb980c3a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c108770 con 0x7fb97c0f68a0 2024-02-13T00:30:46.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb980c3a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c1088e0 con 0x7fb97c0fe610 2024-02-13T00:30:46.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb980c3a700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c108aa0 con 0x7fb97c0fdcb0 2024-02-13T00:30:46.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb979d9b700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb97c0fdcb0 0x7fb97c10e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:46.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb97a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb97c0f68a0 0x7fb97c10e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:46.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb97a59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb97c0f68a0 0x7fb97c10e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37426/0 (socket says 172.21.15.80:37426) 2024-02-13T00:30:46.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb979d9b700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb97c0fdcb0 0x7fb97c10e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:56018/0 (socket says 172.21.15.80:56018) 2024-02-13T00:30:46.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb97a59c700 1 -- 172.21.15.80:0/2147245771 learned_addr learned my addr 172.21.15.80:0/2147245771 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:30:46.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb97ad9d700 1 --2- 172.21.15.80:0/2147245771 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb97c0fe610 0x7fb97c108280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:46.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb97a59c700 1 -- 172.21.15.80:0/2147245771 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb97c0fdcb0 msgr2=0x7fb97c10e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:46.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb97a59c700 1 --2- 172.21.15.80:0/2147245771 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb97c0fdcb0 0x7fb97c10e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:46.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb97a59c700 1 -- 172.21.15.80:0/2147245771 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb97c0fe610 msgr2=0x7fb97c108280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:46.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb97a59c700 1 --2- 172.21.15.80:0/2147245771 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb97c0fe610 0x7fb97c108280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:46.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb97a59c700 1 -- 172.21.15.80:0/2147245771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c005040 con 0x7fb97c0f68a0 2024-02-13T00:30:46.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb97a59c700 1 --2- 172.21.15.80:0/2147245771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb97c0f68a0 0x7fb97c10e090 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb96c007fd0 tx=0x7fb96c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:30:46.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb96b7fe700 1 -- 172.21.15.80:0/2147245771 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c00e030 con 0x7fb97c0f68a0 2024-02-13T00:30:46.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb96b7fe700 1 -- 172.21.15.80:0/2147245771 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fb96c013e30 con 0x7fb97c0f68a0 2024-02-13T00:30:46.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb96b7fe700 1 -- 172.21.15.80:0/2147245771 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c018070 con 0x7fb97c0f68a0 2024-02-13T00:30:46.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb980c3a700 1 -- 172.21.15.80:0/2147245771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97c108d20 con 0x7fb97c0f68a0 2024-02-13T00:30:46.090 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.082+0000 7fb980c3a700 1 -- 172.21.15.80:0/2147245771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97c114ec0 con 0x7fb97c0f68a0 2024-02-13T00:30:46.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.086+0000 7fb96b7fe700 1 -- 172.21.15.80:0/2147245771 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7fb96c009240 con 0x7fb97c0f68a0 2024-02-13T00:30:46.091 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.086+0000 7fb980c3a700 1 -- 172.21.15.80:0/2147245771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97c109160 con 0x7fb97c0f68a0 2024-02-13T00:30:46.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.086+0000 7fb96b7fe700 1 --2- 172.21.15.80:0/2147245771 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fb964061340 0x7fb964063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:46.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.086+0000 7fb96b7fe700 1 -- 172.21.15.80:0/2147245771 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7fb96c07dfe0 con 0x7fb97c0f68a0 2024-02-13T00:30:46.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.086+0000 7fb979d9b700 1 --2- 172.21.15.80:0/2147245771 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fb964061340 0x7fb964063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:46.092 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.086+0000 7fb979d9b700 1 --2- 172.21.15.80:0/2147245771 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fb964061340 0x7fb964063800 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb97c1099d0 tx=0x7fb97000b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:30:46.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.090+0000 7fb96b7fe700 1 -- 172.21.15.80:0/2147245771 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb96c04de20 con 0x7fb97c0f68a0 2024-02-13T00:30:46.283 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.278+0000 7fb980c3a700 1 -- 172.21.15.80:0/2147245771 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb97c106f40 con 0x7fb97c0f68a0 2024-02-13T00:30:46.284 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.278+0000 7fb96b7fe700 1 -- 172.21.15.80:0/2147245771 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+21270 (secure 0 0 0) 0x7fb96c051440 con 0x7fb97c0f68a0 2024-02-13T00:30:46.285 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-13T00:30:46.285 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":63,"fsid":"a5ae7724-ca05-11ee-95b9-87774f69a715","created":"2024-02-13T00:21:07.716138+0000","modified":"2024-02-13T00:30:16.631634+0000","last_up_change":"2024-02-13T00:29:35.842392+0000","last_in_change":"2024-02-13T00:29:09.950392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-13T00:26:05.027899+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"iscsi","create_time":"2024-02-13T00:29:49.451980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":".rgw.root","create_time":"2024-02-13T00:29:50.696517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-02-13T00:29:52.576333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-02-13T00:29:54.338868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-02-13T00:29:56.456209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"e5a7f0c8-0fa3-4f12-add7-5fb78c8cc514","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":635200923},{"type":"v1","addr":"172.21.15.80:6803","nonce":635200923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":635200923},{"type":"v1","addr":"172.21.15.80:6805","nonce":635200923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":635200923},{"type":"v1","addr":"172.21.15.80:6809","nonce":635200923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":635200923},{"type":"v1","addr":"172.21.15.80:6807","nonce":635200923}]},"public_addr":"172.21.15.80:6803/635200923","cluster_addr":"172.21.15.80:6805/635200923","heartbeat_back_addr":"172.21.15.80:6809/635200923","heartbeat_front_addr":"172.21.15.80:6807/635200923","state":["exists","up"]},{"osd":1,"uuid":"33c91336-14a3-4f0d-8669-2309f34c49c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1803743584},{"type":"v1","addr":"172.21.15.80:6811","nonce":1803743584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1803743584},{"type":"v1","addr":"172.21.15.80:6813","nonce":1803743584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1803743584},{"type":"v1","addr":"172.21.15.80:6817","nonce":1803743584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1803743584},{"type":"v1","addr":"172.21.15.80:6815","nonce":1803743584}]},"public_addr":"172.21.15.80:6811/1803743584","cluster_addr":"172.21.15.80:6813/1803743584","heartbeat_back_addr":"172.21.15.80:6817/1803743584","heartbeat_front_addr":"172.21.15.80:6815/1803743584","state":["exists","up"]},{"osd":2,"uuid":"734aa898-b774-4744-a7b7-15c30c3c4187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":238755079},{"type":"v1","addr":"172.21.15.80:6819","nonce":238755079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":238755079},{"type":"v1","addr":"172.21.15.80:6821","nonce":238755079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":238755079},{"type":"v1","addr":"172.21.15.80:6825","nonce":238755079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":238755079},{"type":"v1","addr":"172.21.15.80:6823","nonce":238755079}]},"public_addr":"172.21.15.80:6819/238755079","cluster_addr":"172.21.15.80:6821/238755079","heartbeat_back_addr":"172.21.15.80:6825/238755079","heartbeat_front_addr":"172.21.15.80:6823/238755079","state":["exists","up"]},{"osd":3,"uuid":"6772f249-7ded-4e8f-b0d2-f04e72eee540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3260371152},{"type":"v1","addr":"172.21.15.80:6827","nonce":3260371152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3260371152},{"type":"v1","addr":"172.21.15.80:6829","nonce":3260371152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3260371152},{"type":"v1","addr":"172.21.15.80:6833","nonce":3260371152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3260371152},{"type":"v1","addr":"172.21.15.80:6831","nonce":3260371152}]},"public_addr":"172.21.15.80:6827/3260371152","cluster_addr":"172.21.15.80:6829/3260371152","heartbeat_back_addr":"172.21.15.80:6833/3260371152","heartbeat_front_addr":"172.21.15.80:6831/3260371152","state":["exists","up"]},{"osd":4,"uuid":"51181b93-78b9-4cb8-954e-1f25ef19518d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":2755922963},{"type":"v1","addr":"172.21.15.106:6801","nonce":2755922963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":2755922963},{"type":"v1","addr":"172.21.15.106:6803","nonce":2755922963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":2755922963},{"type":"v1","addr":"172.21.15.106:6807","nonce":2755922963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":2755922963},{"type":"v1","addr":"172.21.15.106:6805","nonce":2755922963}]},"public_addr":"172.21.15.106:6801/2755922963","cluster_addr":"172.21.15.106:6803/2755922963","heartbeat_back_addr":"172.21.15.106:6807/2755922963","heartbeat_front_addr":"172.21.15.106:6805/2755922963","state":["exists","up"]},{"osd":5,"uuid":"d335acec-df11-42a6-8454-f6933e209d5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":3712665601},{"type":"v1","addr":"172.21.15.106:6809","nonce":3712665601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":3712665601},{"type":"v1","addr":"172.21.15.106:6811","nonce":3712665601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":3712665601},{"type":"v1","addr":"172.21.15.106:6815","nonce":3712665601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":3712665601},{"type":"v1","addr":"172.21.15.106:6813","nonce":3712665601}]},"public_addr":"172.21.15.106:6809/3712665601","cluster_addr":"172.21.15.106:6811/3712665601","heartbeat_back_addr":"172.21.15.106:6815/3712665601","heartbeat_front_addr":"172.21.15.106:6813/3712665601","state":["exists","up"]},{"osd":6,"uuid":"d6440f04-f935-4d72-aebd-9593038549f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":626618901},{"type":"v1","addr":"172.21.15.106:6817","nonce":626618901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":626618901},{"type":"v1","addr":"172.21.15.106:6819","nonce":626618901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":626618901},{"type":"v1","addr":"172.21.15.106:6823","nonce":626618901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":626618901},{"type":"v1","addr":"172.21.15.106:6821","nonce":626618901}]},"public_addr":"172.21.15.106:6817/626618901","cluster_addr":"172.21.15.106:6819/626618901","heartbeat_back_addr":"172.21.15.106:6823/626618901","heartbeat_front_addr":"172.21.15.106:6821/626618901","state":["exists","up"]},{"osd":7,"uuid":"1ced0927-8fb9-4c30-8a8b-0d1b7d49ad39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2273586184},{"type":"v1","addr":"172.21.15.106:6825","nonce":2273586184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2273586184},{"type":"v1","addr":"172.21.15.106:6827","nonce":2273586184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2273586184},{"type":"v1","addr":"172.21.15.106:6831","nonce":2273586184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2273586184},{"type":"v1","addr":"172.21.15.106:6829","nonce":2273586184}]},"public_addr":"172.21.15.106:6825/2273586184","cluster_addr":"172.21.15.106:6827/2273586184","heartbeat_back_addr":"172.21.15.106:6831/2273586184","heartbeat_front_addr":"172.21.15.106:6829/2273586184","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:24:35.972179+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:25:18.309640+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:26:02.697043+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:26:46.567227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:27:27.731147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:28:09.145523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:28:51.627745+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:29:34.158416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/461193090":"2024-02-14T00:30:16.631567+0000","172.21.15.80:6800/461193090":"2024-02-14T00:30:16.631567+0000","172.21.15.80:6800/3429634547":"2024-02-14T00:22:06.647132+0000","172.21.15.80:0/471481369":"2024-02-14T00:30:16.631567+0000","172.21.15.80:0/2814238145":"2024-02-14T00:22:06.647132+0000","172.21.15.80:0/1312114353":"2024-02-14T00:22:06.647132+0000","172.21.15.80:6800/3082938701":"2024-02-14T00:21:35.662370+0000","172.21.15.80:0/886443941":"2024-02-14T00:30:16.631567+0000","172.21.15.80:6801/3082938701":"2024-02-14T00:21:35.662370+0000","172.21.15.80:0/1104045880":"2024-02-14T00:30:16.631567+0000","172.21.15.80:0/1053677790":"2024-02-14T00:21:35.662370+0000","172.21.15.80:6801/3429634547":"2024-02-14T00:22:06.647132+0000","172.21.15.80:0/3188909815":"2024-02-14T00:21:35.662370+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-13T00:30:46.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.278+0000 7fb980c3a700 1 -- 172.21.15.80:0/2147245771 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fb964061340 msgr2=0x7fb964063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:46.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.278+0000 7fb980c3a700 1 --2- 172.21.15.80:0/2147245771 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fb964061340 0x7fb964063800 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb97c1099d0 tx=0x7fb97000b040).stop 2024-02-13T00:30:46.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.278+0000 7fb980c3a700 1 -- 172.21.15.80:0/2147245771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb97c0f68a0 msgr2=0x7fb97c10e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:46.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.278+0000 7fb980c3a700 1 --2- 172.21.15.80:0/2147245771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb97c0f68a0 0x7fb97c10e090 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb96c007fd0 tx=0x7fb96c009cb0).stop 2024-02-13T00:30:46.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.278+0000 7fb980c3a700 1 -- 172.21.15.80:0/2147245771 shutdown_connections 2024-02-13T00:30:46.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.282+0000 7fb980c3a700 1 --2- 172.21.15.80:0/2147245771 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fb964061340 0x7fb964063800 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:46.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.282+0000 7fb980c3a700 1 --2- 172.21.15.80:0/2147245771 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb97c0fe610 0x7fb97c108280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:46.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.282+0000 7fb980c3a700 1 --2- 172.21.15.80:0/2147245771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb97c0f68a0 0x7fb97c10e090 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:46.287 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.282+0000 7fb980c3a700 1 --2- 172.21.15.80:0/2147245771 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb97c0fdcb0 0x7fb97c10e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:46.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.282+0000 7fb980c3a700 1 -- 172.21.15.80:0/2147245771 >> 172.21.15.80:0/2147245771 conn(0x7fb97c070150 msgr2=0x7fb97c0fbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:30:46.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.282+0000 7fb980c3a700 1 -- 172.21.15.80:0/2147245771 shutdown_connections 2024-02-13T00:30:46.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:46.282+0000 7fb980c3a700 1 -- 172.21.15.80:0/2147245771 wait complete. 2024-02-13T00:30:46.618 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:46 smithi080 bash[17386]: audit 2024-02-13T00:30:46.280808+0000 mon.a (mon.0) 648 : audit [DBG] from='client.? 172.21.15.80:0/2147245771' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-13T00:30:46.619 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:46 smithi080 bash[24237]: audit 2024-02-13T00:30:46.280808+0000 mon.a (mon.0) 648 : audit [DBG] from='client.? 172.21.15.80:0/2147245771' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-13T00:30:46.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:46 smithi106 bash[18459]: audit 2024-02-13T00:30:46.280808+0000 mon.a (mon.0) 648 : audit [DBG] from='client.? 172.21.15.80:0/2147245771' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-13T00:30:47.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:47 smithi106 bash[18459]: cluster 2024-02-13T00:30:46.665240+0000 mgr.y (mgr.24461) 33 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:30:47.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:30:47 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:30:47.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:47 smithi080 bash[24237]: cluster 2024-02-13T00:30:46.665240+0000 mgr.y (mgr.24461) 33 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:30:47.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:47 smithi080 bash[17386]: cluster 2024-02-13T00:30:46.665240+0000 mgr.y (mgr.24461) 33 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:30:47.787 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-13T00:26:05.027899+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'iscsi', 'create_time': '2024-02-13T00:29:49.451980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': '.rgw.root', 'create_time': '2024-02-13T00:29:50.696517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 4, 'pool_name': 'default.rgw.log', 'create_time': '2024-02-13T00:29:52.576333+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'default.rgw.control', 'create_time': '2024-02-13T00:29:54.338868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'default.rgw.meta', 'create_time': '2024-02-13T00:29:56.456209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}}] 2024-02-13T00:30:47.788 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph osd pool get device_health_metrics pg_num 2024-02-13T00:30:48.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:48 smithi106 bash[18459]: audit 2024-02-13T00:30:47.681791+0000 mgr.y (mgr.24461) 34 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:30:48.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:48 smithi080 bash[17386]: audit 2024-02-13T00:30:47.681791+0000 mgr.y (mgr.24461) 34 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:30:48.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:48 smithi080 bash[24237]: audit 2024-02-13T00:30:47.681791+0000 mgr.y (mgr.24461) 34 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:30:49.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:49 smithi106 bash[18459]: cluster 2024-02-13T00:30:48.665943+0000 mgr.y (mgr.24461) 35 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:30:49.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:49 smithi080 bash[17386]: cluster 2024-02-13T00:30:48.665943+0000 mgr.y (mgr.24461) 35 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:30:49.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:49 smithi080 bash[24237]: cluster 2024-02-13T00:30:48.665943+0000 mgr.y (mgr.24461) 35 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:30:50.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:30:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:30:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:30:51.185 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:30:51 smithi080 systemd[1]: Started Ceph alertmanager.a for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:30:51.447 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:51 smithi080 bash[17652]: [13/Feb/2024:00:30:51] ENGINE Bus STOPPING 2024-02-13T00:30:51.447 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:51 smithi080 bash[17652]: [13/Feb/2024:00:30:51] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-13T00:30:51.447 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:51 smithi080 bash[17652]: [13/Feb/2024:00:30:51] ENGINE Bus STOPPED 2024-02-13T00:30:51.447 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:51 smithi080 bash[17652]: [13/Feb/2024:00:30:51] ENGINE Bus STARTING 2024-02-13T00:30:51.447 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:51 smithi080 bash[17652]: [13/Feb/2024:00:30:51] ENGINE Serving on http://:::9283 2024-02-13T00:30:51.729 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:51 smithi080 bash[17652]: [13/Feb/2024:00:30:51] ENGINE Bus STARTED 2024-02-13T00:30:52.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:51 smithi106 bash[18459]: cluster 2024-02-13T00:30:50.666362+0000 mgr.y (mgr.24461) 36 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:30:52.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:51 smithi106 bash[18459]: audit 2024-02-13T00:30:51.112925+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:52.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:51 smithi106 bash[18459]: audit 2024-02-13T00:30:51.297603+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:52.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:51 smithi106 bash[18459]: audit 2024-02-13T00:30:51.304852+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:52.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:51 smithi106 bash[18459]: audit 2024-02-13T00:30:51.310202+0000 mon.c (mon.2) 38 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-13T00:30:52.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:51 smithi106 bash[18459]: audit 2024-02-13T00:30:51.315811+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:52.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:51 smithi080 bash[17386]: cluster 2024-02-13T00:30:50.666362+0000 mgr.y (mgr.24461) 36 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:30:52.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:51 smithi080 bash[17386]: audit 2024-02-13T00:30:51.112925+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:52.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:51 smithi080 bash[17386]: audit 2024-02-13T00:30:51.297603+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:52.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:51 smithi080 bash[17386]: audit 2024-02-13T00:30:51.304852+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:52.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:51 smithi080 bash[17386]: audit 2024-02-13T00:30:51.310202+0000 mon.c (mon.2) 38 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-13T00:30:52.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:51 smithi080 bash[17386]: audit 2024-02-13T00:30:51.315811+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:52.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:51 smithi080 bash[24237]: cluster 2024-02-13T00:30:50.666362+0000 mgr.y (mgr.24461) 36 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:30:52.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:51 smithi080 bash[24237]: audit 2024-02-13T00:30:51.112925+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:52.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:51 smithi080 bash[24237]: audit 2024-02-13T00:30:51.297603+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:52.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:51 smithi080 bash[24237]: audit 2024-02-13T00:30:51.304852+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:52.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:51 smithi080 bash[24237]: audit 2024-02-13T00:30:51.310202+0000 mon.c (mon.2) 38 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-13T00:30:52.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:51 smithi080 bash[24237]: audit 2024-02-13T00:30:51.315811+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:52.509 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:30:52 smithi080 bash[46566]: level=info ts=2024-02-13T00:30:52.244Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-02-13T00:30:52.510 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:30:52 smithi080 bash[46566]: level=info ts=2024-02-13T00:30:52.244Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-02-13T00:30:52.510 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:30:52 smithi080 bash[46566]: level=info ts=2024-02-13T00:30:52.247Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.80 port=9094 2024-02-13T00:30:52.510 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:30:52 smithi080 bash[46566]: level=info ts=2024-02-13T00:30:52.249Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-02-13T00:30:52.510 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:30:52 smithi080 bash[46566]: level=info ts=2024-02-13T00:30:52.298Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-13T00:30:52.510 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:30:52 smithi080 bash[46566]: level=info ts=2024-02-13T00:30:52.299Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-13T00:30:52.510 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:30:52 smithi080 bash[46566]: level=info ts=2024-02-13T00:30:52.303Z caller=main.go:518 msg=Listening address=:9093 2024-02-13T00:30:52.510 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:30:52 smithi080 bash[46566]: level=info ts=2024-02-13T00:30:52.303Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-02-13T00:30:53.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:52 smithi106 bash[18459]: audit 2024-02-13T00:30:51.310785+0000 mgr.y (mgr.24461) 37 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-13T00:30:53.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:52 smithi106 bash[18459]: cephadm 2024-02-13T00:30:51.334763+0000 mgr.y (mgr.24461) 38 : cephadm [INF] Deploying daemon grafana.a on smithi106 2024-02-13T00:30:53.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:52 smithi106 bash[18459]: audit 2024-02-13T00:30:51.920921+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:53.258 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:30:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:30:53] "GET /metrics HTTP/1.1" 200 172191 "" "Prometheus/2.33.4" 2024-02-13T00:30:53.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:52 smithi080 bash[17386]: audit 2024-02-13T00:30:51.310785+0000 mgr.y (mgr.24461) 37 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-13T00:30:53.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:52 smithi080 bash[17386]: cephadm 2024-02-13T00:30:51.334763+0000 mgr.y (mgr.24461) 38 : cephadm [INF] Deploying daemon grafana.a on smithi106 2024-02-13T00:30:53.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:52 smithi080 bash[17386]: audit 2024-02-13T00:30:51.920921+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:53.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:52 smithi080 bash[24237]: audit 2024-02-13T00:30:51.310785+0000 mgr.y (mgr.24461) 37 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-13T00:30:53.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:52 smithi080 bash[24237]: cephadm 2024-02-13T00:30:51.334763+0000 mgr.y (mgr.24461) 38 : cephadm [INF] Deploying daemon grafana.a on smithi106 2024-02-13T00:30:53.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:52 smithi080 bash[24237]: audit 2024-02-13T00:30:51.920921+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:30:54.253 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:53 smithi080 bash[17386]: cluster 2024-02-13T00:30:52.667495+0000 mgr.y (mgr.24461) 39 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:30:54.253 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:53 smithi080 bash[24237]: cluster 2024-02-13T00:30:52.667495+0000 mgr.y (mgr.24461) 39 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:30:54.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:53 smithi106 bash[18459]: cluster 2024-02-13T00:30:52.667495+0000 mgr.y (mgr.24461) 39 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:30:54.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:30:54 smithi080 bash[46566]: level=info ts=2024-02-13T00:30:54.249Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000453056s 2024-02-13T00:30:54.622 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:30:55.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:55 smithi106 bash[18459]: cluster 2024-02-13T00:30:54.668164+0000 mgr.y (mgr.24461) 40 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:30:55.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:55 smithi080 bash[24237]: cluster 2024-02-13T00:30:54.668164+0000 mgr.y (mgr.24461) 40 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:30:55.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:55 smithi080 bash[17386]: cluster 2024-02-13T00:30:54.668164+0000 mgr.y (mgr.24461) 40 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:30:57.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c2c859700 1 -- 172.21.15.80:0/3278009155 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c280fdc80 msgr2=0x7f3c280fe060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:57.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c2c859700 1 --2- 172.21.15.80:0/3278009155 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c280fdc80 0x7f3c280fe060 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3c18004870 tx=0x7f3c18009cb0).stop 2024-02-13T00:30:57.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c2c859700 1 -- 172.21.15.80:0/3278009155 shutdown_connections 2024-02-13T00:30:57.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c2c859700 1 --2- 172.21.15.80:0/3278009155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c280f84f0 0x7f3c28104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:57.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c2c859700 1 --2- 172.21.15.80:0/3278009155 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c280fdc80 0x7f3c280fe060 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:57.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c2c859700 1 --2- 172.21.15.80:0/3278009155 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c280fe5e0 0x7f3c280f7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:57.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c2c859700 1 -- 172.21.15.80:0/3278009155 >> 172.21.15.80:0/3278009155 conn(0x7f3c280f38d0 msgr2=0x7f3c280f5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:30:57.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c2c859700 1 -- 172.21.15.80:0/3278009155 shutdown_connections 2024-02-13T00:30:57.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c2c859700 1 -- 172.21.15.80:0/3278009155 wait complete. 2024-02-13T00:30:57.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c2c859700 1 Processor -- start 2024-02-13T00:30:57.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c2c859700 1 -- start start 2024-02-13T00:30:57.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c2c859700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c280f84f0 0x7f3c2810df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:57.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c2c859700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c280fdc80 0x7f3c2810e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:57.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c2c859700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c280fe5e0 0x7f3c28108180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:57.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c2c859700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c28108670 con 0x7f3c280fe5e0 2024-02-13T00:30:57.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c2c859700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c281087e0 con 0x7f3c280f84f0 2024-02-13T00:30:57.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c2c859700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c281089a0 con 0x7f3c280fdc80 2024-02-13T00:30:57.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c26d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c280fe5e0 0x7f3c28108180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:57.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c25d9b700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c280fdc80 0x7f3c2810e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:57.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c26d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c280fe5e0 0x7f3c28108180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52420/0 (socket says 172.21.15.80:52420) 2024-02-13T00:30:57.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c26d9d700 1 -- 172.21.15.80:0/2851734527 learned_addr learned my addr 172.21.15.80:0/2851734527 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:30:57.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c2659c700 1 --2- 172.21.15.80:0/2851734527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c280f84f0 0x7f3c2810df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:57.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c26d9d700 1 -- 172.21.15.80:0/2851734527 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c280fdc80 msgr2=0x7f3c2810e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:57.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c26d9d700 1 --2- 172.21.15.80:0/2851734527 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c280fdc80 0x7f3c2810e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:57.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c26d9d700 1 -- 172.21.15.80:0/2851734527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c280f84f0 msgr2=0x7f3c2810df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:57.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c26d9d700 1 --2- 172.21.15.80:0/2851734527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c280f84f0 0x7f3c2810df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:57.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.454+0000 7f3c26d9d700 1 -- 172.21.15.80:0/2851734527 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c005040 con 0x7f3c280fe5e0 2024-02-13T00:30:57.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.458+0000 7f3c26d9d700 1 --2- 172.21.15.80:0/2851734527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c280fe5e0 0x7f3c28108180 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f3c2000ec20 tx=0x7f3c2000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:30:57.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.458+0000 7f3c177fe700 1 -- 172.21.15.80:0/2851734527 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c20009950 con 0x7f3c280fe5e0 2024-02-13T00:30:57.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.458+0000 7f3c177fe700 1 -- 172.21.15.80:0/2851734527 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f3c2000f040 con 0x7f3c280fe5e0 2024-02-13T00:30:57.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.458+0000 7f3c2c859700 1 -- 172.21.15.80:0/2851734527 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c18005040 con 0x7f3c280fe5e0 2024-02-13T00:30:57.464 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.458+0000 7f3c177fe700 1 -- 172.21.15.80:0/2851734527 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c20007d20 con 0x7f3c280fe5e0 2024-02-13T00:30:57.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.458+0000 7f3c2c859700 1 -- 172.21.15.80:0/2851734527 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c28108f80 con 0x7f3c280fe5e0 2024-02-13T00:30:57.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.458+0000 7f3c2c859700 1 -- 172.21.15.80:0/2851734527 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c28060760 con 0x7f3c280fe5e0 2024-02-13T00:30:57.465 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.458+0000 7f3c177fe700 1 -- 172.21.15.80:0/2851734527 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f3c200092e0 con 0x7f3c280fe5e0 2024-02-13T00:30:57.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.458+0000 7f3c177fe700 1 --2- 172.21.15.80:0/2851734527 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f3c10061340 0x7f3c10063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:30:57.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.458+0000 7f3c177fe700 1 -- 172.21.15.80:0/2851734527 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f3c2007cb80 con 0x7f3c280fe5e0 2024-02-13T00:30:57.466 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.458+0000 7f3c2659c700 1 --2- 172.21.15.80:0/2851734527 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f3c10061340 0x7f3c10063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:30:57.467 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.462+0000 7f3c2659c700 1 --2- 172.21.15.80:0/2851734527 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f3c10061340 0x7f3c10063800 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f3c18005010 tx=0x7f3c1800b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:30:57.472 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.466+0000 7f3c177fe700 1 -- 172.21.15.80:0/2851734527 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3c20049f60 con 0x7f3c280fe5e0 2024-02-13T00:30:57.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.642+0000 7f3c2c859700 1 -- 172.21.15.80:0/2851734527 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3c28109610 con 0x7f3c280fe5e0 2024-02-13T00:30:57.650 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.642+0000 7f3c177fe700 1 -- 172.21.15.80:0/2851734527 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v63) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3c2004c9c0 con 0x7f3c280fe5e0 2024-02-13T00:30:57.650 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 1 2024-02-13T00:30:57.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.646+0000 7f3c2c859700 1 -- 172.21.15.80:0/2851734527 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f3c10061340 msgr2=0x7f3c10063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:57.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.646+0000 7f3c2c859700 1 --2- 172.21.15.80:0/2851734527 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f3c10061340 0x7f3c10063800 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f3c18005010 tx=0x7f3c1800b040).stop 2024-02-13T00:30:57.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.646+0000 7f3c2c859700 1 -- 172.21.15.80:0/2851734527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c280fe5e0 msgr2=0x7f3c28108180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:30:57.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.646+0000 7f3c2c859700 1 --2- 172.21.15.80:0/2851734527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c280fe5e0 0x7f3c28108180 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f3c2000ec20 tx=0x7f3c2000b040).stop 2024-02-13T00:30:57.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.646+0000 7f3c2c859700 1 -- 172.21.15.80:0/2851734527 shutdown_connections 2024-02-13T00:30:57.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.646+0000 7f3c2c859700 1 --2- 172.21.15.80:0/2851734527 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f3c10061340 0x7f3c10063800 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:57.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.646+0000 7f3c2c859700 1 --2- 172.21.15.80:0/2851734527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c280f84f0 0x7f3c2810df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:57.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.646+0000 7f3c2c859700 1 --2- 172.21.15.80:0/2851734527 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f3c280fe5e0 0x7f3c28108180 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:57.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.646+0000 7f3c2c859700 1 --2- 172.21.15.80:0/2851734527 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f3c280fdc80 0x7f3c2810e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:30:57.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.646+0000 7f3c2c859700 1 -- 172.21.15.80:0/2851734527 >> 172.21.15.80:0/2851734527 conn(0x7f3c280f38d0 msgr2=0x7f3c280fbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:30:57.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.646+0000 7f3c2c859700 1 -- 172.21.15.80:0/2851734527 shutdown_connections 2024-02-13T00:30:57.654 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:30:57.646+0000 7f3c2c859700 1 -- 172.21.15.80:0/2851734527 wait complete. 2024-02-13T00:30:58.007 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:30:57 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:30:58.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:57 smithi106 bash[18459]: cluster 2024-02-13T00:30:56.668940+0000 mgr.y (mgr.24461) 41 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T00:30:58.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:57 smithi106 bash[18459]: audit 2024-02-13T00:30:57.647391+0000 mon.a (mon.0) 654 : audit [DBG] from='client.? 172.21.15.80:0/2851734527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-13T00:30:58.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:57 smithi080 bash[24237]: cluster 2024-02-13T00:30:56.668940+0000 mgr.y (mgr.24461) 41 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T00:30:58.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:57 smithi080 bash[24237]: audit 2024-02-13T00:30:57.647391+0000 mon.a (mon.0) 654 : audit [DBG] from='client.? 172.21.15.80:0/2851734527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-13T00:30:58.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:57 smithi080 bash[17386]: cluster 2024-02-13T00:30:56.668940+0000 mgr.y (mgr.24461) 41 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T00:30:58.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:57 smithi080 bash[17386]: audit 2024-02-13T00:30:57.647391+0000 mon.a (mon.0) 654 : audit [DBG] from='client.? 172.21.15.80:0/2851734527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-13T00:30:58.404 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph osd pool get iscsi pg_num 2024-02-13T00:30:59.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:58 smithi106 bash[18459]: audit 2024-02-13T00:30:57.692687+0000 mgr.y (mgr.24461) 42 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:30:59.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:58 smithi080 bash[17386]: audit 2024-02-13T00:30:57.692687+0000 mgr.y (mgr.24461) 42 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:30:59.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:58 smithi080 bash[24237]: audit 2024-02-13T00:30:57.692687+0000 mgr.y (mgr.24461) 42 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:31:00.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:30:59 smithi106 bash[18459]: cluster 2024-02-13T00:30:58.670380+0000 mgr.y (mgr.24461) 43 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:00.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:30:59 smithi080 bash[17386]: cluster 2024-02-13T00:30:58.670380+0000 mgr.y (mgr.24461) 43 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:00.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:30:59 smithi080 bash[24237]: cluster 2024-02-13T00:30:58.670380+0000 mgr.y (mgr.24461) 43 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:00.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:31:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:31:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:31:02.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:01 smithi106 bash[18459]: cluster 2024-02-13T00:31:00.671094+0000 mgr.y (mgr.24461) 44 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:01 smithi080 bash[17386]: cluster 2024-02-13T00:31:00.671094+0000 mgr.y (mgr.24461) 44 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:02.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:01 smithi080 bash[24237]: cluster 2024-02-13T00:31:00.671094+0000 mgr.y (mgr.24461) 44 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:02.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:31:02 smithi080 bash[46566]: level=info ts=2024-02-13T00:31:02.253Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.003860751s 2024-02-13T00:31:03.183 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:31:03.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:31:03] "GET /metrics HTTP/1.1" 200 172187 "" "Prometheus/2.33.4" 2024-02-13T00:31:04.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:03 smithi106 bash[18459]: cluster 2024-02-13T00:31:02.672018+0000 mgr.y (mgr.24461) 45 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:04.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:03 smithi080 bash[17386]: cluster 2024-02-13T00:31:02.672018+0000 mgr.y (mgr.24461) 45 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:04.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:03 smithi080 bash[24237]: cluster 2024-02-13T00:31:02.672018+0000 mgr.y (mgr.24461) 45 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:05.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:05 smithi106 bash[18459]: cluster 2024-02-13T00:31:04.672747+0000 mgr.y (mgr.24461) 46 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:05.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:05 smithi080 bash[17386]: cluster 2024-02-13T00:31:04.672747+0000 mgr.y (mgr.24461) 46 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:05.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:05 smithi080 bash[24237]: cluster 2024-02-13T00:31:04.672747+0000 mgr.y (mgr.24461) 46 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:06.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.026+0000 7f68c017c700 1 -- 172.21.15.80:0/2690166625 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f68b80f6870 msgr2=0x7f68b8104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:06.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.026+0000 7f68c017c700 1 --2- 172.21.15.80:0/2690166625 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f68b80f6870 0x7f68b8104b80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f68b0009be0 tx=0x7f68b0004d10).stop 2024-02-13T00:31:06.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.026+0000 7f68c017c700 1 -- 172.21.15.80:0/2690166625 shutdown_connections 2024-02-13T00:31:06.033 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.026+0000 7f68c017c700 1 --2- 172.21.15.80:0/2690166625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68b80fdd80 0x7f68b80fe160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:06.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.026+0000 7f68c017c700 1 --2- 172.21.15.80:0/2690166625 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f68b80f6870 0x7f68b8104b80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:06.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.026+0000 7f68c017c700 1 --2- 172.21.15.80:0/2690166625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68b80fe6e0 0x7f68b80f6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:06.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.026+0000 7f68c017c700 1 -- 172.21.15.80:0/2690166625 >> 172.21.15.80:0/2690166625 conn(0x7f68b8070100 msgr2=0x7f68b80f44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:31:06.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.026+0000 7f68c017c700 1 -- 172.21.15.80:0/2690166625 shutdown_connections 2024-02-13T00:31:06.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.026+0000 7f68c017c700 1 -- 172.21.15.80:0/2690166625 wait complete. 2024-02-13T00:31:06.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.026+0000 7f68c017c700 1 Processor -- start 2024-02-13T00:31:06.034 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.026+0000 7f68c017c700 1 -- start start 2024-02-13T00:31:06.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.026+0000 7f68c017c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68b80f6870 0x7f68b810dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:06.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68c017c700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f68b80fdd80 0x7f68b810e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:06.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68c017c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68b80fe6e0 0x7f68b8108060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:06.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68c017c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b8108550 con 0x7f68b80f6870 2024-02-13T00:31:06.035 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68bdf18700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68b80f6870 0x7f68b810dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:06.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68bdf18700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68b80f6870 0x7f68b810dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:50460/0 (socket says 172.21.15.80:50460) 2024-02-13T00:31:06.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68bdf18700 1 -- 172.21.15.80:0/3829104189 learned_addr learned my addr 172.21.15.80:0/3829104189 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:31:06.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68bd717700 1 --2- 172.21.15.80:0/3829104189 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f68b80fdd80 0x7f68b810e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:06.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68c017c700 1 -- 172.21.15.80:0/3829104189 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b81086c0 con 0x7f68b80fe6e0 2024-02-13T00:31:06.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68c017c700 1 -- 172.21.15.80:0/3829104189 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b8108880 con 0x7f68b80fdd80 2024-02-13T00:31:06.036 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68be719700 1 --2- 172.21.15.80:0/3829104189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68b80fe6e0 0x7f68b8108060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:06.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68bdf18700 1 -- 172.21.15.80:0/3829104189 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f68b80fdd80 msgr2=0x7f68b810e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:06.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68bdf18700 1 --2- 172.21.15.80:0/3829104189 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f68b80fdd80 0x7f68b810e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:06.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68bdf18700 1 -- 172.21.15.80:0/3829104189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68b80fe6e0 msgr2=0x7f68b8108060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:06.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68bdf18700 1 --2- 172.21.15.80:0/3829104189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68b80fe6e0 0x7f68b8108060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:06.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68bdf18700 1 -- 172.21.15.80:0/3829104189 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b00097c0 con 0x7f68b80f6870 2024-02-13T00:31:06.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68be719700 1 --2- 172.21.15.80:0/3829104189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68b80fe6e0 0x7f68b8108060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:31:06.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68bdf18700 1 --2- 172.21.15.80:0/3829104189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68b80f6870 0x7f68b810dec0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f68b40041d0 tx=0x7f68b4009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:31:06.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68aeffd700 1 -- 172.21.15.80:0/3829104189 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b4007b40 con 0x7f68b80f6870 2024-02-13T00:31:06.037 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68aeffd700 1 -- 172.21.15.80:0/3829104189 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f68b400f040 con 0x7f68b80f6870 2024-02-13T00:31:06.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68aeffd700 1 -- 172.21.15.80:0/3829104189 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b4014690 con 0x7f68b80f6870 2024-02-13T00:31:06.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68c017c700 1 -- 172.21.15.80:0/3829104189 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b8108b60 con 0x7f68b80f6870 2024-02-13T00:31:06.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68c017c700 1 -- 172.21.15.80:0/3829104189 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b8114cf0 con 0x7f68b80f6870 2024-02-13T00:31:06.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68c017c700 1 -- 172.21.15.80:0/3829104189 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b805f9d0 con 0x7f68b80f6870 2024-02-13T00:31:06.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68aeffd700 1 -- 172.21.15.80:0/3829104189 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f68b4009110 con 0x7f68b80f6870 2024-02-13T00:31:06.038 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.030+0000 7f68aeffd700 1 --2- 172.21.15.80:0/3829104189 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f68a4061340 0x7f68a4063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:06.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.034+0000 7f68aeffd700 1 -- 172.21.15.80:0/3829104189 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f68b407cea0 con 0x7f68b80f6870 2024-02-13T00:31:06.039 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.034+0000 7f68bd717700 1 --2- 172.21.15.80:0/3829104189 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f68a4061340 0x7f68a4063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:06.040 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.034+0000 7f68bd717700 1 --2- 172.21.15.80:0/3829104189 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f68a4061340 0x7f68a4063800 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f68b8109800 tx=0x7f68a800b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:31:06.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.038+0000 7f68aeffd700 1 -- 172.21.15.80:0/3829104189 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f68b404cce0 con 0x7f68b80f6870 2024-02-13T00:31:06.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.222+0000 7f68c017c700 1 -- 172.21.15.80:0/3829104189 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"} v 0) v1 -- 0x7f68b8109540 con 0x7f68b80f6870 2024-02-13T00:31:06.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.222+0000 7f68aeffd700 1 -- 172.21.15.80:0/3829104189 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]=0 v63) v1 ==== 94+0+10 (secure 0 0 0) 0x7f68b4050300 con 0x7f68b80f6870 2024-02-13T00:31:06.230 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 3 2024-02-13T00:31:06.233 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.226+0000 7f68c017c700 1 -- 172.21.15.80:0/3829104189 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f68a4061340 msgr2=0x7f68a4063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:06.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.226+0000 7f68c017c700 1 --2- 172.21.15.80:0/3829104189 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f68a4061340 0x7f68a4063800 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f68b8109800 tx=0x7f68a800b040).stop 2024-02-13T00:31:06.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.226+0000 7f68c017c700 1 -- 172.21.15.80:0/3829104189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68b80f6870 msgr2=0x7f68b810dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:06.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.226+0000 7f68c017c700 1 --2- 172.21.15.80:0/3829104189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68b80f6870 0x7f68b810dec0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f68b40041d0 tx=0x7f68b4009f60).stop 2024-02-13T00:31:06.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.226+0000 7f68c017c700 1 -- 172.21.15.80:0/3829104189 shutdown_connections 2024-02-13T00:31:06.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.226+0000 7f68c017c700 1 --2- 172.21.15.80:0/3829104189 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f68a4061340 0x7f68a4063800 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:06.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.226+0000 7f68c017c700 1 --2- 172.21.15.80:0/3829104189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68b80fe6e0 0x7f68b8108060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:06.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.226+0000 7f68c017c700 1 --2- 172.21.15.80:0/3829104189 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f68b80f6870 0x7f68b810dec0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:06.234 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.226+0000 7f68c017c700 1 --2- 172.21.15.80:0/3829104189 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f68b80fdd80 0x7f68b810e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:06.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.226+0000 7f68c017c700 1 -- 172.21.15.80:0/3829104189 >> 172.21.15.80:0/3829104189 conn(0x7f68b8070100 msgr2=0x7f68b806c470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:31:06.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.226+0000 7f68c017c700 1 -- 172.21.15.80:0/3829104189 shutdown_connections 2024-02-13T00:31:06.235 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:06.226+0000 7f68c017c700 1 -- 172.21.15.80:0/3829104189 wait complete. 2024-02-13T00:31:06.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:06 smithi106 bash[18459]: audit 2024-02-13T00:31:06.227221+0000 mon.a (mon.0) 655 : audit [DBG] from='client.? 172.21.15.80:0/3829104189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2024-02-13T00:31:06.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:06 smithi080 bash[17386]: audit 2024-02-13T00:31:06.227221+0000 mon.a (mon.0) 655 : audit [DBG] from='client.? 172.21.15.80:0/3829104189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2024-02-13T00:31:06.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:06 smithi080 bash[24237]: audit 2024-02-13T00:31:06.227221+0000 mon.a (mon.0) 655 : audit [DBG] from='client.? 172.21.15.80:0/3829104189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2024-02-13T00:31:07.058 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph osd pool get .rgw.root pg_num 2024-02-13T00:31:08.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:07 smithi106 bash[18459]: cluster 2024-02-13T00:31:06.673220+0000 mgr.y (mgr.24461) 47 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:08.005 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:31:07 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:31:08.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:07 smithi080 bash[17386]: cluster 2024-02-13T00:31:06.673220+0000 mgr.y (mgr.24461) 47 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:08.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:07 smithi080 bash[24237]: cluster 2024-02-13T00:31:06.673220+0000 mgr.y (mgr.24461) 47 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:09.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:08 smithi106 bash[18459]: audit 2024-02-13T00:31:07.701611+0000 mgr.y (mgr.24461) 48 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:31:09.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:08 smithi080 bash[17386]: audit 2024-02-13T00:31:07.701611+0000 mgr.y (mgr.24461) 48 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:31:09.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:08 smithi080 bash[24237]: audit 2024-02-13T00:31:07.701611+0000 mgr.y (mgr.24461) 48 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:31:09.838 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:09 smithi106 bash[18459]: cluster 2024-02-13T00:31:08.674598+0000 mgr.y (mgr.24461) 49 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:10.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:09 smithi080 bash[17386]: cluster 2024-02-13T00:31:08.674598+0000 mgr.y (mgr.24461) 49 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:10.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:09 smithi080 bash[24237]: cluster 2024-02-13T00:31:08.674598+0000 mgr.y (mgr.24461) 49 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:10.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:31:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:31:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:31:11.835 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:31:11.862 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:11 smithi106 bash[18459]: cluster 2024-02-13T00:31:10.675262+0000 mgr.y (mgr.24461) 50 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:12.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:11 smithi080 bash[17386]: cluster 2024-02-13T00:31:10.675262+0000 mgr.y (mgr.24461) 50 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:12.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:11 smithi080 bash[24237]: cluster 2024-02-13T00:31:10.675262+0000 mgr.y (mgr.24461) 50 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:13.255 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:12 smithi106 systemd[1]: Started Ceph grafana.a for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:31:13.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:31:13] "GET /metrics HTTP/1.1" 200 172187 "" "Prometheus/2.33.4" 2024-02-13T00:31:14.181 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:13 smithi106 bash[18459]: cluster 2024-02-13T00:31:12.676567+0000 mgr.y (mgr.24461) 51 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:14.181 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:13 smithi106 bash[18459]: audit 2024-02-13T00:31:12.951727+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:14.181 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:13 smithi106 bash[18459]: audit 2024-02-13T00:31:12.955121+0000 mon.c (mon.2) 39 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:31:14.182 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrations" logger=settings 2024-02-13T00:31:14.182 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alerting` section if Grafana 8 alerts are enabled." logger=settings 2024-02-13T00:31:14.182 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2024-02-13T00:31:14.182 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2024-02-13T00:31:14.182 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2024-02-13T00:31:14.182 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2024-02-13T00:31:14.182 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-02-13T00:31:14.182 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-02-13T00:31:14.182 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2024-02-13T00:31:14.182 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2024-02-13T00:31:14.182 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2024-02-13T00:31:14.182 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2024-02-13T00:31:14.182 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2024-02-13T00:31:14.183 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="App mode production" logger=settings 2024-02-13T00:31:14.183 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2024-02-13T00:31:14.183 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=warn msg="SQLite database file has broader permissions than it should" logger=sqlstore path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-02-13T00:31:14.183 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Starting DB migrations" logger=migrator 2024-02-13T00:31:14.183 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2024-02-13T00:31:14.183 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2024-02-13T00:31:14.183 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2024-02-13T00:31:14.183 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2024-02-13T00:31:14.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:13 smithi080 bash[17386]: cluster 2024-02-13T00:31:12.676567+0000 mgr.y (mgr.24461) 51 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:14.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:13 smithi080 bash[17386]: audit 2024-02-13T00:31:12.951727+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:14.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:13 smithi080 bash[17386]: audit 2024-02-13T00:31:12.955121+0000 mon.c (mon.2) 39 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:31:14.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:13 smithi080 bash[24237]: cluster 2024-02-13T00:31:12.676567+0000 mgr.y (mgr.24461) 51 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:14.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:13 smithi080 bash[24237]: audit 2024-02-13T00:31:12.951727+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:14.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:13 smithi080 bash[24237]: audit 2024-02-13T00:31:12.955121+0000 mon.c (mon.2) 39 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:31:14.450 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2024-02-13T00:31:14.451 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2024-02-13T00:31:14.451 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2024-02-13T00:31:14.451 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2024-02-13T00:31:14.451 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2024-02-13T00:31:14.451 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2024-02-13T00:31:14.451 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-02-13T00:31:14.451 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2024-02-13T00:31:14.451 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2024-02-13T00:31:14.451 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2024-02-13T00:31:14.711 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2024-02-13T00:31:14.711 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2024-02-13T00:31:14.712 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2024-02-13T00:31:14.712 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="Add index user.login/user.email" 2024-02-13T00:31:14.712 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_service_account column to user" 2024-02-13T00:31:14.712 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2024-02-13T00:31:14.712 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2024-02-13T00:31:14.712 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2024-02-13T00:31:14.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.714+0000 7f805721e700 1 -- 172.21.15.80:0/3180935090 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f80501021d0 msgr2=0x7f80501045c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:14.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.714+0000 7f805721e700 1 --2- 172.21.15.80:0/3180935090 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f80501021d0 0x7f80501045c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f8048009c30 tx=0x7f8048004c50).stop 2024-02-13T00:31:14.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.714+0000 7f805721e700 1 -- 172.21.15.80:0/3180935090 shutdown_connections 2024-02-13T00:31:14.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.714+0000 7f805721e700 1 --2- 172.21.15.80:0/3180935090 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f80501021d0 0x7f80501045c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:14.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.714+0000 7f805721e700 1 --2- 172.21.15.80:0/3180935090 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80500f8c70 0x7f80500f9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:14.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.714+0000 7f805721e700 1 --2- 172.21.15.80:0/3180935090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80500f95d0 0x7f8050101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:14.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.714+0000 7f805721e700 1 -- 172.21.15.80:0/3180935090 >> 172.21.15.80:0/3180935090 conn(0x7f80500f27a0 msgr2=0x7f80500f4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:31:14.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.714+0000 7f805721e700 1 -- 172.21.15.80:0/3180935090 shutdown_connections 2024-02-13T00:31:14.723 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.714+0000 7f805721e700 1 -- 172.21.15.80:0/3180935090 wait complete. 2024-02-13T00:31:14.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f805721e700 1 Processor -- start 2024-02-13T00:31:14.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f805721e700 1 -- start start 2024-02-13T00:31:14.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f805721e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80500f8c70 0x7f805010dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:14.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f805721e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80500f95d0 0x7f805010e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:14.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f805721e700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f80501021d0 0x7f8050107fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:14.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f805721e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8050108490 con 0x7f80500f95d0 2024-02-13T00:31:14.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f805721e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8050108600 con 0x7f80500f8c70 2024-02-13T00:31:14.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f805721e700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8050108770 con 0x7f80501021d0 2024-02-13T00:31:14.724 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f80557bb700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f80501021d0 0x7f8050107fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:14.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f804ffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80500f95d0 0x7f805010e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:14.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f80557bb700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f80501021d0 0x7f8050107fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:58232/0 (socket says 172.21.15.80:58232) 2024-02-13T00:31:14.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f80557bb700 1 -- 172.21.15.80:0/2634655752 learned_addr learned my addr 172.21.15.80:0/2634655752 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:31:14.725 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f8054fba700 1 --2- 172.21.15.80:0/2634655752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80500f8c70 0x7f805010dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:14.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f80557bb700 1 -- 172.21.15.80:0/2634655752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80500f8c70 msgr2=0x7f805010dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:14.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f80557bb700 1 --2- 172.21.15.80:0/2634655752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80500f8c70 0x7f805010dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:14.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f80557bb700 1 -- 172.21.15.80:0/2634655752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80500f95d0 msgr2=0x7f805010e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:14.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f80557bb700 1 --2- 172.21.15.80:0/2634655752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80500f95d0 0x7f805010e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:14.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f80557bb700 1 -- 172.21.15.80:0/2634655752 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80480097c0 con 0x7f80501021d0 2024-02-13T00:31:14.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f804ffff700 1 --2- 172.21.15.80:0/2634655752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80500f95d0 0x7f805010e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:31:14.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f80557bb700 1 --2- 172.21.15.80:0/2634655752 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f80501021d0 0x7f8050107fa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8048009610 tx=0x7f8048004c50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:31:14.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f804dffb700 1 -- 172.21.15.80:0/2634655752 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804800e040 con 0x7f80501021d0 2024-02-13T00:31:14.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f805721e700 1 -- 172.21.15.80:0/2634655752 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80501089f0 con 0x7f80501021d0 2024-02-13T00:31:14.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f804dffb700 1 -- 172.21.15.80:0/2634655752 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f8048018040 con 0x7f80501021d0 2024-02-13T00:31:14.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f804dffb700 1 -- 172.21.15.80:0/2634655752 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804801d400 con 0x7f80501021d0 2024-02-13T00:31:14.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.718+0000 7f805721e700 1 -- 172.21.15.80:0/2634655752 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8050114bc0 con 0x7f80501021d0 2024-02-13T00:31:14.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.722+0000 7f805721e700 1 -- 172.21.15.80:0/2634655752 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80500620e0 con 0x7f80501021d0 2024-02-13T00:31:14.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.722+0000 7f804dffb700 1 -- 172.21.15.80:0/2634655752 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f8048007c70 con 0x7f80501021d0 2024-02-13T00:31:14.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.722+0000 7f804dffb700 1 --2- 172.21.15.80:0/2634655752 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f8040061340 0x7f8040063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:14.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.722+0000 7f804dffb700 1 -- 172.21.15.80:0/2634655752 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f804807ea60 con 0x7f80501021d0 2024-02-13T00:31:14.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.722+0000 7f8054fba700 1 --2- 172.21.15.80:0/2634655752 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f8040061340 0x7f8040063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:14.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.722+0000 7f8054fba700 1 --2- 172.21.15.80:0/2634655752 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f8040061340 0x7f8040063800 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f8044009a00 tx=0x7f804400b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:31:14.735 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.730+0000 7f804dffb700 1 -- 172.21.15.80:0/2634655752 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f804804e7e0 con 0x7f80501021d0 2024-02-13T00:31:14.918 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.910+0000 7f805721e700 1 -- 172.21.15.80:0/2634655752 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"} v 0) v1 -- 0x7f8050106f60 con 0x7f80501021d0 2024-02-13T00:31:14.919 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.914+0000 7f804dffb700 1 -- 172.21.15.80:0/2634655752 <== mon.2 v2:172.21.15.80:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]=0 v63) v1 ==== 98+0+11 (secure 0 0 0) 0x7f8048051e00 con 0x7f80501021d0 2024-02-13T00:31:14.919 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-02-13T00:31:14.922 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.914+0000 7f805721e700 1 -- 172.21.15.80:0/2634655752 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f8040061340 msgr2=0x7f8040063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:14.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.914+0000 7f805721e700 1 --2- 172.21.15.80:0/2634655752 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f8040061340 0x7f8040063800 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f8044009a00 tx=0x7f804400b040).stop 2024-02-13T00:31:14.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.914+0000 7f805721e700 1 -- 172.21.15.80:0/2634655752 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f80501021d0 msgr2=0x7f8050107fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:14.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.914+0000 7f805721e700 1 --2- 172.21.15.80:0/2634655752 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f80501021d0 0x7f8050107fa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8048009610 tx=0x7f8048004c50).stop 2024-02-13T00:31:14.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.914+0000 7f805721e700 1 -- 172.21.15.80:0/2634655752 shutdown_connections 2024-02-13T00:31:14.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.914+0000 7f805721e700 1 --2- 172.21.15.80:0/2634655752 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f8040061340 0x7f8040063800 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:14.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.914+0000 7f805721e700 1 --2- 172.21.15.80:0/2634655752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80500f8c70 0x7f805010dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:14.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.914+0000 7f805721e700 1 --2- 172.21.15.80:0/2634655752 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f80501021d0 0x7f8050107fa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:14.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.914+0000 7f805721e700 1 --2- 172.21.15.80:0/2634655752 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f80500f95d0 0x7f805010e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:14.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.914+0000 7f805721e700 1 -- 172.21.15.80:0/2634655752 >> 172.21.15.80:0/2634655752 conn(0x7f80500f27a0 msgr2=0x7f80500f33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:31:14.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.918+0000 7f805721e700 1 -- 172.21.15.80:0/2634655752 shutdown_connections 2024-02-13T00:31:14.923 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:14.918+0000 7f805721e700 1 -- 172.21.15.80:0/2634655752 wait complete. 2024-02-13T00:31:14.996 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2024-02-13T00:31:14.997 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2024-02-13T00:31:14.997 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2024-02-13T00:31:14.997 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_email - v1" 2024-02-13T00:31:14.997 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_org_id - v1" 2024-02-13T00:31:14.997 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_code - v1" 2024-02-13T00:31:14.997 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_status - v1" 2024-02-13T00:31:15.255 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:14 smithi106 bash[41659]: t=2024-02-13T00:31:14+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-02-13T00:31:15.255 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="create temp_user v2" 2024-02-13T00:31:15.255 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v2" 2024-02-13T00:31:15.255 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v2" 2024-02-13T00:31:15.255 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v2" 2024-02-13T00:31:15.256 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v2" 2024-02-13T00:31:15.256 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="copy temp_user v1 to v2" 2024-02-13T00:31:15.256 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="drop temp_user_tmp_qwerty" 2024-02-13T00:31:15.256 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="Set created for temp users that will otherwise prematurely expire" 2024-02-13T00:31:15.535 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[18459]: cluster 2024-02-13T00:31:14.677318+0000 mgr.y (mgr.24461) 52 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:15.535 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[18459]: audit 2024-02-13T00:31:14.915984+0000 mon.c (mon.2) 40 : audit [DBG] from='client.? 172.21.15.80:0/2634655752' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2024-02-13T00:31:15.535 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2024-02-13T00:31:15.535 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2024-02-13T00:31:15.535 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2024-02-13T00:31:15.535 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2024-02-13T00:31:15.535 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2024-02-13T00:31:15.535 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2024-02-13T00:31:15.535 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2024-02-13T00:31:15.535 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_user_id - v1" 2024-02-13T00:31:15.746 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph osd pool get default.rgw.log pg_num 2024-02-13T00:31:15.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:15 smithi080 bash[17386]: cluster 2024-02-13T00:31:14.677318+0000 mgr.y (mgr.24461) 52 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:15.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:15 smithi080 bash[17386]: audit 2024-02-13T00:31:14.915984+0000 mon.c (mon.2) 40 : audit [DBG] from='client.? 172.21.15.80:0/2634655752' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2024-02-13T00:31:15.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:15 smithi080 bash[24237]: cluster 2024-02-13T00:31:14.677318+0000 mgr.y (mgr.24461) 52 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:15.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:15 smithi080 bash[24237]: audit 2024-02-13T00:31:14.915984+0000 mon.c (mon.2) 40 : audit [DBG] from='client.? 172.21.15.80:0/2634655752' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2024-02-13T00:31:15.804 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2024-02-13T00:31:15.804 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2024-02-13T00:31:15.804 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2024-02-13T00:31:15.804 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2024-02-13T00:31:15.804 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2024-02-13T00:31:15.804 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2024-02-13T00:31:15.804 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2024-02-13T00:31:15.804 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2024-02-13T00:31:15.804 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-02-13T00:31:16.064 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2024-02-13T00:31:16.064 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2024-02-13T00:31:16.064 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2024-02-13T00:31:16.064 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2024-02-13T00:31:16.064 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:15 smithi106 bash[41659]: t=2024-02-13T00:31:15+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2024-02-13T00:31:16.065 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2024-02-13T00:31:16.369 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2024-02-13T00:31:16.370 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2024-02-13T00:31:16.370 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2024-02-13T00:31:16.370 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2024-02-13T00:31:16.370 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2024-02-13T00:31:16.370 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2024-02-13T00:31:16.370 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2024-02-13T00:31:16.370 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2024-02-13T00:31:16.370 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2024-02-13T00:31:16.370 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2024-02-13T00:31:16.628 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2024-02-13T00:31:16.628 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2024-02-13T00:31:16.628 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2024-02-13T00:31:16.628 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2024-02-13T00:31:16.628 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2024-02-13T00:31:16.628 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2024-02-13T00:31:16.628 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2024-02-13T00:31:16.629 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2024-02-13T00:31:16.880 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2024-02-13T00:31:16.880 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2024-02-13T00:31:16.881 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-02-13T00:31:16.881 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2024-02-13T00:31:16.881 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-02-13T00:31:16.881 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-02-13T00:31:16.881 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2024-02-13T00:31:16.881 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2024-02-13T00:31:17.166 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2024-02-13T00:31:17.166 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:16 smithi106 bash[41659]: t=2024-02-13T00:31:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_title" 2024-02-13T00:31:17.166 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="delete tags for deleted dashboards" 2024-02-13T00:31:17.166 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="delete stars for deleted dashboards" 2024-02-13T00:31:17.166 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_is_folder" 2024-02-13T00:31:17.166 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2024-02-13T00:31:17.166 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2024-02-13T00:31:17.166 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2024-02-13T00:31:17.441 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2024-02-13T00:31:17.441 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2024-02-13T00:31:17.441 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2024-02-13T00:31:17.441 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2024-02-13T00:31:17.441 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2024-02-13T00:31:17.441 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2024-02-13T00:31:17.441 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-02-13T00:31:17.441 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2024-02-13T00:31:17.441 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2024-02-13T00:31:17.697 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2024-02-13T00:31:17.697 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2024-02-13T00:31:17.697 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2024-02-13T00:31:17.697 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2024-02-13T00:31:17.697 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2024-02-13T00:31:17.697 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2024-02-13T00:31:17.697 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add uid column" 2024-02-13T00:31:17.958 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:31:17.958 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid value" 2024-02-13T00:31:17.958 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index datasource_org_id_uid" 2024-02-13T00:31:17.958 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index datasource_org_id_is_default" 2024-02-13T00:31:17.958 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2024-02-13T00:31:17.959 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2024-02-13T00:31:17.959 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2024-02-13T00:31:18.218 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[41659]: t=2024-02-13T00:31:17+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2024-02-13T00:31:18.218 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2024-02-13T00:31:18.218 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2024-02-13T00:31:18.218 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2024-02-13T00:31:18.218 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2024-02-13T00:31:18.218 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2024-02-13T00:31:18.218 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2024-02-13T00:31:18.218 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[18459]: cluster 2024-02-13T00:31:16.678067+0000 mgr.y (mgr.24461) 53 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:18.218 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:17 smithi106 bash[18459]: audit 2024-02-13T00:31:16.956123+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:17 smithi080 bash[17386]: cluster 2024-02-13T00:31:16.678067+0000 mgr.y (mgr.24461) 53 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:17 smithi080 bash[17386]: audit 2024-02-13T00:31:16.956123+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:18.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:17 smithi080 bash[24237]: cluster 2024-02-13T00:31:16.678067+0000 mgr.y (mgr.24461) 53 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:18.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:17 smithi080 bash[24237]: audit 2024-02-13T00:31:16.956123+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:18.504 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2024-02-13T00:31:18.504 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2024-02-13T00:31:18.504 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2024-02-13T00:31:18.504 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2024-02-13T00:31:18.504 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2024-02-13T00:31:18.504 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2024-02-13T00:31:18.504 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="Add service account foreign key" 2024-02-13T00:31:18.505 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2024-02-13T00:31:18.755 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2024-02-13T00:31:18.755 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2024-02-13T00:31:18.755 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2024-02-13T00:31:18.755 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-02-13T00:31:18.755 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2024-02-13T00:31:18.755 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2024-02-13T00:31:19.059 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[18459]: audit 2024-02-13T00:31:17.712854+0000 mgr.y (mgr.24461) 54 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:31:19.059 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[18459]: audit 2024-02-13T00:31:18.853058+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:19.059 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2024-02-13T00:31:19.059 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2024-02-13T00:31:19.060 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="Add encrypted dashboard json column" 2024-02-13T00:31:19.060 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-02-13T00:31:19.060 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2024-02-13T00:31:19.060 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2024-02-13T00:31:19.060 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:18 smithi106 bash[41659]: t=2024-02-13T00:31:18+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2024-02-13T00:31:19.060 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2024-02-13T00:31:19.060 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-02-13T00:31:19.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:18 smithi080 bash[17386]: audit 2024-02-13T00:31:17.712854+0000 mgr.y (mgr.24461) 54 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:31:19.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:18 smithi080 bash[17386]: audit 2024-02-13T00:31:18.853058+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:19.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:18 smithi080 bash[24237]: audit 2024-02-13T00:31:17.712854+0000 mgr.y (mgr.24461) 54 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:31:19.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:18 smithi080 bash[24237]: audit 2024-02-13T00:31:18.853058+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:19.336 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2024-02-13T00:31:19.336 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2024-02-13T00:31:19.337 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2024-02-13T00:31:19.337 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2024-02-13T00:31:19.337 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2024-02-13T00:31:19.337 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2024-02-13T00:31:19.337 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2024-02-13T00:31:19.337 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2024-02-13T00:31:19.589 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2024-02-13T00:31:19.589 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2024-02-13T00:31:19.589 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2024-02-13T00:31:19.589 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2024-02-13T00:31:19.589 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2024-02-13T00:31:19.589 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2024-02-13T00:31:19.589 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2024-02-13T00:31:19.589 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add column week_start in preferences" 2024-02-13T00:31:19.849 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2024-02-13T00:31:19.850 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2024-02-13T00:31:19.850 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2024-02-13T00:31:19.850 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2024-02-13T00:31:19.850 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2024-02-13T00:31:19.850 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-02-13T00:31:19.850 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-02-13T00:31:19.850 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-02-13T00:31:19.850 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v2" 2024-02-13T00:31:20.110 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[18459]: cluster 2024-02-13T00:31:18.679327+0000 mgr.y (mgr.24461) 55 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:20.110 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[18459]: audit 2024-02-13T00:31:19.132985+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:20.110 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[18459]: audit 2024-02-13T00:31:19.135365+0000 mon.c (mon.2) 41 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:31:20.110 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[18459]: audit 2024-02-13T00:31:19.136797+0000 mon.c (mon.2) 42 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:31:20.111 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[18459]: audit 2024-02-13T00:31:19.143302+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:20.111 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-02-13T00:31:20.111 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="copy alert_rule_tag v1 to v2" 2024-02-13T00:31:20.111 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="drop table alert_rule_tag_v1" 2024-02-13T00:31:20.111 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2024-02-13T00:31:20.111 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:19 smithi106 bash[41659]: t=2024-02-13T00:31:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2024-02-13T00:31:20.111 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2024-02-13T00:31:20.111 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2024-02-13T00:31:20.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:19 smithi080 bash[17386]: cluster 2024-02-13T00:31:18.679327+0000 mgr.y (mgr.24461) 55 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:20.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:19 smithi080 bash[17386]: audit 2024-02-13T00:31:19.132985+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:20.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:19 smithi080 bash[17386]: audit 2024-02-13T00:31:19.135365+0000 mon.c (mon.2) 41 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:31:20.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:19 smithi080 bash[17386]: audit 2024-02-13T00:31:19.136797+0000 mon.c (mon.2) 42 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:31:20.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:19 smithi080 bash[17386]: audit 2024-02-13T00:31:19.143302+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:20.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:19 smithi080 bash[24237]: cluster 2024-02-13T00:31:18.679327+0000 mgr.y (mgr.24461) 55 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:20.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:19 smithi080 bash[24237]: audit 2024-02-13T00:31:19.132985+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:20.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:19 smithi080 bash[24237]: audit 2024-02-13T00:31:19.135365+0000 mon.c (mon.2) 41 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:31:20.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:19 smithi080 bash[24237]: audit 2024-02-13T00:31:19.136797+0000 mon.c (mon.2) 42 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:31:20.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:19 smithi080 bash[24237]: audit 2024-02-13T00:31:19.143302+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:20.297 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:31:20.362 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2024-02-13T00:31:20.363 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2024-02-13T00:31:20.363 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2024-02-13T00:31:20.363 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2024-02-13T00:31:20.363 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2024-02-13T00:31:20.363 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2024-02-13T00:31:20.363 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2024-02-13T00:31:20.363 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:31:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:31:20.665 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2024-02-13T00:31:20.665 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-02-13T00:31:20.665 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2024-02-13T00:31:20.665 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2024-02-13T00:31:20.665 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2024-02-13T00:31:20.665 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2024-02-13T00:31:20.665 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2024-02-13T00:31:20.665 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add column secure_settings in alert_notification" 2024-02-13T00:31:20.665 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert.settings to mediumtext" 2024-02-13T00:31:20.666 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add non-unique index alert_notification_state_alert_id" 2024-02-13T00:31:20.950 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add non-unique index alert_rule_tag_alert_id" 2024-02-13T00:31:20.951 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2024-02-13T00:31:20.951 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2024-02-13T00:31:20.951 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2024-02-13T00:31:20.951 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2024-02-13T00:31:20.951 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2024-02-13T00:31:20.951 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2024-02-13T00:31:20.951 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2024-02-13T00:31:20.951 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2024-02-13T00:31:21.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:20 smithi080 bash[17386]: cephadm 2024-02-13T00:31:19.151668+0000 mgr.y (mgr.24461) 56 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-13T00:31:21.102 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:20 smithi080 bash[17386]: cephadm 2024-02-13T00:31:19.155395+0000 mgr.y (mgr.24461) 57 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi080 2024-02-13T00:31:21.102 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:20 smithi080 bash[24237]: cephadm 2024-02-13T00:31:19.151668+0000 mgr.y (mgr.24461) 56 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-13T00:31:21.102 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:20 smithi080 bash[24237]: cephadm 2024-02-13T00:31:19.155395+0000 mgr.y (mgr.24461) 57 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi080 2024-02-13T00:31:21.203 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[18459]: cephadm 2024-02-13T00:31:19.151668+0000 mgr.y (mgr.24461) 56 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-13T00:31:21.203 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[18459]: cephadm 2024-02-13T00:31:19.155395+0000 mgr.y (mgr.24461) 57 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi080 2024-02-13T00:31:21.203 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:20 smithi106 bash[41659]: t=2024-02-13T00:31:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2024-02-13T00:31:21.203 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2024-02-13T00:31:21.203 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2024-02-13T00:31:21.203 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2024-02-13T00:31:21.203 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2024-02-13T00:31:21.203 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-02-13T00:31:21.204 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-02-13T00:31:21.204 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v3" 2024-02-13T00:31:21.472 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-02-13T00:31:21.472 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="copy annotation_tag v2 to v3" 2024-02-13T00:31:21.472 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="drop table annotation_tag_v2" 2024-02-13T00:31:21.472 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2024-02-13T00:31:21.472 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2024-02-13T00:31:21.472 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2024-02-13T00:31:21.472 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2024-02-13T00:31:21.472 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2024-02-13T00:31:21.733 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2024-02-13T00:31:21.733 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2024-02-13T00:31:21.733 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2024-02-13T00:31:21.733 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2024-02-13T00:31:21.733 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2024-02-13T00:31:21.733 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2024-02-13T00:31:21.733 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-02-13T00:31:21.733 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-02-13T00:31:21.733 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2024-02-13T00:31:21.993 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[18459]: cluster 2024-02-13T00:31:20.680041+0000 mgr.y (mgr.24461) 58 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:21.993 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2024-02-13T00:31:21.993 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for alert_id on annotation table" 2024-02-13T00:31:21.993 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2024-02-13T00:31:21.993 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2024-02-13T00:31:21.993 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2024-02-13T00:31:21.993 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-02-13T00:31:21.993 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:21 smithi106 bash[41659]: t=2024-02-13T00:31:21+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2024-02-13T00:31:22.255 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2024-02-13T00:31:22.255 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2024-02-13T00:31:22.255 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2024-02-13T00:31:22.255 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2024-02-13T00:31:22.255 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2024-02-13T00:31:22.255 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2024-02-13T00:31:22.256 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2024-02-13T00:31:22.256 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2024-02-13T00:31:22.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:21 smithi080 bash[17386]: cluster 2024-02-13T00:31:20.680041+0000 mgr.y (mgr.24461) 58 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:22.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:21 smithi080 bash[24237]: cluster 2024-02-13T00:31:20.680041+0000 mgr.y (mgr.24461) 58 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:22.531 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.team_id" 2024-02-13T00:31:22.531 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2024-02-13T00:31:22.531 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2024-02-13T00:31:22.531 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2024-02-13T00:31:22.531 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2024-02-13T00:31:22.532 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2024-02-13T00:31:22.532 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2024-02-13T00:31:22.532 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2024-02-13T00:31:22.532 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_user_id" 2024-02-13T00:31:22.809 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_team_id" 2024-02-13T00:31:22.809 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_org_id_role" 2024-02-13T00:31:22.809 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_permission" 2024-02-13T00:31:22.809 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2024-02-13T00:31:22.809 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="delete acl rules for deleted dashboards and folders" 2024-02-13T00:31:22.809 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2024-02-13T00:31:22.809 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2024-02-13T00:31:22.809 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2024-02-13T00:31:23.069 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2024-02-13T00:31:23.069 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2024-02-13T00:31:23.069 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-02-13T00:31:23.069 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2024-02-13T00:31:23.069 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2024-02-13T00:31:23.070 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:22 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2024-02-13T00:31:23.070 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:22+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2024-02-13T00:31:23.070 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2024-02-13T00:31:23.070 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-02-13T00:31:23.258 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:31:23] "GET /metrics HTTP/1.1" 200 172191 "" "Prometheus/2.33.4" 2024-02-13T00:31:23.321 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2024-02-13T00:31:23.321 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2024-02-13T00:31:23.321 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2024-02-13T00:31:23.321 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2024-02-13T00:31:23.322 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2024-02-13T00:31:23.322 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2024-02-13T00:31:23.322 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2024-02-13T00:31:23.322 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2024-02-13T00:31:23.591 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2024-02-13T00:31:23.591 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2024-02-13T00:31:23.591 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2024-02-13T00:31:23.591 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_auth_token.user_id" 2024-02-13T00:31:23.591 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add revoked_at to the user auth token" 2024-02-13T00:31:23.591 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2024-02-13T00:31:23.591 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2024-02-13T00:31:23.591 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="create short_url table v1" 2024-02-13T00:31:23.851 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="add index short_url.org_id-uid" 2024-02-13T00:31:23.851 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="delete alert_definition table" 2024-02-13T00:31:23.851 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="recreate alert_definition table" 2024-02-13T00:31:23.851 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition on org_id and title columns" 2024-02-13T00:31:23.851 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition on org_id and uid columns" 2024-02-13T00:31:23.851 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_definition table data column to mediumtext in mysql" 2024-02-13T00:31:23.852 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="drop index in alert_definition on org_id and title columns" 2024-02-13T00:31:23.852 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="drop index in alert_definition on org_id and uid columns" 2024-02-13T00:31:24.018 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:23 smithi080 bash[17386]: cluster 2024-02-13T00:31:22.681362+0000 mgr.y (mgr.24461) 59 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:24.019 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:23 smithi080 bash[24237]: cluster 2024-02-13T00:31:22.681362+0000 mgr.y (mgr.24461) 59 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:24.136 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[18459]: cluster 2024-02-13T00:31:22.681362+0000 mgr.y (mgr.24461) 59 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:24.136 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index in alert_definition on org_id and title columns" 2024-02-13T00:31:24.136 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index in alert_definition on org_id and uid columns" 2024-02-13T00:31:24.137 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:23 smithi106 bash[41659]: t=2024-02-13T00:31:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add column paused in alert_definition" 2024-02-13T00:31:24.137 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_definition table" 2024-02-13T00:31:24.137 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="delete alert_definition_version table" 2024-02-13T00:31:24.137 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="recreate alert_definition_version table" 2024-02-13T00:31:24.137 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-02-13T00:31:24.430 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-02-13T00:31:24.430 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_definition_version table data column to mediumtext in mysql" 2024-02-13T00:31:24.430 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_definition_version table" 2024-02-13T00:31:24.430 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_instance table" 2024-02-13T00:31:24.431 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-02-13T00:31:24.431 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_instance table on def_org_id, current_state columns" 2024-02-13T00:31:24.431 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="add column current_state_end to alert_instance" 2024-02-13T00:31:24.431 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-02-13T00:31:24.431 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="remove index def_org_id, current_state on alert_instance" 2024-02-13T00:31:24.431 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="rename def_org_id to rule_org_id in alert_instance" 2024-02-13T00:31:24.685 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="rename def_uid to rule_uid in alert_instance" 2024-02-13T00:31:24.685 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-02-13T00:31:24.685 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="add index rule_org_id, current_state on alert_instance" 2024-02-13T00:31:24.685 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_rule table" 2024-02-13T00:31:24.685 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id and title columns" 2024-02-13T00:31:24.685 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id and uid columns" 2024-02-13T00:31:24.685 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-02-13T00:31:24.965 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_rule table data column to mediumtext in mysql" 2024-02-13T00:31:24.965 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="add column for to alert_rule" 2024-02-13T00:31:24.965 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="add column annotations to alert_rule" 2024-02-13T00:31:24.966 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="add column labels to alert_rule" 2024-02-13T00:31:24.966 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="remove unique index from alert_rule on org_id, title columns" 2024-02-13T00:31:24.966 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-02-13T00:31:24.966 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="add dashboard_uid column to alert_rule" 2024-02-13T00:31:24.966 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="add panel_id column to alert_rule" 2024-02-13T00:31:24.966 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-02-13T00:31:25.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.194+0000 7f4165c08700 1 -- 172.21.15.80:0/1167750439 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41600fd4d0 msgr2=0x7f41600f6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:25.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.194+0000 7f4165c08700 1 --2- 172.21.15.80:0/1167750439 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41600fd4d0 0x7f41600f6d00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4154004870 tx=0x7f4154009cb0).stop 2024-02-13T00:31:25.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.194+0000 7f4165c08700 1 -- 172.21.15.80:0/1167750439 shutdown_connections 2024-02-13T00:31:25.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.194+0000 7f4165c08700 1 --2- 172.21.15.80:0/1167750439 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41600f73e0 0x7f41601039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:25.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.194+0000 7f4165c08700 1 --2- 172.21.15.80:0/1167750439 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41600fcb70 0x7f41600fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:25.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.194+0000 7f4165c08700 1 --2- 172.21.15.80:0/1167750439 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41600fd4d0 0x7f41600f6d00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:25.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.194+0000 7f4165c08700 1 -- 172.21.15.80:0/1167750439 >> 172.21.15.80:0/1167750439 conn(0x7f41600f27a0 msgr2=0x7f41600f4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:31:25.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.194+0000 7f4165c08700 1 -- 172.21.15.80:0/1167750439 shutdown_connections 2024-02-13T00:31:25.202 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.194+0000 7f4165c08700 1 -- 172.21.15.80:0/1167750439 wait complete. 2024-02-13T00:31:25.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f4165c08700 1 Processor -- start 2024-02-13T00:31:25.203 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f4165c08700 1 -- start start 2024-02-13T00:31:25.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f4165c08700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41600f73e0 0x7f4160110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:25.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f4165c08700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41600fcb70 0x7f4160110660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:25.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f4165c08700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41600fd4d0 0x7f416010a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:25.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f4165c08700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416010a840 con 0x7f41600fcb70 2024-02-13T00:31:25.204 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f4165c08700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416010a9b0 con 0x7f41600f73e0 2024-02-13T00:31:25.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f4165c08700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416010ab20 con 0x7f41600fd4d0 2024-02-13T00:31:25.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f415effd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41600fcb70 0x7f4160110660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:25.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f415effd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41600fcb70 0x7f4160110660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:49978/0 (socket says 172.21.15.80:49978) 2024-02-13T00:31:25.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f415effd700 1 -- 172.21.15.80:0/2465167937 learned_addr learned my addr 172.21.15.80:0/2465167937 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:31:25.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f415ffff700 1 --2- 172.21.15.80:0/2465167937 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41600fd4d0 0x7f416010a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:25.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f415effd700 1 -- 172.21.15.80:0/2465167937 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41600fd4d0 msgr2=0x7f416010a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:25.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f415effd700 1 --2- 172.21.15.80:0/2465167937 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41600fd4d0 0x7f416010a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:25.205 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f415effd700 1 -- 172.21.15.80:0/2465167937 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41600f73e0 msgr2=0x7f4160110170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:25.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f415effd700 1 --2- 172.21.15.80:0/2465167937 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41600f73e0 0x7f4160110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-13T00:31:25.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f415effd700 1 -- 172.21.15.80:0/2465167937 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4154005040 con 0x7f41600fcb70 2024-02-13T00:31:25.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f415ffff700 1 --2- 172.21.15.80:0/2465167937 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41600fd4d0 0x7f416010a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-13T00:31:25.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f415effd700 1 --2- 172.21.15.80:0/2465167937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41600fcb70 0x7f4160110660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f4154005010 tx=0x7f4154009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:31:25.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f415cff9700 1 -- 172.21.15.80:0/2465167937 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415400e030 con 0x7f41600fcb70 2024-02-13T00:31:25.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f4165c08700 1 -- 172.21.15.80:0/2465167937 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f416010ada0 con 0x7f41600fcb70 2024-02-13T00:31:25.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f415cff9700 1 -- 172.21.15.80:0/2465167937 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f41540096d0 con 0x7f41600fcb70 2024-02-13T00:31:25.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f415cff9700 1 -- 172.21.15.80:0/2465167937 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4154018070 con 0x7f41600fcb70 2024-02-13T00:31:25.206 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.198+0000 7f4165c08700 1 -- 172.21.15.80:0/2465167937 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4160116fe0 con 0x7f41600fcb70 2024-02-13T00:31:25.207 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.202+0000 7f4165c08700 1 -- 172.21.15.80:0/2465167937 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41600620e0 con 0x7f41600fcb70 2024-02-13T00:31:25.208 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.202+0000 7f415cff9700 1 -- 172.21.15.80:0/2465167937 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f4154009240 con 0x7f41600fcb70 2024-02-13T00:31:25.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.202+0000 7f415cff9700 1 --2- 172.21.15.80:0/2465167937 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4148061340 0x7f4148063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:25.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.202+0000 7f415cff9700 1 -- 172.21.15.80:0/2465167937 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f415407e170 con 0x7f41600fcb70 2024-02-13T00:31:25.209 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.202+0000 7f415f7fe700 1 --2- 172.21.15.80:0/2465167937 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4148061340 0x7f4148063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:25.210 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.202+0000 7f415f7fe700 1 --2- 172.21.15.80:0/2465167937 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4148061340 0x7f4148063800 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f4150004bd0 tx=0x7f415000b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:31:25.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.210+0000 7f415cff9700 1 -- 172.21.15.80:0/2465167937 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f415404def0 con 0x7f41600fcb70 2024-02-13T00:31:25.237 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:24 smithi106 bash[41659]: t=2024-02-13T00:31:24+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_rule_version table" 2024-02-13T00:31:25.237 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-02-13T00:31:25.237 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-02-13T00:31:25.237 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_rule_version table data column to mediumtext in mysql" 2024-02-13T00:31:25.237 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="add column for to alert_rule_version" 2024-02-13T00:31:25.237 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="add column annotations to alert_rule_version" 2024-02-13T00:31:25.237 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="add column labels to alert_rule_version" 2024-02-13T00:31:25.237 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id=create_alert_configuration_table 2024-02-13T00:31:25.237 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column default in alert_configuration" 2024-02-13T00:31:25.258 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:31:25 smithi080 systemd[1]: Stopping Ceph alertmanager.a for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:31:25.258 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:31:25 smithi080 bash[47912]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-alertmanager.a 2024-02-13T00:31:25.258 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:31:25 smithi080 bash[46566]: level=info ts=2024-02-13T00:31:25.201Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-02-13T00:31:25.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.390+0000 7f4165c08700 1 -- 172.21.15.80:0/2465167937 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"} v 0) v1 -- 0x7f416010b830 con 0x7f41600fcb70 2024-02-13T00:31:25.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.394+0000 7f415cff9700 1 -- 172.21.15.80:0/2465167937 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"}]=0 v63) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4154051510 con 0x7f41600fcb70 2024-02-13T00:31:25.399 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-02-13T00:31:25.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.394+0000 7f4165c08700 1 -- 172.21.15.80:0/2465167937 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4148061340 msgr2=0x7f4148063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:25.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.394+0000 7f4165c08700 1 --2- 172.21.15.80:0/2465167937 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4148061340 0x7f4148063800 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f4150004bd0 tx=0x7f415000b040).stop 2024-02-13T00:31:25.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.394+0000 7f4165c08700 1 -- 172.21.15.80:0/2465167937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41600fcb70 msgr2=0x7f4160110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:25.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.394+0000 7f4165c08700 1 --2- 172.21.15.80:0/2465167937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41600fcb70 0x7f4160110660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f4154005010 tx=0x7f4154009cb0).stop 2024-02-13T00:31:25.401 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.394+0000 7f4165c08700 1 -- 172.21.15.80:0/2465167937 shutdown_connections 2024-02-13T00:31:25.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.394+0000 7f4165c08700 1 --2- 172.21.15.80:0/2465167937 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4148061340 0x7f4148063800 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:25.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.394+0000 7f4165c08700 1 --2- 172.21.15.80:0/2465167937 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41600f73e0 0x7f4160110170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-13T00:31:25.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.394+0000 7f4165c08700 1 --2- 172.21.15.80:0/2465167937 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41600fd4d0 0x7f416010a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:25.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.394+0000 7f4165c08700 1 --2- 172.21.15.80:0/2465167937 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41600fcb70 0x7f4160110660 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:25.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.394+0000 7f4165c08700 1 -- 172.21.15.80:0/2465167937 >> 172.21.15.80:0/2465167937 conn(0x7f41600f27a0 msgr2=0x7f41600f42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:31:25.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.394+0000 7f4165c08700 1 -- 172.21.15.80:0/2465167937 shutdown_connections 2024-02-13T00:31:25.402 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:25.394+0000 7f4165c08700 1 -- 172.21.15.80:0/2465167937 wait complete. 2024-02-13T00:31:25.497 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-02-13T00:31:25.497 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="add column org_id in alert_configuration" 2024-02-13T00:31:25.497 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_configuration table on org_id column" 2024-02-13T00:31:25.497 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id=create_ngalert_configuration_table 2024-02-13T00:31:25.497 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index in ngalert_configuration on org_id column" 2024-02-13T00:31:25.497 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="clear migration entry \"remove unified alerting data\"" 2024-02-13T00:31:25.497 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="move dashboard alerts to unified alerting" 2024-02-13T00:31:25.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[18459]: cluster 2024-02-13T00:31:24.682048+0000 mgr.y (mgr.24461) 60 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:25.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[18459]: audit 2024-02-13T00:31:25.396128+0000 mon.a (mon.0) 661 : audit [DBG] from='client.? 172.21.15.80:0/2465167937' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"}]: dispatch 2024-02-13T00:31:25.755 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="create library_element table v1" 2024-02-13T00:31:25.755 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index library_element org_id-folder_id-name-kind" 2024-02-13T00:31:25.756 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="create library_element_connection table v1" 2024-02-13T00:31:25.756 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index library_element_connection element_id-kind-connection_id" 2024-02-13T00:31:25.756 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index library_element org_id_uid" 2024-02-13T00:31:25.756 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="clone move dashboard alerts to unified alerting" 2024-02-13T00:31:25.756 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="create data_keys table" 2024-02-13T00:31:25.756 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="create kv_store table v1" 2024-02-13T00:31:25.756 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index kv_store.org_id-namespace-key" 2024-02-13T00:31:25.756 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="update dashboard_uid and panel_id from existing annotations" 2024-02-13T00:31:25.776 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:25 smithi080 bash[17386]: cluster 2024-02-13T00:31:24.682048+0000 mgr.y (mgr.24461) 60 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:25.777 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:25 smithi080 bash[17386]: audit 2024-02-13T00:31:25.396128+0000 mon.a (mon.0) 661 : audit [DBG] from='client.? 172.21.15.80:0/2465167937' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"}]: dispatch 2024-02-13T00:31:25.777 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:25 smithi080 bash[24237]: cluster 2024-02-13T00:31:24.682048+0000 mgr.y (mgr.24461) 60 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:25.777 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:25 smithi080 bash[24237]: audit 2024-02-13T00:31:25.396128+0000 mon.a (mon.0) 661 : audit [DBG] from='client.? 172.21.15.80:0/2465167937' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.log", "var": "pg_num"}]: dispatch 2024-02-13T00:31:26.056 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="create permission table" 2024-02-13T00:31:26.056 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index permission.role_id" 2024-02-13T00:31:26.057 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role_id_action_scope" 2024-02-13T00:31:26.057 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="create role table" 2024-02-13T00:31:26.057 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="add column display_name" 2024-02-13T00:31:26.057 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="add column group_name" 2024-02-13T00:31:26.057 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index role.org_id" 2024-02-13T00:31:26.057 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:25 smithi106 bash[41659]: t=2024-02-13T00:31:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role_org_id_name" 2024-02-13T00:31:26.057 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Executing migration" logger=migrator id="add index role_org_id_uid" 2024-02-13T00:31:26.058 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Executing migration" logger=migrator id="create team role table" 2024-02-13T00:31:26.336 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_role.org_id" 2024-02-13T00:31:26.336 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_role_org_id_team_id_role_id" 2024-02-13T00:31:26.336 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_role.team_id" 2024-02-13T00:31:26.336 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Executing migration" logger=migrator id="create user role table" 2024-02-13T00:31:26.336 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_role.org_id" 2024-02-13T00:31:26.336 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_role_org_id_user_id_role_id" 2024-02-13T00:31:26.337 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_role.user_id" 2024-02-13T00:31:26.337 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Executing migration" logger=migrator id="create builtin role table" 2024-02-13T00:31:26.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:31:26 smithi080 bash[47955]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-alertmanager-a 2024-02-13T00:31:26.605 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.role_id" 2024-02-13T00:31:26.605 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.name" 2024-02-13T00:31:26.605 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Executing migration" logger=migrator id="Add column org_id to builtin_role table" 2024-02-13T00:31:26.605 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.org_id" 2024-02-13T00:31:26.605 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index builtin_role_org_id_role_id_role" 2024-02-13T00:31:26.605 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index role_org_id_uid" 2024-02-13T00:31:26.605 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role.uid" 2024-02-13T00:31:26.605 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Executing migration" logger=migrator id="create seed assignment table" 2024-02-13T00:31:26.606 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index builtin_role_role_name" 2024-02-13T00:31:26.606 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="migrations completed" logger=migrator performed=381 skipped=0 duration=12.540243978s 2024-02-13T00:31:26.673 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph osd pool get default.rgw.control pg_num 2024-02-13T00:31:26.871 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Created default organization" logger=sqlstore 2024-02-13T00:31:26.871 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Initialising plugins" logger=plugin.manager 2024-02-13T00:31:26.871 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=input 2024-02-13T00:31:26.871 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=grafana-piechart-panel 2024-02-13T00:31:26.872 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=vonage-status-panel 2024-02-13T00:31:26.872 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="Live Push Gateway initialization" logger=live.push_http 2024-02-13T00:31:27.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:31:26 smithi080 bash[48061]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-alertmanager-a 2024-02-13T00:31:27.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:31:26 smithi080 systemd[1]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@alertmanager.a.service: Succeeded. 2024-02-13T00:31:27.009 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:31:26 smithi080 systemd[1]: Stopped Ceph alertmanager.a for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:31:27.009 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:31:26 smithi080 systemd[1]: Started Ceph alertmanager.a for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:31:27.255 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2024-02-13T00:31:27.255 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:26 smithi106 bash[41659]: t=2024-02-13T00:31:26+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 uid=P43CA22E17D0F9596 2024-02-13T00:31:27.255 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:27 smithi106 bash[41659]: t=2024-02-13T00:31:27+0000 lvl=info msg="warming cache for startup" logger=ngalert 2024-02-13T00:31:27.255 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:27 smithi106 bash[41659]: t=2024-02-13T00:31:27+0000 lvl=info msg="starting MultiOrg Alertmanager" logger=ngalert.multiorg.alertmanager 2024-02-13T00:31:27.255 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:31:27 smithi106 bash[41659]: t=2024-02-13T00:31:27+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2024-02-13T00:31:27.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:27 smithi080 bash[17386]: audit 2024-02-13T00:31:26.612887+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:27.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:27 smithi080 bash[17386]: cephadm 2024-02-13T00:31:26.616741+0000 mgr.y (mgr.24461) 61 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-13T00:31:27.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:27 smithi080 bash[17386]: cephadm 2024-02-13T00:31:26.622017+0000 mgr.y (mgr.24461) 62 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi106 2024-02-13T00:31:27.875 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:27 smithi080 bash[17386]: cluster 2024-02-13T00:31:26.682735+0000 mgr.y (mgr.24461) 63 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:27.875 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:27 smithi080 bash[24237]: audit 2024-02-13T00:31:26.612887+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:27.875 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:27 smithi080 bash[24237]: cephadm 2024-02-13T00:31:26.616741+0000 mgr.y (mgr.24461) 61 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-13T00:31:27.875 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:27 smithi080 bash[24237]: cephadm 2024-02-13T00:31:26.622017+0000 mgr.y (mgr.24461) 62 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi106 2024-02-13T00:31:27.875 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:27 smithi080 bash[24237]: cluster 2024-02-13T00:31:26.682735+0000 mgr.y (mgr.24461) 63 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:27.876 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:31:27 smithi080 bash[48089]: level=info ts=2024-02-13T00:31:27.864Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-02-13T00:31:27.876 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:31:27 smithi080 bash[48089]: level=info ts=2024-02-13T00:31:27.864Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-02-13T00:31:27.876 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:31:27 smithi080 bash[48089]: level=info ts=2024-02-13T00:31:27.866Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.80 port=9094 2024-02-13T00:31:27.876 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:31:27 smithi080 bash[48089]: level=info ts=2024-02-13T00:31:27.871Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-02-13T00:31:28.005 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:31:27 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:31:28.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:27 smithi106 bash[18459]: audit 2024-02-13T00:31:26.612887+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:28.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:27 smithi106 bash[18459]: cephadm 2024-02-13T00:31:26.616741+0000 mgr.y (mgr.24461) 61 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-13T00:31:28.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:27 smithi106 bash[18459]: cephadm 2024-02-13T00:31:26.622017+0000 mgr.y (mgr.24461) 62 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi106 2024-02-13T00:31:28.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:27 smithi106 bash[18459]: cluster 2024-02-13T00:31:26.682735+0000 mgr.y (mgr.24461) 63 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:28.258 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:31:27 smithi080 bash[48089]: level=info ts=2024-02-13T00:31:27.911Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-13T00:31:28.258 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:31:27 smithi080 bash[48089]: level=info ts=2024-02-13T00:31:27.912Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-13T00:31:28.259 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:31:27 smithi080 bash[48089]: level=info ts=2024-02-13T00:31:27.916Z caller=main.go:518 msg=Listening address=:9093 2024-02-13T00:31:28.259 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:31:27 smithi080 bash[48089]: level=info ts=2024-02-13T00:31:27.916Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-02-13T00:31:28.934 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:28 smithi106 bash[18459]: audit 2024-02-13T00:31:27.724462+0000 mgr.y (mgr.24461) 64 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:31:29.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:28 smithi080 bash[24237]: audit 2024-02-13T00:31:27.724462+0000 mgr.y (mgr.24461) 64 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:31:29.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:28 smithi080 bash[17386]: audit 2024-02-13T00:31:27.724462+0000 mgr.y (mgr.24461) 64 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:31:30.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:29 smithi106 bash[18459]: cluster 2024-02-13T00:31:28.684113+0000 mgr.y (mgr.24461) 65 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:30.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:29 smithi080 bash[17386]: cluster 2024-02-13T00:31:28.684113+0000 mgr.y (mgr.24461) 65 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:30.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:29 smithi080 bash[24237]: cluster 2024-02-13T00:31:28.684113+0000 mgr.y (mgr.24461) 65 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:30.009 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:31:29 smithi080 bash[48089]: level=info ts=2024-02-13T00:31:29.872Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000667978s 2024-02-13T00:31:30.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:31:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:31:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:31:31.477 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:31:31.746 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:31 smithi106 systemd[1]: Stopping Ceph prometheus.a for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:31:31.746 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:31 smithi106 bash[42321]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-prometheus.a 2024-02-13T00:31:31.746 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:31 smithi106 bash[41301]: ts=2024-02-13T00:31:31.535Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-02-13T00:31:31.746 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:31 smithi106 bash[41301]: ts=2024-02-13T00:31:31.535Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-02-13T00:31:31.746 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:31 smithi106 bash[41301]: ts=2024-02-13T00:31:31.535Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-02-13T00:31:31.746 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:31 smithi106 bash[41301]: ts=2024-02-13T00:31:31.535Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-02-13T00:31:31.746 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:31 smithi106 bash[41301]: ts=2024-02-13T00:31:31.535Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-02-13T00:31:31.747 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:31 smithi106 bash[41301]: ts=2024-02-13T00:31:31.535Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-02-13T00:31:31.747 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:31 smithi106 bash[41301]: ts=2024-02-13T00:31:31.536Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-02-13T00:31:31.747 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:31 smithi106 bash[41301]: ts=2024-02-13T00:31:31.536Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-02-13T00:31:31.747 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:31 smithi106 bash[41301]: ts=2024-02-13T00:31:31.536Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-02-13T00:31:31.747 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:31 smithi106 bash[41301]: ts=2024-02-13T00:31:31.537Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-02-13T00:31:31.747 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:31 smithi106 bash[41301]: ts=2024-02-13T00:31:31.537Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-02-13T00:31:31.747 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:31 smithi106 bash[41301]: ts=2024-02-13T00:31:31.537Z caller=main.go:1066 level=info msg="See you next time!" 2024-02-13T00:31:31.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:31 smithi080 bash[17386]: cluster 2024-02-13T00:31:30.684710+0000 mgr.y (mgr.24461) 66 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:31.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:31 smithi080 bash[24237]: cluster 2024-02-13T00:31:30.684710+0000 mgr.y (mgr.24461) 66 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:32.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:31 smithi106 bash[18459]: cluster 2024-02-13T00:31:30.684710+0000 mgr.y (mgr.24461) 66 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:32.359 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:32 smithi106 bash[42354]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-prometheus-a 2024-02-13T00:31:32.359 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:32 smithi106 bash[42419]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-prometheus-a 2024-02-13T00:31:32.359 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:32 smithi106 systemd[1]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@prometheus.a.service: Succeeded. 2024-02-13T00:31:32.359 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:32 smithi106 systemd[1]: Stopped Ceph prometheus.a for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:31:32.359 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:32 smithi106 systemd[1]: Started Ceph prometheus.a for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:31:32.625 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:32 smithi080 bash[17652]: [13/Feb/2024:00:31:32] ENGINE Bus STOPPING 2024-02-13T00:31:32.625 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:32 smithi080 bash[17652]: [13/Feb/2024:00:31:32] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-13T00:31:32.625 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:32 smithi080 bash[17652]: [13/Feb/2024:00:31:32] ENGINE Bus STOPPED 2024-02-13T00:31:32.626 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:32 smithi080 bash[17652]: [13/Feb/2024:00:31:32] ENGINE Bus STARTING 2024-02-13T00:31:32.626 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:32 smithi080 bash[17652]: [13/Feb/2024:00:31:32] ENGINE Serving on http://:::9283 2024-02-13T00:31:32.626 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:32 smithi080 bash[17652]: [13/Feb/2024:00:31:32] ENGINE Bus STARTED 2024-02-13T00:31:32.626 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:32 smithi080 bash[17652]: [13/Feb/2024:00:31:32] ENGINE Bus STOPPING 2024-02-13T00:31:32.626 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:32 smithi080 bash[17652]: [13/Feb/2024:00:31:32] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-13T00:31:32.626 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:32 smithi080 bash[17652]: [13/Feb/2024:00:31:32] ENGINE Bus STOPPED 2024-02-13T00:31:32.626 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:32 smithi080 bash[17652]: [13/Feb/2024:00:31:32] ENGINE Bus STARTING 2024-02-13T00:31:32.626 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:32 smithi080 bash[17652]: [13/Feb/2024:00:31:32] ENGINE Serving on http://:::9283 2024-02-13T00:31:32.626 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:32 smithi080 bash[17652]: [13/Feb/2024:00:31:32] ENGINE Bus STARTED 2024-02-13T00:31:32.626 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:32 smithi080 bash[17652]: [13/Feb/2024:00:31:32] ENGINE Bus STOPPING 2024-02-13T00:31:32.626 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:32 smithi080 bash[17652]: [13/Feb/2024:00:31:32] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-13T00:31:32.626 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:32 smithi080 bash[17652]: [13/Feb/2024:00:31:32] ENGINE Bus STOPPED 2024-02-13T00:31:32.941 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:32 smithi080 bash[17652]: [13/Feb/2024:00:31:32] ENGINE Bus STARTING 2024-02-13T00:31:32.941 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:32 smithi080 bash[17652]: [13/Feb/2024:00:31:32] ENGINE Serving on http://:::9283 2024-02-13T00:31:32.941 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:32 smithi080 bash[17652]: [13/Feb/2024:00:31:32] ENGINE Bus STARTED 2024-02-13T00:31:33.718 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[42447]: ts=2024-02-13T00:31:33.409Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-02-13T00:31:33.718 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[42447]: ts=2024-02-13T00:31:33.409Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-02-13T00:31:33.719 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[42447]: ts=2024-02-13T00:31:33.409Z caller=main.go:518 level=info host_details="(Linux 5.15.0-94-generic #104~20.04.1-Ubuntu SMP Tue Jan 16 13:34:09 UTC 2024 x86_64 smithi106 (none))" 2024-02-13T00:31:33.719 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[42447]: ts=2024-02-13T00:31:33.409Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-02-13T00:31:33.719 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[42447]: ts=2024-02-13T00:31:33.409Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-02-13T00:31:33.719 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[42447]: ts=2024-02-13T00:31:33.411Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-02-13T00:31:33.719 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[42447]: ts=2024-02-13T00:31:33.411Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-02-13T00:31:33.719 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[42447]: ts=2024-02-13T00:31:33.413Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-02-13T00:31:33.719 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[42447]: ts=2024-02-13T00:31:33.414Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-02-13T00:31:33.719 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[42447]: ts=2024-02-13T00:31:33.414Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.127µs 2024-02-13T00:31:33.719 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[42447]: ts=2024-02-13T00:31:33.414Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-02-13T00:31:33.719 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[42447]: ts=2024-02-13T00:31:33.716Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-02-13T00:31:33.719 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[42447]: ts=2024-02-13T00:31:33.716Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-02-13T00:31:33.719 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[18459]: audit 2024-02-13T00:31:32.342822+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:33.720 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[18459]: audit 2024-02-13T00:31:32.349091+0000 mon.c (mon.2) 43 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-13T00:31:33.720 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[18459]: audit 2024-02-13T00:31:32.349741+0000 mgr.y (mgr.24461) 67 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-13T00:31:33.720 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[18459]: audit 2024-02-13T00:31:32.351185+0000 mon.c (mon.2) 44 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi080.front.sepia.ceph.com:9093"}]: dispatch 2024-02-13T00:31:33.720 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[18459]: audit 2024-02-13T00:31:32.351622+0000 mgr.y (mgr.24461) 68 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi080.front.sepia.ceph.com:9093"}]: dispatch 2024-02-13T00:31:33.720 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[18459]: audit 2024-02-13T00:31:32.356934+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:33.720 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[18459]: audit 2024-02-13T00:31:32.363416+0000 mon.c (mon.2) 45 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-13T00:31:33.720 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[18459]: audit 2024-02-13T00:31:32.364329+0000 mgr.y (mgr.24461) 69 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-13T00:31:33.720 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[18459]: audit 2024-02-13T00:31:32.367747+0000 mon.c (mon.2) 46 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi106.front.sepia.ceph.com:9095"}]: dispatch 2024-02-13T00:31:33.720 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[18459]: audit 2024-02-13T00:31:32.368585+0000 mgr.y (mgr.24461) 70 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi106.front.sepia.ceph.com:9095"}]: dispatch 2024-02-13T00:31:33.720 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[18459]: audit 2024-02-13T00:31:32.375933+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:33.720 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[18459]: audit 2024-02-13T00:31:32.382361+0000 mon.c (mon.2) 47 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-13T00:31:33.720 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[18459]: audit 2024-02-13T00:31:32.383048+0000 mgr.y (mgr.24461) 71 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-13T00:31:33.720 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[18459]: audit 2024-02-13T00:31:32.391620+0000 mon.c (mon.2) 48 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi106.front.sepia.ceph.com:3000"}]: dispatch 2024-02-13T00:31:33.721 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[18459]: audit 2024-02-13T00:31:32.392471+0000 mgr.y (mgr.24461) 72 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi106.front.sepia.ceph.com:3000"}]: dispatch 2024-02-13T00:31:33.721 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[18459]: audit 2024-02-13T00:31:32.399845+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:33.721 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[18459]: audit 2024-02-13T00:31:32.405437+0000 mon.c (mon.2) 49 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:31:33.721 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[18459]: cluster 2024-02-13T00:31:32.685671+0000 mgr.y (mgr.24461) 73 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:33.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[24237]: audit 2024-02-13T00:31:32.342822+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:33.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[24237]: audit 2024-02-13T00:31:32.349091+0000 mon.c (mon.2) 43 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-13T00:31:33.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[24237]: audit 2024-02-13T00:31:32.349741+0000 mgr.y (mgr.24461) 67 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-13T00:31:33.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[24237]: audit 2024-02-13T00:31:32.351185+0000 mon.c (mon.2) 44 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi080.front.sepia.ceph.com:9093"}]: dispatch 2024-02-13T00:31:33.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[24237]: audit 2024-02-13T00:31:32.351622+0000 mgr.y (mgr.24461) 68 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi080.front.sepia.ceph.com:9093"}]: dispatch 2024-02-13T00:31:33.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[24237]: audit 2024-02-13T00:31:32.356934+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:33.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[24237]: audit 2024-02-13T00:31:32.363416+0000 mon.c (mon.2) 45 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-13T00:31:33.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[24237]: audit 2024-02-13T00:31:32.364329+0000 mgr.y (mgr.24461) 69 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-13T00:31:33.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[24237]: audit 2024-02-13T00:31:32.367747+0000 mon.c (mon.2) 46 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi106.front.sepia.ceph.com:9095"}]: dispatch 2024-02-13T00:31:33.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[24237]: audit 2024-02-13T00:31:32.368585+0000 mgr.y (mgr.24461) 70 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi106.front.sepia.ceph.com:9095"}]: dispatch 2024-02-13T00:31:33.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[24237]: audit 2024-02-13T00:31:32.375933+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:33.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[24237]: audit 2024-02-13T00:31:32.382361+0000 mon.c (mon.2) 47 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-13T00:31:33.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[24237]: audit 2024-02-13T00:31:32.383048+0000 mgr.y (mgr.24461) 71 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-13T00:31:33.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[24237]: audit 2024-02-13T00:31:32.391620+0000 mon.c (mon.2) 48 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi106.front.sepia.ceph.com:3000"}]: dispatch 2024-02-13T00:31:33.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[24237]: audit 2024-02-13T00:31:32.392471+0000 mgr.y (mgr.24461) 72 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi106.front.sepia.ceph.com:3000"}]: dispatch 2024-02-13T00:31:33.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[24237]: audit 2024-02-13T00:31:32.399845+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:33.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[24237]: audit 2024-02-13T00:31:32.405437+0000 mon.c (mon.2) 49 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:31:33.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[24237]: cluster 2024-02-13T00:31:32.685671+0000 mgr.y (mgr.24461) 73 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:33.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[17386]: audit 2024-02-13T00:31:32.342822+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:33.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[17386]: audit 2024-02-13T00:31:32.349091+0000 mon.c (mon.2) 43 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-13T00:31:33.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[17386]: audit 2024-02-13T00:31:32.349741+0000 mgr.y (mgr.24461) 67 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-13T00:31:33.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[17386]: audit 2024-02-13T00:31:32.351185+0000 mon.c (mon.2) 44 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi080.front.sepia.ceph.com:9093"}]: dispatch 2024-02-13T00:31:33.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[17386]: audit 2024-02-13T00:31:32.351622+0000 mgr.y (mgr.24461) 68 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi080.front.sepia.ceph.com:9093"}]: dispatch 2024-02-13T00:31:33.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[17386]: audit 2024-02-13T00:31:32.356934+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:33.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[17386]: audit 2024-02-13T00:31:32.363416+0000 mon.c (mon.2) 45 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-13T00:31:33.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[17386]: audit 2024-02-13T00:31:32.364329+0000 mgr.y (mgr.24461) 69 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-13T00:31:33.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[17386]: audit 2024-02-13T00:31:32.367747+0000 mon.c (mon.2) 46 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi106.front.sepia.ceph.com:9095"}]: dispatch 2024-02-13T00:31:33.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[17386]: audit 2024-02-13T00:31:32.368585+0000 mgr.y (mgr.24461) 70 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi106.front.sepia.ceph.com:9095"}]: dispatch 2024-02-13T00:31:33.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[17386]: audit 2024-02-13T00:31:32.375933+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:33.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[17386]: audit 2024-02-13T00:31:32.382361+0000 mon.c (mon.2) 47 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-13T00:31:33.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[17386]: audit 2024-02-13T00:31:32.383048+0000 mgr.y (mgr.24461) 71 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-13T00:31:33.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[17386]: audit 2024-02-13T00:31:32.391620+0000 mon.c (mon.2) 48 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi106.front.sepia.ceph.com:3000"}]: dispatch 2024-02-13T00:31:33.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[17386]: audit 2024-02-13T00:31:32.392471+0000 mgr.y (mgr.24461) 72 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi106.front.sepia.ceph.com:3000"}]: dispatch 2024-02-13T00:31:33.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[17386]: audit 2024-02-13T00:31:32.399845+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:33.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[17386]: audit 2024-02-13T00:31:32.405437+0000 mon.c (mon.2) 49 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:31:33.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:33 smithi080 bash[17386]: cluster 2024-02-13T00:31:32.685671+0000 mgr.y (mgr.24461) 73 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:34.005 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[42447]: ts=2024-02-13T00:31:33.716Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=32.405µs wal_replay_duration=301.866914ms total_replay_duration=301.911678ms 2024-02-13T00:31:34.005 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[42447]: ts=2024-02-13T00:31:33.721Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-02-13T00:31:34.005 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[42447]: ts=2024-02-13T00:31:33.721Z caller=main.go:947 level=info msg="TSDB started" 2024-02-13T00:31:34.005 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[42447]: ts=2024-02-13T00:31:33.721Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-13T00:31:34.005 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[42447]: ts=2024-02-13T00:31:33.748Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=26.201009ms db_storage=1.054µs remote_storage=2.153µs web_handler=519ns query_engine=921ns scrape=334.13µs scrape_sd=39.436µs notify=28.416µs notify_sd=32.314µs rules=25.443137ms 2024-02-13T00:31:34.005 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:31:33 smithi106 bash[42447]: ts=2024-02-13T00:31:33.748Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-02-13T00:31:34.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.562+0000 7f51e8adf700 1 -- 172.21.15.80:0/3613648823 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51e40fd4f0 msgr2=0x7f51e40f6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:34.569 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.562+0000 7f51e8adf700 1 --2- 172.21.15.80:0/3613648823 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51e40fd4f0 0x7f51e40f6d20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f51d4004870 tx=0x7f51d4009cb0).stop 2024-02-13T00:31:34.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.562+0000 7f51e8adf700 1 -- 172.21.15.80:0/3613648823 shutdown_connections 2024-02-13T00:31:34.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.562+0000 7f51e8adf700 1 --2- 172.21.15.80:0/3613648823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51e40fcb90 0x7f51e40fcf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:34.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.562+0000 7f51e8adf700 1 --2- 172.21.15.80:0/3613648823 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51e40f7400 0x7f51e4103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:34.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.562+0000 7f51e8adf700 1 --2- 172.21.15.80:0/3613648823 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51e40fd4f0 0x7f51e40f6d20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:34.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.562+0000 7f51e8adf700 1 -- 172.21.15.80:0/3613648823 >> 172.21.15.80:0/3613648823 conn(0x7f51e40f27a0 msgr2=0x7f51e40f4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:31:34.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.562+0000 7f51e8adf700 1 -- 172.21.15.80:0/3613648823 shutdown_connections 2024-02-13T00:31:34.570 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.562+0000 7f51e8adf700 1 -- 172.21.15.80:0/3613648823 wait complete. 2024-02-13T00:31:34.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.562+0000 7f51e8adf700 1 Processor -- start 2024-02-13T00:31:34.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.562+0000 7f51e8adf700 1 -- start start 2024-02-13T00:31:34.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51e8adf700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51e40f7400 0x7f51e410e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:34.571 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51e8adf700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51e40fcb90 0x7f51e410e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:34.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51e8adf700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51e40fd4f0 0x7f51e41081d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:34.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51e8adf700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e41086c0 con 0x7f51e40fcb90 2024-02-13T00:31:34.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51e8adf700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e4108830 con 0x7f51e40fd4f0 2024-02-13T00:31:34.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51e8adf700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e41089f0 con 0x7f51e40f7400 2024-02-13T00:31:34.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51dbfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51e40fcb90 0x7f51e410e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:34.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51e259c700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51e40f7400 0x7f51e410e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:34.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51dbfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51e40fcb90 0x7f51e410e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:55338/0 (socket says 172.21.15.80:55338) 2024-02-13T00:31:34.572 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51dbfff700 1 -- 172.21.15.80:0/4012654310 learned_addr learned my addr 172.21.15.80:0/4012654310 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:31:34.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51dbfff700 1 -- 172.21.15.80:0/4012654310 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51e40f7400 msgr2=0x7f51e410e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:34.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51dbfff700 1 --2- 172.21.15.80:0/4012654310 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51e40f7400 0x7f51e410e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:34.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51e2d9d700 1 --2- 172.21.15.80:0/4012654310 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51e40fd4f0 0x7f51e41081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:34.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51dbfff700 1 -- 172.21.15.80:0/4012654310 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51e40fd4f0 msgr2=0x7f51e41081d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:34.573 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51dbfff700 1 --2- 172.21.15.80:0/4012654310 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51e40fd4f0 0x7f51e41081d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:34.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51dbfff700 1 -- 172.21.15.80:0/4012654310 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d4005040 con 0x7f51e40fcb90 2024-02-13T00:31:34.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51dbfff700 1 --2- 172.21.15.80:0/4012654310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51e40fcb90 0x7f51e410e520 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f51d4000e50 tx=0x7f51d4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:31:34.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51e2d9d700 1 --2- 172.21.15.80:0/4012654310 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51e40fd4f0 0x7f51e41081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-13T00:31:34.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51db7fe700 1 -- 172.21.15.80:0/4012654310 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d400e030 con 0x7f51e40fcb90 2024-02-13T00:31:34.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51e8adf700 1 -- 172.21.15.80:0/4012654310 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e4108c70 con 0x7f51e40fcb90 2024-02-13T00:31:34.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51db7fe700 1 -- 172.21.15.80:0/4012654310 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f51d40096d0 con 0x7f51e40fcb90 2024-02-13T00:31:34.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51db7fe700 1 -- 172.21.15.80:0/4012654310 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4018070 con 0x7f51e40fcb90 2024-02-13T00:31:34.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51e8adf700 1 -- 172.21.15.80:0/4012654310 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e4114e60 con 0x7f51e40fcb90 2024-02-13T00:31:34.574 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.566+0000 7f51e8adf700 1 -- 172.21.15.80:0/4012654310 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c4004f50 con 0x7f51e40fcb90 2024-02-13T00:31:34.577 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.570+0000 7f51db7fe700 1 -- 172.21.15.80:0/4012654310 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f51d4013d30 con 0x7f51e40fcb90 2024-02-13T00:31:34.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.570+0000 7f51db7fe700 1 --2- 172.21.15.80:0/4012654310 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f51d0061340 0x7f51d0063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:34.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.570+0000 7f51db7fe700 1 -- 172.21.15.80:0/4012654310 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f51d407dee0 con 0x7f51e40fcb90 2024-02-13T00:31:34.578 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.570+0000 7f51e259c700 1 --2- 172.21.15.80:0/4012654310 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f51d0061340 0x7f51d0063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:34.579 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.574+0000 7f51e259c700 1 --2- 172.21.15.80:0/4012654310 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f51d0061340 0x7f51d0063800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f51cc004ee0 tx=0x7f51cc00b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:31:34.584 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.578+0000 7f51db7fe700 1 -- 172.21.15.80:0/4012654310 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f51d404dc60 con 0x7f51e40fcb90 2024-02-13T00:31:34.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.766+0000 7f51e8adf700 1 -- 172.21.15.80:0/4012654310 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"} v 0) v1 -- 0x7f51c4005780 con 0x7f51e40fcb90 2024-02-13T00:31:34.772 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.766+0000 7f51db7fe700 1 -- 172.21.15.80:0/4012654310 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"}]=0 v63) v1 ==== 108+0+11 (secure 0 0 0) 0x7f51d4051280 con 0x7f51e40fcb90 2024-02-13T00:31:34.772 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-02-13T00:31:34.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.766+0000 7f51e8adf700 1 -- 172.21.15.80:0/4012654310 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f51d0061340 msgr2=0x7f51d0063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:34.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.766+0000 7f51e8adf700 1 --2- 172.21.15.80:0/4012654310 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f51d0061340 0x7f51d0063800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f51cc004ee0 tx=0x7f51cc00b040).stop 2024-02-13T00:31:34.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.766+0000 7f51e8adf700 1 -- 172.21.15.80:0/4012654310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51e40fcb90 msgr2=0x7f51e410e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:34.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.766+0000 7f51e8adf700 1 --2- 172.21.15.80:0/4012654310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51e40fcb90 0x7f51e410e520 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f51d4000e50 tx=0x7f51d4009cb0).stop 2024-02-13T00:31:34.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.766+0000 7f51e8adf700 1 -- 172.21.15.80:0/4012654310 shutdown_connections 2024-02-13T00:31:34.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.766+0000 7f51e8adf700 1 --2- 172.21.15.80:0/4012654310 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f51d0061340 0x7f51d0063800 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:34.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.766+0000 7f51e8adf700 1 --2- 172.21.15.80:0/4012654310 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51e40fd4f0 0x7f51e41081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:34.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.766+0000 7f51e8adf700 1 --2- 172.21.15.80:0/4012654310 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51e40f7400 0x7f51e410e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:34.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.766+0000 7f51e8adf700 1 --2- 172.21.15.80:0/4012654310 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51e40fcb90 0x7f51e410e520 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:34.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.766+0000 7f51e8adf700 1 -- 172.21.15.80:0/4012654310 >> 172.21.15.80:0/4012654310 conn(0x7f51e40f27a0 msgr2=0x7f51e4061010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:31:34.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.766+0000 7f51e8adf700 1 -- 172.21.15.80:0/4012654310 shutdown_connections 2024-02-13T00:31:34.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:34.766+0000 7f51e8adf700 1 -- 172.21.15.80:0/4012654310 wait complete. 2024-02-13T00:31:35.553 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph osd pool get default.rgw.meta pg_num 2024-02-13T00:31:35.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:35 smithi106 bash[18459]: cluster 2024-02-13T00:31:34.686294+0000 mgr.y (mgr.24461) 74 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:35.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:35 smithi106 bash[18459]: audit 2024-02-13T00:31:34.769060+0000 mon.a (mon.0) 667 : audit [DBG] from='client.? 172.21.15.80:0/4012654310' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"}]: dispatch 2024-02-13T00:31:35.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:35 smithi080 bash[17386]: cluster 2024-02-13T00:31:34.686294+0000 mgr.y (mgr.24461) 74 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:35.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:35 smithi080 bash[17386]: audit 2024-02-13T00:31:34.769060+0000 mon.a (mon.0) 667 : audit [DBG] from='client.? 172.21.15.80:0/4012654310' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"}]: dispatch 2024-02-13T00:31:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:35 smithi080 bash[24237]: cluster 2024-02-13T00:31:34.686294+0000 mgr.y (mgr.24461) 74 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:35 smithi080 bash[24237]: audit 2024-02-13T00:31:34.769060+0000 mon.a (mon.0) 667 : audit [DBG] from='client.? 172.21.15.80:0/4012654310' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.control", "var": "pg_num"}]: dispatch 2024-02-13T00:31:38.005 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:31:37 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:31:38.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:37 smithi106 bash[18459]: cluster 2024-02-13T00:31:36.686977+0000 mgr.y (mgr.24461) 75 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:38.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:37 smithi080 bash[17386]: cluster 2024-02-13T00:31:36.686977+0000 mgr.y (mgr.24461) 75 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:38.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:31:37 smithi080 bash[48089]: level=info ts=2024-02-13T00:31:37.875Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.003538812s 2024-02-13T00:31:38.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:37 smithi080 bash[24237]: cluster 2024-02-13T00:31:36.686977+0000 mgr.y (mgr.24461) 75 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:39.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:38 smithi106 bash[18459]: audit 2024-02-13T00:31:37.732976+0000 mgr.y (mgr.24461) 76 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:31:39.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:38 smithi106 bash[18459]: audit 2024-02-13T00:31:38.460933+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:39.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:38 smithi080 bash[17386]: audit 2024-02-13T00:31:37.732976+0000 mgr.y (mgr.24461) 76 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:31:39.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:38 smithi080 bash[17386]: audit 2024-02-13T00:31:38.460933+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:39.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:38 smithi080 bash[24237]: audit 2024-02-13T00:31:37.732976+0000 mgr.y (mgr.24461) 76 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:31:39.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:38 smithi080 bash[24237]: audit 2024-02-13T00:31:38.460933+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:40.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:39 smithi106 bash[18459]: cluster 2024-02-13T00:31:38.688376+0000 mgr.y (mgr.24461) 77 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:40.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:39 smithi106 bash[18459]: audit 2024-02-13T00:31:39.157343+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:40.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:39 smithi106 bash[18459]: audit 2024-02-13T00:31:39.445140+0000 mon.c (mon.2) 50 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:31:40.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:39 smithi106 bash[18459]: audit 2024-02-13T00:31:39.446896+0000 mon.c (mon.2) 51 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:31:40.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:39 smithi106 bash[18459]: audit 2024-02-13T00:31:39.455627+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:40.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:39 smithi106 bash[18459]: audit 2024-02-13T00:31:39.464555+0000 mon.c (mon.2) 52 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:31:40.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:39 smithi080 bash[17386]: cluster 2024-02-13T00:31:38.688376+0000 mgr.y (mgr.24461) 77 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:40.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:39 smithi080 bash[17386]: audit 2024-02-13T00:31:39.157343+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:40.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:39 smithi080 bash[17386]: audit 2024-02-13T00:31:39.445140+0000 mon.c (mon.2) 50 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:31:40.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:39 smithi080 bash[17386]: audit 2024-02-13T00:31:39.446896+0000 mon.c (mon.2) 51 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:31:40.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:39 smithi080 bash[17386]: audit 2024-02-13T00:31:39.455627+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:40.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:39 smithi080 bash[17386]: audit 2024-02-13T00:31:39.464555+0000 mon.c (mon.2) 52 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:31:40.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:39 smithi080 bash[24237]: cluster 2024-02-13T00:31:38.688376+0000 mgr.y (mgr.24461) 77 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:40.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:39 smithi080 bash[24237]: audit 2024-02-13T00:31:39.157343+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:40.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:39 smithi080 bash[24237]: audit 2024-02-13T00:31:39.445140+0000 mon.c (mon.2) 50 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:31:40.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:39 smithi080 bash[24237]: audit 2024-02-13T00:31:39.446896+0000 mon.c (mon.2) 51 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:31:40.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:39 smithi080 bash[24237]: audit 2024-02-13T00:31:39.455627+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:40.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:39 smithi080 bash[24237]: audit 2024-02-13T00:31:39.464555+0000 mon.c (mon.2) 52 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:31:40.335 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:31:40.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:31:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:31:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:31:42.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:41 smithi080 bash[17386]: cluster 2024-02-13T00:31:40.688816+0000 mgr.y (mgr.24461) 78 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:42.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:41 smithi080 bash[24237]: cluster 2024-02-13T00:31:40.688816+0000 mgr.y (mgr.24461) 78 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:42.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:41 smithi106 bash[18459]: cluster 2024-02-13T00:31:40.688816+0000 mgr.y (mgr.24461) 78 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:43.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.085+0000 7efcb8d3a700 1 -- 172.21.15.80:0/1755059119 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efcb4104600 msgr2=0x7efcb41069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:43.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.085+0000 7efcb8d3a700 1 --2- 172.21.15.80:0/1755059119 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efcb4104600 0x7efcb41069f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7efcac0047b0 tx=0x7efcac009cb0).stop 2024-02-13T00:31:43.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.085+0000 7efcb8d3a700 1 -- 172.21.15.80:0/1755059119 shutdown_connections 2024-02-13T00:31:43.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.085+0000 7efcb8d3a700 1 --2- 172.21.15.80:0/1755059119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcb40f6aa0 0x7efcb40f6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:43.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.085+0000 7efcb8d3a700 1 --2- 172.21.15.80:0/1755059119 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efcb4104600 0x7efcb41069f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:43.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.085+0000 7efcb8d3a700 1 --2- 172.21.15.80:0/1755059119 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcb40f7370 0x7efcb4104110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:43.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.085+0000 7efcb8d3a700 1 -- 172.21.15.80:0/1755059119 >> 172.21.15.80:0/1755059119 conn(0x7efcb40f27e0 msgr2=0x7efcb40f4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:31:43.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.085+0000 7efcb8d3a700 1 -- 172.21.15.80:0/1755059119 shutdown_connections 2024-02-13T00:31:43.093 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.085+0000 7efcb8d3a700 1 -- 172.21.15.80:0/1755059119 wait complete. 2024-02-13T00:31:43.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.085+0000 7efcb8d3a700 1 Processor -- start 2024-02-13T00:31:43.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.085+0000 7efcb8d3a700 1 -- start start 2024-02-13T00:31:43.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.085+0000 7efcb8d3a700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efcb40f6aa0 0x7efcb41100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:43.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.085+0000 7efcb8d3a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcb40f7370 0x7efcb41105b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:43.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.085+0000 7efcb8d3a700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcb4104600 0x7efcb410a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:43.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.085+0000 7efcb8d3a700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb410a750 con 0x7efcb4104600 2024-02-13T00:31:43.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.085+0000 7efcb8d3a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb410a8c0 con 0x7efcb40f7370 2024-02-13T00:31:43.095 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.085+0000 7efcb8d3a700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb410aa80 con 0x7efcb40f6aa0 2024-02-13T00:31:43.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.089+0000 7efcb259c700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efcb40f6aa0 0x7efcb41100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:43.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.089+0000 7efcb2d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcb4104600 0x7efcb410a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:43.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.089+0000 7efcb259c700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efcb40f6aa0 0x7efcb41100c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:60380/0 (socket says 172.21.15.80:60380) 2024-02-13T00:31:43.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.089+0000 7efcb259c700 1 -- 172.21.15.80:0/3376092368 learned_addr learned my addr 172.21.15.80:0/3376092368 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:31:43.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.089+0000 7efcb1d9b700 1 --2- 172.21.15.80:0/3376092368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcb40f7370 0x7efcb41105b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:43.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.089+0000 7efcb2d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcb4104600 0x7efcb410a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:56356/0 (socket says 172.21.15.80:56356) 2024-02-13T00:31:43.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.089+0000 7efcb259c700 1 -- 172.21.15.80:0/3376092368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcb40f7370 msgr2=0x7efcb41105b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:43.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.089+0000 7efcb259c700 1 --2- 172.21.15.80:0/3376092368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcb40f7370 0x7efcb41105b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:43.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.089+0000 7efcb259c700 1 -- 172.21.15.80:0/3376092368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcb4104600 msgr2=0x7efcb410a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:43.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.089+0000 7efcb259c700 1 --2- 172.21.15.80:0/3376092368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcb4104600 0x7efcb410a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:43.096 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.089+0000 7efcb259c700 1 -- 172.21.15.80:0/3376092368 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca8005040 con 0x7efcb40f6aa0 2024-02-13T00:31:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.089+0000 7efcb259c700 1 --2- 172.21.15.80:0/3376092368 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efcb40f6aa0 0x7efcb41100c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7efca400db80 tx=0x7efca4004f00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:31:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.089+0000 7efca37fe700 1 -- 172.21.15.80:0/3376092368 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca40077a0 con 0x7efcb40f6aa0 2024-02-13T00:31:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.089+0000 7efca37fe700 1 -- 172.21.15.80:0/3376092368 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7efca400f040 con 0x7efcb40f6aa0 2024-02-13T00:31:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.089+0000 7efca37fe700 1 -- 172.21.15.80:0/3376092368 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca4013910 con 0x7efcb40f6aa0 2024-02-13T00:31:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.089+0000 7efcb8d3a700 1 -- 172.21.15.80:0/3376092368 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcac005040 con 0x7efcb40f6aa0 2024-02-13T00:31:43.097 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.089+0000 7efcb8d3a700 1 -- 172.21.15.80:0/3376092368 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb410b040 con 0x7efcb40f6aa0 2024-02-13T00:31:43.098 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.089+0000 7efcb8d3a700 1 -- 172.21.15.80:0/3376092368 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb40475e0 con 0x7efcb40f6aa0 2024-02-13T00:31:43.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.093+0000 7efca37fe700 1 -- 172.21.15.80:0/3376092368 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7efca400b960 con 0x7efcb40f6aa0 2024-02-13T00:31:43.099 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.093+0000 7efca37fe700 1 --2- 172.21.15.80:0/3376092368 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7efc9c061340 0x7efc9c063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:43.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.093+0000 7efca37fe700 1 -- 172.21.15.80:0/3376092368 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7efca407c970 con 0x7efcb40f6aa0 2024-02-13T00:31:43.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.093+0000 7efcb1d9b700 1 --2- 172.21.15.80:0/3376092368 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7efc9c061340 0x7efc9c063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:43.100 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.093+0000 7efcb1d9b700 1 --2- 172.21.15.80:0/3376092368 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7efc9c061340 0x7efc9c063800 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7efcb410ba00 tx=0x7efca800b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:31:43.105 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.097+0000 7efca37fe700 1 -- 172.21.15.80:0/3376092368 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7efca404c860 con 0x7efcb40f6aa0 2024-02-13T00:31:43.258 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:31:43] "GET /metrics HTTP/1.1" 200 172200 "" "Prometheus/2.33.4" 2024-02-13T00:31:43.288 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.281+0000 7efcb8d3a700 1 -- 172.21.15.80:0/3376092368 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"} v 0) v1 -- 0x7efcb410b740 con 0x7efcb40f6aa0 2024-02-13T00:31:43.289 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.281+0000 7efca37fe700 1 -- 172.21.15.80:0/3376092368 <== mon.2 v2:172.21.15.80:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"}]=0 v63) v1 ==== 105+0+11 (secure 0 0 0) 0x7efca40180b0 con 0x7efcb40f6aa0 2024-02-13T00:31:43.289 INFO:teuthology.orchestra.run.smithi080.stdout:pg_num: 32 2024-02-13T00:31:43.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.285+0000 7efcb8d3a700 1 -- 172.21.15.80:0/3376092368 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7efc9c061340 msgr2=0x7efc9c063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:43.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.285+0000 7efcb8d3a700 1 --2- 172.21.15.80:0/3376092368 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7efc9c061340 0x7efc9c063800 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7efcb410ba00 tx=0x7efca800b040).stop 2024-02-13T00:31:43.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.285+0000 7efcb8d3a700 1 -- 172.21.15.80:0/3376092368 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efcb40f6aa0 msgr2=0x7efcb41100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:43.291 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.285+0000 7efcb8d3a700 1 --2- 172.21.15.80:0/3376092368 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efcb40f6aa0 0x7efcb41100c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7efca400db80 tx=0x7efca4004f00).stop 2024-02-13T00:31:43.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.285+0000 7efcb8d3a700 1 -- 172.21.15.80:0/3376092368 shutdown_connections 2024-02-13T00:31:43.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.285+0000 7efcb8d3a700 1 --2- 172.21.15.80:0/3376092368 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7efc9c061340 0x7efc9c063800 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:43.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.285+0000 7efcb8d3a700 1 --2- 172.21.15.80:0/3376092368 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7efcb4104600 0x7efcb410a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:43.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.285+0000 7efcb8d3a700 1 --2- 172.21.15.80:0/3376092368 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7efcb40f6aa0 0x7efcb41100c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:43.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.285+0000 7efcb8d3a700 1 --2- 172.21.15.80:0/3376092368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efcb40f7370 0x7efcb41105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:43.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.285+0000 7efcb8d3a700 1 -- 172.21.15.80:0/3376092368 >> 172.21.15.80:0/3376092368 conn(0x7efcb40f27e0 msgr2=0x7efcb40f4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:31:43.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.285+0000 7efcb8d3a700 1 -- 172.21.15.80:0/3376092368 shutdown_connections 2024-02-13T00:31:43.292 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:43.285+0000 7efcb8d3a700 1 -- 172.21.15.80:0/3376092368 wait complete. 2024-02-13T00:31:44.091 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:43 smithi080 bash[17386]: cluster 2024-02-13T00:31:42.689458+0000 mgr.y (mgr.24461) 79 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:44.091 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:43 smithi080 bash[17386]: audit 2024-02-13T00:31:43.286458+0000 mon.c (mon.2) 53 : audit [DBG] from='client.? 172.21.15.80:0/3376092368' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"}]: dispatch 2024-02-13T00:31:44.091 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:43 smithi080 bash[24237]: cluster 2024-02-13T00:31:42.689458+0000 mgr.y (mgr.24461) 79 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:44.091 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:43 smithi080 bash[24237]: audit 2024-02-13T00:31:43.286458+0000 mon.c (mon.2) 53 : audit [DBG] from='client.? 172.21.15.80:0/3376092368' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"}]: dispatch 2024-02-13T00:31:44.092 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-13T00:31:44.092 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-13T00:31:44.093 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph mgr dump --format=json 2024-02-13T00:31:44.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:43 smithi106 bash[18459]: cluster 2024-02-13T00:31:42.689458+0000 mgr.y (mgr.24461) 79 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:44.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:43 smithi106 bash[18459]: audit 2024-02-13T00:31:43.286458+0000 mon.c (mon.2) 53 : audit [DBG] from='client.? 172.21.15.80:0/3376092368' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "default.rgw.meta", "var": "pg_num"}]: dispatch 2024-02-13T00:31:45.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:45 smithi106 bash[18459]: audit 2024-02-13T00:31:44.149068+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:45.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:45 smithi106 bash[18459]: cluster 2024-02-13T00:31:44.690116+0000 mgr.y (mgr.24461) 80 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:45.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:45 smithi080 bash[17386]: audit 2024-02-13T00:31:44.149068+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:45.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:45 smithi080 bash[17386]: cluster 2024-02-13T00:31:44.690116+0000 mgr.y (mgr.24461) 80 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:45.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:45 smithi080 bash[24237]: audit 2024-02-13T00:31:44.149068+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:45.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:45 smithi080 bash[24237]: cluster 2024-02-13T00:31:44.690116+0000 mgr.y (mgr.24461) 80 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:47.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:46 smithi106 bash[18459]: audit 2024-02-13T00:31:45.515001+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:47.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:46 smithi106 bash[18459]: audit 2024-02-13T00:31:45.517582+0000 mon.c (mon.2) 54 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:31:47.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:46 smithi106 bash[18459]: audit 2024-02-13T00:31:45.519068+0000 mon.c (mon.2) 55 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:31:47.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:46 smithi106 bash[18459]: audit 2024-02-13T00:31:45.526216+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:47.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:46 smithi080 bash[17386]: audit 2024-02-13T00:31:45.515001+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:47.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:46 smithi080 bash[17386]: audit 2024-02-13T00:31:45.517582+0000 mon.c (mon.2) 54 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:31:47.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:46 smithi080 bash[17386]: audit 2024-02-13T00:31:45.519068+0000 mon.c (mon.2) 55 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:31:47.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:46 smithi080 bash[17386]: audit 2024-02-13T00:31:45.526216+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:47.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:46 smithi080 bash[24237]: audit 2024-02-13T00:31:45.515001+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:47.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:46 smithi080 bash[24237]: audit 2024-02-13T00:31:45.517582+0000 mon.c (mon.2) 54 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:31:47.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:46 smithi080 bash[24237]: audit 2024-02-13T00:31:45.519068+0000 mon.c (mon.2) 55 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:31:47.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:46 smithi080 bash[24237]: audit 2024-02-13T00:31:45.526216+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:31:48.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:47 smithi106 bash[18459]: cluster 2024-02-13T00:31:46.690799+0000 mgr.y (mgr.24461) 81 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T00:31:48.005 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:31:47 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:31:48.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:47 smithi080 bash[17386]: cluster 2024-02-13T00:31:46.690799+0000 mgr.y (mgr.24461) 81 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T00:31:48.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:47 smithi080 bash[24237]: cluster 2024-02-13T00:31:46.690799+0000 mgr.y (mgr.24461) 81 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T00:31:48.876 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:31:48.906 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:48 smithi080 bash[17386]: audit 2024-02-13T00:31:47.740950+0000 mgr.y (mgr.24461) 82 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:31:48.906 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:48 smithi080 bash[24237]: audit 2024-02-13T00:31:47.740950+0000 mgr.y (mgr.24461) 82 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:31:49.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:48 smithi106 bash[18459]: audit 2024-02-13T00:31:47.740950+0000 mgr.y (mgr.24461) 82 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:31:49.838 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:49 smithi080 bash[17386]: cluster 2024-02-13T00:31:48.692215+0000 mgr.y (mgr.24461) 83 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:49.839 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:49 smithi080 bash[24237]: cluster 2024-02-13T00:31:48.692215+0000 mgr.y (mgr.24461) 83 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:50.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:49 smithi106 bash[18459]: cluster 2024-02-13T00:31:48.692215+0000 mgr.y (mgr.24461) 83 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:50.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:31:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:31:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:31:51.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c97ca700 1 -- 172.21.15.80:0/2211372709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94c40fdd60 msgr2=0x7f94c40fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:51.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c97ca700 1 --2- 172.21.15.80:0/2211372709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94c40fdd60 0x7f94c40fe140 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f94b4004870 tx=0x7f94b4009cb0).stop 2024-02-13T00:31:51.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c97ca700 1 -- 172.21.15.80:0/2211372709 shutdown_connections 2024-02-13T00:31:51.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c97ca700 1 --2- 172.21.15.80:0/2211372709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94c40f6850 0x7f94c4104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:51.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c97ca700 1 --2- 172.21.15.80:0/2211372709 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94c40fdd60 0x7f94c40fe140 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:51.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c97ca700 1 --2- 172.21.15.80:0/2211372709 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94c40fe6c0 0x7f94c40f6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:51.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c97ca700 1 -- 172.21.15.80:0/2211372709 >> 172.21.15.80:0/2211372709 conn(0x7f94c40701a0 msgr2=0x7f94c40f44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:31:51.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c97ca700 1 -- 172.21.15.80:0/2211372709 shutdown_connections 2024-02-13T00:31:51.761 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c97ca700 1 -- 172.21.15.80:0/2211372709 wait complete. 2024-02-13T00:31:51.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c97ca700 1 Processor -- start 2024-02-13T00:31:51.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c97ca700 1 -- start start 2024-02-13T00:31:51.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c97ca700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94c40f6850 0x7f94c4110200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:51.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c97ca700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94c40fdd60 0x7f94c41106f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:51.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c97ca700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94c40fe6c0 0x7f94c410a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:51.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c97ca700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c410a890 con 0x7f94c40f6850 2024-02-13T00:31:51.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c97ca700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c410aa00 con 0x7f94c40fdd60 2024-02-13T00:31:51.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c97ca700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c410abc0 con 0x7f94c40fe6c0 2024-02-13T00:31:51.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c2ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94c40f6850 0x7f94c4110200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:51.763 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c2ffd700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94c40f6850 0x7f94c4110200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:57758/0 (socket says 172.21.15.80:57758) 2024-02-13T00:31:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c2ffd700 1 -- 172.21.15.80:0/2073588544 learned_addr learned my addr 172.21.15.80:0/2073588544 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:31:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c37fe700 1 --2- 172.21.15.80:0/2073588544 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94c40fe6c0 0x7f94c410a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c27fc700 1 --2- 172.21.15.80:0/2073588544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94c40fdd60 0x7f94c41106f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c2ffd700 1 -- 172.21.15.80:0/2073588544 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94c40fe6c0 msgr2=0x7f94c410a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c2ffd700 1 --2- 172.21.15.80:0/2073588544 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94c40fe6c0 0x7f94c410a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c2ffd700 1 -- 172.21.15.80:0/2073588544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94c40fdd60 msgr2=0x7f94c41106f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c2ffd700 1 --2- 172.21.15.80:0/2073588544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94c40fdd60 0x7f94c41106f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c2ffd700 1 -- 172.21.15.80:0/2073588544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b4005040 con 0x7f94c40f6850 2024-02-13T00:31:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94c2ffd700 1 --2- 172.21.15.80:0/2073588544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94c40f6850 0x7f94c4110200 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f94b40045d0 tx=0x7f94b4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:31:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.753+0000 7f94abfff700 1 -- 172.21.15.80:0/2073588544 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b400e030 con 0x7f94c40f6850 2024-02-13T00:31:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.757+0000 7f94abfff700 1 -- 172.21.15.80:0/2073588544 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f94b4013e30 con 0x7f94c40f6850 2024-02-13T00:31:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.757+0000 7f94c97ca700 1 -- 172.21.15.80:0/2073588544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c410ae40 con 0x7f94c40f6850 2024-02-13T00:31:51.764 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.757+0000 7f94abfff700 1 -- 172.21.15.80:0/2073588544 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4018070 con 0x7f94c40f6850 2024-02-13T00:31:51.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.757+0000 7f94c97ca700 1 -- 172.21.15.80:0/2073588544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c4117030 con 0x7f94c40f6850 2024-02-13T00:31:51.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.757+0000 7f94c97ca700 1 -- 172.21.15.80:0/2073588544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c405fad0 con 0x7f94c40f6850 2024-02-13T00:31:51.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.757+0000 7f94abfff700 1 -- 172.21.15.80:0/2073588544 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f94b401dd50 con 0x7f94c40f6850 2024-02-13T00:31:51.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.757+0000 7f94abfff700 1 --2- 172.21.15.80:0/2073588544 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f94ac061370 0x7f94ac063830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:31:51.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.757+0000 7f94abfff700 1 -- 172.21.15.80:0/2073588544 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f94b407e190 con 0x7f94c40f6850 2024-02-13T00:31:51.765 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.757+0000 7f94c27fc700 1 --2- 172.21.15.80:0/2073588544 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f94ac061370 0x7f94ac063830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:31:51.766 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.757+0000 7f94c27fc700 1 --2- 172.21.15.80:0/2073588544 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f94ac061370 0x7f94ac063830 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f94c410bb40 tx=0x7f94b8009cd0).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:31:51.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:51.765+0000 7f94abfff700 1 -- 172.21.15.80:0/2073588544 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f94b404df10 con 0x7f94c40f6850 2024-02-13T00:31:52.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:51 smithi106 bash[18459]: cluster 2024-02-13T00:31:50.692894+0000 mgr.y (mgr.24461) 84 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:52.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:51 smithi080 bash[17386]: cluster 2024-02-13T00:31:50.692894+0000 mgr.y (mgr.24461) 84 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:52.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:51 smithi080 bash[24237]: cluster 2024-02-13T00:31:50.692894+0000 mgr.y (mgr.24461) 84 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:52.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:52.009+0000 7f94c97ca700 1 -- 172.21.15.80:0/2073588544 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f94c4107100 con 0x7f94c40f6850 2024-02-13T00:31:52.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:52.017+0000 7f94abfff700 1 -- 172.21.15.80:0/2073588544 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+151997 (secure 0 0 0) 0x7f94b4051530 con 0x7f94c40f6850 2024-02-13T00:31:52.030 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-13T00:31:52.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:52.021+0000 7f94c97ca700 1 -- 172.21.15.80:0/2073588544 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f94ac061370 msgr2=0x7f94ac063830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:52.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:52.021+0000 7f94c97ca700 1 --2- 172.21.15.80:0/2073588544 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f94ac061370 0x7f94ac063830 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f94c410bb40 tx=0x7f94b8009cd0).stop 2024-02-13T00:31:52.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:52.021+0000 7f94c97ca700 1 -- 172.21.15.80:0/2073588544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94c40f6850 msgr2=0x7f94c4110200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:31:52.031 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:52.021+0000 7f94c97ca700 1 --2- 172.21.15.80:0/2073588544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94c40f6850 0x7f94c4110200 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f94b40045d0 tx=0x7f94b4009cb0).stop 2024-02-13T00:31:52.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:52.021+0000 7f94c97ca700 1 -- 172.21.15.80:0/2073588544 shutdown_connections 2024-02-13T00:31:52.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:52.021+0000 7f94c97ca700 1 --2- 172.21.15.80:0/2073588544 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f94ac061370 0x7f94ac063830 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:52.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:52.021+0000 7f94c97ca700 1 --2- 172.21.15.80:0/2073588544 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f94c40fe6c0 0x7f94c410a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:52.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:52.021+0000 7f94c97ca700 1 --2- 172.21.15.80:0/2073588544 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f94c40f6850 0x7f94c4110200 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:52.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:52.021+0000 7f94c97ca700 1 --2- 172.21.15.80:0/2073588544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94c40fdd60 0x7f94c41106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:31:52.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:52.021+0000 7f94c97ca700 1 -- 172.21.15.80:0/2073588544 >> 172.21.15.80:0/2073588544 conn(0x7f94c40701a0 msgr2=0x7f94c406c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:31:52.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:52.021+0000 7f94c97ca700 1 -- 172.21.15.80:0/2073588544 shutdown_connections 2024-02-13T00:31:52.032 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:31:52.025+0000 7f94c97ca700 1 -- 172.21.15.80:0/2073588544 wait complete. 2024-02-13T00:31:52.778 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":19,"active_gid":24461,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":2955905243},{"type":"v1","addr":"172.21.15.80:6801","nonce":2955905243}]},"active_addr":"172.21.15.80:6801/2955905243","active_change":"2024-02-13T00:30:16.631982+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":24454,"name":"x","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.80:8443/","prometheus":"http://172.21.15.80:9283/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":63,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":1808568592}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":4209124747}]}]} 2024-02-13T00:31:52.782 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-13T00:31:52.782 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-13T00:31:52.782 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph osd dump --format=json 2024-02-13T00:31:53.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:52 smithi080 bash[17386]: audit 2024-02-13T00:31:52.016708+0000 mon.a (mon.0) 674 : audit [DBG] from='client.? 172.21.15.80:0/2073588544' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-13T00:31:53.118 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:52 smithi080 bash[24237]: audit 2024-02-13T00:31:52.016708+0000 mon.a (mon.0) 674 : audit [DBG] from='client.? 172.21.15.80:0/2073588544' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-13T00:31:53.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:52 smithi106 bash[18459]: audit 2024-02-13T00:31:52.016708+0000 mon.a (mon.0) 674 : audit [DBG] from='client.? 172.21.15.80:0/2073588544' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-13T00:31:53.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:31:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:31:53] "GET /metrics HTTP/1.1" 200 172203 "" "Prometheus/2.33.4" 2024-02-13T00:31:54.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:53 smithi106 bash[18459]: cluster 2024-02-13T00:31:52.694211+0000 mgr.y (mgr.24461) 85 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:54.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:53 smithi080 bash[17386]: cluster 2024-02-13T00:31:52.694211+0000 mgr.y (mgr.24461) 85 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:54.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:53 smithi080 bash[24237]: cluster 2024-02-13T00:31:52.694211+0000 mgr.y (mgr.24461) 85 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:31:55.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:55 smithi080 bash[17386]: cluster 2024-02-13T00:31:54.694885+0000 mgr.y (mgr.24461) 86 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:55.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:55 smithi080 bash[24237]: cluster 2024-02-13T00:31:54.694885+0000 mgr.y (mgr.24461) 86 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:55 smithi106 bash[18459]: cluster 2024-02-13T00:31:54.694885+0000 mgr.y (mgr.24461) 86 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:57.564 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:31:58.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:57 smithi080 bash[17386]: cluster 2024-02-13T00:31:56.695590+0000 mgr.y (mgr.24461) 87 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:58.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:57 smithi080 bash[24237]: cluster 2024-02-13T00:31:56.695590+0000 mgr.y (mgr.24461) 87 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:58.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:31:57 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:31:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:57 smithi106 bash[18459]: cluster 2024-02-13T00:31:56.695590+0000 mgr.y (mgr.24461) 87 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:31:59.001 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:58 smithi080 bash[17386]: audit 2024-02-13T00:31:57.752125+0000 mgr.y (mgr.24461) 88 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:31:59.001 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:58 smithi080 bash[24237]: audit 2024-02-13T00:31:57.752125+0000 mgr.y (mgr.24461) 88 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:31:59.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:58 smithi106 bash[18459]: audit 2024-02-13T00:31:57.752125+0000 mgr.y (mgr.24461) 88 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:32:00.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:31:59 smithi106 bash[18459]: cluster 2024-02-13T00:31:58.697032+0000 mgr.y (mgr.24461) 89 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:00.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:31:59 smithi080 bash[17386]: cluster 2024-02-13T00:31:58.697032+0000 mgr.y (mgr.24461) 89 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:00.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:31:59 smithi080 bash[24237]: cluster 2024-02-13T00:31:58.697032+0000 mgr.y (mgr.24461) 89 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:00.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:32:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:32:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:32:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.509+0000 7fcecc21d700 1 -- 172.21.15.80:0/1437962771 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcec406ba80 msgr2=0x7fcec4104090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:00.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.509+0000 7fcecc21d700 1 --2- 172.21.15.80:0/1437962771 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcec406ba80 0x7fcec4104090 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fceb8004870 tx=0x7fceb8009cb0).stop 2024-02-13T00:32:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.509+0000 7fcecc21d700 1 -- 172.21.15.80:0/1437962771 shutdown_connections 2024-02-13T00:32:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.509+0000 7fcecc21d700 1 --2- 172.21.15.80:0/1437962771 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcec406b1b0 0x7fcec406b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.509+0000 7fcecc21d700 1 --2- 172.21.15.80:0/1437962771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcec4104580 0x7fcec4106970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.509+0000 7fcecc21d700 1 --2- 172.21.15.80:0/1437962771 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcec406ba80 0x7fcec4104090 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.509+0000 7fcecc21d700 1 -- 172.21.15.80:0/1437962771 >> 172.21.15.80:0/1437962771 conn(0x7fcec40f38c0 msgr2=0x7fcec40f5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:32:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.509+0000 7fcecc21d700 1 -- 172.21.15.80:0/1437962771 shutdown_connections 2024-02-13T00:32:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.509+0000 7fcecc21d700 1 -- 172.21.15.80:0/1437962771 wait complete. 2024-02-13T00:32:00.517 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.509+0000 7fcecc21d700 1 Processor -- start 2024-02-13T00:32:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.509+0000 7fcecc21d700 1 -- start start 2024-02-13T00:32:00.518 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.509+0000 7fcecc21d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcec406b1b0 0x7fcec41102c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.509+0000 7fcecc21d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcec406ba80 0x7fcec41107b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.509+0000 7fcecc21d700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcec4104580 0x7fcec410a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.509+0000 7fcecc21d700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec410a950 con 0x7fcec406ba80 2024-02-13T00:32:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.509+0000 7fcecc21d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec410aac0 con 0x7fcec406b1b0 2024-02-13T00:32:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.509+0000 7fcecc21d700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec410ac80 con 0x7fcec4104580 2024-02-13T00:32:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.509+0000 7fceca7ba700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcec4104580 0x7fcec410a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.509+0000 7fceca7ba700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcec4104580 0x7fcec410a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:46718/0 (socket says 172.21.15.80:46718) 2024-02-13T00:32:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.509+0000 7fceca7ba700 1 -- 172.21.15.80:0/1185062976 learned_addr learned my addr 172.21.15.80:0/1185062976 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:32:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.509+0000 7fcec97b8700 1 --2- 172.21.15.80:0/1185062976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcec406ba80 0x7fcec41107b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.509+0000 7fcec9fb9700 1 --2- 172.21.15.80:0/1185062976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcec406b1b0 0x7fcec41102c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.513+0000 7fceca7ba700 1 -- 172.21.15.80:0/1185062976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcec406b1b0 msgr2=0x7fcec41102c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.513+0000 7fceca7ba700 1 --2- 172.21.15.80:0/1185062976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcec406b1b0 0x7fcec41102c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:00.519 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.513+0000 7fceca7ba700 1 -- 172.21.15.80:0/1185062976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcec406ba80 msgr2=0x7fcec41107b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.513+0000 7fceca7ba700 1 --2- 172.21.15.80:0/1185062976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcec406ba80 0x7fcec41107b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.513+0000 7fceca7ba700 1 -- 172.21.15.80:0/1185062976 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb8005040 con 0x7fcec4104580 2024-02-13T00:32:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.513+0000 7fcec9fb9700 1 --2- 172.21.15.80:0/1185062976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcec406b1b0 0x7fcec41102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-13T00:32:00.520 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.513+0000 7fceca7ba700 1 --2- 172.21.15.80:0/1185062976 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcec4104580 0x7fcec410a460 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fcebc00eb70 tx=0x7fcebc00b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:32:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.513+0000 7fcec2ffd700 1 -- 172.21.15.80:0/1185062976 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc009910 con 0x7fcec4104580 2024-02-13T00:32:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.513+0000 7fcecc21d700 1 -- 172.21.15.80:0/1185062976 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec410af00 con 0x7fcec4104580 2024-02-13T00:32:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.513+0000 7fcec2ffd700 1 -- 172.21.15.80:0/1185062976 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fcebc00f040 con 0x7fcec4104580 2024-02-13T00:32:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.513+0000 7fcec2ffd700 1 -- 172.21.15.80:0/1185062976 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc007d20 con 0x7fcec4104580 2024-02-13T00:32:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.513+0000 7fcecc21d700 1 -- 172.21.15.80:0/1185062976 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec41170f0 con 0x7fcec4104580 2024-02-13T00:32:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.513+0000 7fcecc21d700 1 -- 172.21.15.80:0/1185062976 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec40620c0 con 0x7fcec4104580 2024-02-13T00:32:00.521 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.513+0000 7fcec2ffd700 1 -- 172.21.15.80:0/1185062976 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7fcebc0092e0 con 0x7fcec4104580 2024-02-13T00:32:00.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.513+0000 7fcec2ffd700 1 --2- 172.21.15.80:0/1185062976 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fceac061340 0x7fceac063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:00.522 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.517+0000 7fcec9fb9700 1 --2- 172.21.15.80:0/1185062976 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fceac061340 0x7fceac063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:00.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.517+0000 7fcec2ffd700 1 -- 172.21.15.80:0/1185062976 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7fcebc07cc70 con 0x7fcec4104580 2024-02-13T00:32:00.523 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.517+0000 7fcec9fb9700 1 --2- 172.21.15.80:0/1185062976 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fceac061340 0x7fceac063800 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fceb4007fd0 tx=0x7fceb400b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:32:00.528 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.521+0000 7fcec2ffd700 1 -- 172.21.15.80:0/1185062976 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fcebc049f60 con 0x7fcec4104580 2024-02-13T00:32:00.720 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.713+0000 7fcecc21d700 1 -- 172.21.15.80:0/1185062976 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcec410b940 con 0x7fcec4104580 2024-02-13T00:32:00.722 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.713+0000 7fcec2ffd700 1 -- 172.21.15.80:0/1185062976 <== mon.2 v2:172.21.15.80:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+21270 (secure 0 0 0) 0x7fcebc04c9f0 con 0x7fcec4104580 2024-02-13T00:32:00.723 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-13T00:32:00.723 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":63,"fsid":"a5ae7724-ca05-11ee-95b9-87774f69a715","created":"2024-02-13T00:21:07.716138+0000","modified":"2024-02-13T00:30:16.631634+0000","last_up_change":"2024-02-13T00:29:35.842392+0000","last_in_change":"2024-02-13T00:29:09.950392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-13T00:26:05.027899+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"iscsi","create_time":"2024-02-13T00:29:49.451980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":".rgw.root","create_time":"2024-02-13T00:29:50.696517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-02-13T00:29:52.576333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-02-13T00:29:54.338868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-02-13T00:29:56.456209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"e5a7f0c8-0fa3-4f12-add7-5fb78c8cc514","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":635200923},{"type":"v1","addr":"172.21.15.80:6803","nonce":635200923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":635200923},{"type":"v1","addr":"172.21.15.80:6805","nonce":635200923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":635200923},{"type":"v1","addr":"172.21.15.80:6809","nonce":635200923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":635200923},{"type":"v1","addr":"172.21.15.80:6807","nonce":635200923}]},"public_addr":"172.21.15.80:6803/635200923","cluster_addr":"172.21.15.80:6805/635200923","heartbeat_back_addr":"172.21.15.80:6809/635200923","heartbeat_front_addr":"172.21.15.80:6807/635200923","state":["exists","up"]},{"osd":1,"uuid":"33c91336-14a3-4f0d-8669-2309f34c49c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1803743584},{"type":"v1","addr":"172.21.15.80:6811","nonce":1803743584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1803743584},{"type":"v1","addr":"172.21.15.80:6813","nonce":1803743584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1803743584},{"type":"v1","addr":"172.21.15.80:6817","nonce":1803743584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1803743584},{"type":"v1","addr":"172.21.15.80:6815","nonce":1803743584}]},"public_addr":"172.21.15.80:6811/1803743584","cluster_addr":"172.21.15.80:6813/1803743584","heartbeat_back_addr":"172.21.15.80:6817/1803743584","heartbeat_front_addr":"172.21.15.80:6815/1803743584","state":["exists","up"]},{"osd":2,"uuid":"734aa898-b774-4744-a7b7-15c30c3c4187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":238755079},{"type":"v1","addr":"172.21.15.80:6819","nonce":238755079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":238755079},{"type":"v1","addr":"172.21.15.80:6821","nonce":238755079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":238755079},{"type":"v1","addr":"172.21.15.80:6825","nonce":238755079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":238755079},{"type":"v1","addr":"172.21.15.80:6823","nonce":238755079}]},"public_addr":"172.21.15.80:6819/238755079","cluster_addr":"172.21.15.80:6821/238755079","heartbeat_back_addr":"172.21.15.80:6825/238755079","heartbeat_front_addr":"172.21.15.80:6823/238755079","state":["exists","up"]},{"osd":3,"uuid":"6772f249-7ded-4e8f-b0d2-f04e72eee540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3260371152},{"type":"v1","addr":"172.21.15.80:6827","nonce":3260371152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3260371152},{"type":"v1","addr":"172.21.15.80:6829","nonce":3260371152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3260371152},{"type":"v1","addr":"172.21.15.80:6833","nonce":3260371152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3260371152},{"type":"v1","addr":"172.21.15.80:6831","nonce":3260371152}]},"public_addr":"172.21.15.80:6827/3260371152","cluster_addr":"172.21.15.80:6829/3260371152","heartbeat_back_addr":"172.21.15.80:6833/3260371152","heartbeat_front_addr":"172.21.15.80:6831/3260371152","state":["exists","up"]},{"osd":4,"uuid":"51181b93-78b9-4cb8-954e-1f25ef19518d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":2755922963},{"type":"v1","addr":"172.21.15.106:6801","nonce":2755922963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":2755922963},{"type":"v1","addr":"172.21.15.106:6803","nonce":2755922963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":2755922963},{"type":"v1","addr":"172.21.15.106:6807","nonce":2755922963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":2755922963},{"type":"v1","addr":"172.21.15.106:6805","nonce":2755922963}]},"public_addr":"172.21.15.106:6801/2755922963","cluster_addr":"172.21.15.106:6803/2755922963","heartbeat_back_addr":"172.21.15.106:6807/2755922963","heartbeat_front_addr":"172.21.15.106:6805/2755922963","state":["exists","up"]},{"osd":5,"uuid":"d335acec-df11-42a6-8454-f6933e209d5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":3712665601},{"type":"v1","addr":"172.21.15.106:6809","nonce":3712665601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":3712665601},{"type":"v1","addr":"172.21.15.106:6811","nonce":3712665601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":3712665601},{"type":"v1","addr":"172.21.15.106:6815","nonce":3712665601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":3712665601},{"type":"v1","addr":"172.21.15.106:6813","nonce":3712665601}]},"public_addr":"172.21.15.106:6809/3712665601","cluster_addr":"172.21.15.106:6811/3712665601","heartbeat_back_addr":"172.21.15.106:6815/3712665601","heartbeat_front_addr":"172.21.15.106:6813/3712665601","state":["exists","up"]},{"osd":6,"uuid":"d6440f04-f935-4d72-aebd-9593038549f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":626618901},{"type":"v1","addr":"172.21.15.106:6817","nonce":626618901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":626618901},{"type":"v1","addr":"172.21.15.106:6819","nonce":626618901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":626618901},{"type":"v1","addr":"172.21.15.106:6823","nonce":626618901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":626618901},{"type":"v1","addr":"172.21.15.106:6821","nonce":626618901}]},"public_addr":"172.21.15.106:6817/626618901","cluster_addr":"172.21.15.106:6819/626618901","heartbeat_back_addr":"172.21.15.106:6823/626618901","heartbeat_front_addr":"172.21.15.106:6821/626618901","state":["exists","up"]},{"osd":7,"uuid":"1ced0927-8fb9-4c30-8a8b-0d1b7d49ad39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2273586184},{"type":"v1","addr":"172.21.15.106:6825","nonce":2273586184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2273586184},{"type":"v1","addr":"172.21.15.106:6827","nonce":2273586184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2273586184},{"type":"v1","addr":"172.21.15.106:6831","nonce":2273586184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2273586184},{"type":"v1","addr":"172.21.15.106:6829","nonce":2273586184}]},"public_addr":"172.21.15.106:6825/2273586184","cluster_addr":"172.21.15.106:6827/2273586184","heartbeat_back_addr":"172.21.15.106:6831/2273586184","heartbeat_front_addr":"172.21.15.106:6829/2273586184","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:24:35.972179+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:25:18.309640+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:26:02.697043+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:26:46.567227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:27:27.731147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:28:09.145523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:28:51.627745+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:29:34.158416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/461193090":"2024-02-14T00:30:16.631567+0000","172.21.15.80:6800/461193090":"2024-02-14T00:30:16.631567+0000","172.21.15.80:6800/3429634547":"2024-02-14T00:22:06.647132+0000","172.21.15.80:0/471481369":"2024-02-14T00:30:16.631567+0000","172.21.15.80:0/2814238145":"2024-02-14T00:22:06.647132+0000","172.21.15.80:0/1312114353":"2024-02-14T00:22:06.647132+0000","172.21.15.80:6800/3082938701":"2024-02-14T00:21:35.662370+0000","172.21.15.80:0/886443941":"2024-02-14T00:30:16.631567+0000","172.21.15.80:6801/3082938701":"2024-02-14T00:21:35.662370+0000","172.21.15.80:0/1104045880":"2024-02-14T00:30:16.631567+0000","172.21.15.80:0/1053677790":"2024-02-14T00:21:35.662370+0000","172.21.15.80:6801/3429634547":"2024-02-14T00:22:06.647132+0000","172.21.15.80:0/3188909815":"2024-02-14T00:21:35.662370+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-13T00:32:00.726 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.717+0000 7fcecc21d700 1 -- 172.21.15.80:0/1185062976 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fceac061340 msgr2=0x7fceac063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.717+0000 7fcecc21d700 1 --2- 172.21.15.80:0/1185062976 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fceac061340 0x7fceac063800 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fceb4007fd0 tx=0x7fceb400b040).stop 2024-02-13T00:32:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.717+0000 7fcecc21d700 1 -- 172.21.15.80:0/1185062976 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcec4104580 msgr2=0x7fcec410a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.717+0000 7fcecc21d700 1 --2- 172.21.15.80:0/1185062976 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcec4104580 0x7fcec410a460 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fcebc00eb70 tx=0x7fcebc00b040).stop 2024-02-13T00:32:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.717+0000 7fcecc21d700 1 -- 172.21.15.80:0/1185062976 shutdown_connections 2024-02-13T00:32:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.717+0000 7fcecc21d700 1 --2- 172.21.15.80:0/1185062976 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fceac061340 0x7fceac063800 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.717+0000 7fcecc21d700 1 --2- 172.21.15.80:0/1185062976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcec406b1b0 0x7fcec41102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.717+0000 7fcecc21d700 1 --2- 172.21.15.80:0/1185062976 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fcec4104580 0x7fcec410a460 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.717+0000 7fcecc21d700 1 --2- 172.21.15.80:0/1185062976 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fcec406ba80 0x7fcec41107b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.717+0000 7fcecc21d700 1 -- 172.21.15.80:0/1185062976 >> 172.21.15.80:0/1185062976 conn(0x7fcec40f38c0 msgr2=0x7fcec40f44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:32:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.717+0000 7fcecc21d700 1 -- 172.21.15.80:0/1185062976 shutdown_connections 2024-02-13T00:32:00.727 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:00.721+0000 7fcecc21d700 1 -- 172.21.15.80:0/1185062976 wait complete. 2024-02-13T00:32:01.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:00 smithi106 bash[18459]: audit 2024-02-13T00:32:00.717693+0000 mon.c (mon.2) 56 : audit [DBG] from='client.? 172.21.15.80:0/1185062976' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-13T00:32:01.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:00 smithi080 bash[17386]: audit 2024-02-13T00:32:00.717693+0000 mon.c (mon.2) 56 : audit [DBG] from='client.? 172.21.15.80:0/1185062976' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-13T00:32:01.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:00 smithi080 bash[24237]: audit 2024-02-13T00:32:00.717693+0000 mon.c (mon.2) 56 : audit [DBG] from='client.? 172.21.15.80:0/1185062976' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-13T00:32:01.560 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-13T00:32:01.560 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph osd dump --format=json 2024-02-13T00:32:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:01 smithi080 bash[17386]: cluster 2024-02-13T00:32:00.697694+0000 mgr.y (mgr.24461) 90 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:02.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:01 smithi080 bash[24237]: cluster 2024-02-13T00:32:00.697694+0000 mgr.y (mgr.24461) 90 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:02.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:01 smithi106 bash[18459]: cluster 2024-02-13T00:32:00.697694+0000 mgr.y (mgr.24461) 90 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:03.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:32:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:32:03] "GET /metrics HTTP/1.1" 200 172195 "" "Prometheus/2.33.4" 2024-02-13T00:32:04.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:03 smithi106 bash[18459]: cluster 2024-02-13T00:32:02.698750+0000 mgr.y (mgr.24461) 91 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:04.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:03 smithi080 bash[24237]: cluster 2024-02-13T00:32:02.698750+0000 mgr.y (mgr.24461) 91 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:04.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:03 smithi080 bash[17386]: cluster 2024-02-13T00:32:02.698750+0000 mgr.y (mgr.24461) 91 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:06.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:05 smithi106 bash[18459]: cluster 2024-02-13T00:32:04.699416+0000 mgr.y (mgr.24461) 92 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:06.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:05 smithi080 bash[17386]: cluster 2024-02-13T00:32:04.699416+0000 mgr.y (mgr.24461) 92 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:06.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:05 smithi080 bash[24237]: cluster 2024-02-13T00:32:04.699416+0000 mgr.y (mgr.24461) 92 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:06.335 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:32:08.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:07 smithi080 bash[17386]: cluster 2024-02-13T00:32:06.700112+0000 mgr.y (mgr.24461) 93 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:08.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:07 smithi080 bash[24237]: cluster 2024-02-13T00:32:06.700112+0000 mgr.y (mgr.24461) 93 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:08.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:07 smithi106 bash[18459]: cluster 2024-02-13T00:32:06.700112+0000 mgr.y (mgr.24461) 93 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:08.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:32:07 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:32:09.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.109+0000 7fbcabfff700 1 -- 172.21.15.80:0/769514075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbcac0fa470 msgr2=0x7fbcac0fa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:09.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.109+0000 7fbcabfff700 1 --2- 172.21.15.80:0/769514075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbcac0fa470 0x7fbcac0fa8d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fbca4004870 tx=0x7fbca4009cb0).stop 2024-02-13T00:32:09.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.109+0000 7fbcabfff700 1 -- 172.21.15.80:0/769514075 shutdown_connections 2024-02-13T00:32:09.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.109+0000 7fbcabfff700 1 --2- 172.21.15.80:0/769514075 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbcac0ffd10 0x7fbcac1000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:09.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.109+0000 7fbcabfff700 1 --2- 172.21.15.80:0/769514075 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbcac0fa470 0x7fbcac0fa8d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:09.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.109+0000 7fbcabfff700 1 --2- 172.21.15.80:0/769514075 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbcac1005e0 0x7fbcac0f9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:09.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.109+0000 7fbcabfff700 1 -- 172.21.15.80:0/769514075 >> 172.21.15.80:0/769514075 conn(0x7fbcac0f5960 msgr2=0x7fbcac0f7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:32:09.117 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.109+0000 7fbcabfff700 1 -- 172.21.15.80:0/769514075 shutdown_connections 2024-02-13T00:32:09.118 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.109+0000 7fbcabfff700 1 -- 172.21.15.80:0/769514075 wait complete. 2024-02-13T00:32:09.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.109+0000 7fbcabfff700 1 Processor -- start 2024-02-13T00:32:09.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.109+0000 7fbcabfff700 1 -- start start 2024-02-13T00:32:09.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.109+0000 7fbcabfff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbcac0fa470 0x7fbcac10fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:09.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.109+0000 7fbcabfff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbcac0ffd10 0x7fbcac110210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:09.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.109+0000 7fbcabfff700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbcac1005e0 0x7fbcac109ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:09.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.109+0000 7fbcabfff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac10a3b0 con 0x7fbcac0ffd10 2024-02-13T00:32:09.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.109+0000 7fbcabfff700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac10a520 con 0x7fbcac0fa470 2024-02-13T00:32:09.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.109+0000 7fbcabfff700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac10a6e0 con 0x7fbcac1005e0 2024-02-13T00:32:09.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.109+0000 7fbcaa7fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbcac0ffd10 0x7fbcac110210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:09.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.109+0000 7fbcaa7fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbcac0ffd10 0x7fbcac110210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:42820/0 (socket says 172.21.15.80:42820) 2024-02-13T00:32:09.119 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.109+0000 7fbcaa7fc700 1 -- 172.21.15.80:0/4285332518 learned_addr learned my addr 172.21.15.80:0/4285332518 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:32:09.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.109+0000 7fbcaaffd700 1 --2- 172.21.15.80:0/4285332518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbcac0fa470 0x7fbcac10fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:09.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.109+0000 7fbcab7fe700 1 --2- 172.21.15.80:0/4285332518 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbcac1005e0 0x7fbcac109ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:09.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.113+0000 7fbcaa7fc700 1 -- 172.21.15.80:0/4285332518 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbcac1005e0 msgr2=0x7fbcac109ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:09.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.113+0000 7fbcaa7fc700 1 --2- 172.21.15.80:0/4285332518 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbcac1005e0 0x7fbcac109ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:09.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.113+0000 7fbcaa7fc700 1 -- 172.21.15.80:0/4285332518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbcac0fa470 msgr2=0x7fbcac10fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:09.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.113+0000 7fbcaa7fc700 1 --2- 172.21.15.80:0/4285332518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbcac0fa470 0x7fbcac10fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:09.120 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.113+0000 7fbcaa7fc700 1 -- 172.21.15.80:0/4285332518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca4005040 con 0x7fbcac0ffd10 2024-02-13T00:32:09.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.113+0000 7fbcaa7fc700 1 --2- 172.21.15.80:0/4285332518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbcac0ffd10 0x7fbcac110210 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fbc9400e940 tx=0x7fbc9400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:32:09.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.113+0000 7fbca3fff700 1 -- 172.21.15.80:0/4285332518 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc94004660 con 0x7fbcac0ffd10 2024-02-13T00:32:09.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.113+0000 7fbcabfff700 1 -- 172.21.15.80:0/4285332518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcac10a9c0 con 0x7fbcac0ffd10 2024-02-13T00:32:09.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.113+0000 7fbca3fff700 1 -- 172.21.15.80:0/4285332518 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fbc9400f040 con 0x7fbcac0ffd10 2024-02-13T00:32:09.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.113+0000 7fbca3fff700 1 -- 172.21.15.80:0/4285332518 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc940146f0 con 0x7fbcac0ffd10 2024-02-13T00:32:09.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.113+0000 7fbcabfff700 1 -- 172.21.15.80:0/4285332518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcac10ad40 con 0x7fbcac0ffd10 2024-02-13T00:32:09.121 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.113+0000 7fbcabfff700 1 -- 172.21.15.80:0/4285332518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcac0475e0 con 0x7fbcac0ffd10 2024-02-13T00:32:09.122 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.113+0000 7fbca3fff700 1 -- 172.21.15.80:0/4285332518 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7fbc94007b40 con 0x7fbcac0ffd10 2024-02-13T00:32:09.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.117+0000 7fbca3fff700 1 --2- 172.21.15.80:0/4285332518 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fbc98061340 0x7fbc98063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:09.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.117+0000 7fbca3fff700 1 -- 172.21.15.80:0/4285332518 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7fbc9407ca60 con 0x7fbcac0ffd10 2024-02-13T00:32:09.123 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.117+0000 7fbcaaffd700 1 --2- 172.21.15.80:0/4285332518 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fbc98061340 0x7fbc98063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:09.124 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.117+0000 7fbcaaffd700 1 --2- 172.21.15.80:0/4285332518 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fbc98061340 0x7fbc98063800 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fbc9c007fb0 tx=0x7fbc9c009040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:32:09.129 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.121+0000 7fbca3fff700 1 -- 172.21.15.80:0/4285332518 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fbc9404c7f0 con 0x7fbcac0ffd10 2024-02-13T00:32:09.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:08 smithi106 bash[18459]: audit 2024-02-13T00:32:07.760851+0000 mgr.y (mgr.24461) 94 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:32:09.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:08 smithi080 bash[17386]: audit 2024-02-13T00:32:07.760851+0000 mgr.y (mgr.24461) 94 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:32:09.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:08 smithi080 bash[24237]: audit 2024-02-13T00:32:07.760851+0000 mgr.y (mgr.24461) 94 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:32:09.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.309+0000 7fbcabfff700 1 -- 172.21.15.80:0/4285332518 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcac108fd0 con 0x7fbcac0ffd10 2024-02-13T00:32:09.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.309+0000 7fbca3fff700 1 -- 172.21.15.80:0/4285332518 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+21270 (secure 0 0 0) 0x7fbc9404fe10 con 0x7fbcac0ffd10 2024-02-13T00:32:09.318 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-13T00:32:09.318 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":63,"fsid":"a5ae7724-ca05-11ee-95b9-87774f69a715","created":"2024-02-13T00:21:07.716138+0000","modified":"2024-02-13T00:30:16.631634+0000","last_up_change":"2024-02-13T00:29:35.842392+0000","last_in_change":"2024-02-13T00:29:09.950392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-13T00:26:05.027899+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"iscsi","create_time":"2024-02-13T00:29:49.451980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":".rgw.root","create_time":"2024-02-13T00:29:50.696517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-02-13T00:29:52.576333+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-02-13T00:29:54.338868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-02-13T00:29:56.456209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"e5a7f0c8-0fa3-4f12-add7-5fb78c8cc514","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":635200923},{"type":"v1","addr":"172.21.15.80:6803","nonce":635200923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":635200923},{"type":"v1","addr":"172.21.15.80:6805","nonce":635200923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":635200923},{"type":"v1","addr":"172.21.15.80:6809","nonce":635200923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":635200923},{"type":"v1","addr":"172.21.15.80:6807","nonce":635200923}]},"public_addr":"172.21.15.80:6803/635200923","cluster_addr":"172.21.15.80:6805/635200923","heartbeat_back_addr":"172.21.15.80:6809/635200923","heartbeat_front_addr":"172.21.15.80:6807/635200923","state":["exists","up"]},{"osd":1,"uuid":"33c91336-14a3-4f0d-8669-2309f34c49c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":1803743584},{"type":"v1","addr":"172.21.15.80:6811","nonce":1803743584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":1803743584},{"type":"v1","addr":"172.21.15.80:6813","nonce":1803743584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":1803743584},{"type":"v1","addr":"172.21.15.80:6817","nonce":1803743584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":1803743584},{"type":"v1","addr":"172.21.15.80:6815","nonce":1803743584}]},"public_addr":"172.21.15.80:6811/1803743584","cluster_addr":"172.21.15.80:6813/1803743584","heartbeat_back_addr":"172.21.15.80:6817/1803743584","heartbeat_front_addr":"172.21.15.80:6815/1803743584","state":["exists","up"]},{"osd":2,"uuid":"734aa898-b774-4744-a7b7-15c30c3c4187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":238755079},{"type":"v1","addr":"172.21.15.80:6819","nonce":238755079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":238755079},{"type":"v1","addr":"172.21.15.80:6821","nonce":238755079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":238755079},{"type":"v1","addr":"172.21.15.80:6825","nonce":238755079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":238755079},{"type":"v1","addr":"172.21.15.80:6823","nonce":238755079}]},"public_addr":"172.21.15.80:6819/238755079","cluster_addr":"172.21.15.80:6821/238755079","heartbeat_back_addr":"172.21.15.80:6825/238755079","heartbeat_front_addr":"172.21.15.80:6823/238755079","state":["exists","up"]},{"osd":3,"uuid":"6772f249-7ded-4e8f-b0d2-f04e72eee540","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3260371152},{"type":"v1","addr":"172.21.15.80:6827","nonce":3260371152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3260371152},{"type":"v1","addr":"172.21.15.80:6829","nonce":3260371152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6832","nonce":3260371152},{"type":"v1","addr":"172.21.15.80:6833","nonce":3260371152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3260371152},{"type":"v1","addr":"172.21.15.80:6831","nonce":3260371152}]},"public_addr":"172.21.15.80:6827/3260371152","cluster_addr":"172.21.15.80:6829/3260371152","heartbeat_back_addr":"172.21.15.80:6833/3260371152","heartbeat_front_addr":"172.21.15.80:6831/3260371152","state":["exists","up"]},{"osd":4,"uuid":"51181b93-78b9-4cb8-954e-1f25ef19518d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":2755922963},{"type":"v1","addr":"172.21.15.106:6801","nonce":2755922963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":2755922963},{"type":"v1","addr":"172.21.15.106:6803","nonce":2755922963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":2755922963},{"type":"v1","addr":"172.21.15.106:6807","nonce":2755922963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":2755922963},{"type":"v1","addr":"172.21.15.106:6805","nonce":2755922963}]},"public_addr":"172.21.15.106:6801/2755922963","cluster_addr":"172.21.15.106:6803/2755922963","heartbeat_back_addr":"172.21.15.106:6807/2755922963","heartbeat_front_addr":"172.21.15.106:6805/2755922963","state":["exists","up"]},{"osd":5,"uuid":"d335acec-df11-42a6-8454-f6933e209d5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":3712665601},{"type":"v1","addr":"172.21.15.106:6809","nonce":3712665601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":3712665601},{"type":"v1","addr":"172.21.15.106:6811","nonce":3712665601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":3712665601},{"type":"v1","addr":"172.21.15.106:6815","nonce":3712665601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":3712665601},{"type":"v1","addr":"172.21.15.106:6813","nonce":3712665601}]},"public_addr":"172.21.15.106:6809/3712665601","cluster_addr":"172.21.15.106:6811/3712665601","heartbeat_back_addr":"172.21.15.106:6815/3712665601","heartbeat_front_addr":"172.21.15.106:6813/3712665601","state":["exists","up"]},{"osd":6,"uuid":"d6440f04-f935-4d72-aebd-9593038549f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":626618901},{"type":"v1","addr":"172.21.15.106:6817","nonce":626618901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":626618901},{"type":"v1","addr":"172.21.15.106:6819","nonce":626618901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":626618901},{"type":"v1","addr":"172.21.15.106:6823","nonce":626618901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":626618901},{"type":"v1","addr":"172.21.15.106:6821","nonce":626618901}]},"public_addr":"172.21.15.106:6817/626618901","cluster_addr":"172.21.15.106:6819/626618901","heartbeat_back_addr":"172.21.15.106:6823/626618901","heartbeat_front_addr":"172.21.15.106:6821/626618901","state":["exists","up"]},{"osd":7,"uuid":"1ced0927-8fb9-4c30-8a8b-0d1b7d49ad39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2273586184},{"type":"v1","addr":"172.21.15.106:6825","nonce":2273586184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2273586184},{"type":"v1","addr":"172.21.15.106:6827","nonce":2273586184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2273586184},{"type":"v1","addr":"172.21.15.106:6831","nonce":2273586184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2273586184},{"type":"v1","addr":"172.21.15.106:6829","nonce":2273586184}]},"public_addr":"172.21.15.106:6825/2273586184","cluster_addr":"172.21.15.106:6827/2273586184","heartbeat_back_addr":"172.21.15.106:6831/2273586184","heartbeat_front_addr":"172.21.15.106:6829/2273586184","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:24:35.972179+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:25:18.309640+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:26:02.697043+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:26:46.567227+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:27:27.731147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:28:09.145523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:28:51.627745+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T00:29:34.158416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.80:6801/461193090":"2024-02-14T00:30:16.631567+0000","172.21.15.80:6800/461193090":"2024-02-14T00:30:16.631567+0000","172.21.15.80:6800/3429634547":"2024-02-14T00:22:06.647132+0000","172.21.15.80:0/471481369":"2024-02-14T00:30:16.631567+0000","172.21.15.80:0/2814238145":"2024-02-14T00:22:06.647132+0000","172.21.15.80:0/1312114353":"2024-02-14T00:22:06.647132+0000","172.21.15.80:6800/3082938701":"2024-02-14T00:21:35.662370+0000","172.21.15.80:0/886443941":"2024-02-14T00:30:16.631567+0000","172.21.15.80:6801/3082938701":"2024-02-14T00:21:35.662370+0000","172.21.15.80:0/1104045880":"2024-02-14T00:30:16.631567+0000","172.21.15.80:0/1053677790":"2024-02-14T00:21:35.662370+0000","172.21.15.80:6801/3429634547":"2024-02-14T00:22:06.647132+0000","172.21.15.80:0/3188909815":"2024-02-14T00:21:35.662370+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-13T00:32:09.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.313+0000 7fbcabfff700 1 -- 172.21.15.80:0/4285332518 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fbc98061340 msgr2=0x7fbc98063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:09.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.313+0000 7fbcabfff700 1 --2- 172.21.15.80:0/4285332518 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fbc98061340 0x7fbc98063800 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fbc9c007fb0 tx=0x7fbc9c009040).stop 2024-02-13T00:32:09.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.313+0000 7fbcabfff700 1 -- 172.21.15.80:0/4285332518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbcac0ffd10 msgr2=0x7fbcac110210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:09.321 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.313+0000 7fbcabfff700 1 --2- 172.21.15.80:0/4285332518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbcac0ffd10 0x7fbcac110210 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fbc9400e940 tx=0x7fbc9400b040).stop 2024-02-13T00:32:09.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.313+0000 7fbcabfff700 1 -- 172.21.15.80:0/4285332518 shutdown_connections 2024-02-13T00:32:09.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.313+0000 7fbcabfff700 1 --2- 172.21.15.80:0/4285332518 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fbc98061340 0x7fbc98063800 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:09.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.313+0000 7fbcabfff700 1 --2- 172.21.15.80:0/4285332518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbcac0fa470 0x7fbcac10fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:09.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.313+0000 7fbcabfff700 1 --2- 172.21.15.80:0/4285332518 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbcac1005e0 0x7fbcac109ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:09.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.313+0000 7fbcabfff700 1 --2- 172.21.15.80:0/4285332518 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbcac0ffd10 0x7fbcac110210 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:09.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.313+0000 7fbcabfff700 1 -- 172.21.15.80:0/4285332518 >> 172.21.15.80:0/4285332518 conn(0x7fbcac0f5960 msgr2=0x7fbcac0f7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:32:09.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.313+0000 7fbcabfff700 1 -- 172.21.15.80:0/4285332518 shutdown_connections 2024-02-13T00:32:09.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:09.313+0000 7fbcabfff700 1 -- 172.21.15.80:0/4285332518 wait complete. 2024-02-13T00:32:10.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:09 smithi080 bash[17386]: cluster 2024-02-13T00:32:08.701558+0000 mgr.y (mgr.24461) 95 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:10.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:09 smithi080 bash[17386]: audit 2024-02-13T00:32:09.313102+0000 mon.a (mon.0) 675 : audit [DBG] from='client.? 172.21.15.80:0/4285332518' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-13T00:32:10.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:09 smithi080 bash[24237]: cluster 2024-02-13T00:32:08.701558+0000 mgr.y (mgr.24461) 95 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:10.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:09 smithi080 bash[24237]: audit 2024-02-13T00:32:09.313102+0000 mon.a (mon.0) 675 : audit [DBG] from='client.? 172.21.15.80:0/4285332518' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-13T00:32:10.085 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-13T00:32:10.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:09 smithi106 bash[18459]: cluster 2024-02-13T00:32:08.701558+0000 mgr.y (mgr.24461) 95 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:10.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:09 smithi106 bash[18459]: audit 2024-02-13T00:32:09.313102+0000 mon.a (mon.0) 675 : audit [DBG] from='client.? 172.21.15.80:0/4285332518' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-13T00:32:10.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:32:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:32:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:32:12.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:11 smithi106 bash[18459]: cluster 2024-02-13T00:32:10.702233+0000 mgr.y (mgr.24461) 96 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:12.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:11 smithi080 bash[17386]: cluster 2024-02-13T00:32:10.702233+0000 mgr.y (mgr.24461) 96 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:12.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:11 smithi080 bash[24237]: cluster 2024-02-13T00:32:10.702233+0000 mgr.y (mgr.24461) 96 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:13.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:32:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:32:13] "GET /metrics HTTP/1.1" 200 172195 "" "Prometheus/2.33.4" 2024-02-13T00:32:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:13 smithi106 bash[18459]: cluster 2024-02-13T00:32:12.703496+0000 mgr.y (mgr.24461) 97 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:14.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:13 smithi080 bash[17386]: cluster 2024-02-13T00:32:12.703496+0000 mgr.y (mgr.24461) 97 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:14.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:13 smithi080 bash[24237]: cluster 2024-02-13T00:32:12.703496+0000 mgr.y (mgr.24461) 97 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:14.865 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:32:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:15 smithi080 bash[17386]: cluster 2024-02-13T00:32:14.704103+0000 mgr.y (mgr.24461) 98 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:15.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:15 smithi080 bash[24237]: cluster 2024-02-13T00:32:14.704103+0000 mgr.y (mgr.24461) 98 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:16.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:15 smithi106 bash[18459]: cluster 2024-02-13T00:32:14.704103+0000 mgr.y (mgr.24461) 98 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:17.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.741+0000 7f95d37c3700 1 -- 172.21.15.80:0/199102557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95cc0f8c90 msgr2=0x7f95cc0f9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:17.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.741+0000 7f95d37c3700 1 --2- 172.21.15.80:0/199102557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95cc0f8c90 0x7f95cc0f9070 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f95c8004870 tx=0x7f95c8009cb0).stop 2024-02-13T00:32:17.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.741+0000 7f95d37c3700 1 -- 172.21.15.80:0/199102557 shutdown_connections 2024-02-13T00:32:17.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d37c3700 1 --2- 172.21.15.80:0/199102557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95cc1021f0 0x7f95cc1045e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:17.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d37c3700 1 --2- 172.21.15.80:0/199102557 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95cc0f8c90 0x7f95cc0f9070 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:17.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d37c3700 1 --2- 172.21.15.80:0/199102557 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f95cc0f95f0 0x7f95cc101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:17.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d37c3700 1 -- 172.21.15.80:0/199102557 >> 172.21.15.80:0/199102557 conn(0x7f95cc0f27a0 msgr2=0x7f95cc0f4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:32:17.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d37c3700 1 -- 172.21.15.80:0/199102557 shutdown_connections 2024-02-13T00:32:17.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d37c3700 1 -- 172.21.15.80:0/199102557 wait complete. 2024-02-13T00:32:17.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d37c3700 1 Processor -- start 2024-02-13T00:32:17.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d37c3700 1 -- start start 2024-02-13T00:32:17.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d37c3700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f95cc0f8c90 0x7f95cc10e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:17.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d37c3700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95cc0f95f0 0x7f95cc10e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:17.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d37c3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95cc1021f0 0x7f95cc1081e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:17.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d37c3700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc1086d0 con 0x7f95cc1021f0 2024-02-13T00:32:17.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d37c3700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc108840 con 0x7f95cc0f95f0 2024-02-13T00:32:17.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d37c3700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc108a00 con 0x7f95cc0f8c90 2024-02-13T00:32:17.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d155f700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f95cc0f8c90 0x7f95cc10e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:17.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d155f700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f95cc0f8c90 0x7f95cc10e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:56686/0 (socket says 172.21.15.80:56686) 2024-02-13T00:32:17.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d155f700 1 -- 172.21.15.80:0/2524982812 learned_addr learned my addr 172.21.15.80:0/2524982812 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:32:17.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d1d60700 1 --2- 172.21.15.80:0/2524982812 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95cc1021f0 0x7f95cc1081e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:17.754 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d0d5e700 1 --2- 172.21.15.80:0/2524982812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95cc0f95f0 0x7f95cc10e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:17.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d155f700 1 -- 172.21.15.80:0/2524982812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95cc0f95f0 msgr2=0x7f95cc10e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:17.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d155f700 1 --2- 172.21.15.80:0/2524982812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95cc0f95f0 0x7f95cc10e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:17.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d155f700 1 -- 172.21.15.80:0/2524982812 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95cc1021f0 msgr2=0x7f95cc1081e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:17.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d155f700 1 --2- 172.21.15.80:0/2524982812 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95cc1021f0 0x7f95cc1081e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:17.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d155f700 1 -- 172.21.15.80:0/2524982812 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc005040 con 0x7f95cc0f8c90 2024-02-13T00:32:17.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d1d60700 1 --2- 172.21.15.80:0/2524982812 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f95cc1021f0 0x7f95cc1081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:32:17.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d155f700 1 --2- 172.21.15.80:0/2524982812 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f95cc0f8c90 0x7f95cc10e040 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f95c8005010 tx=0x7f95c8009cb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:32:17.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95c27fc700 1 -- 172.21.15.80:0/2524982812 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c800e030 con 0x7f95cc0f8c90 2024-02-13T00:32:17.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95c27fc700 1 -- 172.21.15.80:0/2524982812 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f95c80096d0 con 0x7f95cc0f8c90 2024-02-13T00:32:17.755 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95d37c3700 1 -- 172.21.15.80:0/2524982812 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c8005040 con 0x7f95cc0f8c90 2024-02-13T00:32:17.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.745+0000 7f95c27fc700 1 -- 172.21.15.80:0/2524982812 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c8018070 con 0x7f95cc0f8c90 2024-02-13T00:32:17.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.749+0000 7f95d37c3700 1 -- 172.21.15.80:0/2524982812 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95cc108ea0 con 0x7f95cc0f8c90 2024-02-13T00:32:17.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.749+0000 7f95d37c3700 1 -- 172.21.15.80:0/2524982812 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95cc059480 con 0x7f95cc0f8c90 2024-02-13T00:32:17.756 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.749+0000 7f95c27fc700 1 -- 172.21.15.80:0/2524982812 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f95c8009240 con 0x7f95cc0f8c90 2024-02-13T00:32:17.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.749+0000 7f95c27fc700 1 --2- 172.21.15.80:0/2524982812 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f95b8061340 0x7f95b8063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:17.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.749+0000 7f95c27fc700 1 -- 172.21.15.80:0/2524982812 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f95c807dff0 con 0x7f95cc0f8c90 2024-02-13T00:32:17.757 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.749+0000 7f95d0d5e700 1 --2- 172.21.15.80:0/2524982812 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f95b8061340 0x7f95b8063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:17.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.749+0000 7f95c27fc700 1 --2- 172.21.15.80:0/2524982812 >> [v2:172.21.15.80:6802/635200923,v1:172.21.15.80:6803/635200923] conn(0x7f95b806b250 0x7f95b806d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:17.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.749+0000 7f95c27fc700 1 -- 172.21.15.80:0/2524982812 --> [v2:172.21.15.80:6802/635200923,v1:172.21.15.80:6803/635200923] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95b806dd70 con 0x7f95b806b250 2024-02-13T00:32:17.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.749+0000 7f95c27fc700 1 -- 172.21.15.80:0/2524982812 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95c80805d0 con 0x7f95cc0f8c90 2024-02-13T00:32:17.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.749+0000 7f95d1d60700 1 --2- 172.21.15.80:0/2524982812 >> [v2:172.21.15.80:6802/635200923,v1:172.21.15.80:6803/635200923] conn(0x7f95b806b250 0x7f95b806d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:17.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.749+0000 7f95d0d5e700 1 --2- 172.21.15.80:0/2524982812 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f95b8061340 0x7f95b8063800 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f95cc109980 tx=0x7f95bc00b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:32:17.758 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.749+0000 7f95d1d60700 1 --2- 172.21.15.80:0/2524982812 >> [v2:172.21.15.80:6802/635200923,v1:172.21.15.80:6803/635200923] conn(0x7f95b806b250 0x7f95b806d6f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:32:17.759 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.753+0000 7f95c27fc700 1 -- 172.21.15.80:0/2524982812 <== osd.0 v2:172.21.15.80:6802/635200923 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f95b806dd70 con 0x7f95b806b250 2024-02-13T00:32:17.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.769+0000 7f95d37c3700 1 -- 172.21.15.80:0/2524982812 --> [v2:172.21.15.80:6802/635200923,v1:172.21.15.80:6803/635200923] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f95cc060740 con 0x7f95b806b250 2024-02-13T00:32:17.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.769+0000 7f95c27fc700 1 -- 172.21.15.80:0/2524982812 <== osd.0 v2:172.21.15.80:6802/635200923 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f95cc060740 con 0x7f95b806b250 2024-02-13T00:32:17.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.769+0000 7f95d37c3700 1 -- 172.21.15.80:0/2524982812 >> [v2:172.21.15.80:6802/635200923,v1:172.21.15.80:6803/635200923] conn(0x7f95b806b250 msgr2=0x7f95b806d6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:17.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.769+0000 7f95d37c3700 1 --2- 172.21.15.80:0/2524982812 >> [v2:172.21.15.80:6802/635200923,v1:172.21.15.80:6803/635200923] conn(0x7f95b806b250 0x7f95b806d6f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:17.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.773+0000 7f95d37c3700 1 -- 172.21.15.80:0/2524982812 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f95b8061340 msgr2=0x7f95b8063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:17.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.773+0000 7f95d37c3700 1 --2- 172.21.15.80:0/2524982812 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f95b8061340 0x7f95b8063800 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f95cc109980 tx=0x7f95bc00b040).stop 2024-02-13T00:32:17.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.773+0000 7f95d37c3700 1 -- 172.21.15.80:0/2524982812 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f95cc0f8c90 msgr2=0x7f95cc10e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:17.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.773+0000 7f95d37c3700 1 --2- 172.21.15.80:0/2524982812 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f95cc0f8c90 0x7f95cc10e040 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f95c8005010 tx=0x7f95c8009cb0).stop 2024-02-13T00:32:17.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.773+0000 7f95d1d60700 1 -- 172.21.15.80:0/2524982812 reap_dead start 2024-02-13T00:32:17.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.773+0000 7f95d37c3700 1 -- 172.21.15.80:0/2524982812 shutdown_connections 2024-02-13T00:32:17.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.773+0000 7f95d37c3700 1 -- 172.21.15.80:0/2524982812 >> 172.21.15.80:0/2524982812 conn(0x7f95cc0f27a0 msgr2=0x7f95cc0f3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:32:17.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.773+0000 7f95d37c3700 1 -- 172.21.15.80:0/2524982812 shutdown_connections 2024-02-13T00:32:17.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:17.773+0000 7f95d37c3700 1 -- 172.21.15.80:0/2524982812 wait complete. 2024-02-13T00:32:17.807 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:17 smithi080 bash[17386]: cluster 2024-02-13T00:32:16.704802+0000 mgr.y (mgr.24461) 99 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:17.807 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:17 smithi080 bash[24237]: cluster 2024-02-13T00:32:16.704802+0000 mgr.y (mgr.24461) 99 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:18.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:17 smithi106 bash[18459]: cluster 2024-02-13T00:32:16.704802+0000 mgr.y (mgr.24461) 99 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:18.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:32:17 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:32:18.572 INFO:teuthology.orchestra.run.smithi080.stdout:34359738461 2024-02-13T00:32:18.572 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-13T00:32:19.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:18 smithi080 bash[17386]: audit 2024-02-13T00:32:17.768894+0000 mgr.y (mgr.24461) 100 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:32:19.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:18 smithi080 bash[24237]: audit 2024-02-13T00:32:17.768894+0000 mgr.y (mgr.24461) 100 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:32:19.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:18 smithi106 bash[18459]: audit 2024-02-13T00:32:17.768894+0000 mgr.y (mgr.24461) 100 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:32:20.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:19 smithi106 bash[18459]: cluster 2024-02-13T00:32:18.706249+0000 mgr.y (mgr.24461) 101 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:20.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:19 smithi080 bash[17386]: cluster 2024-02-13T00:32:18.706249+0000 mgr.y (mgr.24461) 101 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:20.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:19 smithi080 bash[24237]: cluster 2024-02-13T00:32:18.706249+0000 mgr.y (mgr.24461) 101 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:20.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:32:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:32:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:32:22.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:21 smithi106 bash[18459]: cluster 2024-02-13T00:32:20.706956+0000 mgr.y (mgr.24461) 102 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:22.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:21 smithi080 bash[17386]: cluster 2024-02-13T00:32:20.706956+0000 mgr.y (mgr.24461) 102 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:22.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:21 smithi080 bash[24237]: cluster 2024-02-13T00:32:20.706956+0000 mgr.y (mgr.24461) 102 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:23.351 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:32:23.381 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:32:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:32:23] "GET /metrics HTTP/1.1" 200 172201 "" "Prometheus/2.33.4" 2024-02-13T00:32:24.222 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:23 smithi080 bash[17386]: cluster 2024-02-13T00:32:22.708333+0000 mgr.y (mgr.24461) 103 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:24.222 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:23 smithi080 bash[24237]: cluster 2024-02-13T00:32:22.708333+0000 mgr.y (mgr.24461) 103 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:24.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:23 smithi106 bash[18459]: cluster 2024-02-13T00:32:22.708333+0000 mgr.y (mgr.24461) 103 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:25.781 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:25 smithi080 bash[17386]: cluster 2024-02-13T00:32:24.708965+0000 mgr.y (mgr.24461) 104 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:25.781 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:25 smithi080 bash[24237]: cluster 2024-02-13T00:32:24.708965+0000 mgr.y (mgr.24461) 104 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b74ae700 1 -- 172.21.15.80:0/3908235566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42b00f97a0 msgr2=0x7f42b0101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b74ae700 1 --2- 172.21.15.80:0/3908235566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42b00f97a0 0x7f42b0101d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f42a0004870 tx=0x7f42a0009cb0).stop 2024-02-13T00:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b74ae700 1 -- 172.21.15.80:0/3908235566 shutdown_connections 2024-02-13T00:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b74ae700 1 --2- 172.21.15.80:0/3908235566 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42b00f8ed0 0x7f42b00f92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b74ae700 1 --2- 172.21.15.80:0/3908235566 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42b0102270 0x7f42b0104660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b74ae700 1 --2- 172.21.15.80:0/3908235566 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42b00f97a0 0x7f42b0101d80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b74ae700 1 -- 172.21.15.80:0/3908235566 >> 172.21.15.80:0/3908235566 conn(0x7f42b00f27e0 msgr2=0x7f42b00f4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b74ae700 1 -- 172.21.15.80:0/3908235566 shutdown_connections 2024-02-13T00:32:25.940 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b74ae700 1 -- 172.21.15.80:0/3908235566 wait complete. 2024-02-13T00:32:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b74ae700 1 Processor -- start 2024-02-13T00:32:25.941 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b74ae700 1 -- start start 2024-02-13T00:32:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b74ae700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42b00f8ed0 0x7f42b00f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b74ae700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42b00f97a0 0x7f42b00f71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b74ae700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42b0102270 0x7f42b00f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b74ae700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b01165e0 con 0x7f42b0102270 2024-02-13T00:32:25.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b74ae700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b0116750 con 0x7f42b00f97a0 2024-02-13T00:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b74ae700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b0116910 con 0x7f42b00f8ed0 2024-02-13T00:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b524a700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42b00f8ed0 0x7f42b00f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b524a700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42b00f8ed0 0x7f42b00f6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:54696/0 (socket says 172.21.15.80:54696) 2024-02-13T00:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b524a700 1 -- 172.21.15.80:0/4282628252 learned_addr learned my addr 172.21.15.80:0/4282628252 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b4a49700 1 --2- 172.21.15.80:0/4282628252 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42b00f97a0 0x7f42b00f71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b5a4b700 1 --2- 172.21.15.80:0/4282628252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42b0102270 0x7f42b00f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b524a700 1 -- 172.21.15.80:0/4282628252 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42b00f97a0 msgr2=0x7f42b00f71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b524a700 1 --2- 172.21.15.80:0/4282628252 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42b00f97a0 0x7f42b00f71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b524a700 1 -- 172.21.15.80:0/4282628252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42b0102270 msgr2=0x7f42b00f76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b524a700 1 --2- 172.21.15.80:0/4282628252 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f42b0102270 0x7f42b00f76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.933+0000 7f42b524a700 1 -- 172.21.15.80:0/4282628252 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a80097c0 con 0x7f42b00f8ed0 2024-02-13T00:32:25.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.937+0000 7f42b524a700 1 --2- 172.21.15.80:0/4282628252 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42b00f8ed0 0x7f42b00f6cc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f42ac00e970 tx=0x7f42ac00b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:32:25.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.937+0000 7f42a67fc700 1 -- 172.21.15.80:0/4282628252 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac004660 con 0x7f42b00f8ed0 2024-02-13T00:32:25.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.937+0000 7f42a67fc700 1 -- 172.21.15.80:0/4282628252 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f42ac00f040 con 0x7f42b00f8ed0 2024-02-13T00:32:25.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.937+0000 7f42b74ae700 1 -- 172.21.15.80:0/4282628252 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a0005040 con 0x7f42b00f8ed0 2024-02-13T00:32:25.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.937+0000 7f42a67fc700 1 -- 172.21.15.80:0/4282628252 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac0146f0 con 0x7f42b00f8ed0 2024-02-13T00:32:25.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.937+0000 7f42b74ae700 1 -- 172.21.15.80:0/4282628252 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b0116fa0 con 0x7f42b00f8ed0 2024-02-13T00:32:25.948 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.937+0000 7f42b74ae700 1 -- 172.21.15.80:0/4282628252 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f42b00f4d80 con 0x7f42b00f8ed0 2024-02-13T00:32:25.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.937+0000 7f42a67fc700 1 -- 172.21.15.80:0/4282628252 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f42ac007b40 con 0x7f42b00f8ed0 2024-02-13T00:32:25.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.937+0000 7f42a67fc700 1 --2- 172.21.15.80:0/4282628252 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f429c061340 0x7f429c063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:25.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.937+0000 7f42a67fc700 1 -- 172.21.15.80:0/4282628252 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f42ac07d280 con 0x7f42b00f8ed0 2024-02-13T00:32:25.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.937+0000 7f42b4a49700 1 --2- 172.21.15.80:0/4282628252 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f429c061340 0x7f429c063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:25.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.937+0000 7f42a67fc700 1 --2- 172.21.15.80:0/4282628252 >> [v2:172.21.15.80:6810/1803743584,v1:172.21.15.80:6811/1803743584] conn(0x7f429c06b250 0x7f429c06d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:25.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.937+0000 7f42a67fc700 1 -- 172.21.15.80:0/4282628252 --> [v2:172.21.15.80:6810/1803743584,v1:172.21.15.80:6811/1803743584] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f429c06dd70 con 0x7f429c06b250 2024-02-13T00:32:25.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.937+0000 7f42a67fc700 1 -- 172.21.15.80:0/4282628252 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42ac07d570 con 0x7f42b00f8ed0 2024-02-13T00:32:25.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.941+0000 7f42b5a4b700 1 --2- 172.21.15.80:0/4282628252 >> [v2:172.21.15.80:6810/1803743584,v1:172.21.15.80:6811/1803743584] conn(0x7f429c06b250 0x7f429c06d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:25.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.941+0000 7f42b4a49700 1 --2- 172.21.15.80:0/4282628252 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f429c061340 0x7f429c063800 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f42b00f8460 tx=0x7f42a0009cb0).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:32:25.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.941+0000 7f42b5a4b700 1 --2- 172.21.15.80:0/4282628252 >> [v2:172.21.15.80:6810/1803743584,v1:172.21.15.80:6811/1803743584] conn(0x7f429c06b250 0x7f429c06d6f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:32:25.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.941+0000 7f42a67fc700 1 -- 172.21.15.80:0/4282628252 <== osd.1 v2:172.21.15.80:6810/1803743584 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f429c06dd70 con 0x7f429c06b250 2024-02-13T00:32:25.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.957+0000 7f42b74ae700 1 -- 172.21.15.80:0/4282628252 --> [v2:172.21.15.80:6810/1803743584,v1:172.21.15.80:6811/1803743584] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f42b00475e0 con 0x7f429c06b250 2024-02-13T00:32:25.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.957+0000 7f42a67fc700 1 -- 172.21.15.80:0/4282628252 <== osd.1 v2:172.21.15.80:6810/1803743584 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f42b00475e0 con 0x7f429c06b250 2024-02-13T00:32:25.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.957+0000 7f42b74ae700 1 -- 172.21.15.80:0/4282628252 >> [v2:172.21.15.80:6810/1803743584,v1:172.21.15.80:6811/1803743584] conn(0x7f429c06b250 msgr2=0x7f429c06d6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:25.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.957+0000 7f42b74ae700 1 --2- 172.21.15.80:0/4282628252 >> [v2:172.21.15.80:6810/1803743584,v1:172.21.15.80:6811/1803743584] conn(0x7f429c06b250 0x7f429c06d6f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:25.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.957+0000 7f42b74ae700 1 -- 172.21.15.80:0/4282628252 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f429c061340 msgr2=0x7f429c063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:25.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.957+0000 7f42b74ae700 1 --2- 172.21.15.80:0/4282628252 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f429c061340 0x7f429c063800 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f42b00f8460 tx=0x7f42a0009cb0).stop 2024-02-13T00:32:25.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.957+0000 7f42b74ae700 1 -- 172.21.15.80:0/4282628252 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42b00f8ed0 msgr2=0x7f42b00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:25.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.957+0000 7f42b74ae700 1 --2- 172.21.15.80:0/4282628252 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f42b00f8ed0 0x7f42b00f6cc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f42ac00e970 tx=0x7f42ac00b040).stop 2024-02-13T00:32:25.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.957+0000 7f42b5a4b700 1 -- 172.21.15.80:0/4282628252 reap_dead start 2024-02-13T00:32:25.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.957+0000 7f42b74ae700 1 -- 172.21.15.80:0/4282628252 shutdown_connections 2024-02-13T00:32:25.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.957+0000 7f42b74ae700 1 -- 172.21.15.80:0/4282628252 >> 172.21.15.80:0/4282628252 conn(0x7f42b00f27e0 msgr2=0x7f42b00f33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:32:25.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.961+0000 7f42b74ae700 1 -- 172.21.15.80:0/4282628252 shutdown_connections 2024-02-13T00:32:25.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:25.961+0000 7f42b74ae700 1 -- 172.21.15.80:0/4282628252 wait complete. 2024-02-13T00:32:26.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:25 smithi106 bash[18459]: cluster 2024-02-13T00:32:24.708965+0000 mgr.y (mgr.24461) 104 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:26.886 INFO:teuthology.orchestra.run.smithi080.stdout:55834574933 2024-02-13T00:32:26.887 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-13T00:32:28.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:27 smithi106 bash[18459]: cluster 2024-02-13T00:32:26.709647+0000 mgr.y (mgr.24461) 105 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:28.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:32:27 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:32:28.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:27 smithi080 bash[24237]: cluster 2024-02-13T00:32:26.709647+0000 mgr.y (mgr.24461) 105 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:28.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:27 smithi080 bash[17386]: cluster 2024-02-13T00:32:26.709647+0000 mgr.y (mgr.24461) 105 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:29.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:28 smithi106 bash[18459]: audit 2024-02-13T00:32:27.780204+0000 mgr.y (mgr.24461) 106 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:32:29.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:28 smithi080 bash[17386]: audit 2024-02-13T00:32:27.780204+0000 mgr.y (mgr.24461) 106 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:32:29.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:28 smithi080 bash[24237]: audit 2024-02-13T00:32:27.780204+0000 mgr.y (mgr.24461) 106 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:32:30.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:29 smithi106 bash[18459]: cluster 2024-02-13T00:32:28.710991+0000 mgr.y (mgr.24461) 107 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:30.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:29 smithi080 bash[17386]: cluster 2024-02-13T00:32:28.710991+0000 mgr.y (mgr.24461) 107 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:30.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:29 smithi080 bash[24237]: cluster 2024-02-13T00:32:28.710991+0000 mgr.y (mgr.24461) 107 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:30.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:32:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:32:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:32:31.665 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:32:32.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:31 smithi080 bash[17386]: cluster 2024-02-13T00:32:30.711610+0000 mgr.y (mgr.24461) 108 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:32.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:31 smithi080 bash[24237]: cluster 2024-02-13T00:32:30.711610+0000 mgr.y (mgr.24461) 108 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:32.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:31 smithi106 bash[18459]: cluster 2024-02-13T00:32:30.711610+0000 mgr.y (mgr.24461) 108 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:33.258 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:32:33 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:32:33] "GET /metrics HTTP/1.1" 200 172218 "" "Prometheus/2.33.4" 2024-02-13T00:32:34.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:33 smithi080 bash[17386]: cluster 2024-02-13T00:32:32.712977+0000 mgr.y (mgr.24461) 109 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:34.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:33 smithi080 bash[24237]: cluster 2024-02-13T00:32:32.712977+0000 mgr.y (mgr.24461) 109 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:34.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:33 smithi106 bash[18459]: cluster 2024-02-13T00:32:32.712977+0000 mgr.y (mgr.24461) 109 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.692+0000 7f56d40a6700 1 -- 172.21.15.80:0/1855809468 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56cc0fe5f0 msgr2=0x7f56cc0f7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.692+0000 7f56d40a6700 1 --2- 172.21.15.80:0/1855809468 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56cc0fe5f0 0x7f56cc0f7e20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f56bc004870 tx=0x7f56bc009cb0).stop 2024-02-13T00:32:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.692+0000 7f56d40a6700 1 -- 172.21.15.80:0/1855809468 shutdown_connections 2024-02-13T00:32:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.692+0000 7f56d40a6700 1 --2- 172.21.15.80:0/1855809468 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56cc0fdc90 0x7f56cc0fe070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.692+0000 7f56d40a6700 1 --2- 172.21.15.80:0/1855809468 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56cc0f8500 0x7f56cc104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.692+0000 7f56d40a6700 1 --2- 172.21.15.80:0/1855809468 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56cc0fe5f0 0x7f56cc0f7e20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.692+0000 7f56d40a6700 1 -- 172.21.15.80:0/1855809468 >> 172.21.15.80:0/1855809468 conn(0x7f56cc0f3900 msgr2=0x7f56cc0f5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:32:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.692+0000 7f56d40a6700 1 -- 172.21.15.80:0/1855809468 shutdown_connections 2024-02-13T00:32:34.702 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.692+0000 7f56d40a6700 1 -- 172.21.15.80:0/1855809468 wait complete. 2024-02-13T00:32:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56d40a6700 1 Processor -- start 2024-02-13T00:32:34.703 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56d40a6700 1 -- start start 2024-02-13T00:32:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56d40a6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56cc0f8500 0x7f56cc10df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56d40a6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56cc0fdc90 0x7f56cc10e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56d40a6700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56cc0fe5f0 0x7f56cc108170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56d40a6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc108660 con 0x7f56cc0f8500 2024-02-13T00:32:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56d40a6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc1087d0 con 0x7f56cc0fdc90 2024-02-13T00:32:34.704 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56d40a6700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc108990 con 0x7f56cc0fe5f0 2024-02-13T00:32:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56d1e42700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56cc0f8500 0x7f56cc10df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56d2643700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56cc0fe5f0 0x7f56cc108170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56d1e42700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56cc0f8500 0x7f56cc10df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34292/0 (socket says 172.21.15.80:34292) 2024-02-13T00:32:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56d1e42700 1 -- 172.21.15.80:0/3054277296 learned_addr learned my addr 172.21.15.80:0/3054277296 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:32:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56d1641700 1 --2- 172.21.15.80:0/3054277296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56cc0fdc90 0x7f56cc10e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:34.705 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56d2643700 1 -- 172.21.15.80:0/3054277296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56cc0fdc90 msgr2=0x7f56cc10e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:34.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56d2643700 1 --2- 172.21.15.80:0/3054277296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56cc0fdc90 0x7f56cc10e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:34.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56d2643700 1 -- 172.21.15.80:0/3054277296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56cc0f8500 msgr2=0x7f56cc10df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:34.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56d2643700 1 --2- 172.21.15.80:0/3054277296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56cc0f8500 0x7f56cc10df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:34.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56d2643700 1 -- 172.21.15.80:0/3054277296 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56bc005040 con 0x7f56cc0fe5f0 2024-02-13T00:32:34.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56d1e42700 1 --2- 172.21.15.80:0/3054277296 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f56cc0f8500 0x7f56cc10df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:32:34.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56d2643700 1 --2- 172.21.15.80:0/3054277296 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56cc0fe5f0 0x7f56cc108170 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f56c400eb70 tx=0x7f56c400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:32:34.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56c2ffd700 1 -- 172.21.15.80:0/3054277296 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c4009870 con 0x7f56cc0fe5f0 2024-02-13T00:32:34.706 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56d40a6700 1 -- 172.21.15.80:0/3054277296 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56cc108c10 con 0x7f56cc0fe5f0 2024-02-13T00:32:34.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56c2ffd700 1 -- 172.21.15.80:0/3054277296 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f56c400f040 con 0x7f56cc0fe5f0 2024-02-13T00:32:34.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56c2ffd700 1 -- 172.21.15.80:0/3054277296 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c4007c40 con 0x7f56cc0fe5f0 2024-02-13T00:32:34.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.696+0000 7f56d40a6700 1 -- 172.21.15.80:0/3054277296 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56cc114db0 con 0x7f56cc0fe5f0 2024-02-13T00:32:34.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.700+0000 7f56d40a6700 1 -- 172.21.15.80:0/3054277296 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f56cc059440 con 0x7f56cc0fe5f0 2024-02-13T00:32:34.707 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.700+0000 7f56c2ffd700 1 -- 172.21.15.80:0/3054277296 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f56c400c7c0 con 0x7f56cc0fe5f0 2024-02-13T00:32:34.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.700+0000 7f56c2ffd700 1 --2- 172.21.15.80:0/3054277296 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f56b8061340 0x7f56b8063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:34.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.700+0000 7f56d1e42700 1 --2- 172.21.15.80:0/3054277296 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f56b8061340 0x7f56b8063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:34.708 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.700+0000 7f56c2ffd700 1 -- 172.21.15.80:0/3054277296 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f56c407cd20 con 0x7f56cc0fe5f0 2024-02-13T00:32:34.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.700+0000 7f56c2ffd700 1 --2- 172.21.15.80:0/3054277296 >> [v2:172.21.15.80:6818/238755079,v1:172.21.15.80:6819/238755079] conn(0x7f56b806b1d0 0x7f56b806d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:34.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.700+0000 7f56c2ffd700 1 -- 172.21.15.80:0/3054277296 --> [v2:172.21.15.80:6818/238755079,v1:172.21.15.80:6819/238755079] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f56b806dcf0 con 0x7f56b806b1d0 2024-02-13T00:32:34.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.700+0000 7f56c2ffd700 1 -- 172.21.15.80:0/3054277296 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56c4082330 con 0x7f56cc0fe5f0 2024-02-13T00:32:34.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.700+0000 7f56d1641700 1 --2- 172.21.15.80:0/3054277296 >> [v2:172.21.15.80:6818/238755079,v1:172.21.15.80:6819/238755079] conn(0x7f56b806b1d0 0x7f56b806d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:34.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.700+0000 7f56d1e42700 1 --2- 172.21.15.80:0/3054277296 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f56b8061340 0x7f56b8063800 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f56c8007d30 tx=0x7f56c800b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:32:34.709 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.700+0000 7f56d1641700 1 --2- 172.21.15.80:0/3054277296 >> [v2:172.21.15.80:6818/238755079,v1:172.21.15.80:6819/238755079] conn(0x7f56b806b1d0 0x7f56b806d670 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:32:34.710 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.700+0000 7f56c2ffd700 1 -- 172.21.15.80:0/3054277296 <== osd.2 v2:172.21.15.80:6818/238755079 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f56b806dcf0 con 0x7f56b806b1d0 2024-02-13T00:32:34.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.720+0000 7f56d40a6700 1 -- 172.21.15.80:0/3054277296 --> [v2:172.21.15.80:6818/238755079,v1:172.21.15.80:6819/238755079] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f56cc05fab0 con 0x7f56b806b1d0 2024-02-13T00:32:34.728 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.720+0000 7f56c2ffd700 1 -- 172.21.15.80:0/3054277296 <== osd.2 v2:172.21.15.80:6818/238755079 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f56cc05fab0 con 0x7f56b806b1d0 2024-02-13T00:32:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.720+0000 7f56d40a6700 1 -- 172.21.15.80:0/3054277296 >> [v2:172.21.15.80:6818/238755079,v1:172.21.15.80:6819/238755079] conn(0x7f56b806b1d0 msgr2=0x7f56b806d670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:34.729 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.720+0000 7f56d40a6700 1 --2- 172.21.15.80:0/3054277296 >> [v2:172.21.15.80:6818/238755079,v1:172.21.15.80:6819/238755079] conn(0x7f56b806b1d0 0x7f56b806d670 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.720+0000 7f56d40a6700 1 -- 172.21.15.80:0/3054277296 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f56b8061340 msgr2=0x7f56b8063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.720+0000 7f56d40a6700 1 --2- 172.21.15.80:0/3054277296 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f56b8061340 0x7f56b8063800 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f56c8007d30 tx=0x7f56c800b040).stop 2024-02-13T00:32:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.720+0000 7f56d40a6700 1 -- 172.21.15.80:0/3054277296 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56cc0fe5f0 msgr2=0x7f56cc108170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.720+0000 7f56d40a6700 1 --2- 172.21.15.80:0/3054277296 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f56cc0fe5f0 0x7f56cc108170 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f56c400eb70 tx=0x7f56c400b040).stop 2024-02-13T00:32:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.720+0000 7f56d2643700 1 -- 172.21.15.80:0/3054277296 reap_dead start 2024-02-13T00:32:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.720+0000 7f56d40a6700 1 -- 172.21.15.80:0/3054277296 shutdown_connections 2024-02-13T00:32:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.720+0000 7f56d40a6700 1 -- 172.21.15.80:0/3054277296 >> 172.21.15.80:0/3054277296 conn(0x7f56cc0f3900 msgr2=0x7f56cc0fbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:32:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.720+0000 7f56d40a6700 1 -- 172.21.15.80:0/3054277296 shutdown_connections 2024-02-13T00:32:34.730 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:34.720+0000 7f56d40a6700 1 -- 172.21.15.80:0/3054277296 wait complete. 2024-02-13T00:32:35.547 INFO:teuthology.orchestra.run.smithi080.stdout:77309411407 2024-02-13T00:32:35.547 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-13T00:32:36.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:35 smithi106 bash[18459]: cluster 2024-02-13T00:32:34.713457+0000 mgr.y (mgr.24461) 110 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:36.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:35 smithi080 bash[17386]: cluster 2024-02-13T00:32:34.713457+0000 mgr.y (mgr.24461) 110 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:36.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:35 smithi080 bash[24237]: cluster 2024-02-13T00:32:34.713457+0000 mgr.y (mgr.24461) 110 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:38.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:32:37 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:32:38.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:37 smithi106 bash[18459]: cluster 2024-02-13T00:32:36.714226+0000 mgr.y (mgr.24461) 111 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:38.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:37 smithi080 bash[17386]: cluster 2024-02-13T00:32:36.714226+0000 mgr.y (mgr.24461) 111 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:38.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:37 smithi080 bash[24237]: cluster 2024-02-13T00:32:36.714226+0000 mgr.y (mgr.24461) 111 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:39.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:38 smithi106 bash[18459]: audit 2024-02-13T00:32:37.789119+0000 mgr.y (mgr.24461) 112 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:32:39.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:38 smithi080 bash[17386]: audit 2024-02-13T00:32:37.789119+0000 mgr.y (mgr.24461) 112 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:32:39.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:38 smithi080 bash[24237]: audit 2024-02-13T00:32:37.789119+0000 mgr.y (mgr.24461) 112 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:32:40.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:39 smithi106 bash[18459]: cluster 2024-02-13T00:32:38.715748+0000 mgr.y (mgr.24461) 113 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:40.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:39 smithi080 bash[17386]: cluster 2024-02-13T00:32:38.715748+0000 mgr.y (mgr.24461) 113 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:40.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:39 smithi080 bash[24237]: cluster 2024-02-13T00:32:38.715748+0000 mgr.y (mgr.24461) 113 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:40.320 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:32:40.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:32:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:32:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:32:42.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:41 smithi080 bash[17386]: cluster 2024-02-13T00:32:40.716478+0000 mgr.y (mgr.24461) 114 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:42.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:41 smithi080 bash[24237]: cluster 2024-02-13T00:32:40.716478+0000 mgr.y (mgr.24461) 114 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:42.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:41 smithi106 bash[18459]: cluster 2024-02-13T00:32:40.716478+0000 mgr.y (mgr.24461) 114 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:43.016 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.008+0000 7f7705e84700 1 -- 172.21.15.80:0/89525225 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f77000f73f0 msgr2=0x7f77001039f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:43.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.008+0000 7f7705e84700 1 --2- 172.21.15.80:0/89525225 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f77000f73f0 0x7f77001039f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f76f8009be0 tx=0x7f76f8004d10).stop 2024-02-13T00:32:43.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.008+0000 7f7705e84700 1 -- 172.21.15.80:0/89525225 shutdown_connections 2024-02-13T00:32:43.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.008+0000 7f7705e84700 1 --2- 172.21.15.80:0/89525225 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f77000f73f0 0x7f77001039f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:43.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.008+0000 7f7705e84700 1 --2- 172.21.15.80:0/89525225 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77000fcb80 0x7f77000fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:43.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.008+0000 7f7705e84700 1 --2- 172.21.15.80:0/89525225 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77000fd4e0 0x7f77000f6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:43.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.008+0000 7f7705e84700 1 -- 172.21.15.80:0/89525225 >> 172.21.15.80:0/89525225 conn(0x7f77000f2770 msgr2=0x7f77000f4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:32:43.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.008+0000 7f7705e84700 1 -- 172.21.15.80:0/89525225 shutdown_connections 2024-02-13T00:32:43.017 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.008+0000 7f7705e84700 1 -- 172.21.15.80:0/89525225 wait complete. 2024-02-13T00:32:43.018 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.008+0000 7f7705e84700 1 Processor -- start 2024-02-13T00:32:43.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.008+0000 7f7705e84700 1 -- start start 2024-02-13T00:32:43.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.008+0000 7f7705e84700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77000f73f0 0x7f770010de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:43.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.008+0000 7f7705e84700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77000fcb80 0x7f770010e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:43.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.008+0000 7f7705e84700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f77000fd4e0 0x7f7700107fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:43.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.008+0000 7f7705e84700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77001084d0 con 0x7f77000f73f0 2024-02-13T00:32:43.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.008+0000 7f7705e84700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7700108640 con 0x7f77000fcb80 2024-02-13T00:32:43.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.008+0000 7f7705e84700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7700108800 con 0x7f77000fd4e0 2024-02-13T00:32:43.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.008+0000 7f76ff7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77000f73f0 0x7f770010de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:43.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.008+0000 7f76ff7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77000f73f0 0x7f770010de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:48922/0 (socket says 172.21.15.80:48922) 2024-02-13T00:32:43.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.008+0000 7f76fffff700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f77000fd4e0 0x7f7700107fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:43.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.008+0000 7f76ff7fe700 1 -- 172.21.15.80:0/3656480109 learned_addr learned my addr 172.21.15.80:0/3656480109 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:32:43.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.008+0000 7f76feffd700 1 --2- 172.21.15.80:0/3656480109 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77000fcb80 0x7f770010e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:43.019 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.012+0000 7f76ff7fe700 1 -- 172.21.15.80:0/3656480109 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f77000fd4e0 msgr2=0x7f7700107fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:43.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.012+0000 7f76ff7fe700 1 --2- 172.21.15.80:0/3656480109 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f77000fd4e0 0x7f7700107fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:43.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.012+0000 7f76ff7fe700 1 -- 172.21.15.80:0/3656480109 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77000fcb80 msgr2=0x7f770010e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:43.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.012+0000 7f76ff7fe700 1 --2- 172.21.15.80:0/3656480109 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77000fcb80 0x7f770010e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:43.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.012+0000 7f76ff7fe700 1 -- 172.21.15.80:0/3656480109 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f4005040 con 0x7f77000f73f0 2024-02-13T00:32:43.020 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.012+0000 7f76fffff700 1 --2- 172.21.15.80:0/3656480109 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f77000fd4e0 0x7f7700107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:32:43.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.012+0000 7f76ff7fe700 1 --2- 172.21.15.80:0/3656480109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77000f73f0 0x7f770010de40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f76f40048f0 tx=0x7f76f4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:32:43.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.012+0000 7f76fcff9700 1 -- 172.21.15.80:0/3656480109 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4007b00 con 0x7f77000f73f0 2024-02-13T00:32:43.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.012+0000 7f76fcff9700 1 -- 172.21.15.80:0/3656480109 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f76f400f040 con 0x7f77000f73f0 2024-02-13T00:32:43.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.012+0000 7f76fcff9700 1 -- 172.21.15.80:0/3656480109 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4014840 con 0x7f77000f73f0 2024-02-13T00:32:43.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.012+0000 7f7705e84700 1 -- 172.21.15.80:0/3656480109 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f80097c0 con 0x7f77000f73f0 2024-02-13T00:32:43.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.012+0000 7f7705e84700 1 -- 172.21.15.80:0/3656480109 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7700108df0 con 0x7f77000f73f0 2024-02-13T00:32:43.021 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.012+0000 7f7705e84700 1 -- 172.21.15.80:0/3656480109 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f77000f4a00 con 0x7f77000f73f0 2024-02-13T00:32:43.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.012+0000 7f76fcff9700 1 -- 172.21.15.80:0/3656480109 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f76f4014c70 con 0x7f77000f73f0 2024-02-13T00:32:43.022 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.016+0000 7f76fcff9700 1 --2- 172.21.15.80:0/3656480109 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f76e8061340 0x7f76e8063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:43.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.016+0000 7f76fcff9700 1 -- 172.21.15.80:0/3656480109 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f76f407cb30 con 0x7f77000f73f0 2024-02-13T00:32:43.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.016+0000 7f76feffd700 1 --2- 172.21.15.80:0/3656480109 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f76e8061340 0x7f76e8063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:43.023 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.016+0000 7f76fcff9700 1 --2- 172.21.15.80:0/3656480109 >> [v2:172.21.15.80:6826/3260371152,v1:172.21.15.80:6827/3260371152] conn(0x7f76e806b1d0 0x7f76e806d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:43.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.016+0000 7f76fcff9700 1 -- 172.21.15.80:0/3656480109 --> [v2:172.21.15.80:6826/3260371152,v1:172.21.15.80:6827/3260371152] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f76e806dcf0 con 0x7f76e806b1d0 2024-02-13T00:32:43.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.016+0000 7f76fcff9700 1 -- 172.21.15.80:0/3656480109 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76f4081220 con 0x7f77000f73f0 2024-02-13T00:32:43.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.016+0000 7f76fffff700 1 --2- 172.21.15.80:0/3656480109 >> [v2:172.21.15.80:6826/3260371152,v1:172.21.15.80:6827/3260371152] conn(0x7f76e806b1d0 0x7f76e806d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:43.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.016+0000 7f76feffd700 1 --2- 172.21.15.80:0/3656480109 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f76e8061340 0x7f76e8063800 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7700109780 tx=0x7f76f000b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:32:43.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.016+0000 7f76fffff700 1 --2- 172.21.15.80:0/3656480109 >> [v2:172.21.15.80:6826/3260371152,v1:172.21.15.80:6827/3260371152] conn(0x7f76e806b1d0 0x7f76e806d670 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:32:43.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.016+0000 7f76fcff9700 1 -- 172.21.15.80:0/3656480109 <== osd.3 v2:172.21.15.80:6826/3260371152 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f76e806dcf0 con 0x7f76e806b1d0 2024-02-13T00:32:43.042 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.036+0000 7f7705e84700 1 -- 172.21.15.80:0/3656480109 --> [v2:172.21.15.80:6826/3260371152,v1:172.21.15.80:6827/3260371152] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7700060760 con 0x7f76e806b1d0 2024-02-13T00:32:43.043 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.036+0000 7f76fcff9700 1 -- 172.21.15.80:0/3656480109 <== osd.3 v2:172.21.15.80:6826/3260371152 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7700060760 con 0x7f76e806b1d0 2024-02-13T00:32:43.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.036+0000 7f7705e84700 1 -- 172.21.15.80:0/3656480109 >> [v2:172.21.15.80:6826/3260371152,v1:172.21.15.80:6827/3260371152] conn(0x7f76e806b1d0 msgr2=0x7f76e806d670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:43.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.036+0000 7f7705e84700 1 --2- 172.21.15.80:0/3656480109 >> [v2:172.21.15.80:6826/3260371152,v1:172.21.15.80:6827/3260371152] conn(0x7f76e806b1d0 0x7f76e806d670 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:43.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.036+0000 7f7705e84700 1 -- 172.21.15.80:0/3656480109 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f76e8061340 msgr2=0x7f76e8063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:43.044 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.036+0000 7f7705e84700 1 --2- 172.21.15.80:0/3656480109 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f76e8061340 0x7f76e8063800 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7700109780 tx=0x7f76f000b040).stop 2024-02-13T00:32:43.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.036+0000 7f7705e84700 1 -- 172.21.15.80:0/3656480109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77000f73f0 msgr2=0x7f770010de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:43.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.036+0000 7f7705e84700 1 --2- 172.21.15.80:0/3656480109 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f77000f73f0 0x7f770010de40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f76f40048f0 tx=0x7f76f4009cb0).stop 2024-02-13T00:32:43.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.036+0000 7f76fffff700 1 -- 172.21.15.80:0/3656480109 reap_dead start 2024-02-13T00:32:43.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.036+0000 7f7705e84700 1 -- 172.21.15.80:0/3656480109 shutdown_connections 2024-02-13T00:32:43.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.036+0000 7f7705e84700 1 -- 172.21.15.80:0/3656480109 >> 172.21.15.80:0/3656480109 conn(0x7f77000f2770 msgr2=0x7f77000f4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:32:43.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.036+0000 7f7705e84700 1 -- 172.21.15.80:0/3656480109 shutdown_connections 2024-02-13T00:32:43.045 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:43.036+0000 7f7705e84700 1 -- 172.21.15.80:0/3656480109 wait complete. 2024-02-13T00:32:43.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:32:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:32:43] "GET /metrics HTTP/1.1" 200 172218 "" "Prometheus/2.33.4" 2024-02-13T00:32:43.822 INFO:teuthology.orchestra.run.smithi080.stdout:107374182473 2024-02-13T00:32:43.822 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-13T00:32:44.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:43 smithi106 bash[18459]: cluster 2024-02-13T00:32:42.717824+0000 mgr.y (mgr.24461) 115 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:44.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:43 smithi080 bash[17386]: cluster 2024-02-13T00:32:42.717824+0000 mgr.y (mgr.24461) 115 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:44.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:43 smithi080 bash[24237]: cluster 2024-02-13T00:32:42.717824+0000 mgr.y (mgr.24461) 115 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:46.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:45 smithi106 bash[18459]: cluster 2024-02-13T00:32:44.718693+0000 mgr.y (mgr.24461) 116 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:46.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:45 smithi080 bash[17386]: cluster 2024-02-13T00:32:44.718693+0000 mgr.y (mgr.24461) 116 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:46.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:45 smithi080 bash[24237]: cluster 2024-02-13T00:32:44.718693+0000 mgr.y (mgr.24461) 116 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:47.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:46 smithi106 bash[18459]: audit 2024-02-13T00:32:45.537362+0000 mon.c (mon.2) 57 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:32:47.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:46 smithi106 bash[18459]: audit 2024-02-13T00:32:45.813308+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:32:47.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:46 smithi080 bash[17386]: audit 2024-02-13T00:32:45.537362+0000 mon.c (mon.2) 57 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:32:47.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:46 smithi080 bash[17386]: audit 2024-02-13T00:32:45.813308+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:32:47.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:46 smithi080 bash[24237]: audit 2024-02-13T00:32:45.537362+0000 mon.c (mon.2) 57 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:32:47.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:46 smithi080 bash[24237]: audit 2024-02-13T00:32:45.813308+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:32:47.803 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:47 smithi106 bash[18459]: cluster 2024-02-13T00:32:46.719394+0000 mgr.y (mgr.24461) 117 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:48.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:47 smithi080 bash[17386]: cluster 2024-02-13T00:32:46.719394+0000 mgr.y (mgr.24461) 117 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:48.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:47 smithi080 bash[24237]: cluster 2024-02-13T00:32:46.719394+0000 mgr.y (mgr.24461) 117 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:48.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:32:47 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:32:48.593 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:32:49.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:48 smithi106 bash[18459]: audit 2024-02-13T00:32:47.799842+0000 mgr.y (mgr.24461) 118 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:32:49.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:48 smithi080 bash[17386]: audit 2024-02-13T00:32:47.799842+0000 mgr.y (mgr.24461) 118 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:32:49.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:48 smithi080 bash[24237]: audit 2024-02-13T00:32:47.799842+0000 mgr.y (mgr.24461) 118 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:32:49.907 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:49 smithi080 bash[17386]: cluster 2024-02-13T00:32:48.720376+0000 mgr.y (mgr.24461) 119 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:49.907 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:49 smithi080 bash[24237]: cluster 2024-02-13T00:32:48.720376+0000 mgr.y (mgr.24461) 119 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:50.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:49 smithi106 bash[18459]: cluster 2024-02-13T00:32:48.720376+0000 mgr.y (mgr.24461) 119 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:50.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:32:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:32:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:32:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.416+0000 7f467e4df700 1 -- 172.21.15.80:0/2886034336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46780fa620 msgr2=0x7f46780faa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.416+0000 7f467e4df700 1 --2- 172.21.15.80:0/2886034336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46780fa620 0x7f46780faa80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f4670009be0 tx=0x7f4670004d10).stop 2024-02-13T00:32:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.416+0000 7f467e4df700 1 -- 172.21.15.80:0/2886034336 shutdown_connections 2024-02-13T00:32:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.416+0000 7f467e4df700 1 --2- 172.21.15.80:0/2886034336 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46780fa620 0x7f46780faa80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.416+0000 7f467e4df700 1 --2- 172.21.15.80:0/2886034336 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f46780ffec0 0x7f46781002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.416+0000 7f467e4df700 1 --2- 172.21.15.80:0/2886034336 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4678100790 0x7f46780fa050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:51.425 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.416+0000 7f467e4df700 1 -- 172.21.15.80:0/2886034336 >> 172.21.15.80:0/2886034336 conn(0x7f46780f5ad0 msgr2=0x7f46780f7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:32:51.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.416+0000 7f467e4df700 1 -- 172.21.15.80:0/2886034336 shutdown_connections 2024-02-13T00:32:51.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.416+0000 7f467e4df700 1 -- 172.21.15.80:0/2886034336 wait complete. 2024-02-13T00:32:51.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.416+0000 7f467e4df700 1 Processor -- start 2024-02-13T00:32:51.426 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.416+0000 7f467e4df700 1 -- start start 2024-02-13T00:32:51.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f467e4df700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46780fa620 0x7f46781100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:51.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f467e4df700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f46780ffec0 0x7f46781105b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:51.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f467e4df700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4678100790 0x7f467810a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:51.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f467e4df700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467810a750 con 0x7f46780fa620 2024-02-13T00:32:51.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f467e4df700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467810a8c0 con 0x7f4678100790 2024-02-13T00:32:51.427 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f467e4df700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467810aa80 con 0x7f46780ffec0 2024-02-13T00:32:51.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f46777fe700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f46780ffec0 0x7f46781105b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:51.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f4677fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46780fa620 0x7f46781100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:51.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f46777fe700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f46780ffec0 0x7f46781105b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:53812/0 (socket says 172.21.15.80:53812) 2024-02-13T00:32:51.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f46777fe700 1 -- 172.21.15.80:0/4263031967 learned_addr learned my addr 172.21.15.80:0/4263031967 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:32:51.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f467ca7c700 1 --2- 172.21.15.80:0/4263031967 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4678100790 0x7f467810a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:51.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f4677fff700 1 -- 172.21.15.80:0/4263031967 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f46780ffec0 msgr2=0x7f46781105b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:51.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f4677fff700 1 --2- 172.21.15.80:0/4263031967 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f46780ffec0 0x7f46781105b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:51.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f4677fff700 1 -- 172.21.15.80:0/4263031967 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4678100790 msgr2=0x7f467810a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:51.428 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f4677fff700 1 --2- 172.21.15.80:0/4263031967 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4678100790 0x7f467810a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:51.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f4677fff700 1 -- 172.21.15.80:0/4263031967 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4668005040 con 0x7f46780fa620 2024-02-13T00:32:51.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f46777fe700 1 --2- 172.21.15.80:0/4263031967 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f46780ffec0 0x7f46781105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:32:51.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f4677fff700 1 --2- 172.21.15.80:0/4263031967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46780fa620 0x7f46781100c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f4668004920 tx=0x7f4668009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:32:51.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f46757fa700 1 -- 172.21.15.80:0/4263031967 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466800e030 con 0x7f46780fa620 2024-02-13T00:32:51.429 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f467e4df700 1 -- 172.21.15.80:0/4263031967 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46700097c0 con 0x7f46780fa620 2024-02-13T00:32:51.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f46757fa700 1 -- 172.21.15.80:0/4263031967 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f466800f040 con 0x7f46780fa620 2024-02-13T00:32:51.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f46757fa700 1 -- 172.21.15.80:0/4263031967 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4668014660 con 0x7f46780fa620 2024-02-13T00:32:51.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f467e4df700 1 -- 172.21.15.80:0/4263031967 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4678116ef0 con 0x7f46780fa620 2024-02-13T00:32:51.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.420+0000 7f467e4df700 1 -- 172.21.15.80:0/4263031967 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4678101730 con 0x7f46780fa620 2024-02-13T00:32:51.430 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.424+0000 7f46757fa700 1 -- 172.21.15.80:0/4263031967 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f4668010500 con 0x7f46780fa620 2024-02-13T00:32:51.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.424+0000 7f46757fa700 1 --2- 172.21.15.80:0/4263031967 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4660061340 0x7f4660063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:51.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.424+0000 7f46757fa700 1 -- 172.21.15.80:0/4263031967 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f466807cec0 con 0x7f46780fa620 2024-02-13T00:32:51.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.424+0000 7f46777fe700 1 --2- 172.21.15.80:0/4263031967 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4660061340 0x7f4660063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:51.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.424+0000 7f46757fa700 1 --2- 172.21.15.80:0/4263031967 >> [v2:172.21.15.106:6800/2755922963,v1:172.21.15.106:6801/2755922963] conn(0x7f466006b1d0 0x7f466006d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:51.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.424+0000 7f46757fa700 1 -- 172.21.15.80:0/4263031967 --> [v2:172.21.15.106:6800/2755922963,v1:172.21.15.106:6801/2755922963] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f466006dcf0 con 0x7f466006b1d0 2024-02-13T00:32:51.431 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.424+0000 7f46757fa700 1 -- 172.21.15.80:0/4263031967 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46680824d0 con 0x7f46780fa620 2024-02-13T00:32:51.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.424+0000 7f467ca7c700 1 --2- 172.21.15.80:0/4263031967 >> [v2:172.21.15.106:6800/2755922963,v1:172.21.15.106:6801/2755922963] conn(0x7f466006b1d0 0x7f466006d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:51.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.424+0000 7f46777fe700 1 --2- 172.21.15.80:0/4263031967 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4660061340 0x7f4660063800 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f466c009fd0 tx=0x7f466c00b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:32:51.432 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.424+0000 7f467ca7c700 1 --2- 172.21.15.80:0/4263031967 >> [v2:172.21.15.106:6800/2755922963,v1:172.21.15.106:6801/2755922963] conn(0x7f466006b1d0 0x7f466006d670 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:32:51.433 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.424+0000 7f46757fa700 1 -- 172.21.15.80:0/4263031967 <== osd.4 v2:172.21.15.106:6800/2755922963 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f466006dcf0 con 0x7f466006b1d0 2024-02-13T00:32:51.451 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.444+0000 7f467e4df700 1 -- 172.21.15.80:0/4263031967 --> [v2:172.21.15.106:6800/2755922963,v1:172.21.15.106:6801/2755922963] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f467805fab0 con 0x7f466006b1d0 2024-02-13T00:32:51.452 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.444+0000 7f46757fa700 1 -- 172.21.15.80:0/4263031967 <== osd.4 v2:172.21.15.106:6800/2755922963 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f467805fab0 con 0x7f466006b1d0 2024-02-13T00:32:51.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.444+0000 7f467e4df700 1 -- 172.21.15.80:0/4263031967 >> [v2:172.21.15.106:6800/2755922963,v1:172.21.15.106:6801/2755922963] conn(0x7f466006b1d0 msgr2=0x7f466006d670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:51.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.444+0000 7f467e4df700 1 --2- 172.21.15.80:0/4263031967 >> [v2:172.21.15.106:6800/2755922963,v1:172.21.15.106:6801/2755922963] conn(0x7f466006b1d0 0x7f466006d670 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:51.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.444+0000 7f467e4df700 1 -- 172.21.15.80:0/4263031967 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4660061340 msgr2=0x7f4660063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:51.453 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.444+0000 7f467e4df700 1 --2- 172.21.15.80:0/4263031967 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4660061340 0x7f4660063800 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f466c009fd0 tx=0x7f466c00b040).stop 2024-02-13T00:32:51.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.444+0000 7f467e4df700 1 -- 172.21.15.80:0/4263031967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46780fa620 msgr2=0x7f46781100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:51.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.444+0000 7f467e4df700 1 --2- 172.21.15.80:0/4263031967 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f46780fa620 0x7f46781100c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f4668004920 tx=0x7f4668009cb0).stop 2024-02-13T00:32:51.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.444+0000 7f467ca7c700 1 -- 172.21.15.80:0/4263031967 reap_dead start 2024-02-13T00:32:51.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.444+0000 7f467e4df700 1 -- 172.21.15.80:0/4263031967 shutdown_connections 2024-02-13T00:32:51.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.444+0000 7f467e4df700 1 -- 172.21.15.80:0/4263031967 >> 172.21.15.80:0/4263031967 conn(0x7f46780f5ad0 msgr2=0x7f4678100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:32:51.454 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.444+0000 7f467e4df700 1 -- 172.21.15.80:0/4263031967 shutdown_connections 2024-02-13T00:32:51.455 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:51.444+0000 7f467e4df700 1 -- 172.21.15.80:0/4263031967 wait complete. 2024-02-13T00:32:52.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:51 smithi080 bash[17386]: cluster 2024-02-13T00:32:50.721021+0000 mgr.y (mgr.24461) 120 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:52.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:51 smithi080 bash[17386]: audit 2024-02-13T00:32:51.565601+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:32:52.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:51 smithi080 bash[24237]: cluster 2024-02-13T00:32:50.721021+0000 mgr.y (mgr.24461) 120 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:52.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:51 smithi080 bash[24237]: audit 2024-02-13T00:32:51.565601+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:32:52.203 INFO:teuthology.orchestra.run.smithi080.stdout:128849018946 2024-02-13T00:32:52.204 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-13T00:32:52.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:51 smithi106 bash[18459]: cluster 2024-02-13T00:32:50.721021+0000 mgr.y (mgr.24461) 120 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:52.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:51 smithi106 bash[18459]: audit 2024-02-13T00:32:51.565601+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:32:53.116 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:52 smithi080 bash[17386]: audit 2024-02-13T00:32:51.828418+0000 mon.c (mon.2) 58 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:32:53.116 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:52 smithi080 bash[17386]: audit 2024-02-13T00:32:51.830230+0000 mon.c (mon.2) 59 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:32:53.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:52 smithi080 bash[17386]: audit 2024-02-13T00:32:51.837840+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:32:53.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:52 smithi080 bash[24237]: audit 2024-02-13T00:32:51.828418+0000 mon.c (mon.2) 58 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:32:53.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:52 smithi080 bash[24237]: audit 2024-02-13T00:32:51.830230+0000 mon.c (mon.2) 59 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:32:53.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:52 smithi080 bash[24237]: audit 2024-02-13T00:32:51.837840+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:32:53.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:52 smithi106 bash[18459]: audit 2024-02-13T00:32:51.828418+0000 mon.c (mon.2) 58 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:32:53.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:52 smithi106 bash[18459]: audit 2024-02-13T00:32:51.830230+0000 mon.c (mon.2) 59 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:32:53.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:52 smithi106 bash[18459]: audit 2024-02-13T00:32:51.837840+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:32:53.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:32:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:32:53] "GET /metrics HTTP/1.1" 200 172213 "" "Prometheus/2.33.4" 2024-02-13T00:32:54.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:53 smithi106 bash[18459]: cluster 2024-02-13T00:32:52.722442+0000 mgr.y (mgr.24461) 121 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:54.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:53 smithi080 bash[17386]: cluster 2024-02-13T00:32:52.722442+0000 mgr.y (mgr.24461) 121 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:54.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:53 smithi080 bash[24237]: cluster 2024-02-13T00:32:52.722442+0000 mgr.y (mgr.24461) 121 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:55 smithi106 bash[18459]: cluster 2024-02-13T00:32:54.723147+0000 mgr.y (mgr.24461) 122 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:55 smithi080 bash[17386]: cluster 2024-02-13T00:32:54.723147+0000 mgr.y (mgr.24461) 122 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:56.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:55 smithi080 bash[24237]: cluster 2024-02-13T00:32:54.723147+0000 mgr.y (mgr.24461) 122 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:56.972 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:32:58.105 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:57 smithi080 bash[17386]: cluster 2024-02-13T00:32:56.723990+0000 mgr.y (mgr.24461) 123 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:58.105 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:57 smithi080 bash[24237]: cluster 2024-02-13T00:32:56.723990+0000 mgr.y (mgr.24461) 123 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:57 smithi106 bash[18459]: cluster 2024-02-13T00:32:56.723990+0000 mgr.y (mgr.24461) 123 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:32:58.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:32:57 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:32:59.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:58 smithi106 bash[18459]: audit 2024-02-13T00:32:57.811060+0000 mgr.y (mgr.24461) 124 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:32:59.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:58 smithi080 bash[17386]: audit 2024-02-13T00:32:57.811060+0000 mgr.y (mgr.24461) 124 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:32:59.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:58 smithi080 bash[24237]: audit 2024-02-13T00:32:57.811060+0000 mgr.y (mgr.24461) 124 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:32:59.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.840+0000 7f7eca90e700 1 -- 172.21.15.80:0/4236206024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ec40f7960 msgr2=0x7f7ec41039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:59.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.840+0000 7f7eca90e700 1 --2- 172.21.15.80:0/4236206024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ec40f7960 0x7f7ec41039e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f7ebc009be0 tx=0x7f7ebc004d10).stop 2024-02-13T00:32:59.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.840+0000 7f7eca90e700 1 -- 172.21.15.80:0/4236206024 shutdown_connections 2024-02-13T00:32:59.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.840+0000 7f7eca90e700 1 --2- 172.21.15.80:0/4236206024 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ec40fcb70 0x7f7ec40fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:59.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.840+0000 7f7eca90e700 1 --2- 172.21.15.80:0/4236206024 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ec40f7960 0x7f7ec41039e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:59.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.840+0000 7f7eca90e700 1 --2- 172.21.15.80:0/4236206024 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ec40fd4d0 0x7f7ec40f7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:59.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.840+0000 7f7eca90e700 1 -- 172.21.15.80:0/4236206024 >> 172.21.15.80:0/4236206024 conn(0x7f7ec40701a0 msgr2=0x7f7ec40f44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:32:59.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.840+0000 7f7eca90e700 1 -- 172.21.15.80:0/4236206024 shutdown_connections 2024-02-13T00:32:59.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.840+0000 7f7eca90e700 1 -- 172.21.15.80:0/4236206024 wait complete. 2024-02-13T00:32:59.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7eca90e700 1 Processor -- start 2024-02-13T00:32:59.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7eca90e700 1 -- start start 2024-02-13T00:32:59.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7eca90e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ec40f7960 0x7f7ec4108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:59.851 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7eca90e700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ec40fcb70 0x7f7ec41094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:59.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7eca90e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ec40fd4d0 0x7f7ec4109af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:59.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7eca90e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec4114200 con 0x7f7ec40f7960 2024-02-13T00:32:59.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7eca90e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec4114370 con 0x7f7ec40fd4d0 2024-02-13T00:32:59.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7eca90e700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec4114530 con 0x7f7ec40fcb70 2024-02-13T00:32:59.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7ec3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ec40f7960 0x7f7ec4108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:59.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7ec37fe700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ec40fcb70 0x7f7ec41094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:59.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7ec37fe700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ec40fcb70 0x7f7ec41094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:59620/0 (socket says 172.21.15.80:59620) 2024-02-13T00:32:59.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7ec3fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ec40f7960 0x7f7ec4108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:59406/0 (socket says 172.21.15.80:59406) 2024-02-13T00:32:59.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7ec37fe700 1 -- 172.21.15.80:0/1345697804 learned_addr learned my addr 172.21.15.80:0/1345697804 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:32:59.852 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7ec8eab700 1 --2- 172.21.15.80:0/1345697804 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ec40fd4d0 0x7f7ec4109af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:59.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7ec37fe700 1 -- 172.21.15.80:0/1345697804 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ec40fd4d0 msgr2=0x7f7ec4109af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:59.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7ec37fe700 1 --2- 172.21.15.80:0/1345697804 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ec40fd4d0 0x7f7ec4109af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:59.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7ec37fe700 1 -- 172.21.15.80:0/1345697804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ec40f7960 msgr2=0x7f7ec4108fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:59.853 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7ec37fe700 1 --2- 172.21.15.80:0/1345697804 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f7ec40f7960 0x7f7ec4108fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:59.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7ec37fe700 1 -- 172.21.15.80:0/1345697804 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ebc0097c0 con 0x7f7ec40fcb70 2024-02-13T00:32:59.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7ec37fe700 1 --2- 172.21.15.80:0/1345697804 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ec40fcb70 0x7f7ec41094c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f7eb800e8f0 tx=0x7f7eb800b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:32:59.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7ec17fa700 1 -- 172.21.15.80:0/1345697804 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8004660 con 0x7f7ec40fcb70 2024-02-13T00:32:59.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7ec17fa700 1 -- 172.21.15.80:0/1345697804 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f7eb800f040 con 0x7f7ec40fcb70 2024-02-13T00:32:59.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7eca90e700 1 -- 172.21.15.80:0/1345697804 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec4114810 con 0x7f7ec40fcb70 2024-02-13T00:32:59.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7ec17fa700 1 -- 172.21.15.80:0/1345697804 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb80146f0 con 0x7f7ec40fcb70 2024-02-13T00:32:59.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7eca90e700 1 -- 172.21.15.80:0/1345697804 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec4114d50 con 0x7f7ec40fcb70 2024-02-13T00:32:59.854 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.844+0000 7f7eaaffd700 1 -- 172.21.15.80:0/1345697804 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7ea4000f10 con 0x7f7ec40fcb70 2024-02-13T00:32:59.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.848+0000 7f7ec17fa700 1 -- 172.21.15.80:0/1345697804 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f7eb8007b40 con 0x7f7ec40fcb70 2024-02-13T00:32:59.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.848+0000 7f7ec17fa700 1 --2- 172.21.15.80:0/1345697804 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f7eac061340 0x7f7eac063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:59.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.848+0000 7f7ec17fa700 1 -- 172.21.15.80:0/1345697804 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f7eb807c780 con 0x7f7ec40fcb70 2024-02-13T00:32:59.855 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.848+0000 7f7ec3fff700 1 --2- 172.21.15.80:0/1345697804 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f7eac061340 0x7f7eac063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:59.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.848+0000 7f7ec17fa700 1 --2- 172.21.15.80:0/1345697804 >> [v2:172.21.15.106:6808/3712665601,v1:172.21.15.106:6809/3712665601] conn(0x7f7eac06b250 0x7f7eac06d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:32:59.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.848+0000 7f7ec17fa700 1 -- 172.21.15.80:0/1345697804 --> [v2:172.21.15.106:6808/3712665601,v1:172.21.15.106:6809/3712665601] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7eac06dd70 con 0x7f7eac06b250 2024-02-13T00:32:59.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.848+0000 7f7ec17fa700 1 -- 172.21.15.80:0/1345697804 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7eb8081220 con 0x7f7ec40fcb70 2024-02-13T00:32:59.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.848+0000 7f7ec3fff700 1 --2- 172.21.15.80:0/1345697804 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f7eac061340 0x7f7eac063800 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7eb40048b0 tx=0x7f7eb400b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:32:59.856 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.848+0000 7f7ec8eab700 1 --2- 172.21.15.80:0/1345697804 >> [v2:172.21.15.106:6808/3712665601,v1:172.21.15.106:6809/3712665601] conn(0x7f7eac06b250 0x7f7eac06d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:32:59.857 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.848+0000 7f7ec8eab700 1 --2- 172.21.15.80:0/1345697804 >> [v2:172.21.15.106:6808/3712665601,v1:172.21.15.106:6809/3712665601] conn(0x7f7eac06b250 0x7f7eac06d6f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:32:59.858 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.852+0000 7f7ec17fa700 1 -- 172.21.15.80:0/1345697804 <== osd.5 v2:172.21.15.106:6808/3712665601 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f7eac06dd70 con 0x7f7eac06b250 2024-02-13T00:32:59.878 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.872+0000 7f7eaaffd700 1 -- 172.21.15.80:0/1345697804 --> [v2:172.21.15.106:6808/3712665601,v1:172.21.15.106:6809/3712665601] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7ea4002a20 con 0x7f7eac06b250 2024-02-13T00:32:59.879 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.872+0000 7f7ec17fa700 1 -- 172.21.15.80:0/1345697804 <== osd.5 v2:172.21.15.106:6808/3712665601 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7ea4002a20 con 0x7f7eac06b250 2024-02-13T00:32:59.880 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.872+0000 7f7eaaffd700 1 -- 172.21.15.80:0/1345697804 >> [v2:172.21.15.106:6808/3712665601,v1:172.21.15.106:6809/3712665601] conn(0x7f7eac06b250 msgr2=0x7f7eac06d6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:59.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.872+0000 7f7eaaffd700 1 --2- 172.21.15.80:0/1345697804 >> [v2:172.21.15.106:6808/3712665601,v1:172.21.15.106:6809/3712665601] conn(0x7f7eac06b250 0x7f7eac06d6f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:32:59.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.872+0000 7f7eaaffd700 1 -- 172.21.15.80:0/1345697804 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f7eac061340 msgr2=0x7f7eac063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:59.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.872+0000 7f7eaaffd700 1 --2- 172.21.15.80:0/1345697804 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f7eac061340 0x7f7eac063800 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7eb40048b0 tx=0x7f7eb400b040).stop 2024-02-13T00:32:59.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.872+0000 7f7eaaffd700 1 -- 172.21.15.80:0/1345697804 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ec40fcb70 msgr2=0x7f7ec41094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:32:59.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.872+0000 7f7eaaffd700 1 --2- 172.21.15.80:0/1345697804 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f7ec40fcb70 0x7f7ec41094c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f7eb800e8f0 tx=0x7f7eb800b040).stop 2024-02-13T00:32:59.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.872+0000 7f7ec8eab700 1 -- 172.21.15.80:0/1345697804 reap_dead start 2024-02-13T00:32:59.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.872+0000 7f7eaaffd700 1 -- 172.21.15.80:0/1345697804 shutdown_connections 2024-02-13T00:32:59.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.872+0000 7f7eaaffd700 1 -- 172.21.15.80:0/1345697804 >> 172.21.15.80:0/1345697804 conn(0x7f7ec40701a0 msgr2=0x7f7ec406d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:32:59.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.872+0000 7f7eaaffd700 1 -- 172.21.15.80:0/1345697804 shutdown_connections 2024-02-13T00:32:59.881 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:32:59.872+0000 7f7eaaffd700 1 -- 172.21.15.80:0/1345697804 wait complete. 2024-02-13T00:32:59.928 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:32:59 smithi080 bash[17386]: cluster 2024-02-13T00:32:58.725532+0000 mgr.y (mgr.24461) 125 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:32:59.928 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:32:59 smithi080 bash[24237]: cluster 2024-02-13T00:32:58.725532+0000 mgr.y (mgr.24461) 125 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:00.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:32:59 smithi106 bash[18459]: cluster 2024-02-13T00:32:58.725532+0000 mgr.y (mgr.24461) 125 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:00.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:33:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:33:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:33:00.660 INFO:teuthology.orchestra.run.smithi080.stdout:154618822716 2024-02-13T00:33:00.660 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-02-13T00:33:02.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:01 smithi106 bash[18459]: cluster 2024-02-13T00:33:00.726362+0000 mgr.y (mgr.24461) 126 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:02.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:01 smithi080 bash[17386]: cluster 2024-02-13T00:33:00.726362+0000 mgr.y (mgr.24461) 126 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:02.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:01 smithi080 bash[24237]: cluster 2024-02-13T00:33:00.726362+0000 mgr.y (mgr.24461) 126 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:03.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:33:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:33:03] "GET /metrics HTTP/1.1" 200 172217 "" "Prometheus/2.33.4" 2024-02-13T00:33:04.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:03 smithi106 bash[18459]: cluster 2024-02-13T00:33:02.727722+0000 mgr.y (mgr.24461) 127 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:04.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:03 smithi080 bash[17386]: cluster 2024-02-13T00:33:02.727722+0000 mgr.y (mgr.24461) 127 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:04.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:03 smithi080 bash[24237]: cluster 2024-02-13T00:33:02.727722+0000 mgr.y (mgr.24461) 127 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:05.432 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:33:05.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:05 smithi080 bash[17386]: cluster 2024-02-13T00:33:04.728445+0000 mgr.y (mgr.24461) 128 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T00:33:05.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:05 smithi080 bash[24237]: cluster 2024-02-13T00:33:04.728445+0000 mgr.y (mgr.24461) 128 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T00:33:06.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:05 smithi106 bash[18459]: cluster 2024-02-13T00:33:04.728445+0000 mgr.y (mgr.24461) 128 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T00:33:08.213 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:07 smithi080 bash[17386]: cluster 2024-02-13T00:33:06.729091+0000 mgr.y (mgr.24461) 129 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T00:33:08.213 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:07 smithi080 bash[24237]: cluster 2024-02-13T00:33:06.729091+0000 mgr.y (mgr.24461) 129 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T00:33:08.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:07 smithi106 bash[18459]: cluster 2024-02-13T00:33:06.729091+0000 mgr.y (mgr.24461) 129 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T00:33:08.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:33:07 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:33:08.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0cfe7700 1 -- 172.21.15.80:0/3029591641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b080f8c80 msgr2=0x7f8b080f9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:08.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0cfe7700 1 --2- 172.21.15.80:0/3029591641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b080f8c80 0x7f8b080f9060 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f8af8004870 tx=0x7f8af8009cb0).stop 2024-02-13T00:33:08.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0cfe7700 1 -- 172.21.15.80:0/3029591641 shutdown_connections 2024-02-13T00:33:08.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0cfe7700 1 --2- 172.21.15.80:0/3029591641 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8b081021e0 0x7f8b081045d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:08.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0cfe7700 1 --2- 172.21.15.80:0/3029591641 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b080f8c80 0x7f8b080f9060 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:08.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0cfe7700 1 --2- 172.21.15.80:0/3029591641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b080f95e0 0x7f8b08101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:08.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0cfe7700 1 -- 172.21.15.80:0/3029591641 >> 172.21.15.80:0/3029591641 conn(0x7f8b080f2770 msgr2=0x7f8b080f4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:33:08.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0cfe7700 1 -- 172.21.15.80:0/3029591641 shutdown_connections 2024-02-13T00:33:08.391 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0cfe7700 1 -- 172.21.15.80:0/3029591641 wait complete. 2024-02-13T00:33:08.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0cfe7700 1 Processor -- start 2024-02-13T00:33:08.392 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0cfe7700 1 -- start start 2024-02-13T00:33:08.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0cfe7700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b080f8c80 0x7f8b0810dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:08.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0cfe7700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8b080f95e0 0x7f8b0810e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:08.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0cfe7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b081021e0 0x7f8b081081c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:08.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0cfe7700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b081086b0 con 0x7f8b080f8c80 2024-02-13T00:33:08.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0cfe7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b08108820 con 0x7f8b081021e0 2024-02-13T00:33:08.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0cfe7700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b081089e0 con 0x7f8b080f95e0 2024-02-13T00:33:08.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b05d9b700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8b080f95e0 0x7f8b0810e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:08.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0659c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b080f8c80 0x7f8b0810dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:08.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b05d9b700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8b080f95e0 0x7f8b0810e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:59642/0 (socket says 172.21.15.80:59642) 2024-02-13T00:33:08.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b05d9b700 1 -- 172.21.15.80:0/1563254683 learned_addr learned my addr 172.21.15.80:0/1563254683 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:33:08.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b06d9d700 1 --2- 172.21.15.80:0/1563254683 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b081021e0 0x7f8b081081c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:08.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0659c700 1 -- 172.21.15.80:0/1563254683 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8b080f95e0 msgr2=0x7f8b0810e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:08.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0659c700 1 --2- 172.21.15.80:0/1563254683 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8b080f95e0 0x7f8b0810e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:08.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0659c700 1 -- 172.21.15.80:0/1563254683 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b081021e0 msgr2=0x7f8b081081c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:08.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0659c700 1 --2- 172.21.15.80:0/1563254683 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b081021e0 0x7f8b081081c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:08.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0659c700 1 -- 172.21.15.80:0/1563254683 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af8005040 con 0x7f8b080f8c80 2024-02-13T00:33:08.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b05d9b700 1 --2- 172.21.15.80:0/1563254683 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8b080f95e0 0x7f8b0810e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:33:08.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b06d9d700 1 --2- 172.21.15.80:0/1563254683 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b081021e0 0x7f8b081081c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-13T00:33:08.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.384+0000 7f8b0659c700 1 --2- 172.21.15.80:0/1563254683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b080f8c80 0x7f8b0810dfd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f8af8007fd0 tx=0x7f8af8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:33:08.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.388+0000 7f8af77fe700 1 -- 172.21.15.80:0/1563254683 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af800e030 con 0x7f8b080f8c80 2024-02-13T00:33:08.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.388+0000 7f8b0cfe7700 1 -- 172.21.15.80:0/1563254683 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b08108c60 con 0x7f8b080f8c80 2024-02-13T00:33:08.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.388+0000 7f8af77fe700 1 -- 172.21.15.80:0/1563254683 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f8af8013db0 con 0x7f8b080f8c80 2024-02-13T00:33:08.396 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.388+0000 7f8af77fe700 1 -- 172.21.15.80:0/1563254683 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af8018070 con 0x7f8b080f8c80 2024-02-13T00:33:08.397 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.388+0000 7f8b0cfe7700 1 -- 172.21.15.80:0/1563254683 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b08114e00 con 0x7f8b080f8c80 2024-02-13T00:33:08.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.388+0000 7f8b0cfe7700 1 -- 172.21.15.80:0/1563254683 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8b08059480 con 0x7f8b080f8c80 2024-02-13T00:33:08.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.388+0000 7f8af77fe700 1 -- 172.21.15.80:0/1563254683 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f8af8009240 con 0x7f8b080f8c80 2024-02-13T00:33:08.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.388+0000 7f8af77fe700 1 --2- 172.21.15.80:0/1563254683 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f8af0061210 0x7f8af00636d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:08.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.388+0000 7f8af77fe700 1 -- 172.21.15.80:0/1563254683 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f8af807dde0 con 0x7f8b080f8c80 2024-02-13T00:33:08.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.388+0000 7f8b05d9b700 1 --2- 172.21.15.80:0/1563254683 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f8af0061210 0x7f8af00636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:08.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.388+0000 7f8af77fe700 1 --2- 172.21.15.80:0/1563254683 >> [v2:172.21.15.106:6816/626618901,v1:172.21.15.106:6817/626618901] conn(0x7f8af006ae30 0x7f8af006d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:08.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.388+0000 7f8af77fe700 1 -- 172.21.15.80:0/1563254683 --> [v2:172.21.15.106:6816/626618901,v1:172.21.15.106:6817/626618901] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8af006d950 con 0x7f8af006ae30 2024-02-13T00:33:08.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.388+0000 7f8af77fe700 1 -- 172.21.15.80:0/1563254683 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8af80833f0 con 0x7f8b080f8c80 2024-02-13T00:33:08.398 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.388+0000 7f8b05d9b700 1 --2- 172.21.15.80:0/1563254683 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f8af0061210 0x7f8af00636d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f8afc004fd0 tx=0x7f8afc00b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:33:08.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.388+0000 7f8b06d9d700 1 --2- 172.21.15.80:0/1563254683 >> [v2:172.21.15.106:6816/626618901,v1:172.21.15.106:6817/626618901] conn(0x7f8af006ae30 0x7f8af006d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:08.399 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.392+0000 7f8b06d9d700 1 --2- 172.21.15.80:0/1563254683 >> [v2:172.21.15.106:6816/626618901,v1:172.21.15.106:6817/626618901] conn(0x7f8af006ae30 0x7f8af006d2d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:33:08.400 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.392+0000 7f8af77fe700 1 -- 172.21.15.80:0/1563254683 <== osd.6 v2:172.21.15.106:6816/626618901 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f8af006d950 con 0x7f8af006ae30 2024-02-13T00:33:08.420 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.412+0000 7f8b0cfe7700 1 -- 172.21.15.80:0/1563254683 --> [v2:172.21.15.106:6816/626618901,v1:172.21.15.106:6817/626618901] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8b08060760 con 0x7f8af006ae30 2024-02-13T00:33:08.421 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.412+0000 7f8af77fe700 1 -- 172.21.15.80:0/1563254683 <== osd.6 v2:172.21.15.106:6816/626618901 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8b08060760 con 0x7f8af006ae30 2024-02-13T00:33:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.412+0000 7f8b0cfe7700 1 -- 172.21.15.80:0/1563254683 >> [v2:172.21.15.106:6816/626618901,v1:172.21.15.106:6817/626618901] conn(0x7f8af006ae30 msgr2=0x7f8af006d2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.412+0000 7f8b0cfe7700 1 --2- 172.21.15.80:0/1563254683 >> [v2:172.21.15.106:6816/626618901,v1:172.21.15.106:6817/626618901] conn(0x7f8af006ae30 0x7f8af006d2d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.412+0000 7f8b0cfe7700 1 -- 172.21.15.80:0/1563254683 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f8af0061210 msgr2=0x7f8af00636d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.412+0000 7f8b0cfe7700 1 --2- 172.21.15.80:0/1563254683 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f8af0061210 0x7f8af00636d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f8afc004fd0 tx=0x7f8afc00b040).stop 2024-02-13T00:33:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.412+0000 7f8b0cfe7700 1 -- 172.21.15.80:0/1563254683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b080f8c80 msgr2=0x7f8b0810dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.412+0000 7f8b0cfe7700 1 --2- 172.21.15.80:0/1563254683 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8b080f8c80 0x7f8b0810dfd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f8af8007fd0 tx=0x7f8af8009cb0).stop 2024-02-13T00:33:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.412+0000 7f8b06d9d700 1 -- 172.21.15.80:0/1563254683 reap_dead start 2024-02-13T00:33:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.412+0000 7f8b0cfe7700 1 -- 172.21.15.80:0/1563254683 shutdown_connections 2024-02-13T00:33:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.412+0000 7f8b0cfe7700 1 -- 172.21.15.80:0/1563254683 >> 172.21.15.80:0/1563254683 conn(0x7f8b080f2770 msgr2=0x7f8b080f3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:33:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.412+0000 7f8b0cfe7700 1 -- 172.21.15.80:0/1563254683 shutdown_connections 2024-02-13T00:33:08.422 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:08.412+0000 7f8b0cfe7700 1 -- 172.21.15.80:0/1563254683 wait complete. 2024-02-13T00:33:09.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:08 smithi080 bash[24237]: audit 2024-02-13T00:33:07.821272+0000 mgr.y (mgr.24461) 130 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:33:09.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:08 smithi080 bash[17386]: audit 2024-02-13T00:33:07.821272+0000 mgr.y (mgr.24461) 130 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:33:09.137 INFO:teuthology.orchestra.run.smithi080.stdout:180388626485 2024-02-13T00:33:09.138 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-02-13T00:33:09.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:08 smithi106 bash[18459]: audit 2024-02-13T00:33:07.821272+0000 mgr.y (mgr.24461) 130 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:33:10.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:09 smithi106 bash[18459]: cluster 2024-02-13T00:33:08.729829+0000 mgr.y (mgr.24461) 131 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:10.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:09 smithi080 bash[17386]: cluster 2024-02-13T00:33:08.729829+0000 mgr.y (mgr.24461) 131 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:10.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:09 smithi080 bash[24237]: cluster 2024-02-13T00:33:08.729829+0000 mgr.y (mgr.24461) 131 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:10.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:33:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:33:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:33:12.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:11 smithi106 bash[18459]: cluster 2024-02-13T00:33:10.730564+0000 mgr.y (mgr.24461) 132 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T00:33:12.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:11 smithi080 bash[17386]: cluster 2024-02-13T00:33:10.730564+0000 mgr.y (mgr.24461) 132 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T00:33:12.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:11 smithi080 bash[24237]: cluster 2024-02-13T00:33:10.730564+0000 mgr.y (mgr.24461) 132 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T00:33:13.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:33:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:33:13] "GET /metrics HTTP/1.1" 200 172217 "" "Prometheus/2.33.4" 2024-02-13T00:33:13.913 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:33:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:13 smithi106 bash[18459]: cluster 2024-02-13T00:33:12.731964+0000 mgr.y (mgr.24461) 133 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:14.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:13 smithi080 bash[17386]: cluster 2024-02-13T00:33:12.731964+0000 mgr.y (mgr.24461) 133 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:14.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:13 smithi080 bash[24237]: cluster 2024-02-13T00:33:12.731964+0000 mgr.y (mgr.24461) 133 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:16.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:15 smithi106 bash[18459]: cluster 2024-02-13T00:33:14.732656+0000 mgr.y (mgr.24461) 134 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:16.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:15 smithi080 bash[17386]: cluster 2024-02-13T00:33:14.732656+0000 mgr.y (mgr.24461) 134 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:16.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:15 smithi080 bash[24237]: cluster 2024-02-13T00:33:14.732656+0000 mgr.y (mgr.24461) 134 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:16.841 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.836+0000 7fa70d2cc700 1 -- 172.21.15.80:0/4237209270 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7080fc2e0 msgr2=0x7fa7080fc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:16.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.836+0000 7fa70d2cc700 1 --2- 172.21.15.80:0/4237209270 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7080fc2e0 0x7fa7080fc6c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa700004870 tx=0x7fa700009cb0).stop 2024-02-13T00:33:16.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.836+0000 7fa70d2cc700 1 -- 172.21.15.80:0/4237209270 shutdown_connections 2024-02-13T00:33:16.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.836+0000 7fa70d2cc700 1 --2- 172.21.15.80:0/4237209270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7080f6b50 0x7fa708103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-13T00:33:16.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.836+0000 7fa70d2cc700 1 --2- 172.21.15.80:0/4237209270 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7080fc2e0 0x7fa7080fc6c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:16.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.836+0000 7fa70d2cc700 1 --2- 172.21.15.80:0/4237209270 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7080fcc40 0x7fa7080f6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:16.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.836+0000 7fa70d2cc700 1 -- 172.21.15.80:0/4237209270 >> 172.21.15.80:0/4237209270 conn(0x7fa7080701a0 msgr2=0x7fa7080f44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:33:16.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.836+0000 7fa70d2cc700 1 -- 172.21.15.80:0/4237209270 shutdown_connections 2024-02-13T00:33:16.842 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.836+0000 7fa70d2cc700 1 -- 172.21.15.80:0/4237209270 wait complete. 2024-02-13T00:33:16.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa70d2cc700 1 Processor -- start 2024-02-13T00:33:16.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa70d2cc700 1 -- start start 2024-02-13T00:33:16.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa70d2cc700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7080f6b50 0x7fa70810e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:16.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa70d2cc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7080fc2e0 0x7fa70810e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:16.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa70d2cc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7080fcc40 0x7fa7081081f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:16.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa70d2cc700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7081086e0 con 0x7fa7080fcc40 2024-02-13T00:33:16.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa70d2cc700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa708108850 con 0x7fa7080fc2e0 2024-02-13T00:33:16.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa70d2cc700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa708108a10 con 0x7fa7080f6b50 2024-02-13T00:33:16.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa706ffd700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7080f6b50 0x7fa70810e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:16.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa706ffd700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7080f6b50 0x7fa70810e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:34530/0 (socket says 172.21.15.80:34530) 2024-02-13T00:33:16.844 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa706ffd700 1 -- 172.21.15.80:0/2412967760 learned_addr learned my addr 172.21.15.80:0/2412967760 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:33:16.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa7067fc700 1 --2- 172.21.15.80:0/2412967760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7080fc2e0 0x7fa70810e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:16.845 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa7077fe700 1 --2- 172.21.15.80:0/2412967760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7080fcc40 0x7fa7081081f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:16.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa706ffd700 1 -- 172.21.15.80:0/2412967760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7080fc2e0 msgr2=0x7fa70810e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:16.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa706ffd700 1 --2- 172.21.15.80:0/2412967760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7080fc2e0 0x7fa70810e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:16.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa706ffd700 1 -- 172.21.15.80:0/2412967760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7080fcc40 msgr2=0x7fa7081081f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:16.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa706ffd700 1 --2- 172.21.15.80:0/2412967760 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fa7080fcc40 0x7fa7081081f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:16.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa706ffd700 1 -- 172.21.15.80:0/2412967760 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa700005040 con 0x7fa7080f6b50 2024-02-13T00:33:16.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa706ffd700 1 --2- 172.21.15.80:0/2412967760 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7080f6b50 0x7fa70810e000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa700007fd0 tx=0x7fa700009cb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:33:16.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa6fffff700 1 -- 172.21.15.80:0/2412967760 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70000e030 con 0x7fa7080f6b50 2024-02-13T00:33:16.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa6fffff700 1 -- 172.21.15.80:0/2412967760 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fa700013d30 con 0x7fa7080f6b50 2024-02-13T00:33:16.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa70d2cc700 1 -- 172.21.15.80:0/2412967760 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa708108c90 con 0x7fa7080f6b50 2024-02-13T00:33:16.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa70d2cc700 1 -- 172.21.15.80:0/2412967760 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa708104750 con 0x7fa7080f6b50 2024-02-13T00:33:16.846 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.840+0000 7fa6fffff700 1 -- 172.21.15.80:0/2412967760 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa700018070 con 0x7fa7080f6b50 2024-02-13T00:33:16.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.844+0000 7fa70d2cc700 1 -- 172.21.15.80:0/2412967760 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa6e8000f40 con 0x7fa7080f6b50 2024-02-13T00:33:16.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.844+0000 7fa6fffff700 1 -- 172.21.15.80:0/2412967760 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7fa700009240 con 0x7fa7080f6b50 2024-02-13T00:33:16.847 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.844+0000 7fa6fffff700 1 --2- 172.21.15.80:0/2412967760 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fa6f4061340 0x7fa6f4063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:16.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.844+0000 7fa6fffff700 1 -- 172.21.15.80:0/2412967760 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7fa70007e0d0 con 0x7fa7080f6b50 2024-02-13T00:33:16.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.844+0000 7fa7067fc700 1 --2- 172.21.15.80:0/2412967760 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fa6f4061340 0x7fa6f4063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:16.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.844+0000 7fa6fffff700 1 --2- 172.21.15.80:0/2412967760 >> [v2:172.21.15.106:6824/2273586184,v1:172.21.15.106:6825/2273586184] conn(0x7fa6f406b250 0x7fa6f406d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:16.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.844+0000 7fa6fffff700 1 -- 172.21.15.80:0/2412967760 --> [v2:172.21.15.106:6824/2273586184,v1:172.21.15.106:6825/2273586184] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa6f406dd70 con 0x7fa6f406b250 2024-02-13T00:33:16.848 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.844+0000 7fa6fffff700 1 -- 172.21.15.80:0/2412967760 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa700080630 con 0x7fa7080f6b50 2024-02-13T00:33:16.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.844+0000 7fa7067fc700 1 --2- 172.21.15.80:0/2412967760 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fa6f4061340 0x7fa6f4063800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fa708109940 tx=0x7fa6f000b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:33:16.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.844+0000 7fa7077fe700 1 --2- 172.21.15.80:0/2412967760 >> [v2:172.21.15.106:6824/2273586184,v1:172.21.15.106:6825/2273586184] conn(0x7fa6f406b250 0x7fa6f406d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:16.849 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.844+0000 7fa7077fe700 1 --2- 172.21.15.80:0/2412967760 >> [v2:172.21.15.106:6824/2273586184,v1:172.21.15.106:6825/2273586184] conn(0x7fa6f406b250 0x7fa6f406d6f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:33:16.850 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.844+0000 7fa6fffff700 1 -- 172.21.15.80:0/2412967760 <== osd.7 v2:172.21.15.106:6824/2273586184 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fa6f406dd70 con 0x7fa6f406b250 2024-02-13T00:33:16.867 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.864+0000 7fa70d2cc700 1 -- 172.21.15.80:0/2412967760 --> [v2:172.21.15.106:6824/2273586184,v1:172.21.15.106:6825/2273586184] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa6e8002a20 con 0x7fa6f406b250 2024-02-13T00:33:16.868 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.864+0000 7fa6fffff700 1 -- 172.21.15.80:0/2412967760 <== osd.7 v2:172.21.15.106:6824/2273586184 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa6e8002a20 con 0x7fa6f406b250 2024-02-13T00:33:16.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.864+0000 7fa70d2cc700 1 -- 172.21.15.80:0/2412967760 >> [v2:172.21.15.106:6824/2273586184,v1:172.21.15.106:6825/2273586184] conn(0x7fa6f406b250 msgr2=0x7fa6f406d6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:16.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.864+0000 7fa70d2cc700 1 --2- 172.21.15.80:0/2412967760 >> [v2:172.21.15.106:6824/2273586184,v1:172.21.15.106:6825/2273586184] conn(0x7fa6f406b250 0x7fa6f406d6f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:16.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.864+0000 7fa70d2cc700 1 -- 172.21.15.80:0/2412967760 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fa6f4061340 msgr2=0x7fa6f4063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:16.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.864+0000 7fa70d2cc700 1 --2- 172.21.15.80:0/2412967760 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fa6f4061340 0x7fa6f4063800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fa708109940 tx=0x7fa6f000b040).stop 2024-02-13T00:33:16.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.864+0000 7fa70d2cc700 1 -- 172.21.15.80:0/2412967760 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7080f6b50 msgr2=0x7fa70810e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:16.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.864+0000 7fa70d2cc700 1 --2- 172.21.15.80:0/2412967760 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fa7080f6b50 0x7fa70810e000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa700007fd0 tx=0x7fa700009cb0).stop 2024-02-13T00:33:16.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.864+0000 7fa7077fe700 1 -- 172.21.15.80:0/2412967760 reap_dead start 2024-02-13T00:33:16.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.864+0000 7fa70d2cc700 1 -- 172.21.15.80:0/2412967760 shutdown_connections 2024-02-13T00:33:16.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.864+0000 7fa70d2cc700 1 -- 172.21.15.80:0/2412967760 >> 172.21.15.80:0/2412967760 conn(0x7fa7080701a0 msgr2=0x7fa7080fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:33:16.869 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.864+0000 7fa70d2cc700 1 -- 172.21.15.80:0/2412967760 shutdown_connections 2024-02-13T00:33:16.870 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:16.864+0000 7fa70d2cc700 1 -- 172.21.15.80:0/2412967760 wait complete. 2024-02-13T00:33:17.616 INFO:teuthology.orchestra.run.smithi080.stdout:206158430254 2024-02-13T00:33:17.616 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-13T00:33:18.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:17 smithi080 bash[17386]: cluster 2024-02-13T00:33:16.733375+0000 mgr.y (mgr.24461) 135 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:18.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:17 smithi080 bash[24237]: cluster 2024-02-13T00:33:16.733375+0000 mgr.y (mgr.24461) 135 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:18.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:17 smithi106 bash[18459]: cluster 2024-02-13T00:33:16.733375+0000 mgr.y (mgr.24461) 135 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:18.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:33:17 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:33:19.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:18 smithi106 bash[18459]: audit 2024-02-13T00:33:17.827128+0000 mgr.y (mgr.24461) 136 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:33:19.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:18 smithi080 bash[17386]: audit 2024-02-13T00:33:17.827128+0000 mgr.y (mgr.24461) 136 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:33:19.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:18 smithi080 bash[24237]: audit 2024-02-13T00:33:17.827128+0000 mgr.y (mgr.24461) 136 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:33:20.142 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:19 smithi106 bash[18459]: cluster 2024-02-13T00:33:18.734854+0000 mgr.y (mgr.24461) 137 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:20.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:19 smithi080 bash[17386]: cluster 2024-02-13T00:33:18.734854+0000 mgr.y (mgr.24461) 137 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:20.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:19 smithi080 bash[24237]: cluster 2024-02-13T00:33:18.734854+0000 mgr.y (mgr.24461) 137 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:20.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:33:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:33:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:33:22.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:21 smithi106 bash[18459]: cluster 2024-02-13T00:33:20.735576+0000 mgr.y (mgr.24461) 138 : cluster [DBG] pgmap v95: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:22.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:21 smithi080 bash[17386]: cluster 2024-02-13T00:33:20.735576+0000 mgr.y (mgr.24461) 138 : cluster [DBG] pgmap v95: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:22.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:21 smithi080 bash[24237]: cluster 2024-02-13T00:33:20.735576+0000 mgr.y (mgr.24461) 138 : cluster [DBG] pgmap v95: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:22.392 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:33:23.374 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:33:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:33:23] "GET /metrics HTTP/1.1" 200 172211 "" "Prometheus/2.33.4" 2024-02-13T00:33:24.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:23 smithi080 bash[17386]: cluster 2024-02-13T00:33:22.736895+0000 mgr.y (mgr.24461) 139 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:24.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:23 smithi080 bash[24237]: cluster 2024-02-13T00:33:22.736895+0000 mgr.y (mgr.24461) 139 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:24.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:23 smithi106 bash[18459]: cluster 2024-02-13T00:33:22.736895+0000 mgr.y (mgr.24461) 139 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:25.310 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.303+0000 7fe03a1cc700 1 -- 172.21.15.80:0/4290814620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0340fe610 msgr2=0x7fe0340f61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:25.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.303+0000 7fe03a1cc700 1 --2- 172.21.15.80:0/4290814620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0340fe610 0x7fe0340f61e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fe0280047b0 tx=0x7fe028009cb0).stop 2024-02-13T00:33:25.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.303+0000 7fe03a1cc700 1 -- 172.21.15.80:0/4290814620 shutdown_connections 2024-02-13T00:33:25.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.303+0000 7fe03a1cc700 1 --2- 172.21.15.80:0/4290814620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0340f68a0 0x7fe034104b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:25.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.303+0000 7fe03a1cc700 1 --2- 172.21.15.80:0/4290814620 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe0340fdcb0 0x7fe0340fe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:25.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.303+0000 7fe03a1cc700 1 --2- 172.21.15.80:0/4290814620 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0340fe610 0x7fe0340f61e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:25.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.303+0000 7fe03a1cc700 1 -- 172.21.15.80:0/4290814620 >> 172.21.15.80:0/4290814620 conn(0x7fe034070150 msgr2=0x7fe0340f44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:33:25.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.303+0000 7fe03a1cc700 1 -- 172.21.15.80:0/4290814620 shutdown_connections 2024-02-13T00:33:25.311 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe03a1cc700 1 -- 172.21.15.80:0/4290814620 wait complete. 2024-02-13T00:33:25.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe03a1cc700 1 Processor -- start 2024-02-13T00:33:25.312 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe03a1cc700 1 -- start start 2024-02-13T00:33:25.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe03a1cc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0340f68a0 0x7fe03410e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:25.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe03a1cc700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe0340fdcb0 0x7fe03410e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:25.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe03a1cc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0340fe610 0x7fe034108200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:25.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe03a1cc700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0341086f0 con 0x7fe0340fe610 2024-02-13T00:33:25.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe03a1cc700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe034108860 con 0x7fe0340f68a0 2024-02-13T00:33:25.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe03a1cc700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe034108a20 con 0x7fe0340fdcb0 2024-02-13T00:33:25.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe032ffd700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe0340fdcb0 0x7fe03410e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:25.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe032ffd700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe0340fdcb0 0x7fe03410e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:32892/0 (socket says 172.21.15.80:32892) 2024-02-13T00:33:25.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe032ffd700 1 -- 172.21.15.80:0/2962274347 learned_addr learned my addr 172.21.15.80:0/2962274347 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:33:25.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe033fff700 1 --2- 172.21.15.80:0/2962274347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0340fe610 0x7fe034108200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:25.313 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe0337fe700 1 --2- 172.21.15.80:0/2962274347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0340f68a0 0x7fe03410e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:25.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe033fff700 1 -- 172.21.15.80:0/2962274347 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe0340fdcb0 msgr2=0x7fe03410e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:25.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe033fff700 1 --2- 172.21.15.80:0/2962274347 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe0340fdcb0 0x7fe03410e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:25.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe033fff700 1 -- 172.21.15.80:0/2962274347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0340f68a0 msgr2=0x7fe03410e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:25.314 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe033fff700 1 --2- 172.21.15.80:0/2962274347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0340f68a0 0x7fe03410e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:25.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe033fff700 1 -- 172.21.15.80:0/2962274347 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe028005040 con 0x7fe0340fe610 2024-02-13T00:33:25.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe0337fe700 1 --2- 172.21.15.80:0/2962274347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0340f68a0 0x7fe03410e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-13T00:33:25.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe033fff700 1 --2- 172.21.15.80:0/2962274347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0340fe610 0x7fe034108200 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fe02c00eb70 tx=0x7fe02c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:33:25.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe030ff9700 1 -- 172.21.15.80:0/2962274347 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c009870 con 0x7fe0340fe610 2024-02-13T00:33:25.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe030ff9700 1 -- 172.21.15.80:0/2962274347 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fe02c00f040 con 0x7fe0340fe610 2024-02-13T00:33:25.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe03a1cc700 1 -- 172.21.15.80:0/2962274347 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe034108ca0 con 0x7fe0340fe610 2024-02-13T00:33:25.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe030ff9700 1 -- 172.21.15.80:0/2962274347 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c007d20 con 0x7fe0340fe610 2024-02-13T00:33:25.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.307+0000 7fe03a1cc700 1 -- 172.21.15.80:0/2962274347 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe034114e90 con 0x7fe0340fe610 2024-02-13T00:33:25.315 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.311+0000 7fe03a1cc700 1 -- 172.21.15.80:0/2962274347 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe03405fa50 con 0x7fe0340fe610 2024-02-13T00:33:25.316 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.311+0000 7fe030ff9700 1 -- 172.21.15.80:0/2962274347 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7fe02c004120 con 0x7fe0340fe610 2024-02-13T00:33:25.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.311+0000 7fe030ff9700 1 --2- 172.21.15.80:0/2962274347 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fe01c061340 0x7fe01c063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:25.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.311+0000 7fe030ff9700 1 -- 172.21.15.80:0/2962274347 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7fe02c07cc10 con 0x7fe0340fe610 2024-02-13T00:33:25.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.311+0000 7fe0337fe700 1 --2- 172.21.15.80:0/2962274347 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fe01c061340 0x7fe01c063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:25.317 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.311+0000 7fe0337fe700 1 --2- 172.21.15.80:0/2962274347 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fe01c061340 0x7fe01c063800 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fe0240043d0 tx=0x7fe02400b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:33:25.322 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.315+0000 7fe030ff9700 1 -- 172.21.15.80:0/2962274347 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe02c049f60 con 0x7fe0340fe610 2024-02-13T00:33:25.511 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.507+0000 7fe03a1cc700 1 -- 172.21.15.80:0/2962274347 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe0341096e0 con 0x7fe0340fe610 2024-02-13T00:33:25.512 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.507+0000 7fe030ff9700 1 -- 172.21.15.80:0/2962274347 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe02c04ca50 con 0x7fe0340fe610 2024-02-13T00:33:25.512 INFO:teuthology.orchestra.run.smithi080.stdout:34359738474 2024-02-13T00:33:25.515 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.511+0000 7fe03a1cc700 1 -- 172.21.15.80:0/2962274347 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fe01c061340 msgr2=0x7fe01c063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:25.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.511+0000 7fe03a1cc700 1 --2- 172.21.15.80:0/2962274347 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fe01c061340 0x7fe01c063800 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fe0240043d0 tx=0x7fe02400b040).stop 2024-02-13T00:33:25.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.511+0000 7fe03a1cc700 1 -- 172.21.15.80:0/2962274347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0340fe610 msgr2=0x7fe034108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:25.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.511+0000 7fe03a1cc700 1 --2- 172.21.15.80:0/2962274347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0340fe610 0x7fe034108200 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fe02c00eb70 tx=0x7fe02c00b040).stop 2024-02-13T00:33:25.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.511+0000 7fe03a1cc700 1 -- 172.21.15.80:0/2962274347 shutdown_connections 2024-02-13T00:33:25.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.511+0000 7fe03a1cc700 1 --2- 172.21.15.80:0/2962274347 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fe01c061340 0x7fe01c063800 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:25.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.511+0000 7fe03a1cc700 1 --2- 172.21.15.80:0/2962274347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0340f68a0 0x7fe03410e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:25.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.511+0000 7fe03a1cc700 1 --2- 172.21.15.80:0/2962274347 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fe0340fe610 0x7fe034108200 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:25.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.511+0000 7fe03a1cc700 1 --2- 172.21.15.80:0/2962274347 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fe0340fdcb0 0x7fe03410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:25.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.511+0000 7fe03a1cc700 1 -- 172.21.15.80:0/2962274347 >> 172.21.15.80:0/2962274347 conn(0x7fe034070150 msgr2=0x7fe0340fbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:33:25.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.511+0000 7fe03a1cc700 1 -- 172.21.15.80:0/2962274347 shutdown_connections 2024-02-13T00:33:25.516 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:25.511+0000 7fe03a1cc700 1 -- 172.21.15.80:0/2962274347 wait complete. 2024-02-13T00:33:26.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:25 smithi106 bash[18459]: cluster 2024-02-13T00:33:24.737531+0000 mgr.y (mgr.24461) 140 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:26.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:25 smithi106 bash[18459]: audit 2024-02-13T00:33:25.509511+0000 mon.a (mon.0) 679 : audit [DBG] from='client.? 172.21.15.80:0/2962274347' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-13T00:33:26.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:25 smithi080 bash[17386]: cluster 2024-02-13T00:33:24.737531+0000 mgr.y (mgr.24461) 140 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:26.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:25 smithi080 bash[17386]: audit 2024-02-13T00:33:25.509511+0000 mon.a (mon.0) 679 : audit [DBG] from='client.? 172.21.15.80:0/2962274347' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-13T00:33:26.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:25 smithi080 bash[24237]: cluster 2024-02-13T00:33:24.737531+0000 mgr.y (mgr.24461) 140 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:26.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:25 smithi080 bash[24237]: audit 2024-02-13T00:33:25.509511+0000 mon.a (mon.0) 679 : audit [DBG] from='client.? 172.21.15.80:0/2962274347' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-13T00:33:26.270 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738461 got 34359738474 for osd.0 2024-02-13T00:33:26.271 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-13T00:33:28.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:33:27 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:33:28.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:27 smithi106 bash[18459]: cluster 2024-02-13T00:33:26.738237+0000 mgr.y (mgr.24461) 141 : cluster [DBG] pgmap v98: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:28.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:27 smithi080 bash[17386]: cluster 2024-02-13T00:33:26.738237+0000 mgr.y (mgr.24461) 141 : cluster [DBG] pgmap v98: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:28.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:27 smithi080 bash[24237]: cluster 2024-02-13T00:33:26.738237+0000 mgr.y (mgr.24461) 141 : cluster [DBG] pgmap v98: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:29.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:28 smithi106 bash[18459]: audit 2024-02-13T00:33:27.838571+0000 mgr.y (mgr.24461) 142 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:33:29.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:28 smithi080 bash[17386]: audit 2024-02-13T00:33:27.838571+0000 mgr.y (mgr.24461) 142 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:33:29.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:28 smithi080 bash[24237]: audit 2024-02-13T00:33:27.838571+0000 mgr.y (mgr.24461) 142 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:33:30.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:29 smithi106 bash[18459]: cluster 2024-02-13T00:33:28.739669+0000 mgr.y (mgr.24461) 143 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:30.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:29 smithi080 bash[17386]: cluster 2024-02-13T00:33:28.739669+0000 mgr.y (mgr.24461) 143 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:30.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:29 smithi080 bash[24237]: cluster 2024-02-13T00:33:28.739669+0000 mgr.y (mgr.24461) 143 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:30.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:33:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:33:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:33:31.056 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:33:32.080 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:31 smithi080 bash[17386]: cluster 2024-02-13T00:33:30.740386+0000 mgr.y (mgr.24461) 144 : cluster [DBG] pgmap v100: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:32.080 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:31 smithi080 bash[24237]: cluster 2024-02-13T00:33:30.740386+0000 mgr.y (mgr.24461) 144 : cluster [DBG] pgmap v100: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:32.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:31 smithi106 bash[18459]: cluster 2024-02-13T00:33:30.740386+0000 mgr.y (mgr.24461) 144 : cluster [DBG] pgmap v100: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:33.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:33:33 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:33:33] "GET /metrics HTTP/1.1" 200 172215 "" "Prometheus/2.33.4" 2024-02-13T00:33:33.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.767+0000 7fb2575d3700 1 -- 172.21.15.80:0/966373993 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb2500f8c80 msgr2=0x7fb2500f9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:33.773 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.767+0000 7fb2575d3700 1 --2- 172.21.15.80:0/966373993 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb2500f8c80 0x7fb2500f9060 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb24c0047b0 tx=0x7fb24c009cb0).stop 2024-02-13T00:33:33.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.767+0000 7fb2575d3700 1 -- 172.21.15.80:0/966373993 shutdown_connections 2024-02-13T00:33:33.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.767+0000 7fb2575d3700 1 --2- 172.21.15.80:0/966373993 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2501021e0 0x7fb2501045d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:33.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.767+0000 7fb2575d3700 1 --2- 172.21.15.80:0/966373993 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb2500f8c80 0x7fb2500f9060 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:33.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.767+0000 7fb2575d3700 1 --2- 172.21.15.80:0/966373993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2500f95e0 0x7fb250101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:33.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.767+0000 7fb2575d3700 1 -- 172.21.15.80:0/966373993 >> 172.21.15.80:0/966373993 conn(0x7fb2500f2770 msgr2=0x7fb2500f4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:33:33.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.767+0000 7fb2575d3700 1 -- 172.21.15.80:0/966373993 shutdown_connections 2024-02-13T00:33:33.774 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.767+0000 7fb2575d3700 1 -- 172.21.15.80:0/966373993 wait complete. 2024-02-13T00:33:33.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.767+0000 7fb2575d3700 1 Processor -- start 2024-02-13T00:33:33.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.767+0000 7fb2575d3700 1 -- start start 2024-02-13T00:33:33.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb2575d3700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb2500f8c80 0x7fb25010e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:33.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb2575d3700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2500f95e0 0x7fb25010e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:33.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb2575d3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2501021e0 0x7fb250108200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:33.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb2575d3700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2501086f0 con 0x7fb2501021e0 2024-02-13T00:33:33.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb2575d3700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb250108860 con 0x7fb2500f95e0 2024-02-13T00:33:33.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb2575d3700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb250108a20 con 0x7fb2500f8c80 2024-02-13T00:33:33.775 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb25536f700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb2500f8c80 0x7fb25010e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:33.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb25536f700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb2500f8c80 0x7fb25010e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:48478/0 (socket says 172.21.15.80:48478) 2024-02-13T00:33:33.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb25536f700 1 -- 172.21.15.80:0/3930872491 learned_addr learned my addr 172.21.15.80:0/3930872491 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:33:33.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb254b6e700 1 --2- 172.21.15.80:0/3930872491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2500f95e0 0x7fb25010e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:33.776 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb255b70700 1 --2- 172.21.15.80:0/3930872491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2501021e0 0x7fb250108200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:33.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb25536f700 1 -- 172.21.15.80:0/3930872491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2500f95e0 msgr2=0x7fb25010e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:33.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb25536f700 1 --2- 172.21.15.80:0/3930872491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2500f95e0 0x7fb25010e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:33.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb25536f700 1 -- 172.21.15.80:0/3930872491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2501021e0 msgr2=0x7fb250108200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:33.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb25536f700 1 --2- 172.21.15.80:0/3930872491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2501021e0 0x7fb250108200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:33.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb25536f700 1 -- 172.21.15.80:0/3930872491 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2480097c0 con 0x7fb2500f8c80 2024-02-13T00:33:33.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb255b70700 1 --2- 172.21.15.80:0/3930872491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2501021e0 0x7fb250108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:33:33.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb25536f700 1 --2- 172.21.15.80:0/3930872491 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb2500f8c80 0x7fb25010e010 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fb24c009f20 tx=0x7fb24c009cb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:33:33.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb2467fc700 1 -- 172.21.15.80:0/3930872491 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c018070 con 0x7fb2500f8c80 2024-02-13T00:33:33.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb2467fc700 1 -- 172.21.15.80:0/3930872491 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fb24c013df0 con 0x7fb2500f8c80 2024-02-13T00:33:33.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb2575d3700 1 -- 172.21.15.80:0/3930872491 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb24c005040 con 0x7fb2500f8c80 2024-02-13T00:33:33.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb2467fc700 1 -- 172.21.15.80:0/3930872491 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c01d9f0 con 0x7fb2500f8c80 2024-02-13T00:33:33.777 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb2575d3700 1 -- 172.21.15.80:0/3930872491 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb250108ec0 con 0x7fb2500f8c80 2024-02-13T00:33:33.778 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.771+0000 7fb2575d3700 1 -- 172.21.15.80:0/3930872491 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb250060760 con 0x7fb2500f8c80 2024-02-13T00:33:33.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.775+0000 7fb2467fc700 1 -- 172.21.15.80:0/3930872491 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7fb24c009240 con 0x7fb2500f8c80 2024-02-13T00:33:33.779 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.775+0000 7fb2467fc700 1 --2- 172.21.15.80:0/3930872491 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fb23c061340 0x7fb23c063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:33.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.775+0000 7fb2467fc700 1 -- 172.21.15.80:0/3930872491 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7fb24c07e180 con 0x7fb2500f8c80 2024-02-13T00:33:33.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.775+0000 7fb254b6e700 1 --2- 172.21.15.80:0/3930872491 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fb23c061340 0x7fb23c063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:33.780 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.775+0000 7fb254b6e700 1 --2- 172.21.15.80:0/3930872491 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fb23c061340 0x7fb23c063800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fb250109950 tx=0x7fb24000b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:33:33.786 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.779+0000 7fb2467fc700 1 -- 172.21.15.80:0/3930872491 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb24c04dfc0 con 0x7fb2500f8c80 2024-02-13T00:33:33.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.967+0000 7fb2575d3700 1 -- 172.21.15.80:0/3930872491 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb250106f80 con 0x7fb2500f8c80 2024-02-13T00:33:33.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.967+0000 7fb2467fc700 1 -- 172.21.15.80:0/3930872491 <== mon.2 v2:172.21.15.80:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb24c0515e0 con 0x7fb2500f8c80 2024-02-13T00:33:33.972 INFO:teuthology.orchestra.run.smithi080.stdout:55834574947 2024-02-13T00:33:33.975 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.971+0000 7fb2575d3700 1 -- 172.21.15.80:0/3930872491 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fb23c061340 msgr2=0x7fb23c063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:33.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.971+0000 7fb2575d3700 1 --2- 172.21.15.80:0/3930872491 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fb23c061340 0x7fb23c063800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fb250109950 tx=0x7fb24000b040).stop 2024-02-13T00:33:33.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.971+0000 7fb2575d3700 1 -- 172.21.15.80:0/3930872491 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb2500f8c80 msgr2=0x7fb25010e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:33.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.971+0000 7fb2575d3700 1 --2- 172.21.15.80:0/3930872491 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb2500f8c80 0x7fb25010e010 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fb24c009f20 tx=0x7fb24c009cb0).stop 2024-02-13T00:33:33.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.971+0000 7fb2575d3700 1 -- 172.21.15.80:0/3930872491 shutdown_connections 2024-02-13T00:33:33.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.971+0000 7fb2575d3700 1 --2- 172.21.15.80:0/3930872491 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fb23c061340 0x7fb23c063800 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:33.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.971+0000 7fb2575d3700 1 --2- 172.21.15.80:0/3930872491 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb2501021e0 0x7fb250108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:33.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.971+0000 7fb2575d3700 1 --2- 172.21.15.80:0/3930872491 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb2500f8c80 0x7fb25010e010 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:33.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.971+0000 7fb2575d3700 1 --2- 172.21.15.80:0/3930872491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2500f95e0 0x7fb25010e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:33.976 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.971+0000 7fb2575d3700 1 -- 172.21.15.80:0/3930872491 >> 172.21.15.80:0/3930872491 conn(0x7fb2500f2770 msgr2=0x7fb2500f3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:33:33.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.971+0000 7fb2575d3700 1 -- 172.21.15.80:0/3930872491 shutdown_connections 2024-02-13T00:33:33.977 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:33.971+0000 7fb2575d3700 1 -- 172.21.15.80:0/3930872491 wait complete. 2024-02-13T00:33:34.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:33 smithi080 bash[17386]: cluster 2024-02-13T00:33:32.741612+0000 mgr.y (mgr.24461) 145 : cluster [DBG] pgmap v101: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:34.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:33 smithi080 bash[24237]: cluster 2024-02-13T00:33:32.741612+0000 mgr.y (mgr.24461) 145 : cluster [DBG] pgmap v101: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:34.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:33 smithi106 bash[18459]: cluster 2024-02-13T00:33:32.741612+0000 mgr.y (mgr.24461) 145 : cluster [DBG] pgmap v101: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:34.729 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574933 got 55834574947 for osd.1 2024-02-13T00:33:34.729 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-13T00:33:35.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:34 smithi080 bash[17386]: audit 2024-02-13T00:33:33.969330+0000 mon.c (mon.2) 60 : audit [DBG] from='client.? 172.21.15.80:0/3930872491' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-13T00:33:35.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:34 smithi080 bash[24237]: audit 2024-02-13T00:33:33.969330+0000 mon.c (mon.2) 60 : audit [DBG] from='client.? 172.21.15.80:0/3930872491' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-13T00:33:35.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:34 smithi106 bash[18459]: audit 2024-02-13T00:33:33.969330+0000 mon.c (mon.2) 60 : audit [DBG] from='client.? 172.21.15.80:0/3930872491' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-13T00:33:36.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:35 smithi106 bash[18459]: cluster 2024-02-13T00:33:34.742437+0000 mgr.y (mgr.24461) 146 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:36.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:35 smithi080 bash[17386]: cluster 2024-02-13T00:33:34.742437+0000 mgr.y (mgr.24461) 146 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:36.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:35 smithi080 bash[24237]: cluster 2024-02-13T00:33:34.742437+0000 mgr.y (mgr.24461) 146 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:38.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:33:37 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:33:38.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:37 smithi106 bash[18459]: cluster 2024-02-13T00:33:36.743157+0000 mgr.y (mgr.24461) 147 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:38.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:37 smithi080 bash[17386]: cluster 2024-02-13T00:33:36.743157+0000 mgr.y (mgr.24461) 147 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:38.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:37 smithi080 bash[24237]: cluster 2024-02-13T00:33:36.743157+0000 mgr.y (mgr.24461) 147 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:39.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:38 smithi106 bash[18459]: audit 2024-02-13T00:33:37.849336+0000 mgr.y (mgr.24461) 148 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:33:39.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:38 smithi080 bash[17386]: audit 2024-02-13T00:33:37.849336+0000 mgr.y (mgr.24461) 148 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:33:39.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:38 smithi080 bash[24237]: audit 2024-02-13T00:33:37.849336+0000 mgr.y (mgr.24461) 148 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:33:39.510 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:33:40.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:39 smithi106 bash[18459]: cluster 2024-02-13T00:33:38.744608+0000 mgr.y (mgr.24461) 149 : cluster [DBG] pgmap v104: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:40.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:39 smithi080 bash[24237]: cluster 2024-02-13T00:33:38.744608+0000 mgr.y (mgr.24461) 149 : cluster [DBG] pgmap v104: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:40.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:39 smithi080 bash[17386]: cluster 2024-02-13T00:33:38.744608+0000 mgr.y (mgr.24461) 149 : cluster [DBG] pgmap v104: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:40.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:33:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:33:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:33:42.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:41 smithi106 bash[18459]: cluster 2024-02-13T00:33:40.745248+0000 mgr.y (mgr.24461) 150 : cluster [DBG] pgmap v105: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:42.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:41 smithi080 bash[24237]: cluster 2024-02-13T00:33:40.745248+0000 mgr.y (mgr.24461) 150 : cluster [DBG] pgmap v105: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:42.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:41 smithi080 bash[17386]: cluster 2024-02-13T00:33:40.745248+0000 mgr.y (mgr.24461) 150 : cluster [DBG] pgmap v105: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:42.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.431+0000 7f3714c82700 1 -- 172.21.15.80:0/3327947946 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37100ffec0 msgr2=0x7f37101002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:42.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.431+0000 7f3714c82700 1 --2- 172.21.15.80:0/3327947946 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37100ffec0 0x7f37101002a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f3700009be0 tx=0x7f3700004d10).stop 2024-02-13T00:33:42.437 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.431+0000 7f3714c82700 1 -- 172.21.15.80:0/3327947946 shutdown_connections 2024-02-13T00:33:42.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.431+0000 7f3714c82700 1 --2- 172.21.15.80:0/3327947946 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37100fa620 0x7f37100faa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:42.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.431+0000 7f3714c82700 1 --2- 172.21.15.80:0/3327947946 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37100ffec0 0x7f37101002a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:42.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.431+0000 7f3714c82700 1 --2- 172.21.15.80:0/3327947946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3710100790 0x7f37100fa050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:42.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.431+0000 7f3714c82700 1 -- 172.21.15.80:0/3327947946 >> 172.21.15.80:0/3327947946 conn(0x7f37100f5ad0 msgr2=0x7f37100f7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:33:42.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.431+0000 7f3714c82700 1 -- 172.21.15.80:0/3327947946 shutdown_connections 2024-02-13T00:33:42.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.431+0000 7f3714c82700 1 -- 172.21.15.80:0/3327947946 wait complete. 2024-02-13T00:33:42.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f3714c82700 1 Processor -- start 2024-02-13T00:33:42.438 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f3714c82700 1 -- start start 2024-02-13T00:33:42.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f3714c82700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37100fa620 0x7f371010ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:42.439 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f3714c82700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37100ffec0 0x7f37101104a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:42.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f3714c82700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3710100790 0x7f371010a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:42.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f3714c82700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371010a8a0 con 0x7f37100fa620 2024-02-13T00:33:42.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f3714c82700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371010aa10 con 0x7f3710100790 2024-02-13T00:33:42.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f3714c82700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371010abd0 con 0x7f37100ffec0 2024-02-13T00:33:42.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f370e59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37100fa620 0x7f371010ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:42.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f370dd9b700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37100ffec0 0x7f37101104a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:42.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f370dd9b700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37100ffec0 0x7f37101104a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:34970/0 (socket says 172.21.15.80:34970) 2024-02-13T00:33:42.440 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f370dd9b700 1 -- 172.21.15.80:0/4119657850 learned_addr learned my addr 172.21.15.80:0/4119657850 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:33:42.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f370ed9d700 1 --2- 172.21.15.80:0/4119657850 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3710100790 0x7f371010a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:42.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f370dd9b700 1 -- 172.21.15.80:0/4119657850 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3710100790 msgr2=0x7f371010a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:42.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f370dd9b700 1 --2- 172.21.15.80:0/4119657850 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3710100790 0x7f371010a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:42.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f370dd9b700 1 -- 172.21.15.80:0/4119657850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37100fa620 msgr2=0x7f371010ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:42.441 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f370dd9b700 1 --2- 172.21.15.80:0/4119657850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37100fa620 0x7f371010ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:42.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f370dd9b700 1 -- 172.21.15.80:0/4119657850 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37000097c0 con 0x7f37100ffec0 2024-02-13T00:33:42.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f370e59c700 1 --2- 172.21.15.80:0/4119657850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37100fa620 0x7f371010ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:33:42.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f370dd9b700 1 --2- 172.21.15.80:0/4119657850 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37100ffec0 0x7f37101104a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f3704002800 tx=0x7f3704009ee0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:33:42.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f36ff7fe700 1 -- 172.21.15.80:0/4119657850 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3704007b40 con 0x7f37100ffec0 2024-02-13T00:33:42.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f36ff7fe700 1 -- 172.21.15.80:0/4119657850 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f370400f040 con 0x7f37100ffec0 2024-02-13T00:33:42.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f36ff7fe700 1 -- 172.21.15.80:0/4119657850 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3704014670 con 0x7f37100ffec0 2024-02-13T00:33:42.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f3714c82700 1 -- 172.21.15.80:0/4119657850 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f371010aeb0 con 0x7f37100ffec0 2024-02-13T00:33:42.442 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.435+0000 7f3714c82700 1 -- 172.21.15.80:0/4119657850 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3710116de0 con 0x7f37100ffec0 2024-02-13T00:33:42.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.439+0000 7f3714c82700 1 -- 172.21.15.80:0/4119657850 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f371005fab0 con 0x7f37100ffec0 2024-02-13T00:33:42.443 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.439+0000 7f36ff7fe700 1 -- 172.21.15.80:0/4119657850 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f3704009110 con 0x7f37100ffec0 2024-02-13T00:33:42.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.439+0000 7f36ff7fe700 1 --2- 172.21.15.80:0/4119657850 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f36f8061340 0x7f36f8063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:42.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.439+0000 7f36ff7fe700 1 -- 172.21.15.80:0/4119657850 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f370407cf80 con 0x7f37100ffec0 2024-02-13T00:33:42.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.439+0000 7f370e59c700 1 --2- 172.21.15.80:0/4119657850 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f36f8061340 0x7f36f8063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:42.444 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.439+0000 7f370e59c700 1 --2- 172.21.15.80:0/4119657850 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f36f8061340 0x7f36f8063800 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f37000048c0 tx=0x7f3700004d10).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:33:42.448 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.443+0000 7f36ff7fe700 1 -- 172.21.15.80:0/4119657850 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f370404cca0 con 0x7f37100ffec0 2024-02-13T00:33:42.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.627+0000 7f3714c82700 1 -- 172.21.15.80:0/4119657850 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3710109180 con 0x7f37100ffec0 2024-02-13T00:33:42.632 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.627+0000 7f36ff7fe700 1 -- 172.21.15.80:0/4119657850 <== mon.2 v2:172.21.15.80:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37040502c0 con 0x7f37100ffec0 2024-02-13T00:33:42.633 INFO:teuthology.orchestra.run.smithi080.stdout:77309411420 2024-02-13T00:33:42.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.627+0000 7f3714c82700 1 -- 172.21.15.80:0/4119657850 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f36f8061340 msgr2=0x7f36f8063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:42.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.627+0000 7f3714c82700 1 --2- 172.21.15.80:0/4119657850 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f36f8061340 0x7f36f8063800 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f37000048c0 tx=0x7f3700004d10).stop 2024-02-13T00:33:42.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.631+0000 7f3714c82700 1 -- 172.21.15.80:0/4119657850 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37100ffec0 msgr2=0x7f37101104a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:42.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.631+0000 7f3714c82700 1 --2- 172.21.15.80:0/4119657850 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37100ffec0 0x7f37101104a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f3704002800 tx=0x7f3704009ee0).stop 2024-02-13T00:33:42.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.631+0000 7f3714c82700 1 -- 172.21.15.80:0/4119657850 shutdown_connections 2024-02-13T00:33:42.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.631+0000 7f3714c82700 1 --2- 172.21.15.80:0/4119657850 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f36f8061340 0x7f36f8063800 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:42.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.631+0000 7f3714c82700 1 --2- 172.21.15.80:0/4119657850 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3710100790 0x7f371010a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:42.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.631+0000 7f3714c82700 1 --2- 172.21.15.80:0/4119657850 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f37100fa620 0x7f371010ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:42.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.631+0000 7f3714c82700 1 --2- 172.21.15.80:0/4119657850 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f37100ffec0 0x7f37101104a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:42.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.631+0000 7f3714c82700 1 -- 172.21.15.80:0/4119657850 >> 172.21.15.80:0/4119657850 conn(0x7f37100f5ad0 msgr2=0x7f37100fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:33:42.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.631+0000 7f3714c82700 1 -- 172.21.15.80:0/4119657850 shutdown_connections 2024-02-13T00:33:42.635 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:42.631+0000 7f3714c82700 1 -- 172.21.15.80:0/4119657850 wait complete. 2024-02-13T00:33:43.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:42 smithi080 bash[17386]: audit 2024-02-13T00:33:42.629938+0000 mon.c (mon.2) 61 : audit [DBG] from='client.? 172.21.15.80:0/4119657850' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-13T00:33:43.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:42 smithi080 bash[24237]: audit 2024-02-13T00:33:42.629938+0000 mon.c (mon.2) 61 : audit [DBG] from='client.? 172.21.15.80:0/4119657850' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-13T00:33:43.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:42 smithi106 bash[18459]: audit 2024-02-13T00:33:42.629938+0000 mon.c (mon.2) 61 : audit [DBG] from='client.? 172.21.15.80:0/4119657850' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-13T00:33:43.498 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:33:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:33:43] "GET /metrics HTTP/1.1" 200 172215 "" "Prometheus/2.33.4" 2024-02-13T00:33:43.499 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411407 got 77309411420 for osd.2 2024-02-13T00:33:43.500 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-13T00:33:44.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:43 smithi106 bash[18459]: cluster 2024-02-13T00:33:42.746095+0000 mgr.y (mgr.24461) 151 : cluster [DBG] pgmap v106: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:44.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:43 smithi080 bash[17386]: cluster 2024-02-13T00:33:42.746095+0000 mgr.y (mgr.24461) 151 : cluster [DBG] pgmap v106: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:44.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:43 smithi080 bash[24237]: cluster 2024-02-13T00:33:42.746095+0000 mgr.y (mgr.24461) 151 : cluster [DBG] pgmap v106: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:46.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:45 smithi106 bash[18459]: cluster 2024-02-13T00:33:44.746790+0000 mgr.y (mgr.24461) 152 : cluster [DBG] pgmap v107: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:46.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:45 smithi080 bash[17386]: cluster 2024-02-13T00:33:44.746790+0000 mgr.y (mgr.24461) 152 : cluster [DBG] pgmap v107: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:46.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:45 smithi080 bash[24237]: cluster 2024-02-13T00:33:44.746790+0000 mgr.y (mgr.24461) 152 : cluster [DBG] pgmap v107: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:48.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:47 smithi106 bash[18459]: cluster 2024-02-13T00:33:46.747493+0000 mgr.y (mgr.24461) 153 : cluster [DBG] pgmap v108: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:48.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:33:47 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:33:48.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:47 smithi080 bash[17386]: cluster 2024-02-13T00:33:46.747493+0000 mgr.y (mgr.24461) 153 : cluster [DBG] pgmap v108: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:48.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:47 smithi080 bash[24237]: cluster 2024-02-13T00:33:46.747493+0000 mgr.y (mgr.24461) 153 : cluster [DBG] pgmap v108: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:48.281 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:33:49.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:48 smithi106 bash[18459]: audit 2024-02-13T00:33:47.853390+0000 mgr.y (mgr.24461) 154 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:33:49.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:48 smithi080 bash[24237]: audit 2024-02-13T00:33:47.853390+0000 mgr.y (mgr.24461) 154 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:33:49.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:48 smithi080 bash[17386]: audit 2024-02-13T00:33:47.853390+0000 mgr.y (mgr.24461) 154 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:33:50.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:49 smithi080 bash[17386]: cluster 2024-02-13T00:33:48.749011+0000 mgr.y (mgr.24461) 155 : cluster [DBG] pgmap v109: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:50.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:49 smithi080 bash[24237]: cluster 2024-02-13T00:33:48.749011+0000 mgr.y (mgr.24461) 155 : cluster [DBG] pgmap v109: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:50.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:49 smithi106 bash[18459]: cluster 2024-02-13T00:33:48.749011+0000 mgr.y (mgr.24461) 155 : cluster [DBG] pgmap v109: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:50.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:33:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:33:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:33:51.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.075+0000 7f0cdb465700 1 -- 172.21.15.80:0/2086220254 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0cd40fcb70 msgr2=0x7f0cd40fcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:51.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.075+0000 7f0cdb465700 1 --2- 172.21.15.80:0/2086220254 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0cd40fcb70 0x7f0cd40fcf50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f0ccc004870 tx=0x7f0ccc009cb0).stop 2024-02-13T00:33:51.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.075+0000 7f0cdb465700 1 -- 172.21.15.80:0/2086220254 shutdown_connections 2024-02-13T00:33:51.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.075+0000 7f0cdb465700 1 --2- 172.21.15.80:0/2086220254 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cd40f73e0 0x7f0cd41039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-13T00:33:51.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.075+0000 7f0cdb465700 1 --2- 172.21.15.80:0/2086220254 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0cd40fcb70 0x7f0cd40fcf50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:51.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.075+0000 7f0cdb465700 1 --2- 172.21.15.80:0/2086220254 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cd40fd4d0 0x7f0cd40f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:51.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.075+0000 7f0cdb465700 1 -- 172.21.15.80:0/2086220254 >> 172.21.15.80:0/2086220254 conn(0x7f0cd40f27a0 msgr2=0x7f0cd40f4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:33:51.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cdb465700 1 -- 172.21.15.80:0/2086220254 shutdown_connections 2024-02-13T00:33:51.083 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cdb465700 1 -- 172.21.15.80:0/2086220254 wait complete. 2024-02-13T00:33:51.084 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cdb465700 1 Processor -- start 2024-02-13T00:33:51.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cdb465700 1 -- start start 2024-02-13T00:33:51.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cdb465700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cd40f73e0 0x7f0cd410e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:51.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cdb465700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0cd40fcb70 0x7f0cd410e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:51.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cdb465700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cd40fd4d0 0x7f0cd4108210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:51.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cdb465700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd4108700 con 0x7f0cd40fcb70 2024-02-13T00:33:51.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cdb465700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd4108870 con 0x7f0cd40f73e0 2024-02-13T00:33:51.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cdb465700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd4108a30 con 0x7f0cd40fd4d0 2024-02-13T00:33:51.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cd9a02700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cd40fd4d0 0x7f0cd4108210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:51.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cd8a00700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0cd40fcb70 0x7f0cd410e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:51.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cd9a02700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cd40fd4d0 0x7f0cd4108210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:54390/0 (socket says 172.21.15.80:54390) 2024-02-13T00:33:51.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cd9a02700 1 -- 172.21.15.80:0/1893684396 learned_addr learned my addr 172.21.15.80:0/1893684396 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:33:51.085 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cd9201700 1 --2- 172.21.15.80:0/1893684396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cd40f73e0 0x7f0cd410e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:51.086 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cd8a00700 1 -- 172.21.15.80:0/1893684396 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cd40fd4d0 msgr2=0x7f0cd4108210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:51.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cd8a00700 1 --2- 172.21.15.80:0/1893684396 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cd40fd4d0 0x7f0cd4108210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:51.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cd8a00700 1 -- 172.21.15.80:0/1893684396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cd40f73e0 msgr2=0x7f0cd410e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:51.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cd8a00700 1 --2- 172.21.15.80:0/1893684396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cd40f73e0 0x7f0cd410e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:51.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cd8a00700 1 -- 172.21.15.80:0/1893684396 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc005040 con 0x7f0cd40fcb70 2024-02-13T00:33:51.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cd9201700 1 --2- 172.21.15.80:0/1893684396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cd40f73e0 0x7f0cd410e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-13T00:33:51.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cd8a00700 1 --2- 172.21.15.80:0/1893684396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0cd40fcb70 0x7f0cd410e560 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f0cc800e8f0 tx=0x7f0cc800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:33:51.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cd27fc700 1 -- 172.21.15.80:0/1893684396 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8004620 con 0x7f0cd40fcb70 2024-02-13T00:33:51.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cd27fc700 1 -- 172.21.15.80:0/1893684396 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f0cc800f040 con 0x7f0cd40fcb70 2024-02-13T00:33:51.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cd27fc700 1 -- 172.21.15.80:0/1893684396 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc80146f0 con 0x7f0cd40fcb70 2024-02-13T00:33:51.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cdb465700 1 -- 172.21.15.80:0/1893684396 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd4108d10 con 0x7f0cd40fcb70 2024-02-13T00:33:51.087 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.079+0000 7f0cdb465700 1 -- 172.21.15.80:0/1893684396 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd4109090 con 0x7f0cd40fcb70 2024-02-13T00:33:51.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.083+0000 7f0cdb465700 1 -- 172.21.15.80:0/1893684396 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd40620e0 con 0x7f0cd40fcb70 2024-02-13T00:33:51.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.083+0000 7f0cd27fc700 1 -- 172.21.15.80:0/1893684396 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f0cc8007b40 con 0x7f0cd40fcb70 2024-02-13T00:33:51.088 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.083+0000 7f0cd27fc700 1 --2- 172.21.15.80:0/1893684396 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f0cbc061340 0x7f0cbc063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:51.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.083+0000 7f0cd27fc700 1 -- 172.21.15.80:0/1893684396 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f0cc807ca10 con 0x7f0cd40fcb70 2024-02-13T00:33:51.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.083+0000 7f0cd9201700 1 --2- 172.21.15.80:0/1893684396 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f0cbc061340 0x7f0cbc063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:51.089 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.083+0000 7f0cd9201700 1 --2- 172.21.15.80:0/1893684396 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f0cbc061340 0x7f0cbc063800 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f0ccc005010 tx=0x7f0ccc009cb0).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:33:51.094 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.087+0000 7f0cd27fc700 1 -- 172.21.15.80:0/1893684396 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0cc804c820 con 0x7f0cd40fcb70 2024-02-13T00:33:51.277 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.271+0000 7f0cdb465700 1 -- 172.21.15.80:0/1893684396 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0cd40475e0 con 0x7f0cd40fcb70 2024-02-13T00:33:51.278 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.271+0000 7f0cd27fc700 1 -- 172.21.15.80:0/1893684396 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0cc8019020 con 0x7f0cd40fcb70 2024-02-13T00:33:51.278 INFO:teuthology.orchestra.run.smithi080.stdout:107374182486 2024-02-13T00:33:51.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.275+0000 7f0cdb465700 1 -- 172.21.15.80:0/1893684396 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f0cbc061340 msgr2=0x7f0cbc063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:51.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.275+0000 7f0cdb465700 1 --2- 172.21.15.80:0/1893684396 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f0cbc061340 0x7f0cbc063800 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f0ccc005010 tx=0x7f0ccc009cb0).stop 2024-02-13T00:33:51.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.275+0000 7f0cdb465700 1 -- 172.21.15.80:0/1893684396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0cd40fcb70 msgr2=0x7f0cd410e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:51.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.275+0000 7f0cdb465700 1 --2- 172.21.15.80:0/1893684396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0cd40fcb70 0x7f0cd410e560 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f0cc800e8f0 tx=0x7f0cc800b040).stop 2024-02-13T00:33:51.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.275+0000 7f0cdb465700 1 -- 172.21.15.80:0/1893684396 shutdown_connections 2024-02-13T00:33:51.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.275+0000 7f0cdb465700 1 --2- 172.21.15.80:0/1893684396 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f0cbc061340 0x7f0cbc063800 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:51.281 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.275+0000 7f0cdb465700 1 --2- 172.21.15.80:0/1893684396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cd40f73e0 0x7f0cd410e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:51.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.275+0000 7f0cdb465700 1 --2- 172.21.15.80:0/1893684396 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f0cd40fd4d0 0x7f0cd4108210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:51.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.275+0000 7f0cdb465700 1 --2- 172.21.15.80:0/1893684396 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0cd40fcb70 0x7f0cd410e560 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:51.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.275+0000 7f0cdb465700 1 -- 172.21.15.80:0/1893684396 >> 172.21.15.80:0/1893684396 conn(0x7f0cd40f27a0 msgr2=0x7f0cd40f43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:33:51.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.275+0000 7f0cdb465700 1 -- 172.21.15.80:0/1893684396 shutdown_connections 2024-02-13T00:33:51.282 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:51.275+0000 7f0cdb465700 1 -- 172.21.15.80:0/1893684396 wait complete. 2024-02-13T00:33:51.949 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182473 got 107374182486 for osd.3 2024-02-13T00:33:51.950 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-13T00:33:52.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:51 smithi106 bash[18459]: cluster 2024-02-13T00:33:50.749736+0000 mgr.y (mgr.24461) 156 : cluster [DBG] pgmap v110: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:52.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:51 smithi106 bash[18459]: audit 2024-02-13T00:33:51.275468+0000 mon.a (mon.0) 680 : audit [DBG] from='client.? 172.21.15.80:0/1893684396' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-13T00:33:52.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:51 smithi080 bash[17386]: cluster 2024-02-13T00:33:50.749736+0000 mgr.y (mgr.24461) 156 : cluster [DBG] pgmap v110: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:52.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:51 smithi080 bash[17386]: audit 2024-02-13T00:33:51.275468+0000 mon.a (mon.0) 680 : audit [DBG] from='client.? 172.21.15.80:0/1893684396' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-13T00:33:52.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:51 smithi080 bash[24237]: cluster 2024-02-13T00:33:50.749736+0000 mgr.y (mgr.24461) 156 : cluster [DBG] pgmap v110: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:52.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:51 smithi080 bash[24237]: audit 2024-02-13T00:33:51.275468+0000 mon.a (mon.0) 680 : audit [DBG] from='client.? 172.21.15.80:0/1893684396' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-13T00:33:53.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:52 smithi080 bash[17386]: audit 2024-02-13T00:33:51.845985+0000 mon.c (mon.2) 62 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:33:53.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:52 smithi080 bash[17386]: audit 2024-02-13T00:33:52.121143+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:33:53.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:52 smithi080 bash[17386]: audit 2024-02-13T00:33:52.412869+0000 mon.c (mon.2) 63 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:33:53.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:52 smithi080 bash[17386]: audit 2024-02-13T00:33:52.414167+0000 mon.c (mon.2) 64 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:33:53.120 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:52 smithi080 bash[17386]: audit 2024-02-13T00:33:52.423250+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:33:53.120 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:52 smithi080 bash[24237]: audit 2024-02-13T00:33:51.845985+0000 mon.c (mon.2) 62 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:33:53.120 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:52 smithi080 bash[24237]: audit 2024-02-13T00:33:52.121143+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:33:53.120 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:52 smithi080 bash[24237]: audit 2024-02-13T00:33:52.412869+0000 mon.c (mon.2) 63 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:33:53.120 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:52 smithi080 bash[24237]: audit 2024-02-13T00:33:52.414167+0000 mon.c (mon.2) 64 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:33:53.120 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:52 smithi080 bash[24237]: audit 2024-02-13T00:33:52.423250+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:33:53.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:52 smithi106 bash[18459]: audit 2024-02-13T00:33:51.845985+0000 mon.c (mon.2) 62 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:33:53.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:52 smithi106 bash[18459]: audit 2024-02-13T00:33:52.121143+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:33:53.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:52 smithi106 bash[18459]: audit 2024-02-13T00:33:52.412869+0000 mon.c (mon.2) 63 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:33:53.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:52 smithi106 bash[18459]: audit 2024-02-13T00:33:52.414167+0000 mon.c (mon.2) 64 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:33:53.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:52 smithi106 bash[18459]: audit 2024-02-13T00:33:52.423250+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:33:53.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:33:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:33:53] "GET /metrics HTTP/1.1" 200 172231 "" "Prometheus/2.33.4" 2024-02-13T00:33:54.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:53 smithi106 bash[18459]: cluster 2024-02-13T00:33:52.751154+0000 mgr.y (mgr.24461) 157 : cluster [DBG] pgmap v111: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:54.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:53 smithi080 bash[17386]: cluster 2024-02-13T00:33:52.751154+0000 mgr.y (mgr.24461) 157 : cluster [DBG] pgmap v111: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:54.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:53 smithi080 bash[24237]: cluster 2024-02-13T00:33:52.751154+0000 mgr.y (mgr.24461) 157 : cluster [DBG] pgmap v111: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:33:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:55 smithi106 bash[18459]: cluster 2024-02-13T00:33:54.751981+0000 mgr.y (mgr.24461) 158 : cluster [DBG] pgmap v112: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:55 smithi080 bash[17386]: cluster 2024-02-13T00:33:54.751981+0000 mgr.y (mgr.24461) 158 : cluster [DBG] pgmap v112: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:56.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:55 smithi080 bash[24237]: cluster 2024-02-13T00:33:54.751981+0000 mgr.y (mgr.24461) 158 : cluster [DBG] pgmap v112: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:56.726 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:33:57.992 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:57 smithi080 bash[17386]: cluster 2024-02-13T00:33:56.752696+0000 mgr.y (mgr.24461) 159 : cluster [DBG] pgmap v113: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:57.993 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:57 smithi080 bash[24237]: cluster 2024-02-13T00:33:56.752696+0000 mgr.y (mgr.24461) 159 : cluster [DBG] pgmap v113: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:58.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:33:57 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:33:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:57 smithi106 bash[18459]: cluster 2024-02-13T00:33:56.752696+0000 mgr.y (mgr.24461) 159 : cluster [DBG] pgmap v113: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:33:59.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:58 smithi080 bash[17386]: audit 2024-02-13T00:33:57.861378+0000 mgr.y (mgr.24461) 160 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:33:59.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:58 smithi080 bash[24237]: audit 2024-02-13T00:33:57.861378+0000 mgr.y (mgr.24461) 160 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:33:59.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:58 smithi106 bash[18459]: audit 2024-02-13T00:33:57.861378+0000 mgr.y (mgr.24461) 160 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:33:59.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.583+0000 7f5e7759e700 1 -- 172.21.15.80:0/779016185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e780fdbd0 msgr2=0x7f5e780fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:59.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.583+0000 7f5e7759e700 1 --2- 172.21.15.80:0/779016185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e780fdbd0 0x7f5e780fdfb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f5e68004870 tx=0x7f5e68009cb0).stop 2024-02-13T00:33:59.588 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.583+0000 7f5e7759e700 1 -- 172.21.15.80:0/779016185 shutdown_connections 2024-02-13T00:33:59.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.583+0000 7f5e7759e700 1 --2- 172.21.15.80:0/779016185 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e780f66c0 0x7f5e781049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:59.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.583+0000 7f5e7759e700 1 --2- 172.21.15.80:0/779016185 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e780fdbd0 0x7f5e780fdfb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:59.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.583+0000 7f5e7759e700 1 --2- 172.21.15.80:0/779016185 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e780fe530 0x7f5e780f5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:59.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.583+0000 7f5e7759e700 1 -- 172.21.15.80:0/779016185 >> 172.21.15.80:0/779016185 conn(0x7f5e7806ff80 msgr2=0x7f5e780f42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:33:59.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.583+0000 7f5e7759e700 1 -- 172.21.15.80:0/779016185 shutdown_connections 2024-02-13T00:33:59.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.583+0000 7f5e7759e700 1 -- 172.21.15.80:0/779016185 wait complete. 2024-02-13T00:33:59.589 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.583+0000 7f5e7759e700 1 Processor -- start 2024-02-13T00:33:59.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.583+0000 7f5e7759e700 1 -- start start 2024-02-13T00:33:59.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.583+0000 7f5e7759e700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e780f66c0 0x7f5e780f72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:59.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.583+0000 7f5e7759e700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e780fdbd0 0x7f5e780f77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:59.590 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.587+0000 7f5e7759e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e780fe530 0x7f5e780f7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:59.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.587+0000 7f5e7759e700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e781163e0 con 0x7f5e780fdbd0 2024-02-13T00:33:59.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.587+0000 7f5e6dd9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e780fdbd0 0x7f5e780f77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:59.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.587+0000 7f5e6dd9b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e780fdbd0 0x7f5e780f77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36756/0 (socket says 172.21.15.80:36756) 2024-02-13T00:33:59.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.587+0000 7f5e6dd9b700 1 -- 172.21.15.80:0/2422341751 learned_addr learned my addr 172.21.15.80:0/2422341751 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:33:59.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.587+0000 7f5e7659c700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e780f66c0 0x7f5e780f72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:59.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.587+0000 7f5e7759e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e78116550 con 0x7f5e780fe530 2024-02-13T00:33:59.591 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.587+0000 7f5e7759e700 1 -- 172.21.15.80:0/2422341751 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e78116710 con 0x7f5e780f66c0 2024-02-13T00:33:59.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.587+0000 7f5e76d9d700 1 --2- 172.21.15.80:0/2422341751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e780fe530 0x7f5e780f7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:59.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.587+0000 7f5e6dd9b700 1 -- 172.21.15.80:0/2422341751 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e780f66c0 msgr2=0x7f5e780f72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:59.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.587+0000 7f5e6dd9b700 1 --2- 172.21.15.80:0/2422341751 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e780f66c0 0x7f5e780f72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:59.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.587+0000 7f5e6dd9b700 1 -- 172.21.15.80:0/2422341751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e780fe530 msgr2=0x7f5e780f7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:59.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.587+0000 7f5e6dd9b700 1 --2- 172.21.15.80:0/2422341751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e780fe530 0x7f5e780f7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:59.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.587+0000 7f5e6dd9b700 1 -- 172.21.15.80:0/2422341751 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e68005040 con 0x7f5e780fdbd0 2024-02-13T00:33:59.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.587+0000 7f5e7659c700 1 --2- 172.21.15.80:0/2422341751 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e780f66c0 0x7f5e780f72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:33:59.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.587+0000 7f5e6dd9b700 1 --2- 172.21.15.80:0/2422341751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e780fdbd0 0x7f5e780f77a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f5e6000e910 tx=0x7f5e6000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:33:59.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.587+0000 7f5e6ffff700 1 -- 172.21.15.80:0/2422341751 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e60004620 con 0x7f5e780fdbd0 2024-02-13T00:33:59.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.587+0000 7f5e6ffff700 1 -- 172.21.15.80:0/2422341751 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f5e6000f040 con 0x7f5e780fdbd0 2024-02-13T00:33:59.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.587+0000 7f5e6ffff700 1 -- 172.21.15.80:0/2422341751 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e600146f0 con 0x7f5e780fdbd0 2024-02-13T00:33:59.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.587+0000 7f5e7759e700 1 -- 172.21.15.80:0/2422341751 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e781169f0 con 0x7f5e780fdbd0 2024-02-13T00:33:59.593 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.587+0000 7f5e7759e700 1 -- 172.21.15.80:0/2422341751 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e78116ee0 con 0x7f5e780fdbd0 2024-02-13T00:33:59.594 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.587+0000 7f5e7759e700 1 -- 172.21.15.80:0/2422341751 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e7805f9d0 con 0x7f5e780fdbd0 2024-02-13T00:33:59.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.591+0000 7f5e6ffff700 1 -- 172.21.15.80:0/2422341751 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f5e60007b40 con 0x7f5e780fdbd0 2024-02-13T00:33:59.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.591+0000 7f5e6ffff700 1 --2- 172.21.15.80:0/2422341751 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5e64061340 0x7f5e64063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:33:59.595 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.591+0000 7f5e6ffff700 1 -- 172.21.15.80:0/2422341751 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f5e6007c920 con 0x7f5e780fdbd0 2024-02-13T00:33:59.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.591+0000 7f5e7659c700 1 --2- 172.21.15.80:0/2422341751 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5e64061340 0x7f5e64063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:33:59.596 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.591+0000 7f5e7659c700 1 --2- 172.21.15.80:0/2422341751 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5e64061340 0x7f5e64063800 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f5e68005010 tx=0x7f5e68009cb0).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:33:59.603 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.599+0000 7f5e6ffff700 1 -- 172.21.15.80:0/2422341751 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5e6004c6d0 con 0x7f5e780fdbd0 2024-02-13T00:33:59.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.783+0000 7f5e7759e700 1 -- 172.21.15.80:0/2422341751 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5e780f8790 con 0x7f5e780fdbd0 2024-02-13T00:33:59.789 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.783+0000 7f5e6ffff700 1 -- 172.21.15.80:0/2422341751 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e60019020 con 0x7f5e780fdbd0 2024-02-13T00:33:59.790 INFO:teuthology.orchestra.run.smithi080.stdout:128849018960 2024-02-13T00:33:59.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.787+0000 7f5e7759e700 1 -- 172.21.15.80:0/2422341751 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5e64061340 msgr2=0x7f5e64063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:59.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.787+0000 7f5e7759e700 1 --2- 172.21.15.80:0/2422341751 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5e64061340 0x7f5e64063800 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f5e68005010 tx=0x7f5e68009cb0).stop 2024-02-13T00:33:59.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.787+0000 7f5e7759e700 1 -- 172.21.15.80:0/2422341751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e780fdbd0 msgr2=0x7f5e780f77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:33:59.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.787+0000 7f5e7759e700 1 --2- 172.21.15.80:0/2422341751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e780fdbd0 0x7f5e780f77a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f5e6000e910 tx=0x7f5e6000b040).stop 2024-02-13T00:33:59.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.787+0000 7f5e7759e700 1 -- 172.21.15.80:0/2422341751 shutdown_connections 2024-02-13T00:33:59.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.787+0000 7f5e7759e700 1 --2- 172.21.15.80:0/2422341751 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5e64061340 0x7f5e64063800 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:59.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.787+0000 7f5e7759e700 1 --2- 172.21.15.80:0/2422341751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e780fe530 0x7f5e780f7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:59.792 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.787+0000 7f5e7759e700 1 --2- 172.21.15.80:0/2422341751 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5e780f66c0 0x7f5e780f72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:59.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.787+0000 7f5e7759e700 1 --2- 172.21.15.80:0/2422341751 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5e780fdbd0 0x7f5e780f77a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:33:59.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.787+0000 7f5e7759e700 1 -- 172.21.15.80:0/2422341751 >> 172.21.15.80:0/2422341751 conn(0x7f5e7806ff80 msgr2=0x7f5e7806c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:33:59.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.787+0000 7f5e7759e700 1 -- 172.21.15.80:0/2422341751 shutdown_connections 2024-02-13T00:33:59.793 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:33:59.787+0000 7f5e7759e700 1 -- 172.21.15.80:0/2422341751 wait complete. 2024-02-13T00:34:00.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:59 smithi106 bash[18459]: cluster 2024-02-13T00:33:58.754093+0000 mgr.y (mgr.24461) 161 : cluster [DBG] pgmap v114: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:00.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:33:59 smithi106 bash[18459]: audit 2024-02-13T00:33:59.787236+0000 mon.a (mon.0) 683 : audit [DBG] from='client.? 172.21.15.80:0/2422341751' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-13T00:34:00.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:59 smithi080 bash[17386]: cluster 2024-02-13T00:33:58.754093+0000 mgr.y (mgr.24461) 161 : cluster [DBG] pgmap v114: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:00.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:33:59 smithi080 bash[17386]: audit 2024-02-13T00:33:59.787236+0000 mon.a (mon.0) 683 : audit [DBG] from='client.? 172.21.15.80:0/2422341751' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-13T00:34:00.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:59 smithi080 bash[24237]: cluster 2024-02-13T00:33:58.754093+0000 mgr.y (mgr.24461) 161 : cluster [DBG] pgmap v114: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:00.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:33:59 smithi080 bash[24237]: audit 2024-02-13T00:33:59.787236+0000 mon.a (mon.0) 683 : audit [DBG] from='client.? 172.21.15.80:0/2422341751' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-13T00:34:00.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:34:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:34:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:34:00.556 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018946 got 128849018960 for osd.4 2024-02-13T00:34:00.557 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-13T00:34:02.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:01 smithi106 bash[18459]: cluster 2024-02-13T00:34:00.754689+0000 mgr.y (mgr.24461) 162 : cluster [DBG] pgmap v115: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:02.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:01 smithi080 bash[17386]: cluster 2024-02-13T00:34:00.754689+0000 mgr.y (mgr.24461) 162 : cluster [DBG] pgmap v115: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:02.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:01 smithi080 bash[24237]: cluster 2024-02-13T00:34:00.754689+0000 mgr.y (mgr.24461) 162 : cluster [DBG] pgmap v115: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:03.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:34:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:34:03] "GET /metrics HTTP/1.1" 200 172226 "" "Prometheus/2.33.4" 2024-02-13T00:34:04.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:03 smithi106 bash[18459]: cluster 2024-02-13T00:34:02.756096+0000 mgr.y (mgr.24461) 163 : cluster [DBG] pgmap v116: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:04.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:03 smithi080 bash[17386]: cluster 2024-02-13T00:34:02.756096+0000 mgr.y (mgr.24461) 163 : cluster [DBG] pgmap v116: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:04.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:03 smithi080 bash[24237]: cluster 2024-02-13T00:34:02.756096+0000 mgr.y (mgr.24461) 163 : cluster [DBG] pgmap v116: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:05.339 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:34:05.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:05 smithi080 bash[17386]: cluster 2024-02-13T00:34:04.756779+0000 mgr.y (mgr.24461) 164 : cluster [DBG] pgmap v117: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:05.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:05 smithi080 bash[24237]: cluster 2024-02-13T00:34:04.756779+0000 mgr.y (mgr.24461) 164 : cluster [DBG] pgmap v117: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:06.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:05 smithi106 bash[18459]: cluster 2024-02-13T00:34:04.756779+0000 mgr.y (mgr.24461) 164 : cluster [DBG] pgmap v117: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:08.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.207+0000 7f4fb41db700 1 -- 172.21.15.80:0/2343929313 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4fac0fe5f0 msgr2=0x7f4fac0f7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:08.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.207+0000 7f4fb41db700 1 --2- 172.21.15.80:0/2343929313 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4fac0fe5f0 0x7f4fac0f7e20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f4fa8004870 tx=0x7f4fa8009cb0).stop 2024-02-13T00:34:08.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.207+0000 7f4fb41db700 1 -- 172.21.15.80:0/2343929313 shutdown_connections 2024-02-13T00:34:08.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.207+0000 7f4fb41db700 1 --2- 172.21.15.80:0/2343929313 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fac0f8500 0x7f4fac104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:08.212 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.207+0000 7f4fb41db700 1 --2- 172.21.15.80:0/2343929313 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fac0fdc90 0x7f4fac0fe070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:08.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.207+0000 7f4fb41db700 1 --2- 172.21.15.80:0/2343929313 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4fac0fe5f0 0x7f4fac0f7e20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:08.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.207+0000 7f4fb41db700 1 -- 172.21.15.80:0/2343929313 >> 172.21.15.80:0/2343929313 conn(0x7f4fac0f3900 msgr2=0x7f4fac0f5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:34:08.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.207+0000 7f4fb41db700 1 -- 172.21.15.80:0/2343929313 shutdown_connections 2024-02-13T00:34:08.213 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.207+0000 7f4fb41db700 1 -- 172.21.15.80:0/2343929313 wait complete. 2024-02-13T00:34:08.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.207+0000 7f4fb41db700 1 Processor -- start 2024-02-13T00:34:08.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.207+0000 7f4fb41db700 1 -- start start 2024-02-13T00:34:08.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.207+0000 7f4fb41db700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fac0f8500 0x7f4fac10df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:08.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.207+0000 7f4fb41db700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fac0fdc90 0x7f4fac10e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:08.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.207+0000 7f4fb41db700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4fac0fe5f0 0x7f4fac108120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:08.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.207+0000 7f4fb41db700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac108610 con 0x7f4fac0f8500 2024-02-13T00:34:08.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.207+0000 7f4fb41db700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac108780 con 0x7f4fac0fdc90 2024-02-13T00:34:08.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.207+0000 7f4fb41db700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac108940 con 0x7f4fac0fe5f0 2024-02-13T00:34:08.214 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.207+0000 7f4fb1f77700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fac0f8500 0x7f4fac10df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.207+0000 7f4fb1f77700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fac0f8500 0x7f4fac10df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:36772/0 (socket says 172.21.15.80:36772) 2024-02-13T00:34:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.207+0000 7f4fb1f77700 1 -- 172.21.15.80:0/3044418963 learned_addr learned my addr 172.21.15.80:0/3044418963 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:34:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.207+0000 7f4fb2778700 1 --2- 172.21.15.80:0/3044418963 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4fac0fe5f0 0x7f4fac108120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.207+0000 7f4fb1776700 1 --2- 172.21.15.80:0/3044418963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fac0fdc90 0x7f4fac10e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.211+0000 7f4fb1f77700 1 -- 172.21.15.80:0/3044418963 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4fac0fe5f0 msgr2=0x7f4fac108120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.211+0000 7f4fb1f77700 1 --2- 172.21.15.80:0/3044418963 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4fac0fe5f0 0x7f4fac108120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:08.215 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.211+0000 7f4fb1f77700 1 -- 172.21.15.80:0/3044418963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fac0fdc90 msgr2=0x7f4fac10e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.211+0000 7f4fb1f77700 1 --2- 172.21.15.80:0/3044418963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fac0fdc90 0x7f4fac10e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.211+0000 7f4fb1f77700 1 -- 172.21.15.80:0/3044418963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa8005040 con 0x7f4fac0f8500 2024-02-13T00:34:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.211+0000 7f4fb1776700 1 --2- 172.21.15.80:0/3044418963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fac0fdc90 0x7f4fac10e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-13T00:34:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.211+0000 7f4fb2778700 1 --2- 172.21.15.80:0/3044418963 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4fac0fe5f0 0x7f4fac108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:34:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.211+0000 7f4fb1f77700 1 --2- 172.21.15.80:0/3044418963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fac0f8500 0x7f4fac10df80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f4f9c00e970 tx=0x7f4f9c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:34:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.211+0000 7f4fa2ffd700 1 -- 172.21.15.80:0/3044418963 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c00ee60 con 0x7f4fac0f8500 2024-02-13T00:34:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.211+0000 7f4fb41db700 1 -- 172.21.15.80:0/3044418963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fac108bc0 con 0x7f4fac0f8500 2024-02-13T00:34:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.211+0000 7f4fa2ffd700 1 -- 172.21.15.80:0/3044418963 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f4f9c00f040 con 0x7f4fac0f8500 2024-02-13T00:34:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.211+0000 7f4fa2ffd700 1 -- 172.21.15.80:0/3044418963 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c00c5b0 con 0x7f4fac0f8500 2024-02-13T00:34:08.216 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.211+0000 7f4fb41db700 1 -- 172.21.15.80:0/3044418963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fac06b030 con 0x7f4fac0f8500 2024-02-13T00:34:08.217 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.211+0000 7f4fb41db700 1 -- 172.21.15.80:0/3044418963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fac05fab0 con 0x7f4fac0f8500 2024-02-13T00:34:08.218 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.211+0000 7f4fa2ffd700 1 -- 172.21.15.80:0/3044418963 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f4f9c007b40 con 0x7f4fac0f8500 2024-02-13T00:34:08.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.215+0000 7f4fa2ffd700 1 --2- 172.21.15.80:0/3044418963 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4f98061340 0x7f4f98063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:08.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.215+0000 7f4fa2ffd700 1 -- 172.21.15.80:0/3044418963 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f4f9c07d150 con 0x7f4fac0f8500 2024-02-13T00:34:08.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.215+0000 7f4fb1776700 1 --2- 172.21.15.80:0/3044418963 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4f98061340 0x7f4f98063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:08.219 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.215+0000 7f4fb1776700 1 --2- 172.21.15.80:0/3044418963 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4f98061340 0x7f4f98063800 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4fa8005010 tx=0x7f4fa8009cb0).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:34:08.224 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.219+0000 7f4fa2ffd700 1 -- 172.21.15.80:0/3044418963 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f4f9c04cf60 con 0x7f4fac0f8500 2024-02-13T00:34:08.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:07 smithi106 bash[18459]: cluster 2024-02-13T00:34:06.757469+0000 mgr.y (mgr.24461) 165 : cluster [DBG] pgmap v118: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:08.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:34:07 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:34:08.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:07 smithi080 bash[17386]: cluster 2024-02-13T00:34:06.757469+0000 mgr.y (mgr.24461) 165 : cluster [DBG] pgmap v118: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:08.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:07 smithi080 bash[24237]: cluster 2024-02-13T00:34:06.757469+0000 mgr.y (mgr.24461) 165 : cluster [DBG] pgmap v118: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:08.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.403+0000 7f4fb41db700 1 -- 172.21.15.80:0/3044418963 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4fac0475e0 con 0x7f4fac0f8500 2024-02-13T00:34:08.410 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.407+0000 7f4fa2ffd700 1 -- 172.21.15.80:0/3044418963 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f9c019070 con 0x7f4fac0f8500 2024-02-13T00:34:08.411 INFO:teuthology.orchestra.run.smithi080.stdout:154618822729 2024-02-13T00:34:08.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.407+0000 7f4fb41db700 1 -- 172.21.15.80:0/3044418963 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4f98061340 msgr2=0x7f4f98063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:08.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.407+0000 7f4fb41db700 1 --2- 172.21.15.80:0/3044418963 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4f98061340 0x7f4f98063800 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4fa8005010 tx=0x7f4fa8009cb0).stop 2024-02-13T00:34:08.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.407+0000 7f4fb41db700 1 -- 172.21.15.80:0/3044418963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fac0f8500 msgr2=0x7f4fac10df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:08.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.407+0000 7f4fb41db700 1 --2- 172.21.15.80:0/3044418963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fac0f8500 0x7f4fac10df80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f4f9c00e970 tx=0x7f4f9c00b040).stop 2024-02-13T00:34:08.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.407+0000 7f4fb41db700 1 -- 172.21.15.80:0/3044418963 shutdown_connections 2024-02-13T00:34:08.414 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.407+0000 7f4fb41db700 1 --2- 172.21.15.80:0/3044418963 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4f98061340 0x7f4f98063800 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:08.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.407+0000 7f4fb41db700 1 --2- 172.21.15.80:0/3044418963 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f4fac0fe5f0 0x7f4fac108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:08.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.407+0000 7f4fb41db700 1 --2- 172.21.15.80:0/3044418963 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f4fac0f8500 0x7f4fac10df80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:08.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.407+0000 7f4fb41db700 1 --2- 172.21.15.80:0/3044418963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fac0fdc90 0x7f4fac10e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:08.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.407+0000 7f4fb41db700 1 -- 172.21.15.80:0/3044418963 >> 172.21.15.80:0/3044418963 conn(0x7f4fac0f3900 msgr2=0x7f4fac0fba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:34:08.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.407+0000 7f4fb41db700 1 -- 172.21.15.80:0/3044418963 shutdown_connections 2024-02-13T00:34:08.415 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:08.411+0000 7f4fb41db700 1 -- 172.21.15.80:0/3044418963 wait complete. 2024-02-13T00:34:09.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:08 smithi080 bash[17386]: audit 2024-02-13T00:34:07.869257+0000 mgr.y (mgr.24461) 166 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:34:09.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:08 smithi080 bash[17386]: audit 2024-02-13T00:34:08.408340+0000 mon.a (mon.0) 684 : audit [DBG] from='client.? 172.21.15.80:0/3044418963' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-13T00:34:09.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:08 smithi080 bash[24237]: audit 2024-02-13T00:34:07.869257+0000 mgr.y (mgr.24461) 166 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:34:09.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:08 smithi080 bash[24237]: audit 2024-02-13T00:34:08.408340+0000 mon.a (mon.0) 684 : audit [DBG] from='client.? 172.21.15.80:0/3044418963' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-13T00:34:09.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:08 smithi106 bash[18459]: audit 2024-02-13T00:34:07.869257+0000 mgr.y (mgr.24461) 166 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:34:09.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:08 smithi106 bash[18459]: audit 2024-02-13T00:34:08.408340+0000 mon.a (mon.0) 684 : audit [DBG] from='client.? 172.21.15.80:0/3044418963' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-13T00:34:09.262 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822716 got 154618822729 for osd.5 2024-02-13T00:34:09.262 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-02-13T00:34:10.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:09 smithi106 bash[18459]: cluster 2024-02-13T00:34:08.758214+0000 mgr.y (mgr.24461) 167 : cluster [DBG] pgmap v119: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:10.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:09 smithi080 bash[17386]: cluster 2024-02-13T00:34:08.758214+0000 mgr.y (mgr.24461) 167 : cluster [DBG] pgmap v119: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:10.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:09 smithi080 bash[24237]: cluster 2024-02-13T00:34:08.758214+0000 mgr.y (mgr.24461) 167 : cluster [DBG] pgmap v119: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:10.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:34:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:34:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:34:12.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:11 smithi106 bash[18459]: cluster 2024-02-13T00:34:10.758842+0000 mgr.y (mgr.24461) 168 : cluster [DBG] pgmap v120: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:12.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:11 smithi080 bash[17386]: cluster 2024-02-13T00:34:10.758842+0000 mgr.y (mgr.24461) 168 : cluster [DBG] pgmap v120: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:12.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:11 smithi080 bash[24237]: cluster 2024-02-13T00:34:10.758842+0000 mgr.y (mgr.24461) 168 : cluster [DBG] pgmap v120: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:13.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:34:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:34:13] "GET /metrics HTTP/1.1" 200 172226 "" "Prometheus/2.33.4" 2024-02-13T00:34:14.033 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:34:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:13 smithi106 bash[18459]: cluster 2024-02-13T00:34:12.760204+0000 mgr.y (mgr.24461) 169 : cluster [DBG] pgmap v121: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:14.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:13 smithi080 bash[17386]: cluster 2024-02-13T00:34:12.760204+0000 mgr.y (mgr.24461) 169 : cluster [DBG] pgmap v121: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:14.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:13 smithi080 bash[24237]: cluster 2024-02-13T00:34:12.760204+0000 mgr.y (mgr.24461) 169 : cluster [DBG] pgmap v121: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:15 smithi080 bash[17386]: cluster 2024-02-13T00:34:14.760894+0000 mgr.y (mgr.24461) 170 : cluster [DBG] pgmap v122: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:15.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:15 smithi080 bash[24237]: cluster 2024-02-13T00:34:14.760894+0000 mgr.y (mgr.24461) 170 : cluster [DBG] pgmap v122: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:16.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:15 smithi106 bash[18459]: cluster 2024-02-13T00:34:14.760894+0000 mgr.y (mgr.24461) 170 : cluster [DBG] pgmap v122: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:16.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.958+0000 7f41a8742700 1 -- 172.21.15.80:0/1642095650 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41a00fcc40 msgr2=0x7f41a00fd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:16.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.958+0000 7f41a8742700 1 --2- 172.21.15.80:0/1642095650 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41a00fcc40 0x7f41a00fd020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f419c004870 tx=0x7f419c009cb0).stop 2024-02-13T00:34:16.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.958+0000 7f41a8742700 1 -- 172.21.15.80:0/1642095650 shutdown_connections 2024-02-13T00:34:16.965 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.958+0000 7f41a8742700 1 --2- 172.21.15.80:0/1642095650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a00f7c90 0x7f41a0103a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:16.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.958+0000 7f41a8742700 1 --2- 172.21.15.80:0/1642095650 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41a00fcc40 0x7f41a00fd020 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:16.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.958+0000 7f41a8742700 1 --2- 172.21.15.80:0/1642095650 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41a00fd5a0 0x7f41a00f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:16.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.958+0000 7f41a8742700 1 -- 172.21.15.80:0/1642095650 >> 172.21.15.80:0/1642095650 conn(0x7f41a006c400 msgr2=0x7f41a006c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:34:16.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.958+0000 7f41a8742700 1 -- 172.21.15.80:0/1642095650 shutdown_connections 2024-02-13T00:34:16.966 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.958+0000 7f41a8742700 1 -- 172.21.15.80:0/1642095650 wait complete. 2024-02-13T00:34:16.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.958+0000 7f41a8742700 1 Processor -- start 2024-02-13T00:34:16.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41a8742700 1 -- start start 2024-02-13T00:34:16.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41a8742700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41a00f7c90 0x7f41a010e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:16.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41a8742700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a00fcc40 0x7f41a010e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:16.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41a8742700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41a00fd5a0 0x7f41a01081f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:16.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41a8742700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a01086e0 con 0x7f41a00f7c90 2024-02-13T00:34:16.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41a8742700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a0108850 con 0x7f41a00fcc40 2024-02-13T00:34:16.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41a8742700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a0108a10 con 0x7f41a00fd5a0 2024-02-13T00:34:16.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41a64de700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41a00f7c90 0x7f41a010e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:16.967 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41a6cdf700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41a00fd5a0 0x7f41a01081f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:16.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41a64de700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41a00f7c90 0x7f41a010e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:45510/0 (socket says 172.21.15.80:45510) 2024-02-13T00:34:16.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41a64de700 1 -- 172.21.15.80:0/2918929966 learned_addr learned my addr 172.21.15.80:0/2918929966 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:34:16.968 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41a5cdd700 1 --2- 172.21.15.80:0/2918929966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a00fcc40 0x7f41a010e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:16.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41a64de700 1 -- 172.21.15.80:0/2918929966 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41a00fd5a0 msgr2=0x7f41a01081f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:16.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41a64de700 1 --2- 172.21.15.80:0/2918929966 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41a00fd5a0 0x7f41a01081f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:16.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41a64de700 1 -- 172.21.15.80:0/2918929966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a00fcc40 msgr2=0x7f41a010e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:16.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41a64de700 1 --2- 172.21.15.80:0/2918929966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a00fcc40 0x7f41a010e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:16.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41a64de700 1 -- 172.21.15.80:0/2918929966 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c005040 con 0x7f41a00f7c90 2024-02-13T00:34:16.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41a64de700 1 --2- 172.21.15.80:0/2918929966 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41a00f7c90 0x7f41a010e050 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f419c005010 tx=0x7f419c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:34:16.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41977fe700 1 -- 172.21.15.80:0/2918929966 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c00e030 con 0x7f41a00f7c90 2024-02-13T00:34:16.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41a8742700 1 -- 172.21.15.80:0/2918929966 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a0108c90 con 0x7f41a00f7c90 2024-02-13T00:34:16.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41977fe700 1 -- 172.21.15.80:0/2918929966 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f419c013e30 con 0x7f41a00f7c90 2024-02-13T00:34:16.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41977fe700 1 -- 172.21.15.80:0/2918929966 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c018070 con 0x7f41a00f7c90 2024-02-13T00:34:16.969 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41a8742700 1 -- 172.21.15.80:0/2918929966 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a0114e80 con 0x7f41a00f7c90 2024-02-13T00:34:16.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.962+0000 7f41a8742700 1 -- 172.21.15.80:0/2918929966 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a01090d0 con 0x7f41a00f7c90 2024-02-13T00:34:16.970 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.966+0000 7f41977fe700 1 -- 172.21.15.80:0/2918929966 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f419c009240 con 0x7f41a00f7c90 2024-02-13T00:34:16.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.966+0000 7f41977fe700 1 --2- 172.21.15.80:0/2918929966 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f418c061340 0x7f418c063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:16.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.966+0000 7f41977fe700 1 -- 172.21.15.80:0/2918929966 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f419c07e120 con 0x7f41a00f7c90 2024-02-13T00:34:16.971 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.966+0000 7f41a5cdd700 1 --2- 172.21.15.80:0/2918929966 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f418c061340 0x7f418c063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:16.972 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.966+0000 7f41a5cdd700 1 --2- 172.21.15.80:0/2918929966 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f418c061340 0x7f418c063800 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f41a0109990 tx=0x7f419000b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:34:16.978 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:16.974+0000 7f41977fe700 1 -- 172.21.15.80:0/2918929966 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f419c04dea0 con 0x7f41a00f7c90 2024-02-13T00:34:17.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:17.162+0000 7f41a8742700 1 -- 172.21.15.80:0/2918929966 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f41a0105fa0 con 0x7f41a00f7c90 2024-02-13T00:34:17.168 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:17.162+0000 7f41977fe700 1 -- 172.21.15.80:0/2918929966 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f419c0514c0 con 0x7f41a00f7c90 2024-02-13T00:34:17.169 INFO:teuthology.orchestra.run.smithi080.stdout:180388626498 2024-02-13T00:34:17.170 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:17.166+0000 7f41a8742700 1 -- 172.21.15.80:0/2918929966 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f418c061340 msgr2=0x7f418c063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:17.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:17.166+0000 7f41a8742700 1 --2- 172.21.15.80:0/2918929966 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f418c061340 0x7f418c063800 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f41a0109990 tx=0x7f419000b040).stop 2024-02-13T00:34:17.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:17.166+0000 7f41a8742700 1 -- 172.21.15.80:0/2918929966 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41a00f7c90 msgr2=0x7f41a010e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:17.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:17.166+0000 7f41a8742700 1 --2- 172.21.15.80:0/2918929966 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41a00f7c90 0x7f41a010e050 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f419c005010 tx=0x7f419c009cb0).stop 2024-02-13T00:34:17.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:17.166+0000 7f41a8742700 1 -- 172.21.15.80:0/2918929966 shutdown_connections 2024-02-13T00:34:17.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:17.166+0000 7f41a8742700 1 --2- 172.21.15.80:0/2918929966 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f418c061340 0x7f418c063800 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:17.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:17.166+0000 7f41a8742700 1 --2- 172.21.15.80:0/2918929966 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f41a00fd5a0 0x7f41a01081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:17.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:17.166+0000 7f41a8742700 1 --2- 172.21.15.80:0/2918929966 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f41a00f7c90 0x7f41a010e050 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:17.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:17.166+0000 7f41a8742700 1 --2- 172.21.15.80:0/2918929966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a00fcc40 0x7f41a010e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:17.171 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:17.166+0000 7f41a8742700 1 -- 172.21.15.80:0/2918929966 >> 172.21.15.80:0/2918929966 conn(0x7f41a006c400 msgr2=0x7f41a00fab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:34:17.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:17.166+0000 7f41a8742700 1 -- 172.21.15.80:0/2918929966 shutdown_connections 2024-02-13T00:34:17.172 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:17.166+0000 7f41a8742700 1 -- 172.21.15.80:0/2918929966 wait complete. 2024-02-13T00:34:17.866 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626485 got 180388626498 for osd.6 2024-02-13T00:34:17.867 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-02-13T00:34:18.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:34:17 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:34:18.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:17 smithi106 bash[18459]: cluster 2024-02-13T00:34:16.761512+0000 mgr.y (mgr.24461) 171 : cluster [DBG] pgmap v123: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:18.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:17 smithi106 bash[18459]: audit 2024-02-13T00:34:17.166282+0000 mon.a (mon.0) 685 : audit [DBG] from='client.? 172.21.15.80:0/2918929966' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-13T00:34:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:17 smithi080 bash[17386]: cluster 2024-02-13T00:34:16.761512+0000 mgr.y (mgr.24461) 171 : cluster [DBG] pgmap v123: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:17 smithi080 bash[17386]: audit 2024-02-13T00:34:17.166282+0000 mon.a (mon.0) 685 : audit [DBG] from='client.? 172.21.15.80:0/2918929966' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-13T00:34:18.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:17 smithi080 bash[24237]: cluster 2024-02-13T00:34:16.761512+0000 mgr.y (mgr.24461) 171 : cluster [DBG] pgmap v123: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:18.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:17 smithi080 bash[24237]: audit 2024-02-13T00:34:17.166282+0000 mon.a (mon.0) 685 : audit [DBG] from='client.? 172.21.15.80:0/2918929966' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-13T00:34:19.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:18 smithi106 bash[18459]: audit 2024-02-13T00:34:17.880630+0000 mgr.y (mgr.24461) 172 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:34:19.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:18 smithi080 bash[17386]: audit 2024-02-13T00:34:17.880630+0000 mgr.y (mgr.24461) 172 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:34:19.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:18 smithi080 bash[24237]: audit 2024-02-13T00:34:17.880630+0000 mgr.y (mgr.24461) 172 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:34:20.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:19 smithi106 bash[18459]: cluster 2024-02-13T00:34:18.762927+0000 mgr.y (mgr.24461) 173 : cluster [DBG] pgmap v124: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:20.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:19 smithi080 bash[17386]: cluster 2024-02-13T00:34:18.762927+0000 mgr.y (mgr.24461) 173 : cluster [DBG] pgmap v124: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:20.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:19 smithi080 bash[24237]: cluster 2024-02-13T00:34:18.762927+0000 mgr.y (mgr.24461) 173 : cluster [DBG] pgmap v124: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:20.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:34:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:34:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:34:22.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:21 smithi106 bash[18459]: cluster 2024-02-13T00:34:20.763594+0000 mgr.y (mgr.24461) 174 : cluster [DBG] pgmap v125: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:22.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:21 smithi080 bash[17386]: cluster 2024-02-13T00:34:20.763594+0000 mgr.y (mgr.24461) 174 : cluster [DBG] pgmap v125: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:22.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:21 smithi080 bash[24237]: cluster 2024-02-13T00:34:20.763594+0000 mgr.y (mgr.24461) 174 : cluster [DBG] pgmap v125: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:22.649 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:34:23.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:34:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:34:23] "GET /metrics HTTP/1.1" 200 172237 "" "Prometheus/2.33.4" 2024-02-13T00:34:24.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:23 smithi106 bash[18459]: cluster 2024-02-13T00:34:22.765053+0000 mgr.y (mgr.24461) 175 : cluster [DBG] pgmap v126: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:24.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:23 smithi080 bash[17386]: cluster 2024-02-13T00:34:22.765053+0000 mgr.y (mgr.24461) 175 : cluster [DBG] pgmap v126: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:24.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:23 smithi080 bash[24237]: cluster 2024-02-13T00:34:22.765053+0000 mgr.y (mgr.24461) 175 : cluster [DBG] pgmap v126: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:25.456 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.450+0000 7f75c0389700 1 -- 172.21.15.80:0/2155189671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75b80f8a90 msgr2=0x7f75b80f8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:25.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.450+0000 7f75c0389700 1 --2- 172.21.15.80:0/2155189671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75b80f8a90 0x7f75b80f8e70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f75b40047b0 tx=0x7f75b4009cb0).stop 2024-02-13T00:34:25.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.450+0000 7f75c0389700 1 -- 172.21.15.80:0/2155189671 shutdown_connections 2024-02-13T00:34:25.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.450+0000 7f75c0389700 1 --2- 172.21.15.80:0/2155189671 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75b80f7420 0x7f75b8103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:25.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.450+0000 7f75c0389700 1 --2- 172.21.15.80:0/2155189671 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75b80f8a90 0x7f75b80f8e70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:25.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.450+0000 7f75c0389700 1 --2- 172.21.15.80:0/2155189671 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75b80f9360 0x7f75b80f6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:25.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.450+0000 7f75c0389700 1 -- 172.21.15.80:0/2155189671 >> 172.21.15.80:0/2155189671 conn(0x7f75b80f27e0 msgr2=0x7f75b80f4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:34:25.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.450+0000 7f75c0389700 1 -- 172.21.15.80:0/2155189671 shutdown_connections 2024-02-13T00:34:25.457 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.450+0000 7f75c0389700 1 -- 172.21.15.80:0/2155189671 wait complete. 2024-02-13T00:34:25.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.450+0000 7f75c0389700 1 Processor -- start 2024-02-13T00:34:25.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.450+0000 7f75c0389700 1 -- start start 2024-02-13T00:34:25.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.450+0000 7f75c0389700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75b80f7420 0x7f75b80f9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:25.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.450+0000 7f75c0389700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75b80f8a90 0x7f75b80f9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:25.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.450+0000 7f75c0389700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75b80f9360 0x7f75b80fa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:25.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.450+0000 7f75c0389700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b81165b0 con 0x7f75b80f8a90 2024-02-13T00:34:25.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.450+0000 7f75c0389700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b8116720 con 0x7f75b80f7420 2024-02-13T00:34:25.458 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.450+0000 7f75c0389700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b81168e0 con 0x7f75b80f9360 2024-02-13T00:34:25.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.454+0000 7f75be926700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75b80f9360 0x7f75b80fa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:25.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.454+0000 7f75be926700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75b80f9360 0x7f75b80fa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:47198/0 (socket says 172.21.15.80:47198) 2024-02-13T00:34:25.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.454+0000 7f75be926700 1 -- 172.21.15.80:0/935667475 learned_addr learned my addr 172.21.15.80:0/935667475 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:34:25.459 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.454+0000 7f75bd924700 1 --2- 172.21.15.80:0/935667475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75b80f8a90 0x7f75b80f9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:25.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.454+0000 7f75be125700 1 --2- 172.21.15.80:0/935667475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75b80f7420 0x7f75b80f9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:25.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.454+0000 7f75be926700 1 -- 172.21.15.80:0/935667475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75b80f7420 msgr2=0x7f75b80f9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:25.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.454+0000 7f75be926700 1 --2- 172.21.15.80:0/935667475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75b80f7420 0x7f75b80f9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:25.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.454+0000 7f75be926700 1 -- 172.21.15.80:0/935667475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75b80f8a90 msgr2=0x7f75b80f9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:25.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.454+0000 7f75be926700 1 --2- 172.21.15.80:0/935667475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75b80f8a90 0x7f75b80f9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:25.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.454+0000 7f75be926700 1 -- 172.21.15.80:0/935667475 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b4005040 con 0x7f75b80f9360 2024-02-13T00:34:25.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.454+0000 7f75bd924700 1 --2- 172.21.15.80:0/935667475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75b80f8a90 0x7f75b80f9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:34:25.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.454+0000 7f75be926700 1 --2- 172.21.15.80:0/935667475 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75b80f9360 0x7f75b80fa470 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f75b000d970 tx=0x7f75b0004e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:34:25.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.454+0000 7f75af7fe700 1 -- 172.21.15.80:0/935667475 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0004020 con 0x7f75b80f9360 2024-02-13T00:34:25.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.454+0000 7f75c0389700 1 -- 172.21.15.80:0/935667475 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b8116bc0 con 0x7f75b80f9360 2024-02-13T00:34:25.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.454+0000 7f75af7fe700 1 -- 172.21.15.80:0/935667475 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f75b000f040 con 0x7f75b80f9360 2024-02-13T00:34:25.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.454+0000 7f75af7fe700 1 -- 172.21.15.80:0/935667475 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0003430 con 0x7f75b80f9360 2024-02-13T00:34:25.460 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.454+0000 7f75c0389700 1 -- 172.21.15.80:0/935667475 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b8117130 con 0x7f75b80f9360 2024-02-13T00:34:25.461 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.454+0000 7f75c0389700 1 -- 172.21.15.80:0/935667475 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b80475e0 con 0x7f75b80f9360 2024-02-13T00:34:25.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.454+0000 7f75af7fe700 1 -- 172.21.15.80:0/935667475 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f75b000b510 con 0x7f75b80f9360 2024-02-13T00:34:25.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.458+0000 7f75af7fe700 1 --2- 172.21.15.80:0/935667475 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f75a4061340 0x7f75a4063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:25.462 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.458+0000 7f75af7fe700 1 -- 172.21.15.80:0/935667475 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f75b007c860 con 0x7f75b80f9360 2024-02-13T00:34:25.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.458+0000 7f75be125700 1 --2- 172.21.15.80:0/935667475 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f75a4061340 0x7f75a4063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:25.463 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.458+0000 7f75be125700 1 --2- 172.21.15.80:0/935667475 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f75a4061340 0x7f75a4063800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f75b4009bc0 tx=0x7f75b4009cb0).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:34:25.469 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.462+0000 7f75af7fe700 1 -- 172.21.15.80:0/935667475 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f75b0048f60 con 0x7f75b80f9360 2024-02-13T00:34:25.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.646+0000 7f75c0389700 1 -- 172.21.15.80:0/935667475 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f75b80faf70 con 0x7f75b80f9360 2024-02-13T00:34:25.651 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.646+0000 7f75af7fe700 1 -- 172.21.15.80:0/935667475 <== mon.2 v2:172.21.15.80:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75b004c6a0 con 0x7f75b80f9360 2024-02-13T00:34:25.651 INFO:teuthology.orchestra.run.smithi080.stdout:206158430268 2024-02-13T00:34:25.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.650+0000 7f75c0389700 1 -- 172.21.15.80:0/935667475 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f75a4061340 msgr2=0x7f75a4063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:25.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.650+0000 7f75c0389700 1 --2- 172.21.15.80:0/935667475 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f75a4061340 0x7f75a4063800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f75b4009bc0 tx=0x7f75b4009cb0).stop 2024-02-13T00:34:25.655 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.650+0000 7f75c0389700 1 -- 172.21.15.80:0/935667475 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75b80f9360 msgr2=0x7f75b80fa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:25.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.650+0000 7f75c0389700 1 --2- 172.21.15.80:0/935667475 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75b80f9360 0x7f75b80fa470 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f75b000d970 tx=0x7f75b0004e60).stop 2024-02-13T00:34:25.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.650+0000 7f75c0389700 1 -- 172.21.15.80:0/935667475 shutdown_connections 2024-02-13T00:34:25.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.650+0000 7f75c0389700 1 --2- 172.21.15.80:0/935667475 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f75a4061340 0x7f75a4063800 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:25.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.650+0000 7f75c0389700 1 --2- 172.21.15.80:0/935667475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75b80f7420 0x7f75b80f9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:25.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.650+0000 7f75c0389700 1 --2- 172.21.15.80:0/935667475 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75b80f9360 0x7f75b80fa470 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:25.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.650+0000 7f75c0389700 1 --2- 172.21.15.80:0/935667475 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75b80f8a90 0x7f75b80f9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:25.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.650+0000 7f75c0389700 1 -- 172.21.15.80:0/935667475 >> 172.21.15.80:0/935667475 conn(0x7f75b80f27e0 msgr2=0x7f75b80f4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:34:25.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.650+0000 7f75c0389700 1 -- 172.21.15.80:0/935667475 shutdown_connections 2024-02-13T00:34:25.656 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:25.650+0000 7f75c0389700 1 -- 172.21.15.80:0/935667475 wait complete. 2024-02-13T00:34:25.910 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:25 smithi080 bash[17386]: cluster 2024-02-13T00:34:24.765480+0000 mgr.y (mgr.24461) 176 : cluster [DBG] pgmap v127: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:25.911 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:25 smithi080 bash[24237]: cluster 2024-02-13T00:34:24.765480+0000 mgr.y (mgr.24461) 176 : cluster [DBG] pgmap v127: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:26.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:25 smithi106 bash[18459]: cluster 2024-02-13T00:34:24.765480+0000 mgr.y (mgr.24461) 176 : cluster [DBG] pgmap v127: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:26.498 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430254 got 206158430268 for osd.7 2024-02-13T00:34:26.498 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-13T00:34:26.499 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph pg dump --format=json 2024-02-13T00:34:26.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:26 smithi080 bash[17386]: audit 2024-02-13T00:34:25.649095+0000 mon.c (mon.2) 65 : audit [DBG] from='client.? 172.21.15.80:0/935667475' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-13T00:34:26.822 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:26 smithi080 bash[24237]: audit 2024-02-13T00:34:25.649095+0000 mon.c (mon.2) 65 : audit [DBG] from='client.? 172.21.15.80:0/935667475' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-13T00:34:27.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:26 smithi106 bash[18459]: audit 2024-02-13T00:34:25.649095+0000 mon.c (mon.2) 65 : audit [DBG] from='client.? 172.21.15.80:0/935667475' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-13T00:34:27.895 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:27 smithi106 bash[18459]: cluster 2024-02-13T00:34:26.766123+0000 mgr.y (mgr.24461) 177 : cluster [DBG] pgmap v128: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:28.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:27 smithi080 bash[24237]: cluster 2024-02-13T00:34:26.766123+0000 mgr.y (mgr.24461) 177 : cluster [DBG] pgmap v128: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:28.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:27 smithi080 bash[17386]: cluster 2024-02-13T00:34:26.766123+0000 mgr.y (mgr.24461) 177 : cluster [DBG] pgmap v128: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:28.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:34:27 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:34:29.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:28 smithi106 bash[18459]: audit 2024-02-13T00:34:27.892031+0000 mgr.y (mgr.24461) 178 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:34:29.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:28 smithi080 bash[17386]: audit 2024-02-13T00:34:27.892031+0000 mgr.y (mgr.24461) 178 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:34:29.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:28 smithi080 bash[24237]: audit 2024-02-13T00:34:27.892031+0000 mgr.y (mgr.24461) 178 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:34:30.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:29 smithi106 bash[18459]: cluster 2024-02-13T00:34:28.767600+0000 mgr.y (mgr.24461) 179 : cluster [DBG] pgmap v129: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:30.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:29 smithi080 bash[17386]: cluster 2024-02-13T00:34:28.767600+0000 mgr.y (mgr.24461) 179 : cluster [DBG] pgmap v129: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:30.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:29 smithi080 bash[24237]: cluster 2024-02-13T00:34:28.767600+0000 mgr.y (mgr.24461) 179 : cluster [DBG] pgmap v129: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:30.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:34:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:34:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:34:31.279 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:34:32.226 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:31 smithi080 bash[17386]: cluster 2024-02-13T00:34:30.768202+0000 mgr.y (mgr.24461) 180 : cluster [DBG] pgmap v130: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:32.226 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:31 smithi080 bash[24237]: cluster 2024-02-13T00:34:30.768202+0000 mgr.y (mgr.24461) 180 : cluster [DBG] pgmap v130: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:32.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:31 smithi106 bash[18459]: cluster 2024-02-13T00:34:30.768202+0000 mgr.y (mgr.24461) 180 : cluster [DBG] pgmap v130: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:33.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:34:33 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:34:33] "GET /metrics HTTP/1.1" 200 172238 "" "Prometheus/2.33.4" 2024-02-13T00:34:34.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58ffffa700 1 -- 172.21.15.80:0/3252818911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58f80f8f10 msgr2=0x7f58f80f92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:34.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58ffffa700 1 --2- 172.21.15.80:0/3252818911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58f80f8f10 0x7f58f80f92f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f58ec004870 tx=0x7f58ec009cb0).stop 2024-02-13T00:34:34.176 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58ffffa700 1 -- 172.21.15.80:0/3252818911 shutdown_connections 2024-02-13T00:34:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58ffffa700 1 --2- 172.21.15.80:0/3252818911 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f58f81022b0 0x7f58f81046a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58ffffa700 1 --2- 172.21.15.80:0/3252818911 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58f80f8f10 0x7f58f80f92f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58ffffa700 1 --2- 172.21.15.80:0/3252818911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58f80f97e0 0x7f58f8101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58ffffa700 1 -- 172.21.15.80:0/3252818911 >> 172.21.15.80:0/3252818911 conn(0x7f58f80f27e0 msgr2=0x7f58f80f4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:34:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58ffffa700 1 -- 172.21.15.80:0/3252818911 shutdown_connections 2024-02-13T00:34:34.177 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58ffffa700 1 -- 172.21.15.80:0/3252818911 wait complete. 2024-02-13T00:34:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58ffffa700 1 Processor -- start 2024-02-13T00:34:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58ffffa700 1 -- start start 2024-02-13T00:34:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58ffffa700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f58f80f8f10 0x7f58f80f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58ffffa700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58f80f97e0 0x7f58f80f71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58ffffa700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58f81022b0 0x7f58f80f76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:34.178 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58ffffa700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f8116610 con 0x7f58f80f97e0 2024-02-13T00:34:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58ffffa700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f8116780 con 0x7f58f81022b0 2024-02-13T00:34:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58ffffa700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f8116940 con 0x7f58f80f8f10 2024-02-13T00:34:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58fd595700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58f80f97e0 0x7f58f80f71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58fd595700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58f80f97e0 0x7f58f80f71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:34878/0 (socket says 172.21.15.80:34878) 2024-02-13T00:34:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58fd595700 1 -- 172.21.15.80:0/4196553016 learned_addr learned my addr 172.21.15.80:0/4196553016 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:34:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58fdd96700 1 --2- 172.21.15.80:0/4196553016 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f58f80f8f10 0x7f58f80f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58fe597700 1 --2- 172.21.15.80:0/4196553016 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58f81022b0 0x7f58f80f76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58fd595700 1 -- 172.21.15.80:0/4196553016 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f58f80f8f10 msgr2=0x7f58f80f6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58fd595700 1 --2- 172.21.15.80:0/4196553016 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f58f80f8f10 0x7f58f80f6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58fd595700 1 -- 172.21.15.80:0/4196553016 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58f81022b0 msgr2=0x7f58f80f76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.170+0000 7f58fd595700 1 --2- 172.21.15.80:0/4196553016 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58f81022b0 0x7f58f80f76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.174+0000 7f58fd595700 1 -- 172.21.15.80:0/4196553016 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec005040 con 0x7f58f80f97e0 2024-02-13T00:34:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.174+0000 7f58fdd96700 1 --2- 172.21.15.80:0/4196553016 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f58f80f8f10 0x7f58f80f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:34:34.179 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.174+0000 7f58fd595700 1 --2- 172.21.15.80:0/4196553016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58f80f97e0 0x7f58f80f71f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f58f400e970 tx=0x7f58f400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:34:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.174+0000 7f58eaffd700 1 -- 172.21.15.80:0/4196553016 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f4004660 con 0x7f58f80f97e0 2024-02-13T00:34:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.174+0000 7f58eaffd700 1 -- 172.21.15.80:0/4196553016 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f58f400f040 con 0x7f58f80f97e0 2024-02-13T00:34:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.174+0000 7f58ffffa700 1 -- 172.21.15.80:0/4196553016 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f8116c20 con 0x7f58f80f97e0 2024-02-13T00:34:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.174+0000 7f58eaffd700 1 -- 172.21.15.80:0/4196553016 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f40146f0 con 0x7f58f80f97e0 2024-02-13T00:34:34.180 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.174+0000 7f58ffffa700 1 -- 172.21.15.80:0/4196553016 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f8117160 con 0x7f58f80f97e0 2024-02-13T00:34:34.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.174+0000 7f58eaffd700 1 -- 172.21.15.80:0/4196553016 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f58f40133c0 con 0x7f58f80f97e0 2024-02-13T00:34:34.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.174+0000 7f58ffffa700 1 -- 172.21.15.80:0/4196553016 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f80475e0 con 0x7f58f80f97e0 2024-02-13T00:34:34.181 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.174+0000 7f58eaffd700 1 --2- 172.21.15.80:0/4196553016 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f58e4061340 0x7f58e4063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.174+0000 7f58eaffd700 1 -- 172.21.15.80:0/4196553016 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f58f407ca90 con 0x7f58f80f97e0 2024-02-13T00:34:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.174+0000 7f58fdd96700 1 --2- 172.21.15.80:0/4196553016 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f58e4061340 0x7f58e4063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:34.182 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.178+0000 7f58fdd96700 1 --2- 172.21.15.80:0/4196553016 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f58e4061340 0x7f58e4063800 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f58ec004ee0 tx=0x7f58ec009cb0).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:34:34.189 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.182+0000 7f58eaffd700 1 -- 172.21.15.80:0/4196553016 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f58f404c7c0 con 0x7f58f80f97e0 2024-02-13T00:34:34.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:33 smithi106 bash[18459]: cluster 2024-02-13T00:34:32.769318+0000 mgr.y (mgr.24461) 181 : cluster [DBG] pgmap v131: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:34.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:33 smithi080 bash[17386]: cluster 2024-02-13T00:34:32.769318+0000 mgr.y (mgr.24461) 181 : cluster [DBG] pgmap v131: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:34.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:33 smithi080 bash[24237]: cluster 2024-02-13T00:34:32.769318+0000 mgr.y (mgr.24461) 181 : cluster [DBG] pgmap v131: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:34.365 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.358+0000 7f58ffffa700 1 -- 172.21.15.80:0/4196553016 --> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f58f80f8190 con 0x7f58e4061340 2024-02-13T00:34:34.385 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.378+0000 7f58eaffd700 1 -- 172.21.15.80:0/4196553016 <== mgr.24461 v2:172.21.15.80:6800/2955905243 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+355603 (secure 0 0 0) 0x7f58f80f8190 con 0x7f58e4061340 2024-02-13T00:34:34.391 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-13T00:34:34.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.382+0000 7f58ffffa700 1 -- 172.21.15.80:0/4196553016 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f58e4061340 msgr2=0x7f58e4063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:34.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.382+0000 7f58ffffa700 1 --2- 172.21.15.80:0/4196553016 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f58e4061340 0x7f58e4063800 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f58ec004ee0 tx=0x7f58ec009cb0).stop 2024-02-13T00:34:34.393 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.382+0000 7f58ffffa700 1 -- 172.21.15.80:0/4196553016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58f80f97e0 msgr2=0x7f58f80f71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:34.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.382+0000 7f58ffffa700 1 --2- 172.21.15.80:0/4196553016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58f80f97e0 0x7f58f80f71f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f58f400e970 tx=0x7f58f400b040).stop 2024-02-13T00:34:34.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.386+0000 7f58ffffa700 1 -- 172.21.15.80:0/4196553016 shutdown_connections 2024-02-13T00:34:34.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.386+0000 7f58ffffa700 1 --2- 172.21.15.80:0/4196553016 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f58e4061340 0x7f58e4063800 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:34.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.386+0000 7f58ffffa700 1 --2- 172.21.15.80:0/4196553016 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58f81022b0 0x7f58f80f76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:34.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.386+0000 7f58ffffa700 1 --2- 172.21.15.80:0/4196553016 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f58f80f8f10 0x7f58f80f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:34.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.386+0000 7f58ffffa700 1 --2- 172.21.15.80:0/4196553016 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f58f80f97e0 0x7f58f80f71f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:34.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.386+0000 7f58ffffa700 1 -- 172.21.15.80:0/4196553016 >> 172.21.15.80:0/4196553016 conn(0x7f58f80f27e0 msgr2=0x7f58f80f3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:34:34.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.386+0000 7f58ffffa700 1 -- 172.21.15.80:0/4196553016 shutdown_connections 2024-02-13T00:34:34.394 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:34.386+0000 7f58ffffa700 1 -- 172.21.15.80:0/4196553016 wait complete. 2024-02-13T00:34:34.394 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-13T00:34:35.198 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2024-02-13T00:34:32.768416+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5796,"num_objects":224,"num_object_clones":0,"num_object_copies":672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":224,"num_whiteouts":0,"num_read":1375,"num_read_kb":1095,"num_write":620,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":468,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":661,"ondisk_log_size":661,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":2382240,"kb_used_data":5472,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":747578976,"statfs":{"total":767960285184,"available":765520871424,"internally_reserved":0,"allocated":5603328,"data_stored":2305379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005202"},"pg_stats":[{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986207+0000","last_change":"2024-02-13T00:29:57.939697+0000","last_active":"2024-02-13T00:30:07.986207+0000","last_peered":"2024-02-13T00:30:07.986207+0000","last_clean":"2024-02-13T00:30:07.986207+0000","last_became_active":"2024-02-13T00:29:57.938663+0000","last_became_peered":"2024-02-13T00:29:57.938663+0000","last_unstale":"2024-02-13T00:30:07.986207+0000","last_undegraded":"2024-02-13T00:30:07.986207+0000","last_fullsized":"2024-02-13T00:30:07.986207+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986443+0000","last_change":"2024-02-13T00:29:55.909454+0000","last_active":"2024-02-13T00:30:07.986443+0000","last_peered":"2024-02-13T00:30:07.986443+0000","last_clean":"2024-02-13T00:30:07.986443+0000","last_became_active":"2024-02-13T00:29:55.909042+0000","last_became_peered":"2024-02-13T00:29:55.909042+0000","last_unstale":"2024-02-13T00:30:07.986443+0000","last_undegraded":"2024-02-13T00:30:07.986443+0000","last_fullsized":"2024-02-13T00:30:07.986443+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.983322+0000","last_change":"2024-02-13T00:29:52.062064+0000","last_active":"2024-02-13T00:30:07.983322+0000","last_peered":"2024-02-13T00:30:07.983322+0000","last_clean":"2024-02-13T00:30:07.983322+0000","last_became_active":"2024-02-13T00:29:52.061547+0000","last_became_peered":"2024-02-13T00:29:52.061547+0000","last_unstale":"2024-02-13T00:30:07.983322+0000","last_undegraded":"2024-02-13T00:30:07.983322+0000","last_fullsized":"2024-02-13T00:30:07.983322+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"60'15","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986098+0000","last_change":"2024-02-13T00:29:53.877025+0000","last_active":"2024-02-13T00:30:07.986098+0000","last_peered":"2024-02-13T00:30:07.986098+0000","last_clean":"2024-02-13T00:30:07.986098+0000","last_became_active":"2024-02-13T00:29:53.876734+0000","last_became_peered":"2024-02-13T00:29:53.876734+0000","last_unstale":"2024-02-13T00:30:07.986098+0000","last_undegraded":"2024-02-13T00:30:07.986098+0000","last_fullsized":"2024-02-13T00:30:07.986098+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":22,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.981089+0000","last_change":"2024-02-13T00:29:57.927332+0000","last_active":"2024-02-13T00:30:07.981089+0000","last_peered":"2024-02-13T00:30:07.981089+0000","last_clean":"2024-02-13T00:30:07.981089+0000","last_became_active":"2024-02-13T00:29:57.927013+0000","last_became_peered":"2024-02-13T00:29:57.927013+0000","last_unstale":"2024-02-13T00:30:07.981089+0000","last_undegraded":"2024-02-13T00:30:07.981089+0000","last_fullsized":"2024-02-13T00:30:07.981089+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986056+0000","last_change":"2024-02-13T00:29:55.901792+0000","last_active":"2024-02-13T00:30:07.986056+0000","last_peered":"2024-02-13T00:30:07.986056+0000","last_clean":"2024-02-13T00:30:07.986056+0000","last_became_active":"2024-02-13T00:29:55.901483+0000","last_became_peered":"2024-02-13T00:29:55.901483+0000","last_unstale":"2024-02-13T00:30:07.986056+0000","last_undegraded":"2024-02-13T00:30:07.986056+0000","last_fullsized":"2024-02-13T00:30:07.986056+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.980618+0000","last_change":"2024-02-13T00:29:52.058673+0000","last_active":"2024-02-13T00:30:07.980618+0000","last_peered":"2024-02-13T00:30:07.980618+0000","last_clean":"2024-02-13T00:30:07.980618+0000","last_became_active":"2024-02-13T00:29:52.058179+0000","last_became_peered":"2024-02-13T00:29:52.058179+0000","last_unstale":"2024-02-13T00:30:07.980618+0000","last_undegraded":"2024-02-13T00:30:07.980618+0000","last_fullsized":"2024-02-13T00:30:07.980618+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"60'39","reported_seq":102,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.980226+0000","last_change":"2024-02-13T00:29:53.889135+0000","last_active":"2024-02-13T00:30:07.980226+0000","last_peered":"2024-02-13T00:30:07.980226+0000","last_clean":"2024-02-13T00:30:07.980226+0000","last_became_active":"2024-02-13T00:29:53.888756+0000","last_became_peered":"2024-02-13T00:29:53.888756+0000","last_unstale":"2024-02-13T00:30:07.980226+0000","last_undegraded":"2024-02-13T00:30:07.980226+0000","last_fullsized":"2024-02-13T00:30:07.980226+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.978391+0000","last_change":"2024-02-13T00:29:57.931425+0000","last_active":"2024-02-13T00:30:07.978391+0000","last_peered":"2024-02-13T00:30:07.978391+0000","last_clean":"2024-02-13T00:30:07.978391+0000","last_became_active":"2024-02-13T00:29:57.930559+0000","last_became_peered":"2024-02-13T00:29:57.930559+0000","last_unstale":"2024-02-13T00:30:07.978391+0000","last_undegraded":"2024-02-13T00:30:07.978391+0000","last_fullsized":"2024-02-13T00:30:07.978391+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984172+0000","last_change":"2024-02-13T00:29:55.900974+0000","last_active":"2024-02-13T00:30:07.984172+0000","last_peered":"2024-02-13T00:30:07.984172+0000","last_clean":"2024-02-13T00:30:07.984172+0000","last_became_active":"2024-02-13T00:29:55.899685+0000","last_became_peered":"2024-02-13T00:29:55.899685+0000","last_unstale":"2024-02-13T00:30:07.984172+0000","last_undegraded":"2024-02-13T00:30:07.984172+0000","last_fullsized":"2024-02-13T00:30:07.984172+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984325+0000","last_change":"2024-02-13T00:29:51.860174+0000","last_active":"2024-02-13T00:30:07.984325+0000","last_peered":"2024-02-13T00:30:07.984325+0000","last_clean":"2024-02-13T00:30:07.984325+0000","last_became_active":"2024-02-13T00:29:51.859787+0000","last_became_peered":"2024-02-13T00:29:51.859787+0000","last_unstale":"2024-02-13T00:30:07.984325+0000","last_undegraded":"2024-02-13T00:30:07.984325+0000","last_fullsized":"2024-02-13T00:30:07.984325+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"60'21","reported_seq":63,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986632+0000","last_change":"2024-02-13T00:29:53.886764+0000","last_active":"2024-02-13T00:30:07.986632+0000","last_peered":"2024-02-13T00:30:07.986632+0000","last_clean":"2024-02-13T00:30:07.986632+0000","last_became_active":"2024-02-13T00:29:53.886454+0000","last_became_peered":"2024-02-13T00:29:53.886454+0000","last_unstale":"2024-02-13T00:30:07.986632+0000","last_undegraded":"2024-02-13T00:30:07.986632+0000","last_fullsized":"2024-02-13T00:30:07.986632+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.983640+0000","last_change":"2024-02-13T00:29:57.938198+0000","last_active":"2024-02-13T00:30:07.983640+0000","last_peered":"2024-02-13T00:30:07.983640+0000","last_clean":"2024-02-13T00:30:07.983640+0000","last_became_active":"2024-02-13T00:29:57.937829+0000","last_became_peered":"2024-02-13T00:29:57.937829+0000","last_unstale":"2024-02-13T00:30:07.983640+0000","last_undegraded":"2024-02-13T00:30:07.983640+0000","last_fullsized":"2024-02-13T00:30:07.983640+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.976233+0000","last_change":"2024-02-13T00:29:55.899658+0000","last_active":"2024-02-13T00:30:07.976233+0000","last_peered":"2024-02-13T00:30:07.976233+0000","last_clean":"2024-02-13T00:30:07.976233+0000","last_became_active":"2024-02-13T00:29:55.899296+0000","last_became_peered":"2024-02-13T00:29:55.899296+0000","last_unstale":"2024-02-13T00:30:07.976233+0000","last_undegraded":"2024-02-13T00:30:07.976233+0000","last_fullsized":"2024-02-13T00:30:07.976233+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984862+0000","last_change":"2024-02-13T00:29:51.860100+0000","last_active":"2024-02-13T00:30:07.984862+0000","last_peered":"2024-02-13T00:30:07.984862+0000","last_clean":"2024-02-13T00:30:07.984862+0000","last_became_active":"2024-02-13T00:29:51.859693+0000","last_became_peered":"2024-02-13T00:29:51.859693+0000","last_unstale":"2024-02-13T00:30:07.984862+0000","last_undegraded":"2024-02-13T00:30:07.984862+0000","last_fullsized":"2024-02-13T00:30:07.984862+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"60'11","reported_seq":42,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986483+0000","last_change":"2024-02-13T00:29:53.881210+0000","last_active":"2024-02-13T00:30:07.986483+0000","last_peered":"2024-02-13T00:30:07.986483+0000","last_clean":"2024-02-13T00:30:07.986483+0000","last_became_active":"2024-02-13T00:29:53.880882+0000","last_became_peered":"2024-02-13T00:29:53.880882+0000","last_unstale":"2024-02-13T00:30:07.986483+0000","last_undegraded":"2024-02-13T00:30:07.986483+0000","last_fullsized":"2024-02-13T00:30:07.986483+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":18,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.987358+0000","last_change":"2024-02-13T00:29:57.933192+0000","last_active":"2024-02-13T00:30:07.987358+0000","last_peered":"2024-02-13T00:30:07.987358+0000","last_clean":"2024-02-13T00:30:07.987358+0000","last_became_active":"2024-02-13T00:29:57.932838+0000","last_became_peered":"2024-02-13T00:29:57.932838+0000","last_unstale":"2024-02-13T00:30:07.987358+0000","last_undegraded":"2024-02-13T00:30:07.987358+0000","last_fullsized":"2024-02-13T00:30:07.987358+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.988320+0000","last_change":"2024-02-13T00:29:55.900852+0000","last_active":"2024-02-13T00:30:07.988320+0000","last_peered":"2024-02-13T00:30:07.988320+0000","last_clean":"2024-02-13T00:30:07.988320+0000","last_became_active":"2024-02-13T00:29:55.900488+0000","last_became_peered":"2024-02-13T00:29:55.900488+0000","last_unstale":"2024-02-13T00:30:07.988320+0000","last_undegraded":"2024-02-13T00:30:07.988320+0000","last_fullsized":"2024-02-13T00:30:07.988320+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.978876+0000","last_change":"2024-02-13T00:29:51.861278+0000","last_active":"2024-02-13T00:30:07.978876+0000","last_peered":"2024-02-13T00:30:07.978876+0000","last_clean":"2024-02-13T00:30:07.978876+0000","last_became_active":"2024-02-13T00:29:51.860894+0000","last_became_peered":"2024-02-13T00:29:51.860894+0000","last_unstale":"2024-02-13T00:30:07.978876+0000","last_undegraded":"2024-02-13T00:30:07.978876+0000","last_fullsized":"2024-02-13T00:30:07.978876+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"60'15","reported_seq":42,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.981851+0000","last_change":"2024-02-13T00:29:53.880898+0000","last_active":"2024-02-13T00:30:07.981851+0000","last_peered":"2024-02-13T00:30:07.981851+0000","last_clean":"2024-02-13T00:30:07.981851+0000","last_became_active":"2024-02-13T00:29:53.880522+0000","last_became_peered":"2024-02-13T00:29:53.880522+0000","last_unstale":"2024-02-13T00:30:07.981851+0000","last_undegraded":"2024-02-13T00:30:07.981851+0000","last_fullsized":"2024-02-13T00:30:07.981851+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.982413+0000","last_change":"2024-02-13T00:29:57.933154+0000","last_active":"2024-02-13T00:30:07.982413+0000","last_peered":"2024-02-13T00:30:07.982413+0000","last_clean":"2024-02-13T00:30:07.982413+0000","last_became_active":"2024-02-13T00:29:57.932823+0000","last_became_peered":"2024-02-13T00:29:57.932823+0000","last_unstale":"2024-02-13T00:30:07.982413+0000","last_undegraded":"2024-02-13T00:30:07.982413+0000","last_fullsized":"2024-02-13T00:30:07.982413+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986802+0000","last_change":"2024-02-13T00:29:55.900881+0000","last_active":"2024-02-13T00:30:07.986802+0000","last_peered":"2024-02-13T00:30:07.986802+0000","last_clean":"2024-02-13T00:30:07.986802+0000","last_became_active":"2024-02-13T00:29:55.900525+0000","last_became_peered":"2024-02-13T00:29:55.900525+0000","last_unstale":"2024-02-13T00:30:07.986802+0000","last_undegraded":"2024-02-13T00:30:07.986802+0000","last_fullsized":"2024-02-13T00:30:07.986802+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986611+0000","last_change":"2024-02-13T00:29:52.059970+0000","last_active":"2024-02-13T00:30:07.986611+0000","last_peered":"2024-02-13T00:30:07.986611+0000","last_clean":"2024-02-13T00:30:07.986611+0000","last_became_active":"2024-02-13T00:29:52.059469+0000","last_became_peered":"2024-02-13T00:29:52.059469+0000","last_unstale":"2024-02-13T00:30:07.986611+0000","last_undegraded":"2024-02-13T00:30:07.986611+0000","last_fullsized":"2024-02-13T00:30:07.986611+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"60'18","reported_seq":55,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.980848+0000","last_change":"2024-02-13T00:29:53.881771+0000","last_active":"2024-02-13T00:30:07.980848+0000","last_peered":"2024-02-13T00:30:07.980848+0000","last_clean":"2024-02-13T00:30:07.980848+0000","last_became_active":"2024-02-13T00:29:53.881458+0000","last_became_peered":"2024-02-13T00:29:53.881458+0000","last_unstale":"2024-02-13T00:30:07.980848+0000","last_undegraded":"2024-02-13T00:30:07.980848+0000","last_fullsized":"2024-02-13T00:30:07.980848+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":27,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"60'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.976834+0000","last_change":"2024-02-13T00:29:57.933281+0000","last_active":"2024-02-13T00:30:07.976834+0000","last_peered":"2024-02-13T00:30:07.976834+0000","last_clean":"2024-02-13T00:30:07.976834+0000","last_became_active":"2024-02-13T00:29:57.932941+0000","last_became_peered":"2024-02-13T00:29:57.932941+0000","last_unstale":"2024-02-13T00:30:07.976834+0000","last_undegraded":"2024-02-13T00:30:07.976834+0000","last_fullsized":"2024-02-13T00:30:07.976834+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"60'8","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-02-13T00:34:25.466146+0000","last_change":"2024-02-13T00:29:55.907594+0000","last_active":"2024-02-13T00:34:25.466146+0000","last_peered":"2024-02-13T00:34:25.466146+0000","last_clean":"2024-02-13T00:34:25.466146+0000","last_became_active":"2024-02-13T00:29:55.906029+0000","last_became_peered":"2024-02-13T00:29:55.906029+0000","last_unstale":"2024-02-13T00:34:25.466146+0000","last_undegraded":"2024-02-13T00:34:25.466146+0000","last_fullsized":"2024-02-13T00:34:25.466146+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986539+0000","last_change":"2024-02-13T00:29:51.858471+0000","last_active":"2024-02-13T00:30:07.986539+0000","last_peered":"2024-02-13T00:30:07.986539+0000","last_clean":"2024-02-13T00:30:07.986539+0000","last_became_active":"2024-02-13T00:29:51.858115+0000","last_became_peered":"2024-02-13T00:29:51.858115+0000","last_unstale":"2024-02-13T00:30:07.986539+0000","last_undegraded":"2024-02-13T00:30:07.986539+0000","last_fullsized":"2024-02-13T00:30:07.986539+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'16","reported_seq":47,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.981897+0000","last_change":"2024-02-13T00:29:54.019914+0000","last_active":"2024-02-13T00:30:07.981897+0000","last_peered":"2024-02-13T00:30:07.981897+0000","last_clean":"2024-02-13T00:30:07.981897+0000","last_became_active":"2024-02-13T00:29:54.019413+0000","last_became_peered":"2024-02-13T00:29:54.019413+0000","last_unstale":"2024-02-13T00:30:07.981897+0000","last_undegraded":"2024-02-13T00:30:07.981897+0000","last_fullsized":"2024-02-13T00:30:07.981897+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.988464+0000","last_change":"2024-02-13T00:29:57.932821+0000","last_active":"2024-02-13T00:30:07.988464+0000","last_peered":"2024-02-13T00:30:07.988464+0000","last_clean":"2024-02-13T00:30:07.988464+0000","last_became_active":"2024-02-13T00:29:57.932524+0000","last_became_peered":"2024-02-13T00:29:57.932524+0000","last_unstale":"2024-02-13T00:30:07.988464+0000","last_undegraded":"2024-02-13T00:30:07.988464+0000","last_fullsized":"2024-02-13T00:30:07.988464+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.982144+0000","last_change":"2024-02-13T00:29:55.895700+0000","last_active":"2024-02-13T00:30:07.982144+0000","last_peered":"2024-02-13T00:30:07.982144+0000","last_clean":"2024-02-13T00:30:07.982144+0000","last_became_active":"2024-02-13T00:29:55.895355+0000","last_became_peered":"2024-02-13T00:29:55.895355+0000","last_unstale":"2024-02-13T00:30:07.982144+0000","last_undegraded":"2024-02-13T00:30:07.982144+0000","last_fullsized":"2024-02-13T00:30:07.982144+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.979531+0000","last_change":"2024-02-13T00:29:51.854957+0000","last_active":"2024-02-13T00:30:07.979531+0000","last_peered":"2024-02-13T00:30:07.979531+0000","last_clean":"2024-02-13T00:30:07.979531+0000","last_became_active":"2024-02-13T00:29:51.854578+0000","last_became_peered":"2024-02-13T00:29:51.854578+0000","last_unstale":"2024-02-13T00:30:07.979531+0000","last_undegraded":"2024-02-13T00:30:07.979531+0000","last_fullsized":"2024-02-13T00:30:07.979531+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"60'17","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:08.056513+0000","last_change":"2024-02-13T00:29:53.877645+0000","last_active":"2024-02-13T00:30:08.056513+0000","last_peered":"2024-02-13T00:30:08.056513+0000","last_clean":"2024-02-13T00:30:08.056513+0000","last_became_active":"2024-02-13T00:29:53.877281+0000","last_became_peered":"2024-02-13T00:29:53.877281+0000","last_unstale":"2024-02-13T00:30:08.056513+0000","last_undegraded":"2024-02-13T00:30:08.056513+0000","last_fullsized":"2024-02-13T00:30:08.056513+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.976138+0000","last_change":"2024-02-13T00:29:57.935320+0000","last_active":"2024-02-13T00:30:07.976138+0000","last_peered":"2024-02-13T00:30:07.976138+0000","last_clean":"2024-02-13T00:30:07.976138+0000","last_became_active":"2024-02-13T00:29:57.934843+0000","last_became_peered":"2024-02-13T00:29:57.934843+0000","last_unstale":"2024-02-13T00:30:07.976138+0000","last_undegraded":"2024-02-13T00:30:07.976138+0000","last_fullsized":"2024-02-13T00:30:07.976138+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:08.055426+0000","last_change":"2024-02-13T00:29:55.898057+0000","last_active":"2024-02-13T00:30:08.055426+0000","last_peered":"2024-02-13T00:30:08.055426+0000","last_clean":"2024-02-13T00:30:08.055426+0000","last_became_active":"2024-02-13T00:29:55.897758+0000","last_became_peered":"2024-02-13T00:29:55.897758+0000","last_unstale":"2024-02-13T00:30:08.055426+0000","last_undegraded":"2024-02-13T00:30:08.055426+0000","last_fullsized":"2024-02-13T00:30:08.055426+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.983238+0000","last_change":"2024-02-13T00:29:51.855912+0000","last_active":"2024-02-13T00:30:07.983238+0000","last_peered":"2024-02-13T00:30:07.983238+0000","last_clean":"2024-02-13T00:30:07.983238+0000","last_became_active":"2024-02-13T00:29:51.855519+0000","last_became_peered":"2024-02-13T00:29:51.855519+0000","last_unstale":"2024-02-13T00:30:07.983238+0000","last_undegraded":"2024-02-13T00:30:07.983238+0000","last_fullsized":"2024-02-13T00:30:07.983238+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'4","reported_seq":23,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.979800+0000","last_change":"2024-02-13T00:29:53.878977+0000","last_active":"2024-02-13T00:30:07.979800+0000","last_peered":"2024-02-13T00:30:07.979800+0000","last_clean":"2024-02-13T00:30:07.979800+0000","last_became_active":"2024-02-13T00:29:53.878637+0000","last_became_peered":"2024-02-13T00:29:53.878637+0000","last_unstale":"2024-02-13T00:30:07.979800+0000","last_undegraded":"2024-02-13T00:30:07.979800+0000","last_fullsized":"2024-02-13T00:30:07.979800+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.980997+0000","last_change":"2024-02-13T00:29:57.929499+0000","last_active":"2024-02-13T00:30:07.980997+0000","last_peered":"2024-02-13T00:30:07.980997+0000","last_clean":"2024-02-13T00:30:07.980997+0000","last_became_active":"2024-02-13T00:29:57.929174+0000","last_became_peered":"2024-02-13T00:29:57.929174+0000","last_unstale":"2024-02-13T00:30:07.980997+0000","last_undegraded":"2024-02-13T00:30:07.980997+0000","last_fullsized":"2024-02-13T00:30:07.980997+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.976933+0000","last_change":"2024-02-13T00:29:55.905289+0000","last_active":"2024-02-13T00:30:07.976933+0000","last_peered":"2024-02-13T00:30:07.976933+0000","last_clean":"2024-02-13T00:30:07.976933+0000","last_became_active":"2024-02-13T00:29:55.904946+0000","last_became_peered":"2024-02-13T00:29:55.904946+0000","last_unstale":"2024-02-13T00:30:07.976933+0000","last_undegraded":"2024-02-13T00:30:07.976933+0000","last_fullsized":"2024-02-13T00:30:07.976933+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984569+0000","last_change":"2024-02-13T00:29:51.858907+0000","last_active":"2024-02-13T00:30:07.984569+0000","last_peered":"2024-02-13T00:30:07.984569+0000","last_clean":"2024-02-13T00:30:07.984569+0000","last_became_active":"2024-02-13T00:29:51.858385+0000","last_became_peered":"2024-02-13T00:29:51.858385+0000","last_unstale":"2024-02-13T00:30:07.984569+0000","last_undegraded":"2024-02-13T00:30:07.984569+0000","last_fullsized":"2024-02-13T00:30:07.984569+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"60'17","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.980102+0000","last_change":"2024-02-13T00:29:54.016865+0000","last_active":"2024-02-13T00:30:07.980102+0000","last_peered":"2024-02-13T00:30:07.980102+0000","last_clean":"2024-02-13T00:30:07.980102+0000","last_became_active":"2024-02-13T00:29:54.015668+0000","last_became_peered":"2024-02-13T00:29:54.015668+0000","last_unstale":"2024-02-13T00:30:07.980102+0000","last_undegraded":"2024-02-13T00:30:07.980102+0000","last_fullsized":"2024-02-13T00:30:07.980102+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.977416+0000","last_change":"2024-02-13T00:29:57.931638+0000","last_active":"2024-02-13T00:30:07.977416+0000","last_peered":"2024-02-13T00:30:07.977416+0000","last_clean":"2024-02-13T00:30:07.977416+0000","last_became_active":"2024-02-13T00:29:57.931092+0000","last_became_peered":"2024-02-13T00:29:57.931092+0000","last_unstale":"2024-02-13T00:30:07.977416+0000","last_undegraded":"2024-02-13T00:30:07.977416+0000","last_fullsized":"2024-02-13T00:30:07.977416+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.981131+0000","last_change":"2024-02-13T00:29:55.896819+0000","last_active":"2024-02-13T00:30:07.981131+0000","last_peered":"2024-02-13T00:30:07.981131+0000","last_clean":"2024-02-13T00:30:07.981131+0000","last_became_active":"2024-02-13T00:29:55.896473+0000","last_became_peered":"2024-02-13T00:29:55.896473+0000","last_unstale":"2024-02-13T00:30:07.981131+0000","last_undegraded":"2024-02-13T00:30:07.981131+0000","last_fullsized":"2024-02-13T00:30:07.981131+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.977407+0000","last_change":"2024-02-13T00:29:51.868290+0000","last_active":"2024-02-13T00:30:07.977407+0000","last_peered":"2024-02-13T00:30:07.977407+0000","last_clean":"2024-02-13T00:30:07.977407+0000","last_became_active":"2024-02-13T00:29:51.868004+0000","last_became_peered":"2024-02-13T00:29:51.868004+0000","last_unstale":"2024-02-13T00:30:07.977407+0000","last_undegraded":"2024-02-13T00:30:07.977407+0000","last_fullsized":"2024-02-13T00:30:07.977407+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"60'9","reported_seq":33,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.988319+0000","last_change":"2024-02-13T00:29:53.879698+0000","last_active":"2024-02-13T00:30:07.988319+0000","last_peered":"2024-02-13T00:30:07.988319+0000","last_clean":"2024-02-13T00:30:07.988319+0000","last_became_active":"2024-02-13T00:29:53.879421+0000","last_became_peered":"2024-02-13T00:29:53.879421+0000","last_unstale":"2024-02-13T00:30:07.988319+0000","last_undegraded":"2024-02-13T00:30:07.988319+0000","last_fullsized":"2024-02-13T00:30:07.988319+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.979685+0000","last_change":"2024-02-13T00:29:57.932666+0000","last_active":"2024-02-13T00:30:07.979685+0000","last_peered":"2024-02-13T00:30:07.979685+0000","last_clean":"2024-02-13T00:30:07.979685+0000","last_became_active":"2024-02-13T00:29:57.932343+0000","last_became_peered":"2024-02-13T00:29:57.932343+0000","last_unstale":"2024-02-13T00:30:07.979685+0000","last_undegraded":"2024-02-13T00:30:07.979685+0000","last_fullsized":"2024-02-13T00:30:07.979685+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.988213+0000","last_change":"2024-02-13T00:29:55.899763+0000","last_active":"2024-02-13T00:30:07.988213+0000","last_peered":"2024-02-13T00:30:07.988213+0000","last_clean":"2024-02-13T00:30:07.988213+0000","last_became_active":"2024-02-13T00:29:55.899448+0000","last_became_peered":"2024-02-13T00:29:55.899448+0000","last_unstale":"2024-02-13T00:30:07.988213+0000","last_undegraded":"2024-02-13T00:30:07.988213+0000","last_fullsized":"2024-02-13T00:30:07.988213+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.987006+0000","last_change":"2024-02-13T00:29:51.864947+0000","last_active":"2024-02-13T00:30:07.987006+0000","last_peered":"2024-02-13T00:30:07.987006+0000","last_clean":"2024-02-13T00:30:07.987006+0000","last_became_active":"2024-02-13T00:29:51.864604+0000","last_became_peered":"2024-02-13T00:29:51.864604+0000","last_unstale":"2024-02-13T00:30:07.987006+0000","last_undegraded":"2024-02-13T00:30:07.987006+0000","last_fullsized":"2024-02-13T00:30:07.987006+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"60'11","reported_seq":36,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986869+0000","last_change":"2024-02-13T00:29:53.876604+0000","last_active":"2024-02-13T00:30:07.986869+0000","last_peered":"2024-02-13T00:30:07.986869+0000","last_clean":"2024-02-13T00:30:07.986869+0000","last_became_active":"2024-02-13T00:29:53.876163+0000","last_became_peered":"2024-02-13T00:29:53.876163+0000","last_unstale":"2024-02-13T00:30:07.986869+0000","last_undegraded":"2024-02-13T00:30:07.986869+0000","last_fullsized":"2024-02-13T00:30:07.986869+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.978937+0000","last_change":"2024-02-13T00:29:57.934015+0000","last_active":"2024-02-13T00:30:07.978937+0000","last_peered":"2024-02-13T00:30:07.978937+0000","last_clean":"2024-02-13T00:30:07.978937+0000","last_became_active":"2024-02-13T00:29:57.932501+0000","last_became_peered":"2024-02-13T00:29:57.932501+0000","last_unstale":"2024-02-13T00:30:07.978937+0000","last_undegraded":"2024-02-13T00:30:07.978937+0000","last_fullsized":"2024-02-13T00:30:07.978937+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"60'8","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-02-13T00:34:25.466109+0000","last_change":"2024-02-13T00:29:55.911733+0000","last_active":"2024-02-13T00:34:25.466109+0000","last_peered":"2024-02-13T00:34:25.466109+0000","last_clean":"2024-02-13T00:34:25.466109+0000","last_became_active":"2024-02-13T00:29:55.910910+0000","last_became_peered":"2024-02-13T00:29:55.910910+0000","last_unstale":"2024-02-13T00:34:25.466109+0000","last_undegraded":"2024-02-13T00:34:25.466109+0000","last_fullsized":"2024-02-13T00:34:25.466109+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.976484+0000","last_change":"2024-02-13T00:29:52.061256+0000","last_active":"2024-02-13T00:30:07.976484+0000","last_peered":"2024-02-13T00:30:07.976484+0000","last_clean":"2024-02-13T00:30:07.976484+0000","last_became_active":"2024-02-13T00:29:52.060103+0000","last_became_peered":"2024-02-13T00:29:52.060103+0000","last_unstale":"2024-02-13T00:30:07.976484+0000","last_undegraded":"2024-02-13T00:30:07.976484+0000","last_fullsized":"2024-02-13T00:30:07.976484+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"60'22","reported_seq":62,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.981389+0000","last_change":"2024-02-13T00:29:54.016757+0000","last_active":"2024-02-13T00:30:07.981389+0000","last_peered":"2024-02-13T00:30:07.981389+0000","last_clean":"2024-02-13T00:30:07.981389+0000","last_became_active":"2024-02-13T00:29:54.015923+0000","last_became_peered":"2024-02-13T00:29:54.015923+0000","last_unstale":"2024-02-13T00:30:07.981389+0000","last_undegraded":"2024-02-13T00:30:07.981389+0000","last_fullsized":"2024-02-13T00:30:07.981389+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":32,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.987593+0000","last_change":"2024-02-13T00:29:57.933964+0000","last_active":"2024-02-13T00:30:07.987593+0000","last_peered":"2024-02-13T00:30:07.987593+0000","last_clean":"2024-02-13T00:30:07.987593+0000","last_became_active":"2024-02-13T00:29:57.933656+0000","last_became_peered":"2024-02-13T00:29:57.933656+0000","last_unstale":"2024-02-13T00:30:07.987593+0000","last_undegraded":"2024-02-13T00:30:07.987593+0000","last_fullsized":"2024-02-13T00:30:07.987593+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"60'8","reported_seq":78,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-02-13T00:34:25.465246+0000","last_change":"2024-02-13T00:29:55.893134+0000","last_active":"2024-02-13T00:34:25.465246+0000","last_peered":"2024-02-13T00:34:25.465246+0000","last_clean":"2024-02-13T00:34:25.465246+0000","last_became_active":"2024-02-13T00:29:55.892794+0000","last_became_peered":"2024-02-13T00:29:55.892794+0000","last_unstale":"2024-02-13T00:34:25.465246+0000","last_undegraded":"2024-02-13T00:34:25.465246+0000","last_fullsized":"2024-02-13T00:34:25.465246+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.982395+0000","last_change":"2024-02-13T00:29:51.854860+0000","last_active":"2024-02-13T00:30:07.982395+0000","last_peered":"2024-02-13T00:30:07.982395+0000","last_clean":"2024-02-13T00:30:07.982395+0000","last_became_active":"2024-02-13T00:29:51.854498+0000","last_became_peered":"2024-02-13T00:29:51.854498+0000","last_unstale":"2024-02-13T00:30:07.982395+0000","last_undegraded":"2024-02-13T00:30:07.982395+0000","last_fullsized":"2024-02-13T00:30:07.982395+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"60'15","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984697+0000","last_change":"2024-02-13T00:29:54.018919+0000","last_active":"2024-02-13T00:30:07.984697+0000","last_peered":"2024-02-13T00:30:07.984697+0000","last_clean":"2024-02-13T00:30:07.984697+0000","last_became_active":"2024-02-13T00:29:54.018432+0000","last_became_peered":"2024-02-13T00:29:54.018432+0000","last_unstale":"2024-02-13T00:30:07.984697+0000","last_undegraded":"2024-02-13T00:30:07.984697+0000","last_fullsized":"2024-02-13T00:30:07.984697+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":22,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.982405+0000","last_change":"2024-02-13T00:29:57.933693+0000","last_active":"2024-02-13T00:30:07.982405+0000","last_peered":"2024-02-13T00:30:07.982405+0000","last_clean":"2024-02-13T00:30:07.982405+0000","last_became_active":"2024-02-13T00:29:57.933131+0000","last_became_peered":"2024-02-13T00:29:57.933131+0000","last_unstale":"2024-02-13T00:30:07.982405+0000","last_undegraded":"2024-02-13T00:30:07.982405+0000","last_fullsized":"2024-02-13T00:30:07.982405+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.982256+0000","last_change":"2024-02-13T00:29:55.895202+0000","last_active":"2024-02-13T00:30:07.982256+0000","last_peered":"2024-02-13T00:30:07.982256+0000","last_clean":"2024-02-13T00:30:07.982256+0000","last_became_active":"2024-02-13T00:29:55.894865+0000","last_became_peered":"2024-02-13T00:29:55.894865+0000","last_unstale":"2024-02-13T00:30:07.982256+0000","last_undegraded":"2024-02-13T00:30:07.982256+0000","last_fullsized":"2024-02-13T00:30:07.982256+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.976203+0000","last_change":"2024-02-13T00:29:51.868019+0000","last_active":"2024-02-13T00:30:07.976203+0000","last_peered":"2024-02-13T00:30:07.976203+0000","last_clean":"2024-02-13T00:30:07.976203+0000","last_became_active":"2024-02-13T00:29:51.867725+0000","last_became_peered":"2024-02-13T00:29:51.867725+0000","last_unstale":"2024-02-13T00:30:07.976203+0000","last_undegraded":"2024-02-13T00:30:07.976203+0000","last_fullsized":"2024-02-13T00:30:07.976203+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"60'22","reported_seq":64,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.982003+0000","last_change":"2024-02-13T00:29:54.018581+0000","last_active":"2024-02-13T00:30:07.982003+0000","last_peered":"2024-02-13T00:30:07.982003+0000","last_clean":"2024-02-13T00:30:07.982003+0000","last_became_active":"2024-02-13T00:29:54.018012+0000","last_became_peered":"2024-02-13T00:29:54.018012+0000","last_unstale":"2024-02-13T00:30:07.982003+0000","last_undegraded":"2024-02-13T00:30:07.982003+0000","last_fullsized":"2024-02-13T00:30:07.982003+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.977122+0000","last_change":"2024-02-13T00:29:57.934592+0000","last_active":"2024-02-13T00:30:07.977122+0000","last_peered":"2024-02-13T00:30:07.977122+0000","last_clean":"2024-02-13T00:30:07.977122+0000","last_became_active":"2024-02-13T00:29:57.934195+0000","last_became_peered":"2024-02-13T00:29:57.934195+0000","last_unstale":"2024-02-13T00:30:07.977122+0000","last_undegraded":"2024-02-13T00:30:07.977122+0000","last_fullsized":"2024-02-13T00:30:07.977122+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984694+0000","last_change":"2024-02-13T00:29:55.905190+0000","last_active":"2024-02-13T00:30:07.984694+0000","last_peered":"2024-02-13T00:30:07.984694+0000","last_clean":"2024-02-13T00:30:07.984694+0000","last_became_active":"2024-02-13T00:29:55.904836+0000","last_became_peered":"2024-02-13T00:29:55.904836+0000","last_unstale":"2024-02-13T00:30:07.984694+0000","last_undegraded":"2024-02-13T00:30:07.984694+0000","last_fullsized":"2024-02-13T00:30:07.984694+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:08.055370+0000","last_change":"2024-02-13T00:29:51.853440+0000","last_active":"2024-02-13T00:30:08.055370+0000","last_peered":"2024-02-13T00:30:08.055370+0000","last_clean":"2024-02-13T00:30:08.055370+0000","last_became_active":"2024-02-13T00:29:51.852941+0000","last_became_peered":"2024-02-13T00:29:51.852941+0000","last_unstale":"2024-02-13T00:30:08.055370+0000","last_undegraded":"2024-02-13T00:30:08.055370+0000","last_fullsized":"2024-02-13T00:30:08.055370+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"60'13","reported_seq":61,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:09.216330+0000","last_change":"2024-02-13T00:30:09.216038+0000","last_active":"2024-02-13T00:30:09.216330+0000","last_peered":"2024-02-13T00:30:09.216330+0000","last_clean":"2024-02-13T00:30:09.216330+0000","last_became_active":"2024-02-13T00:30:07.985862+0000","last_became_peered":"2024-02-13T00:30:07.985862+0000","last_unstale":"2024-02-13T00:30:09.216330+0000","last_undegraded":"2024-02-13T00:30:09.216330+0000","last_fullsized":"2024-02-13T00:30:09.216330+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984054+0000","last_change":"2024-02-13T00:29:57.936683+0000","last_active":"2024-02-13T00:30:07.984054+0000","last_peered":"2024-02-13T00:30:07.984054+0000","last_clean":"2024-02-13T00:30:07.984054+0000","last_became_active":"2024-02-13T00:29:57.936306+0000","last_became_peered":"2024-02-13T00:29:57.936306+0000","last_unstale":"2024-02-13T00:30:07.984054+0000","last_undegraded":"2024-02-13T00:30:07.984054+0000","last_fullsized":"2024-02-13T00:30:07.984054+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"53'2","reported_seq":32,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.977636+0000","last_change":"2024-02-13T00:29:51.869126+0000","last_active":"2024-02-13T00:30:07.977636+0000","last_peered":"2024-02-13T00:30:07.977636+0000","last_clean":"2024-02-13T00:30:07.977636+0000","last_became_active":"2024-02-13T00:29:51.868821+0000","last_became_peered":"2024-02-13T00:29:51.868821+0000","last_unstale":"2024-02-13T00:30:07.977636+0000","last_undegraded":"2024-02-13T00:30:07.977636+0000","last_fullsized":"2024-02-13T00:30:07.977636+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"60'27","reported_seq":72,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.983636+0000","last_change":"2024-02-13T00:29:54.019697+0000","last_active":"2024-02-13T00:30:07.983636+0000","last_peered":"2024-02-13T00:30:07.983636+0000","last_clean":"2024-02-13T00:30:07.983636+0000","last_became_active":"2024-02-13T00:29:54.019229+0000","last_became_peered":"2024-02-13T00:29:54.019229+0000","last_unstale":"2024-02-13T00:30:07.983636+0000","last_undegraded":"2024-02-13T00:30:07.983636+0000","last_fullsized":"2024-02-13T00:30:07.983636+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"60'8","reported_seq":78,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-02-13T00:34:25.466067+0000","last_change":"2024-02-13T00:29:55.901899+0000","last_active":"2024-02-13T00:34:25.466067+0000","last_peered":"2024-02-13T00:34:25.466067+0000","last_clean":"2024-02-13T00:34:25.466067+0000","last_became_active":"2024-02-13T00:29:55.899216+0000","last_became_peered":"2024-02-13T00:29:55.899216+0000","last_unstale":"2024-02-13T00:34:25.466067+0000","last_undegraded":"2024-02-13T00:34:25.466067+0000","last_fullsized":"2024-02-13T00:34:25.466067+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.981043+0000","last_change":"2024-02-13T00:29:57.934046+0000","last_active":"2024-02-13T00:30:07.981043+0000","last_peered":"2024-02-13T00:30:07.981043+0000","last_clean":"2024-02-13T00:30:07.981043+0000","last_became_active":"2024-02-13T00:29:57.933582+0000","last_became_peered":"2024-02-13T00:29:57.933582+0000","last_unstale":"2024-02-13T00:30:07.981043+0000","last_undegraded":"2024-02-13T00:30:07.981043+0000","last_fullsized":"2024-02-13T00:30:07.981043+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.977200+0000","last_change":"2024-02-13T00:29:51.869095+0000","last_active":"2024-02-13T00:30:07.977200+0000","last_peered":"2024-02-13T00:30:07.977200+0000","last_clean":"2024-02-13T00:30:07.977200+0000","last_became_active":"2024-02-13T00:29:51.868777+0000","last_became_peered":"2024-02-13T00:29:51.868777+0000","last_unstale":"2024-02-13T00:30:07.977200+0000","last_undegraded":"2024-02-13T00:30:07.977200+0000","last_fullsized":"2024-02-13T00:30:07.977200+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"60'24","reported_seq":70,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986956+0000","last_change":"2024-02-13T00:29:53.881169+0000","last_active":"2024-02-13T00:30:07.986956+0000","last_peered":"2024-02-13T00:30:07.986956+0000","last_clean":"2024-02-13T00:30:07.986956+0000","last_became_active":"2024-02-13T00:29:53.880825+0000","last_became_peered":"2024-02-13T00:29:53.880825+0000","last_unstale":"2024-02-13T00:30:07.986956+0000","last_undegraded":"2024-02-13T00:30:07.986956+0000","last_fullsized":"2024-02-13T00:30:07.986956+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":38,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.977313+0000","last_change":"2024-02-13T00:29:55.897697+0000","last_active":"2024-02-13T00:30:07.977313+0000","last_peered":"2024-02-13T00:30:07.977313+0000","last_clean":"2024-02-13T00:30:07.977313+0000","last_became_active":"2024-02-13T00:29:55.896558+0000","last_became_peered":"2024-02-13T00:29:55.896558+0000","last_unstale":"2024-02-13T00:30:07.977313+0000","last_undegraded":"2024-02-13T00:30:07.977313+0000","last_fullsized":"2024-02-13T00:30:07.977313+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.976552+0000","last_change":"2024-02-13T00:29:57.938950+0000","last_active":"2024-02-13T00:30:07.976552+0000","last_peered":"2024-02-13T00:30:07.976552+0000","last_clean":"2024-02-13T00:30:07.976552+0000","last_became_active":"2024-02-13T00:29:57.938634+0000","last_became_peered":"2024-02-13T00:29:57.938634+0000","last_unstale":"2024-02-13T00:30:07.976552+0000","last_undegraded":"2024-02-13T00:30:07.976552+0000","last_fullsized":"2024-02-13T00:30:07.976552+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.978658+0000","last_change":"2024-02-13T00:29:55.897423+0000","last_active":"2024-02-13T00:30:07.978658+0000","last_peered":"2024-02-13T00:30:07.978658+0000","last_clean":"2024-02-13T00:30:07.978658+0000","last_became_active":"2024-02-13T00:29:55.897017+0000","last_became_peered":"2024-02-13T00:29:55.897017+0000","last_unstale":"2024-02-13T00:30:07.978658+0000","last_undegraded":"2024-02-13T00:30:07.978658+0000","last_fullsized":"2024-02-13T00:30:07.978658+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.978023+0000","last_change":"2024-02-13T00:29:51.866582+0000","last_active":"2024-02-13T00:30:07.978023+0000","last_peered":"2024-02-13T00:30:07.978023+0000","last_clean":"2024-02-13T00:30:07.978023+0000","last_became_active":"2024-02-13T00:29:51.866261+0000","last_became_peered":"2024-02-13T00:29:51.866261+0000","last_unstale":"2024-02-13T00:30:07.978023+0000","last_undegraded":"2024-02-13T00:30:07.978023+0000","last_fullsized":"2024-02-13T00:30:07.978023+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"60'25","reported_seq":63,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:08.055661+0000","last_change":"2024-02-13T00:29:54.018257+0000","last_active":"2024-02-13T00:30:08.055661+0000","last_peered":"2024-02-13T00:30:08.055661+0000","last_clean":"2024-02-13T00:30:08.055661+0000","last_became_active":"2024-02-13T00:29:54.017505+0000","last_became_peered":"2024-02-13T00:29:54.017505+0000","last_unstale":"2024-02-13T00:30:08.055661+0000","last_undegraded":"2024-02-13T00:30:08.055661+0000","last_fullsized":"2024-02-13T00:30:08.055661+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":44,"num_read_kb":32,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.977371+0000","last_change":"2024-02-13T00:29:57.934633+0000","last_active":"2024-02-13T00:30:07.977371+0000","last_peered":"2024-02-13T00:30:07.977371+0000","last_clean":"2024-02-13T00:30:07.977371+0000","last_became_active":"2024-02-13T00:29:57.934147+0000","last_became_peered":"2024-02-13T00:29:57.934147+0000","last_unstale":"2024-02-13T00:30:07.977371+0000","last_undegraded":"2024-02-13T00:30:07.977371+0000","last_fullsized":"2024-02-13T00:30:07.977371+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.978191+0000","last_change":"2024-02-13T00:29:55.891819+0000","last_active":"2024-02-13T00:30:07.978191+0000","last_peered":"2024-02-13T00:30:07.978191+0000","last_clean":"2024-02-13T00:30:07.978191+0000","last_became_active":"2024-02-13T00:29:55.890843+0000","last_became_peered":"2024-02-13T00:29:55.890843+0000","last_unstale":"2024-02-13T00:30:07.978191+0000","last_undegraded":"2024-02-13T00:30:07.978191+0000","last_fullsized":"2024-02-13T00:30:07.978191+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"53'1","reported_seq":25,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984938+0000","last_change":"2024-02-13T00:29:51.855439+0000","last_active":"2024-02-13T00:30:07.984938+0000","last_peered":"2024-02-13T00:30:07.984938+0000","last_clean":"2024-02-13T00:30:07.984938+0000","last_became_active":"2024-02-13T00:29:51.854933+0000","last_became_peered":"2024-02-13T00:29:51.854933+0000","last_unstale":"2024-02-13T00:30:07.984938+0000","last_undegraded":"2024-02-13T00:30:07.984938+0000","last_fullsized":"2024-02-13T00:30:07.984938+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"60'15","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.978588+0000","last_change":"2024-02-13T00:29:53.886296+0000","last_active":"2024-02-13T00:30:07.978588+0000","last_peered":"2024-02-13T00:30:07.978588+0000","last_clean":"2024-02-13T00:30:07.978588+0000","last_became_active":"2024-02-13T00:29:53.885914+0000","last_became_peered":"2024-02-13T00:29:53.885914+0000","last_unstale":"2024-02-13T00:30:07.978588+0000","last_undegraded":"2024-02-13T00:30:07.978588+0000","last_fullsized":"2024-02-13T00:30:07.978588+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":22,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.980316+0000","last_change":"2024-02-13T00:29:57.928794+0000","last_active":"2024-02-13T00:30:07.980316+0000","last_peered":"2024-02-13T00:30:07.980316+0000","last_clean":"2024-02-13T00:30:07.980316+0000","last_became_active":"2024-02-13T00:29:57.928471+0000","last_became_peered":"2024-02-13T00:29:57.928471+0000","last_unstale":"2024-02-13T00:30:07.980316+0000","last_undegraded":"2024-02-13T00:30:07.980316+0000","last_fullsized":"2024-02-13T00:30:07.980316+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.983906+0000","last_change":"2024-02-13T00:29:50.845936+0000","last_active":"2024-02-13T00:30:07.983906+0000","last_peered":"2024-02-13T00:30:07.983906+0000","last_clean":"2024-02-13T00:30:07.983906+0000","last_became_active":"2024-02-13T00:29:50.845548+0000","last_became_peered":"2024-02-13T00:29:50.845548+0000","last_unstale":"2024-02-13T00:30:07.983906+0000","last_undegraded":"2024-02-13T00:30:07.983906+0000","last_fullsized":"2024-02-13T00:30:07.983906+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:49.817545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:49.817545+0000","last_clean_scrub_stamp":"2024-02-13T00:29:49.817545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986512+0000","last_change":"2024-02-13T00:29:51.868180+0000","last_active":"2024-02-13T00:30:07.986512+0000","last_peered":"2024-02-13T00:30:07.986512+0000","last_clean":"2024-02-13T00:30:07.986512+0000","last_became_active":"2024-02-13T00:29:51.867847+0000","last_became_peered":"2024-02-13T00:29:51.867847+0000","last_unstale":"2024-02-13T00:30:07.986512+0000","last_undegraded":"2024-02-13T00:30:07.986512+0000","last_fullsized":"2024-02-13T00:30:07.986512+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"62'35","reported_seq":89,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-02-13T00:34:25.466142+0000","last_change":"2024-02-13T00:30:09.212086+0000","last_active":"2024-02-13T00:34:25.466142+0000","last_peered":"2024-02-13T00:34:25.466142+0000","last_clean":"2024-02-13T00:34:25.466142+0000","last_became_active":"2024-02-13T00:30:07.987864+0000","last_became_peered":"2024-02-13T00:30:07.987864+0000","last_unstale":"2024-02-13T00:34:25.466142+0000","last_undegraded":"2024-02-13T00:34:25.466142+0000","last_fullsized":"2024-02-13T00:34:25.466142+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":60,"num_read_kb":44,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.982672+0000","last_change":"2024-02-13T00:29:55.895518+0000","last_active":"2024-02-13T00:30:07.982672+0000","last_peered":"2024-02-13T00:30:07.982672+0000","last_clean":"2024-02-13T00:30:07.982672+0000","last_became_active":"2024-02-13T00:29:55.894925+0000","last_became_peered":"2024-02-13T00:29:55.894925+0000","last_unstale":"2024-02-13T00:30:07.982672+0000","last_undegraded":"2024-02-13T00:30:07.982672+0000","last_fullsized":"2024-02-13T00:30:07.982672+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"60'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.978459+0000","last_change":"2024-02-13T00:29:57.935922+0000","last_active":"2024-02-13T00:30:07.978459+0000","last_peered":"2024-02-13T00:30:07.978459+0000","last_clean":"2024-02-13T00:30:07.978459+0000","last_became_active":"2024-02-13T00:29:57.935576+0000","last_became_peered":"2024-02-13T00:29:57.935576+0000","last_unstale":"2024-02-13T00:30:07.978459+0000","last_undegraded":"2024-02-13T00:30:07.978459+0000","last_fullsized":"2024-02-13T00:30:07.978459+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.987068+0000","last_change":"2024-02-13T00:29:52.058691+0000","last_active":"2024-02-13T00:30:07.987068+0000","last_peered":"2024-02-13T00:30:07.987068+0000","last_clean":"2024-02-13T00:30:07.987068+0000","last_became_active":"2024-02-13T00:29:52.057462+0000","last_became_peered":"2024-02-13T00:29:52.057462+0000","last_unstale":"2024-02-13T00:30:07.987068+0000","last_undegraded":"2024-02-13T00:30:07.987068+0000","last_fullsized":"2024-02-13T00:30:07.987068+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.981462+0000","last_change":"2024-02-13T00:29:50.846750+0000","last_active":"2024-02-13T00:30:07.981462+0000","last_peered":"2024-02-13T00:30:07.981462+0000","last_clean":"2024-02-13T00:30:07.981462+0000","last_became_active":"2024-02-13T00:29:50.846411+0000","last_became_peered":"2024-02-13T00:29:50.846411+0000","last_unstale":"2024-02-13T00:30:07.981462+0000","last_undegraded":"2024-02-13T00:30:07.981462+0000","last_fullsized":"2024-02-13T00:30:07.981462+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:49.817545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:49.817545+0000","last_clean_scrub_stamp":"2024-02-13T00:29:49.817545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'19","reported_seq":59,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.988859+0000","last_change":"2024-02-13T00:29:53.885430+0000","last_active":"2024-02-13T00:30:07.988859+0000","last_peered":"2024-02-13T00:30:07.988859+0000","last_clean":"2024-02-13T00:30:07.988859+0000","last_became_active":"2024-02-13T00:29:53.884985+0000","last_became_peered":"2024-02-13T00:29:53.884985+0000","last_unstale":"2024-02-13T00:30:07.988859+0000","last_undegraded":"2024-02-13T00:30:07.988859+0000","last_fullsized":"2024-02-13T00:30:07.988859+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":42,"num_read_kb":30,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.979271+0000","last_change":"2024-02-13T00:29:55.901379+0000","last_active":"2024-02-13T00:30:07.979271+0000","last_peered":"2024-02-13T00:30:07.979271+0000","last_clean":"2024-02-13T00:30:07.979271+0000","last_became_active":"2024-02-13T00:29:55.901059+0000","last_became_peered":"2024-02-13T00:29:55.901059+0000","last_unstale":"2024-02-13T00:30:07.979271+0000","last_undegraded":"2024-02-13T00:30:07.979271+0000","last_fullsized":"2024-02-13T00:30:07.979271+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.985089+0000","last_change":"2024-02-13T00:29:57.937448+0000","last_active":"2024-02-13T00:30:07.985089+0000","last_peered":"2024-02-13T00:30:07.985089+0000","last_clean":"2024-02-13T00:30:07.985089+0000","last_became_active":"2024-02-13T00:29:57.936964+0000","last_became_peered":"2024-02-13T00:29:57.936964+0000","last_unstale":"2024-02-13T00:30:07.985089+0000","last_undegraded":"2024-02-13T00:30:07.985089+0000","last_fullsized":"2024-02-13T00:30:07.985089+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":23,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.976383+0000","last_change":"2024-02-13T00:29:37.888561+0000","last_active":"2024-02-13T00:30:07.976383+0000","last_peered":"2024-02-13T00:30:07.976383+0000","last_clean":"2024-02-13T00:30:07.976383+0000","last_became_active":"2024-02-13T00:29:37.888117+0000","last_became_peered":"2024-02-13T00:29:37.888117+0000","last_unstale":"2024-02-13T00:30:07.976383+0000","last_undegraded":"2024-02-13T00:30:07.976383+0000","last_fullsized":"2024-02-13T00:30:07.976383+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:26:05.557302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:26:05.557302+0000","last_clean_scrub_stamp":"2024-02-13T00:26:05.557302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.981759+0000","last_change":"2024-02-13T00:29:51.857680+0000","last_active":"2024-02-13T00:30:07.981759+0000","last_peered":"2024-02-13T00:30:07.981759+0000","last_clean":"2024-02-13T00:30:07.981759+0000","last_became_active":"2024-02-13T00:29:51.857468+0000","last_became_peered":"2024-02-13T00:29:51.857468+0000","last_unstale":"2024-02-13T00:30:07.981759+0000","last_undegraded":"2024-02-13T00:30:07.981759+0000","last_fullsized":"2024-02-13T00:30:07.981759+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"60'14","reported_seq":39,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:08.056309+0000","last_change":"2024-02-13T00:29:54.018984+0000","last_active":"2024-02-13T00:30:08.056309+0000","last_peered":"2024-02-13T00:30:08.056309+0000","last_clean":"2024-02-13T00:30:08.056309+0000","last_became_active":"2024-02-13T00:29:54.018382+0000","last_became_peered":"2024-02-13T00:29:54.018382+0000","last_unstale":"2024-02-13T00:30:08.056309+0000","last_undegraded":"2024-02-13T00:30:08.056309+0000","last_fullsized":"2024-02-13T00:30:08.056309+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.977076+0000","last_change":"2024-02-13T00:29:55.902784+0000","last_active":"2024-02-13T00:30:07.977076+0000","last_peered":"2024-02-13T00:30:07.977076+0000","last_clean":"2024-02-13T00:30:07.977076+0000","last_became_active":"2024-02-13T00:29:55.902462+0000","last_became_peered":"2024-02-13T00:29:55.902462+0000","last_unstale":"2024-02-13T00:30:07.977076+0000","last_undegraded":"2024-02-13T00:30:07.977076+0000","last_fullsized":"2024-02-13T00:30:07.977076+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.988444+0000","last_change":"2024-02-13T00:29:57.932098+0000","last_active":"2024-02-13T00:30:07.988444+0000","last_peered":"2024-02-13T00:30:07.988444+0000","last_clean":"2024-02-13T00:30:07.988444+0000","last_became_active":"2024-02-13T00:29:57.931446+0000","last_became_peered":"2024-02-13T00:29:57.931446+0000","last_unstale":"2024-02-13T00:30:07.988444+0000","last_undegraded":"2024-02-13T00:30:07.988444+0000","last_fullsized":"2024-02-13T00:30:07.988444+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.977866+0000","last_change":"2024-02-13T00:29:51.860807+0000","last_active":"2024-02-13T00:30:07.977866+0000","last_peered":"2024-02-13T00:30:07.977866+0000","last_clean":"2024-02-13T00:30:07.977866+0000","last_became_active":"2024-02-13T00:29:51.860442+0000","last_became_peered":"2024-02-13T00:29:51.860442+0000","last_unstale":"2024-02-13T00:30:07.977866+0000","last_undegraded":"2024-02-13T00:30:07.977866+0000","last_fullsized":"2024-02-13T00:30:07.977866+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"60'5","reported_seq":294,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-02-13T00:34:30.864246+0000","last_change":"2024-02-13T00:29:50.846585+0000","last_active":"2024-02-13T00:34:30.864246+0000","last_peered":"2024-02-13T00:34:30.864246+0000","last_clean":"2024-02-13T00:34:30.864246+0000","last_became_active":"2024-02-13T00:29:50.846275+0000","last_became_peered":"2024-02-13T00:29:50.846275+0000","last_unstale":"2024-02-13T00:34:30.864246+0000","last_undegraded":"2024-02-13T00:34:30.864246+0000","last_fullsized":"2024-02-13T00:34:30.864246+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:49.817545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:49.817545+0000","last_clean_scrub_stamp":"2024-02-13T00:29:49.817545+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":271,"num_read_kb":266,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"60'12","reported_seq":35,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.979133+0000","last_change":"2024-02-13T00:29:53.887970+0000","last_active":"2024-02-13T00:30:07.979133+0000","last_peered":"2024-02-13T00:30:07.979133+0000","last_clean":"2024-02-13T00:30:07.979133+0000","last_became_active":"2024-02-13T00:29:53.887543+0000","last_became_peered":"2024-02-13T00:29:53.887543+0000","last_unstale":"2024-02-13T00:30:07.979133+0000","last_undegraded":"2024-02-13T00:30:07.979133+0000","last_fullsized":"2024-02-13T00:30:07.979133+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984954+0000","last_change":"2024-02-13T00:29:55.911189+0000","last_active":"2024-02-13T00:30:07.984954+0000","last_peered":"2024-02-13T00:30:07.984954+0000","last_clean":"2024-02-13T00:30:07.984954+0000","last_became_active":"2024-02-13T00:29:55.910875+0000","last_became_peered":"2024-02-13T00:29:55.910875+0000","last_unstale":"2024-02-13T00:30:07.984954+0000","last_undegraded":"2024-02-13T00:30:07.984954+0000","last_fullsized":"2024-02-13T00:30:07.984954+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986033+0000","last_change":"2024-02-13T00:29:57.930686+0000","last_active":"2024-02-13T00:30:07.986033+0000","last_peered":"2024-02-13T00:30:07.986033+0000","last_clean":"2024-02-13T00:30:07.986033+0000","last_became_active":"2024-02-13T00:29:57.929832+0000","last_became_peered":"2024-02-13T00:29:57.929832+0000","last_unstale":"2024-02-13T00:30:07.986033+0000","last_undegraded":"2024-02-13T00:30:07.986033+0000","last_fullsized":"2024-02-13T00:30:07.986033+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.988654+0000","last_change":"2024-02-13T00:29:52.059620+0000","last_active":"2024-02-13T00:30:07.988654+0000","last_peered":"2024-02-13T00:30:07.988654+0000","last_clean":"2024-02-13T00:30:07.988654+0000","last_became_active":"2024-02-13T00:29:52.058839+0000","last_became_peered":"2024-02-13T00:29:52.058839+0000","last_unstale":"2024-02-13T00:30:07.988654+0000","last_undegraded":"2024-02-13T00:30:07.988654+0000","last_fullsized":"2024-02-13T00:30:07.988654+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'25","reported_seq":68,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.979053+0000","last_change":"2024-02-13T00:29:54.016402+0000","last_active":"2024-02-13T00:30:07.979053+0000","last_peered":"2024-02-13T00:30:07.979053+0000","last_clean":"2024-02-13T00:30:07.979053+0000","last_became_active":"2024-02-13T00:29:54.015628+0000","last_became_peered":"2024-02-13T00:29:54.015628+0000","last_unstale":"2024-02-13T00:30:07.979053+0000","last_undegraded":"2024-02-13T00:30:07.979053+0000","last_fullsized":"2024-02-13T00:30:07.979053+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:08.055813+0000","last_change":"2024-02-13T00:29:55.907774+0000","last_active":"2024-02-13T00:30:08.055813+0000","last_peered":"2024-02-13T00:30:08.055813+0000","last_clean":"2024-02-13T00:30:08.055813+0000","last_became_active":"2024-02-13T00:29:55.907450+0000","last_became_peered":"2024-02-13T00:29:55.907450+0000","last_unstale":"2024-02-13T00:30:08.055813+0000","last_undegraded":"2024-02-13T00:30:08.055813+0000","last_fullsized":"2024-02-13T00:30:08.055813+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.977634+0000","last_change":"2024-02-13T00:29:57.933515+0000","last_active":"2024-02-13T00:30:07.977634+0000","last_peered":"2024-02-13T00:30:07.977634+0000","last_clean":"2024-02-13T00:30:07.977634+0000","last_became_active":"2024-02-13T00:29:57.933159+0000","last_became_peered":"2024-02-13T00:29:57.933159+0000","last_unstale":"2024-02-13T00:30:07.977634+0000","last_undegraded":"2024-02-13T00:30:07.977634+0000","last_fullsized":"2024-02-13T00:30:07.977634+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984673+0000","last_change":"2024-02-13T00:29:52.059873+0000","last_active":"2024-02-13T00:30:07.984673+0000","last_peered":"2024-02-13T00:30:07.984673+0000","last_clean":"2024-02-13T00:30:07.984673+0000","last_became_active":"2024-02-13T00:29:52.059460+0000","last_became_peered":"2024-02-13T00:29:52.059460+0000","last_unstale":"2024-02-13T00:30:07.984673+0000","last_undegraded":"2024-02-13T00:30:07.984673+0000","last_fullsized":"2024-02-13T00:30:07.984673+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"60'16","reported_seq":47,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.988232+0000","last_change":"2024-02-13T00:29:53.885962+0000","last_active":"2024-02-13T00:30:07.988232+0000","last_peered":"2024-02-13T00:30:07.988232+0000","last_clean":"2024-02-13T00:30:07.988232+0000","last_became_active":"2024-02-13T00:29:53.885452+0000","last_became_peered":"2024-02-13T00:29:53.885452+0000","last_unstale":"2024-02-13T00:30:07.988232+0000","last_undegraded":"2024-02-13T00:30:07.988232+0000","last_fullsized":"2024-02-13T00:30:07.988232+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"60'8","reported_seq":78,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-02-13T00:34:25.464866+0000","last_change":"2024-02-13T00:29:55.894896+0000","last_active":"2024-02-13T00:34:25.464866+0000","last_peered":"2024-02-13T00:34:25.464866+0000","last_clean":"2024-02-13T00:34:25.464866+0000","last_became_active":"2024-02-13T00:29:55.894537+0000","last_became_peered":"2024-02-13T00:29:55.894537+0000","last_unstale":"2024-02-13T00:34:25.464866+0000","last_undegraded":"2024-02-13T00:34:25.464866+0000","last_fullsized":"2024-02-13T00:34:25.464866+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.976745+0000","last_change":"2024-02-13T00:29:57.933576+0000","last_active":"2024-02-13T00:30:07.976745+0000","last_peered":"2024-02-13T00:30:07.976745+0000","last_clean":"2024-02-13T00:30:07.976745+0000","last_became_active":"2024-02-13T00:29:57.933073+0000","last_became_peered":"2024-02-13T00:29:57.933073+0000","last_unstale":"2024-02-13T00:30:07.976745+0000","last_undegraded":"2024-02-13T00:30:07.976745+0000","last_fullsized":"2024-02-13T00:30:07.976745+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.979324+0000","last_change":"2024-02-13T00:29:51.860843+0000","last_active":"2024-02-13T00:30:07.979324+0000","last_peered":"2024-02-13T00:30:07.979324+0000","last_clean":"2024-02-13T00:30:07.979324+0000","last_became_active":"2024-02-13T00:29:51.860440+0000","last_became_peered":"2024-02-13T00:29:51.860440+0000","last_unstale":"2024-02-13T00:30:07.979324+0000","last_undegraded":"2024-02-13T00:30:07.979324+0000","last_fullsized":"2024-02-13T00:30:07.979324+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"60'20","reported_seq":53,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986982+0000","last_change":"2024-02-13T00:29:53.876878+0000","last_active":"2024-02-13T00:30:07.986982+0000","last_peered":"2024-02-13T00:30:07.986982+0000","last_clean":"2024-02-13T00:30:07.986982+0000","last_became_active":"2024-02-13T00:29:53.876518+0000","last_became_peered":"2024-02-13T00:29:53.876518+0000","last_unstale":"2024-02-13T00:30:07.986982+0000","last_undegraded":"2024-02-13T00:30:07.986982+0000","last_fullsized":"2024-02-13T00:30:07.986982+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"60'8","reported_seq":78,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-02-13T00:34:25.465092+0000","last_change":"2024-02-13T00:29:55.894408+0000","last_active":"2024-02-13T00:34:25.465092+0000","last_peered":"2024-02-13T00:34:25.465092+0000","last_clean":"2024-02-13T00:34:25.465092+0000","last_became_active":"2024-02-13T00:29:55.894099+0000","last_became_peered":"2024-02-13T00:29:55.894099+0000","last_unstale":"2024-02-13T00:34:25.465092+0000","last_undegraded":"2024-02-13T00:34:25.465092+0000","last_fullsized":"2024-02-13T00:34:25.465092+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986346+0000","last_change":"2024-02-13T00:29:57.932671+0000","last_active":"2024-02-13T00:30:07.986346+0000","last_peered":"2024-02-13T00:30:07.986346+0000","last_clean":"2024-02-13T00:30:07.986346+0000","last_became_active":"2024-02-13T00:29:57.932347+0000","last_became_peered":"2024-02-13T00:29:57.932347+0000","last_unstale":"2024-02-13T00:30:07.986346+0000","last_undegraded":"2024-02-13T00:30:07.986346+0000","last_fullsized":"2024-02-13T00:30:07.986346+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"53'1","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.982048+0000","last_change":"2024-02-13T00:29:51.861926+0000","last_active":"2024-02-13T00:30:07.982048+0000","last_peered":"2024-02-13T00:30:07.982048+0000","last_clean":"2024-02-13T00:30:07.982048+0000","last_became_active":"2024-02-13T00:29:51.861557+0000","last_became_peered":"2024-02-13T00:29:51.861557+0000","last_unstale":"2024-02-13T00:30:07.982048+0000","last_undegraded":"2024-02-13T00:30:07.982048+0000","last_fullsized":"2024-02-13T00:30:07.982048+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"60'30","reported_seq":79,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.979961+0000","last_change":"2024-02-13T00:29:54.018457+0000","last_active":"2024-02-13T00:30:07.979961+0000","last_peered":"2024-02-13T00:30:07.979961+0000","last_clean":"2024-02-13T00:30:07.979961+0000","last_became_active":"2024-02-13T00:29:54.016352+0000","last_became_peered":"2024-02-13T00:29:54.016352+0000","last_unstale":"2024-02-13T00:30:07.979961+0000","last_undegraded":"2024-02-13T00:30:07.979961+0000","last_fullsized":"2024-02-13T00:30:07.979961+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":44,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986221+0000","last_change":"2024-02-13T00:29:55.896701+0000","last_active":"2024-02-13T00:30:07.986221+0000","last_peered":"2024-02-13T00:30:07.986221+0000","last_clean":"2024-02-13T00:30:07.986221+0000","last_became_active":"2024-02-13T00:29:55.895978+0000","last_became_peered":"2024-02-13T00:29:55.895978+0000","last_unstale":"2024-02-13T00:30:07.986221+0000","last_undegraded":"2024-02-13T00:30:07.986221+0000","last_fullsized":"2024-02-13T00:30:07.986221+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984317+0000","last_change":"2024-02-13T00:29:57.938930+0000","last_active":"2024-02-13T00:30:07.984317+0000","last_peered":"2024-02-13T00:30:07.984317+0000","last_clean":"2024-02-13T00:30:07.984317+0000","last_became_active":"2024-02-13T00:29:57.938451+0000","last_became_peered":"2024-02-13T00:29:57.938451+0000","last_unstale":"2024-02-13T00:30:07.984317+0000","last_undegraded":"2024-02-13T00:30:07.984317+0000","last_fullsized":"2024-02-13T00:30:07.984317+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"60'8","reported_seq":78,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-02-13T00:34:25.466042+0000","last_change":"2024-02-13T00:29:55.905253+0000","last_active":"2024-02-13T00:34:25.466042+0000","last_peered":"2024-02-13T00:34:25.466042+0000","last_clean":"2024-02-13T00:34:25.466042+0000","last_became_active":"2024-02-13T00:29:55.905024+0000","last_became_peered":"2024-02-13T00:29:55.905024+0000","last_unstale":"2024-02-13T00:34:25.466042+0000","last_undegraded":"2024-02-13T00:34:25.466042+0000","last_fullsized":"2024-02-13T00:34:25.466042+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.981835+0000","last_change":"2024-02-13T00:29:51.862577+0000","last_active":"2024-02-13T00:30:07.981835+0000","last_peered":"2024-02-13T00:30:07.981835+0000","last_clean":"2024-02-13T00:30:07.981835+0000","last_became_active":"2024-02-13T00:29:51.862174+0000","last_became_peered":"2024-02-13T00:29:51.862174+0000","last_unstale":"2024-02-13T00:30:07.981835+0000","last_undegraded":"2024-02-13T00:30:07.981835+0000","last_fullsized":"2024-02-13T00:30:07.981835+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"60'15","reported_seq":27,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:09.194458+0000","last_change":"2024-02-13T00:30:09.194008+0000","last_active":"2024-02-13T00:30:09.194458+0000","last_peered":"2024-02-13T00:30:09.194458+0000","last_clean":"2024-02-13T00:30:09.194458+0000","last_became_active":"2024-02-13T00:30:07.986058+0000","last_became_peered":"2024-02-13T00:30:07.986058+0000","last_unstale":"2024-02-13T00:30:09.194458+0000","last_undegraded":"2024-02-13T00:30:09.194458+0000","last_fullsized":"2024-02-13T00:30:09.194458+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.981306+0000","last_change":"2024-02-13T00:29:57.935164+0000","last_active":"2024-02-13T00:30:07.981306+0000","last_peered":"2024-02-13T00:30:07.981306+0000","last_clean":"2024-02-13T00:30:07.981306+0000","last_became_active":"2024-02-13T00:29:57.934643+0000","last_became_peered":"2024-02-13T00:29:57.934643+0000","last_unstale":"2024-02-13T00:30:07.981306+0000","last_undegraded":"2024-02-13T00:30:07.981306+0000","last_fullsized":"2024-02-13T00:30:07.981306+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984878+0000","last_change":"2024-02-13T00:29:55.908938+0000","last_active":"2024-02-13T00:30:07.984878+0000","last_peered":"2024-02-13T00:30:07.984878+0000","last_clean":"2024-02-13T00:30:07.984878+0000","last_became_active":"2024-02-13T00:29:55.908549+0000","last_became_peered":"2024-02-13T00:29:55.908549+0000","last_unstale":"2024-02-13T00:30:07.984878+0000","last_undegraded":"2024-02-13T00:30:07.984878+0000","last_fullsized":"2024-02-13T00:30:07.984878+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986460+0000","last_change":"2024-02-13T00:29:52.060739+0000","last_active":"2024-02-13T00:30:07.986460+0000","last_peered":"2024-02-13T00:30:07.986460+0000","last_clean":"2024-02-13T00:30:07.986460+0000","last_became_active":"2024-02-13T00:29:52.059723+0000","last_became_peered":"2024-02-13T00:29:52.059723+0000","last_unstale":"2024-02-13T00:30:07.986460+0000","last_undegraded":"2024-02-13T00:30:07.986460+0000","last_fullsized":"2024-02-13T00:30:07.986460+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"60'17","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.987306+0000","last_change":"2024-02-13T00:29:53.876749+0000","last_active":"2024-02-13T00:30:07.987306+0000","last_peered":"2024-02-13T00:30:07.987306+0000","last_clean":"2024-02-13T00:30:07.987306+0000","last_became_active":"2024-02-13T00:29:53.876306+0000","last_became_peered":"2024-02-13T00:29:53.876306+0000","last_unstale":"2024-02-13T00:30:07.987306+0000","last_undegraded":"2024-02-13T00:30:07.987306+0000","last_fullsized":"2024-02-13T00:30:07.987306+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.980921+0000","last_change":"2024-02-13T00:29:57.936114+0000","last_active":"2024-02-13T00:30:07.980921+0000","last_peered":"2024-02-13T00:30:07.980921+0000","last_clean":"2024-02-13T00:30:07.980921+0000","last_became_active":"2024-02-13T00:29:57.935637+0000","last_became_peered":"2024-02-13T00:29:57.935637+0000","last_unstale":"2024-02-13T00:30:07.980921+0000","last_undegraded":"2024-02-13T00:30:07.980921+0000","last_fullsized":"2024-02-13T00:30:07.980921+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.990444+0000","last_change":"2024-02-13T00:29:55.900894+0000","last_active":"2024-02-13T00:30:07.990444+0000","last_peered":"2024-02-13T00:30:07.990444+0000","last_clean":"2024-02-13T00:30:07.990444+0000","last_became_active":"2024-02-13T00:29:55.900523+0000","last_became_peered":"2024-02-13T00:29:55.900523+0000","last_unstale":"2024-02-13T00:30:07.990444+0000","last_undegraded":"2024-02-13T00:30:07.990444+0000","last_fullsized":"2024-02-13T00:30:07.990444+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:08.055784+0000","last_change":"2024-02-13T00:29:51.862699+0000","last_active":"2024-02-13T00:30:08.055784+0000","last_peered":"2024-02-13T00:30:08.055784+0000","last_clean":"2024-02-13T00:30:08.055784+0000","last_became_active":"2024-02-13T00:29:51.862376+0000","last_became_peered":"2024-02-13T00:29:51.862376+0000","last_unstale":"2024-02-13T00:30:08.055784+0000","last_undegraded":"2024-02-13T00:30:08.055784+0000","last_fullsized":"2024-02-13T00:30:08.055784+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"60'17","reported_seq":45,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.988212+0000","last_change":"2024-02-13T00:29:53.881759+0000","last_active":"2024-02-13T00:30:07.988212+0000","last_peered":"2024-02-13T00:30:07.988212+0000","last_clean":"2024-02-13T00:30:07.988212+0000","last_became_active":"2024-02-13T00:29:53.881426+0000","last_became_peered":"2024-02-13T00:29:53.881426+0000","last_unstale":"2024-02-13T00:30:07.988212+0000","last_undegraded":"2024-02-13T00:30:07.988212+0000","last_fullsized":"2024-02-13T00:30:07.988212+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.987486+0000","last_change":"2024-02-13T00:29:57.938135+0000","last_active":"2024-02-13T00:30:07.987486+0000","last_peered":"2024-02-13T00:30:07.987486+0000","last_clean":"2024-02-13T00:30:07.987486+0000","last_became_active":"2024-02-13T00:29:57.937808+0000","last_became_peered":"2024-02-13T00:29:57.937808+0000","last_unstale":"2024-02-13T00:30:07.987486+0000","last_undegraded":"2024-02-13T00:30:07.987486+0000","last_fullsized":"2024-02-13T00:30:07.987486+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"60'8","reported_seq":78,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-02-13T00:34:25.465028+0000","last_change":"2024-02-13T00:29:55.902644+0000","last_active":"2024-02-13T00:34:25.465028+0000","last_peered":"2024-02-13T00:34:25.465028+0000","last_clean":"2024-02-13T00:34:25.465028+0000","last_became_active":"2024-02-13T00:29:55.902213+0000","last_became_peered":"2024-02-13T00:29:55.902213+0000","last_unstale":"2024-02-13T00:34:25.465028+0000","last_undegraded":"2024-02-13T00:34:25.465028+0000","last_fullsized":"2024-02-13T00:34:25.465028+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.981173+0000","last_change":"2024-02-13T00:29:51.858677+0000","last_active":"2024-02-13T00:30:07.981173+0000","last_peered":"2024-02-13T00:30:07.981173+0000","last_clean":"2024-02-13T00:30:07.981173+0000","last_became_active":"2024-02-13T00:29:51.858230+0000","last_became_peered":"2024-02-13T00:29:51.858230+0000","last_unstale":"2024-02-13T00:30:07.981173+0000","last_undegraded":"2024-02-13T00:30:07.981173+0000","last_fullsized":"2024-02-13T00:30:07.981173+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"60'10","reported_seq":32,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986733+0000","last_change":"2024-02-13T00:29:53.881168+0000","last_active":"2024-02-13T00:30:07.986733+0000","last_peered":"2024-02-13T00:30:07.986733+0000","last_clean":"2024-02-13T00:30:07.986733+0000","last_became_active":"2024-02-13T00:29:53.880821+0000","last_became_peered":"2024-02-13T00:29:53.880821+0000","last_unstale":"2024-02-13T00:30:07.986733+0000","last_undegraded":"2024-02-13T00:30:07.986733+0000","last_fullsized":"2024-02-13T00:30:07.986733+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":209,"num_object_clones":0,"num_object_copies":627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":209,"num_whiteouts":0,"num_read":1082,"num_read_kb":807,"num_write":609,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":468,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":586,"ondisk_log_size":586,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":271,"num_read_kb":266,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":48,"seq":206158430270,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297788,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447364,"statfs":{"total":95995035648,"available":95690100736,"internally_reserved":0,"allocated":708608,"data_stored":289107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 00:33:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.83899999999999997,"15min":0.81999999999999995},"min":{"1min":0.63400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.89100000000000001,"15min":0.83299999999999996},"min":{"1min":0.60299999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.236,"5min":1.333,"15min":1.333},"last":0.872}]},{"osd":1,"last update":"Tue Feb 13 00:33:44 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.90000000000000002,"15min":0.88600000000000001},"min":{"1min":0.63600000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.008,"5min":0.92700000000000005,"15min":0.89000000000000001},"min":{"1min":0.73499999999999999,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2110000000000001,"5min":1.302,"15min":1.302},"last":0.70099999999999996}]},{"osd":2,"last update":"Tue Feb 13 00:33:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.90300000000000002,"15min":0.873},"min":{"1min":0.69299999999999995,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":1.006},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.93000000000000005,"15min":0.90400000000000003},"min":{"1min":0.73499999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3049999999999999,"5min":1.387,"15min":1.387},"last":1.0580000000000001}]},{"osd":3,"last update":"Tue Feb 13 00:33:44 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.871,"15min":0.86799999999999999},"min":{"1min":0.71199999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.113,"5min":1.204,"15min":1.204},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.006,"5min":0.94899999999999995,"15min":0.93700000000000006},"min":{"1min":0.77600000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.284,"5min":1.339,"15min":1.339},"last":1.081}]},{"osd":4,"last update":"Tue Feb 13 00:33:44 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.92000000000000004,"15min":0.84299999999999997},"min":{"1min":0.623,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.282,"5min":1.627,"15min":1.627},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.86099999999999999,"15min":0.80000000000000004},"min":{"1min":0.61499999999999999,"5min":0.433,"15min":0.433},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":1.034}]},{"osd":5,"last update":"Tue Feb 13 00:33:44 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.91000000000000003,"15min":0.85399999999999998},"min":{"1min":0.72699999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.748},{"interface":"front","average":{"1min":1.091,"5min":0.98599999999999999,"15min":0.90600000000000003},"min":{"1min":0.88300000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3999999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.96499999999999997}]},{"osd":6,"last update":"Tue Feb 13 00:33:44 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":0.996,"15min":0.92000000000000004},"min":{"1min":0.83399999999999996,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3740000000000001,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.0509999999999999,"15min":0.95599999999999996},"min":{"1min":0.93200000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4790000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.1399999999999999}]}]},{"osd":6,"up_from":42,"seq":180388626502,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297760,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447392,"statfs":{"total":95995035648,"available":95690129408,"internally_reserved":0,"allocated":679936,"data_stored":287207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 00:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.84799999999999998,"15min":0.85199999999999998},"min":{"1min":0.55100000000000005,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.82699999999999996,"15min":0.81499999999999995},"min":{"1min":0.58799999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.165,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.88200000000000001}]},{"osd":1,"last update":"Tue Feb 13 00:34:04 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.93500000000000005,"15min":0.92100000000000004},"min":{"1min":0.50800000000000001,"5min":0.308,"15min":0.308},"max":{"1min":1.2569999999999999,"5min":1.427,"15min":1.427},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.90600000000000003,"15min":0.93600000000000005},"min":{"1min":0.65700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0780000000000001,"5min":1.419,"15min":1.419},"last":1.1279999999999999}]},{"osd":2,"last update":"Tue Feb 13 00:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.84999999999999998,"15min":0.86399999999999999},"min":{"1min":0.60699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1879999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.86299999999999999,"15min":0.85899999999999999},"min":{"1min":0.69899999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0800000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":1.0669999999999999}]},{"osd":3,"last update":"Tue Feb 13 00:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.90800000000000003,"15min":0.91500000000000004},"min":{"1min":0.65700000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.2569999999999999,"5min":1.296,"15min":1.296},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.72399999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1120000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.96499999999999997}]},{"osd":4,"last update":"Tue Feb 13 00:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.81399999999999995,"15min":0.74199999999999999},"min":{"1min":0.63500000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.2749999999999999,"5min":1.288,"15min":1.288},"last":0.997},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.86699999999999999,"15min":0.79600000000000004},"min":{"1min":0.66100000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.3740000000000001,"5min":1.415,"15min":1.415},"last":1.095}]},{"osd":5,"last update":"Tue Feb 13 00:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.875,"15min":0.79900000000000004},"min":{"1min":0.61699999999999999,"5min":0.434,"15min":0.434},"max":{"1min":1.2030000000000001,"5min":1.22,"15min":1.22},"last":1.155},{"interface":"front","average":{"1min":1.0509999999999999,"5min":0.92700000000000005,"15min":0.86799999999999999},"min":{"1min":0.76700000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.177}]},{"osd":7,"last update":"Tue Feb 13 00:33:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.91000000000000003,"15min":0.83899999999999997},"min":{"1min":0.68700000000000006,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":1.244},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.02,"15min":0.98399999999999999},"min":{"1min":0.84299999999999997,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.232}]}]},{"osd":1,"up_from":13,"seq":55834574959,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297788,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447364,"statfs":{"total":95995035648,"available":95690100736,"internally_reserved":0,"allocated":708608,"data_stored":288061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 00:33:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.68600000000000005,"15min":0.57199999999999995},"min":{"1min":0.47299999999999998,"5min":0.40899999999999997,"15min":0.33000000000000002},"max":{"1min":0.88800000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73199999999999998,"15min":0.59899999999999998},"min":{"1min":0.51600000000000001,"5min":0.38100000000000001,"15min":0.34200000000000003},"max":{"1min":0.96499999999999997,"5min":1.294,"15min":1.294},"last":0.81299999999999994}]},{"osd":2,"last update":"Tue Feb 13 00:34:19 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.751,"15min":0.69699999999999995},"min":{"1min":0.57199999999999995,"5min":0.47299999999999998,"15min":0.39800000000000002},"max":{"1min":1.0069999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.755,"15min":0.69799999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.41399999999999998},"max":{"1min":1.147,"5min":1.149,"15min":1.5169999999999999},"last":0.74099999999999999}]},{"osd":3,"last update":"Tue Feb 13 00:33:56 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.82499999999999996,"15min":0.88400000000000001},"min":{"1min":0.63500000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.998,"5min":1.1799999999999999,"15min":2.9889999999999999},"last":0.62},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56100000000000005,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0369999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.84499999999999997}]},{"osd":4,"last update":"Tue Feb 13 00:33:44 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.95199999999999996,"15min":0.97599999999999998},"min":{"1min":0.70199999999999996,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.286,"5min":1.3009999999999999,"15min":1.9419999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.96699999999999997,"15min":0.95099999999999996},"min":{"1min":0.79500000000000004,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.3380000000000001,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.91200000000000003}]},{"osd":5,"last update":"Tue Feb 13 00:34:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0009999999999999,"15min":0.95499999999999996},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.004,"5min":1.03,"15min":1.0269999999999999},"min":{"1min":0.76600000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3140000000000001,"5min":1.597,"15min":1.597},"last":0.98799999999999999}]},{"osd":6,"last update":"Tue Feb 13 00:33:56 2024","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.048,"15min":1.0409999999999999},"min":{"1min":0.82699999999999996,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.081,"15min":1.123},"min":{"1min":0.82099999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.3240000000000001,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.0389999999999999}]},{"osd":7,"last update":"Tue Feb 13 00:33:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.099,"15min":1.1060000000000001},"min":{"1min":0.85799999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.3700000000000001,"5min":1.595,"15min":1.595},"last":0.876},{"interface":"front","average":{"1min":1.099,"5min":1.101,"15min":1.1100000000000001},"min":{"1min":0.86799999999999999,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.3080000000000001,"5min":1.625,"15min":1.625},"last":0.96499999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738488,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297784,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447368,"statfs":{"total":95995035648,"available":95690104832,"internally_reserved":0,"allocated":704512,"data_stored":288791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Feb 13 00:33:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68400000000000005,"15min":0.58999999999999997},"min":{"1min":0.503,"5min":0.34000000000000002,"15min":0.30499999999999999},"max":{"1min":0.94399999999999995,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.74099999999999999,"15min":0.626},"min":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.35899999999999999},"max":{"1min":0.92100000000000004,"5min":1.173,"15min":1.173},"last":0.753}]},{"osd":2,"last update":"Tue Feb 13 00:34:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.65600000000000003},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40500000000000003},"max":{"1min":0.86699999999999999,"5min":1.141,"15min":1.141},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.81000000000000005,"15min":0.72699999999999998},"min":{"1min":0.53900000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.0189999999999999,"5min":1.22,"15min":1.2829999999999999},"last":0.81299999999999994}]},{"osd":3,"last update":"Tue Feb 13 00:34:00 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.84099999999999997,"15min":0.79600000000000004},"min":{"1min":0.497,"5min":0.433,"15min":0.433},"max":{"1min":1.0940000000000001,"5min":1.175,"15min":1.175},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82499999999999996,"15min":0.78400000000000003},"min":{"1min":0.56299999999999994,"5min":0.45900000000000002,"15min":0.41399999999999998},"max":{"1min":1.1950000000000001,"5min":1.244,"15min":1.244},"last":0.91500000000000004}]},{"osd":4,"last update":"Tue Feb 13 00:33:41 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.98599999999999999,"15min":0.95899999999999996},"min":{"1min":0.69499999999999995,"5min":0.64400000000000002,"15min":0.58799999999999997},"max":{"1min":1.3149999999999999,"5min":1.431,"15min":1.431},"last":0.995},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.96699999999999997,"15min":0.92000000000000004},"min":{"1min":0.70199999999999996,"5min":0.66500000000000004,"15min":0.55400000000000005},"max":{"1min":1.226,"5min":1.349,"15min":1.349},"last":1.0129999999999999}]},{"osd":5,"last update":"Tue Feb 13 00:34:21 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.0469999999999999,"15min":1.014},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1890000000000001,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.014,"15min":0.99399999999999999},"min":{"1min":0.80000000000000004,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.173,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.96499999999999997}]},{"osd":6,"last update":"Tue Feb 13 00:34:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0660000000000001,"15min":1.0680000000000001},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.111,"15min":1.135},"min":{"1min":0.82099999999999995,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.4430000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.294}]},{"osd":7,"last update":"Tue Feb 13 00:33:52 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2070000000000001,"15min":1.2110000000000001},"min":{"1min":0.77500000000000002,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":3.1789999999999998,"5min":3.1789999999999998,"15min":3.1789999999999998},"last":1.244},{"interface":"front","average":{"1min":1.248,"5min":1.1859999999999999,"15min":1.1839999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.21,"5min":3.21,"15min":3.21},"last":1.127}]}]},{"osd":2,"up_from":18,"seq":77309411431,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297760,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447392,"statfs":{"total":95995035648,"available":95690129408,"internally_reserved":0,"allocated":679936,"data_stored":287394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 00:34:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67000000000000004,"15min":0.626},"min":{"1min":0.45000000000000001,"5min":0.433,"15min":0.41199999999999998},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76200000000000001,"15min":0.69299999999999995},"min":{"1min":0.57599999999999996,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.117,"5min":1.135,"15min":1.165},"last":0.68999999999999995}]},{"osd":1,"last update":"Tue Feb 13 00:34:15 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72099999999999997,"15min":0.67200000000000004},"min":{"1min":0.54400000000000004,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.2330000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77700000000000002,"15min":0.70399999999999996},"min":{"1min":0.53400000000000003,"5min":0.313,"15min":0.313},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.80000000000000004}]},{"osd":3,"last update":"Tue Feb 13 00:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79500000000000004,"15min":0.76400000000000001},"min":{"1min":0.53200000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79500000000000004,"15min":0.78700000000000003},"min":{"1min":0.58799999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.407},"last":0.97799999999999998}]},{"osd":4,"last update":"Tue Feb 13 00:33:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.99099999999999999,"15min":0.94899999999999995},"min":{"1min":0.78300000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.03},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95199999999999996,"15min":0.95699999999999996},"min":{"1min":0.77100000000000002,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2969999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.84799999999999998}]},{"osd":5,"last update":"Tue Feb 13 00:34:18 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":0.99099999999999999,"15min":1.022},"min":{"1min":0.745,"5min":0.622,"15min":0.622},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0609999999999999,"15min":1.075},"min":{"1min":0.79100000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6319999999999999,"5min":1.6519999999999999,"15min":1.6870000000000001},"last":1.083}]},{"osd":6,"last update":"Tue Feb 13 00:34:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.103,"15min":1.097},"min":{"1min":0.86199999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.167},{"interface":"front","average":{"1min":1.115,"5min":1.069,"15min":1.0469999999999999},"min":{"1min":0.86499999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.0129999999999999}]},{"osd":7,"last update":"Tue Feb 13 00:33:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1040000000000001,"15min":1.0629999999999999},"min":{"1min":0.72799999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.167,"15min":1.125},"min":{"1min":0.98799999999999999,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.129}]}]},{"osd":3,"up_from":25,"seq":107374182495,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297804,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447348,"statfs":{"total":95995035648,"available":95690084352,"internally_reserved":0,"allocated":724992,"data_stored":289259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 00:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67700000000000005,"15min":0.64500000000000002},"min":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.878},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73999999999999999,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.034,"5min":1.214,"15min":1.214},"last":0.70699999999999996}]},{"osd":1,"last update":"Tue Feb 13 00:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.755,"15min":0.73699999999999999},"min":{"1min":0.51200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0269999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":1.546},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.54700000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.44800000000000001}]},{"osd":2,"last update":"Tue Feb 13 00:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.80300000000000005,"15min":0.79800000000000004},"min":{"1min":0.57199999999999995,"5min":0.379,"15min":0.379},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.77800000000000002,"15min":0.76500000000000001},"min":{"1min":0.54400000000000004,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.109,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.94799999999999995}]},{"osd":4,"last update":"Tue Feb 13 00:33:43 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.93700000000000006,"15min":0.92300000000000004},"min":{"1min":0.80200000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2030000000000001,"5min":1.2290000000000001,"15min":1.2649999999999999},"last":1.081},{"interface":"front","average":{"1min":1.036,"5min":0.98699999999999999,"15min":0.93300000000000005},"min":{"1min":0.81499999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.86299999999999999}]},{"osd":5,"last update":"Tue Feb 13 00:34:16 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.96999999999999997,"15min":0.98599999999999999},"min":{"1min":0.68500000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.411,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.024,"15min":1.038},"min":{"1min":0.72399999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.29}]},{"osd":6,"last update":"Tue Feb 13 00:34:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0309999999999999,"15min":1.075},"min":{"1min":0.74299999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.052,"15min":1.1100000000000001},"min":{"1min":0.78100000000000003,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.92200000000000004}]},{"osd":7,"last update":"Tue Feb 13 00:33:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.115,"15min":1.1160000000000001},"min":{"1min":0.93300000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3069999999999999,"5min":1.347,"15min":1.347},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.175,"5min":1.125,"15min":1.1379999999999999},"min":{"1min":0.85999999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4059999999999999,"5min":1.488,"15min":1.488},"last":0.96799999999999997}]}]},{"osd":4,"up_from":30,"seq":128849018967,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297780,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447372,"statfs":{"total":95995035648,"available":95690108928,"internally_reserved":0,"allocated":700416,"data_stored":287683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 00:33:37 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.89400000000000002,"15min":0.90800000000000003},"min":{"1min":0.56999999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.329,"5min":1.341,"15min":1.341},"last":1.119},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.92400000000000004,"15min":0.96299999999999997},"min":{"1min":0.53900000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.0389999999999999}]},{"osd":1,"last update":"Tue Feb 13 00:33:37 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.84099999999999997,"15min":0.82199999999999995},"min":{"1min":0.63900000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.84699999999999998,"15min":0.85299999999999998},"min":{"1min":0.63100000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.145,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.88600000000000001}]},{"osd":2,"last update":"Tue Feb 13 00:33:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.83899999999999997,"15min":0.84299999999999997},"min":{"1min":0.73899999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.01},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.85899999999999999,"15min":0.86299999999999999},"min":{"1min":0.69399999999999995,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2370000000000001,"5min":1.371,"15min":1.371},"last":0.83699999999999997}]},{"osd":3,"last update":"Tue Feb 13 00:33:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.90200000000000002,"15min":0.88200000000000001},"min":{"1min":0.69599999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.153,"5min":1.45,"15min":1.45},"last":1.131},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.92100000000000004,"15min":0.92700000000000005},"min":{"1min":0.71799999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.232,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.97499999999999998}]},{"osd":5,"last update":"Tue Feb 13 00:34:27 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.87,"15min":0.82299999999999995},"min":{"1min":0.77200000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.345,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.97699999999999998,"15min":0.91300000000000003},"min":{"1min":0.71499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.274,"5min":1.298,"15min":1.298},"last":1.163}]},{"osd":6,"last update":"Tue Feb 13 00:34:01 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.86899999999999999,"15min":0.83599999999999997},"min":{"1min":0.64700000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.258,"5min":1.425,"15min":1.425},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.113,"5min":1.0149999999999999,"15min":0.99099999999999999},"min":{"1min":0.70699999999999996,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3080000000000001,"5min":1.415,"15min":1.415},"last":0.91500000000000004}]},{"osd":7,"last update":"Tue Feb 13 00:33:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":0.93400000000000005,"15min":0.85399999999999998},"min":{"1min":0.71699999999999997,"5min":0.435,"15min":0.435},"max":{"1min":1.3200000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.92900000000000005,"15min":0.86299999999999999},"min":{"1min":0.82499999999999996,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.282,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.75700000000000001}]}]},{"osd":5,"up_from":36,"seq":154618822735,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297776,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447376,"statfs":{"total":95995035648,"available":95690113024,"internally_reserved":0,"allocated":696320,"data_stored":287877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 00:34:21 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.85499999999999998,"15min":0.84099999999999997},"min":{"1min":0.68300000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.2310000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.87,"15min":0.93400000000000005},"min":{"1min":0.61099999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2010000000000001,"5min":1.236,"15min":1.236},"last":0.77300000000000002}]},{"osd":1,"last update":"Tue Feb 13 00:34:21 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.88800000000000001,"15min":0.876},"min":{"1min":0.61599999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.85999999999999999,"15min":0.84099999999999997},"min":{"1min":0.63400000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.256,"5min":1.284,"15min":1.284},"last":0.98699999999999999}]},{"osd":2,"last update":"Tue Feb 13 00:34:21 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.88600000000000001,"15min":0.89500000000000002},"min":{"1min":0.63200000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1799999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.01,"5min":0.93799999999999994,"15min":0.95799999999999996},"min":{"1min":0.71299999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2290000000000001,"5min":1.359,"15min":1.546},"last":0.90600000000000003}]},{"osd":3,"last update":"Tue Feb 13 00:34:21 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.91300000000000003,"15min":0.93999999999999995},"min":{"1min":0.70299999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.238,"5min":1.849,"15min":1.849},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.99099999999999999,"15min":0.98899999999999999},"min":{"1min":0.75900000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.4590000000000001},"last":0.82399999999999995}]},{"osd":4,"last update":"Tue Feb 13 00:34:21 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.80400000000000005,"15min":0.76900000000000002},"min":{"1min":0.60199999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.89500000000000002,"15min":0.83899999999999997},"min":{"1min":0.745,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.94899999999999995}]},{"osd":6,"last update":"Tue Feb 13 00:34:03 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":0.89700000000000002,"15min":0.81200000000000006},"min":{"1min":0.79100000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.036,"5min":0.90200000000000002,"15min":0.86499999999999999},"min":{"1min":0.81999999999999995,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.2629999999999999,"5min":1.363,"15min":1.363},"last":1.093}]},{"osd":7,"last update":"Tue Feb 13 00:33:44 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.048,"15min":0.91700000000000004},"min":{"1min":0.71799999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.403,"5min":6.0039999999999996,"15min":6.0039999999999996},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0169999999999999,"15min":0.92500000000000004},"min":{"1min":0.79600000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.323,"5min":5.04,"15min":5.04},"last":1.143}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-13T00:34:35.207 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph pg dump --format=json 2024-02-13T00:34:36.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:35 smithi106 bash[18459]: audit 2024-02-13T00:34:34.363868+0000 mgr.y (mgr.24461) 182 : audit [DBG] from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-13T00:34:36.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:35 smithi106 bash[18459]: cluster 2024-02-13T00:34:34.769984+0000 mgr.y (mgr.24461) 183 : cluster [DBG] pgmap v132: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:36.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:35 smithi080 bash[17386]: audit 2024-02-13T00:34:34.363868+0000 mgr.y (mgr.24461) 182 : audit [DBG] from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-13T00:34:36.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:35 smithi080 bash[17386]: cluster 2024-02-13T00:34:34.769984+0000 mgr.y (mgr.24461) 183 : cluster [DBG] pgmap v132: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:36.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:35 smithi080 bash[24237]: audit 2024-02-13T00:34:34.363868+0000 mgr.y (mgr.24461) 182 : audit [DBG] from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-13T00:34:36.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:35 smithi080 bash[24237]: cluster 2024-02-13T00:34:34.769984+0000 mgr.y (mgr.24461) 183 : cluster [DBG] pgmap v132: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:38.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:37 smithi106 bash[18459]: cluster 2024-02-13T00:34:36.770575+0000 mgr.y (mgr.24461) 184 : cluster [DBG] pgmap v133: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:38.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:34:37 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:34:38.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:37 smithi080 bash[17386]: cluster 2024-02-13T00:34:36.770575+0000 mgr.y (mgr.24461) 184 : cluster [DBG] pgmap v133: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:38.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:37 smithi080 bash[24237]: cluster 2024-02-13T00:34:36.770575+0000 mgr.y (mgr.24461) 184 : cluster [DBG] pgmap v133: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:39.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:38 smithi106 bash[18459]: audit 2024-02-13T00:34:37.899735+0000 mgr.y (mgr.24461) 185 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:34:39.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:38 smithi080 bash[17386]: audit 2024-02-13T00:34:37.899735+0000 mgr.y (mgr.24461) 185 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:34:39.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:38 smithi080 bash[24237]: audit 2024-02-13T00:34:37.899735+0000 mgr.y (mgr.24461) 185 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:34:39.991 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:34:40.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:39 smithi106 bash[18459]: cluster 2024-02-13T00:34:38.771870+0000 mgr.y (mgr.24461) 186 : cluster [DBG] pgmap v134: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:40.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:39 smithi080 bash[17386]: cluster 2024-02-13T00:34:38.771870+0000 mgr.y (mgr.24461) 186 : cluster [DBG] pgmap v134: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:40.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:39 smithi080 bash[24237]: cluster 2024-02-13T00:34:38.771870+0000 mgr.y (mgr.24461) 186 : cluster [DBG] pgmap v134: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:40.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:34:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:34:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:34:42.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:41 smithi106 bash[18459]: cluster 2024-02-13T00:34:40.772708+0000 mgr.y (mgr.24461) 187 : cluster [DBG] pgmap v135: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:42.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:41 smithi080 bash[17386]: cluster 2024-02-13T00:34:40.772708+0000 mgr.y (mgr.24461) 187 : cluster [DBG] pgmap v135: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:42.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:41 smithi080 bash[24237]: cluster 2024-02-13T00:34:40.772708+0000 mgr.y (mgr.24461) 187 : cluster [DBG] pgmap v135: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:42.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.738+0000 7f5d25e1c700 1 -- 172.21.15.80:0/1089988037 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d200fe670 msgr2=0x7f5d200f61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:42.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.738+0000 7f5d25e1c700 1 --2- 172.21.15.80:0/1089988037 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d200fe670 0x7f5d200f61f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f5d14004870 tx=0x7f5d14009cb0).stop 2024-02-13T00:34:42.745 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.738+0000 7f5d25e1c700 1 -- 172.21.15.80:0/1089988037 shutdown_connections 2024-02-13T00:34:42.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.738+0000 7f5d25e1c700 1 --2- 172.21.15.80:0/1089988037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d200f68d0 0x7f5d20104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:42.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.738+0000 7f5d25e1c700 1 --2- 172.21.15.80:0/1089988037 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d200fdd10 0x7f5d200fe0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:42.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.738+0000 7f5d25e1c700 1 --2- 172.21.15.80:0/1089988037 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d200fe670 0x7f5d200f61f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:42.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.738+0000 7f5d25e1c700 1 -- 172.21.15.80:0/1089988037 >> 172.21.15.80:0/1089988037 conn(0x7f5d200701f0 msgr2=0x7f5d200f4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:34:42.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.738+0000 7f5d25e1c700 1 -- 172.21.15.80:0/1089988037 shutdown_connections 2024-02-13T00:34:42.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.738+0000 7f5d25e1c700 1 -- 172.21.15.80:0/1089988037 wait complete. 2024-02-13T00:34:42.746 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d25e1c700 1 Processor -- start 2024-02-13T00:34:42.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d25e1c700 1 -- start start 2024-02-13T00:34:42.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d25e1c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d200f68d0 0x7f5d2010df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:42.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d25e1c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d200fdd10 0x7f5d2010e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:42.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d25e1c700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d200fe670 0x7f5d20108130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:42.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d25e1c700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d20108620 con 0x7f5d200f68d0 2024-02-13T00:34:42.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d25e1c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d20108790 con 0x7f5d200fdd10 2024-02-13T00:34:42.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d25e1c700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d20108950 con 0x7f5d200fe670 2024-02-13T00:34:42.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d1ffff700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d200fe670 0x7f5d20108130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d1ffff700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d200fe670 0x7f5d20108130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:50216/0 (socket says 172.21.15.80:50216) 2024-02-13T00:34:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d1ffff700 1 -- 172.21.15.80:0/3429272716 learned_addr learned my addr 172.21.15.80:0/3429272716 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:34:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d1f7fe700 1 --2- 172.21.15.80:0/3429272716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d200f68d0 0x7f5d2010df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d1effd700 1 --2- 172.21.15.80:0/3429272716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d200fdd10 0x7f5d2010e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d1f7fe700 1 -- 172.21.15.80:0/3429272716 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d200fe670 msgr2=0x7f5d20108130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d1f7fe700 1 --2- 172.21.15.80:0/3429272716 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d200fe670 0x7f5d20108130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d1f7fe700 1 -- 172.21.15.80:0/3429272716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d200fdd10 msgr2=0x7f5d2010e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d1f7fe700 1 --2- 172.21.15.80:0/3429272716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d200fdd10 0x7f5d2010e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d1f7fe700 1 -- 172.21.15.80:0/3429272716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d14005040 con 0x7f5d200f68d0 2024-02-13T00:34:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d1ffff700 1 --2- 172.21.15.80:0/3429272716 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d200fe670 0x7f5d20108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:34:42.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d1f7fe700 1 --2- 172.21.15.80:0/3429272716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d200f68d0 0x7f5d2010df90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f5d1000e8f0 tx=0x7f5d1000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:34:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d1cff9700 1 -- 172.21.15.80:0/3429272716 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d10004620 con 0x7f5d200f68d0 2024-02-13T00:34:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d1cff9700 1 -- 172.21.15.80:0/3429272716 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f5d1000f040 con 0x7f5d200f68d0 2024-02-13T00:34:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d25e1c700 1 -- 172.21.15.80:0/3429272716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d20108c30 con 0x7f5d200f68d0 2024-02-13T00:34:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d1cff9700 1 -- 172.21.15.80:0/3429272716 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d100146f0 con 0x7f5d200f68d0 2024-02-13T00:34:42.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.742+0000 7f5d25e1c700 1 -- 172.21.15.80:0/3429272716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d20108fb0 con 0x7f5d200f68d0 2024-02-13T00:34:42.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.746+0000 7f5d25e1c700 1 -- 172.21.15.80:0/3429272716 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2005fad0 con 0x7f5d200f68d0 2024-02-13T00:34:42.751 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.746+0000 7f5d1cff9700 1 -- 172.21.15.80:0/3429272716 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f5d10007b40 con 0x7f5d200f68d0 2024-02-13T00:34:42.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.746+0000 7f5d1cff9700 1 --2- 172.21.15.80:0/3429272716 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5d08061340 0x7f5d08063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:42.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.746+0000 7f5d1cff9700 1 -- 172.21.15.80:0/3429272716 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f5d1007c890 con 0x7f5d200f68d0 2024-02-13T00:34:42.752 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.746+0000 7f5d1effd700 1 --2- 172.21.15.80:0/3429272716 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5d08061340 0x7f5d08063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:42.753 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.746+0000 7f5d1effd700 1 --2- 172.21.15.80:0/3429272716 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5d08061340 0x7f5d08063800 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f5d14005010 tx=0x7f5d1400b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:34:42.760 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.754+0000 7f5d1cff9700 1 -- 172.21.15.80:0/3429272716 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5d1004c6a0 con 0x7f5d200f68d0 2024-02-13T00:34:42.942 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.934+0000 7f5d25e1c700 1 -- 172.21.15.80:0/3429272716 --> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5d20109610 con 0x7f5d08061340 2024-02-13T00:34:42.961 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.954+0000 7f5d1cff9700 1 -- 172.21.15.80:0/3429272716 <== mgr.24461 v2:172.21.15.80:6800/2955905243 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+355746 (secure 0 0 0) 0x7f5d20109610 con 0x7f5d08061340 2024-02-13T00:34:42.969 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-13T00:34:42.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.958+0000 7f5d25e1c700 1 -- 172.21.15.80:0/3429272716 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5d08061340 msgr2=0x7f5d08063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:42.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.958+0000 7f5d25e1c700 1 --2- 172.21.15.80:0/3429272716 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5d08061340 0x7f5d08063800 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f5d14005010 tx=0x7f5d1400b040).stop 2024-02-13T00:34:42.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.958+0000 7f5d25e1c700 1 -- 172.21.15.80:0/3429272716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d200f68d0 msgr2=0x7f5d2010df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:42.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.958+0000 7f5d25e1c700 1 --2- 172.21.15.80:0/3429272716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d200f68d0 0x7f5d2010df90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f5d1000e8f0 tx=0x7f5d1000b040).stop 2024-02-13T00:34:42.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.958+0000 7f5d25e1c700 1 -- 172.21.15.80:0/3429272716 shutdown_connections 2024-02-13T00:34:42.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.958+0000 7f5d25e1c700 1 --2- 172.21.15.80:0/3429272716 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5d08061340 0x7f5d08063800 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:42.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.962+0000 7f5d25e1c700 1 --2- 172.21.15.80:0/3429272716 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5d200fe670 0x7f5d20108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:42.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.962+0000 7f5d25e1c700 1 --2- 172.21.15.80:0/3429272716 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f5d200f68d0 0x7f5d2010df90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:42.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.962+0000 7f5d25e1c700 1 --2- 172.21.15.80:0/3429272716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d200fdd10 0x7f5d2010e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:42.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.962+0000 7f5d25e1c700 1 -- 172.21.15.80:0/3429272716 >> 172.21.15.80:0/3429272716 conn(0x7f5d200701f0 msgr2=0x7f5d200fbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:34:42.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.962+0000 7f5d25e1c700 1 -- 172.21.15.80:0/3429272716 shutdown_connections 2024-02-13T00:34:42.973 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:42.962+0000 7f5d25e1c700 1 -- 172.21.15.80:0/3429272716 wait complete. 2024-02-13T00:34:42.973 INFO:teuthology.orchestra.run.smithi080.stderr:dumped all 2024-02-13T00:34:43.257 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:34:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:34:43] "GET /metrics HTTP/1.1" 200 172238 "" "Prometheus/2.33.4" 2024-02-13T00:34:43.689 INFO:teuthology.orchestra.run.smithi080.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-02-13T00:34:42.773007+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5796,"num_objects":224,"num_object_clones":0,"num_object_copies":672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":224,"num_whiteouts":0,"num_read":1385,"num_read_kb":1105,"num_write":620,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":468,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":661,"ondisk_log_size":661,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":2382240,"kb_used_data":5472,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":747578976,"statfs":{"total":767960285184,"available":765520871424,"internally_reserved":0,"allocated":5603328,"data_stored":2305379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005168"},"pg_stats":[{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986207+0000","last_change":"2024-02-13T00:29:57.939697+0000","last_active":"2024-02-13T00:30:07.986207+0000","last_peered":"2024-02-13T00:30:07.986207+0000","last_clean":"2024-02-13T00:30:07.986207+0000","last_became_active":"2024-02-13T00:29:57.938663+0000","last_became_peered":"2024-02-13T00:29:57.938663+0000","last_unstale":"2024-02-13T00:30:07.986207+0000","last_undegraded":"2024-02-13T00:30:07.986207+0000","last_fullsized":"2024-02-13T00:30:07.986207+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986443+0000","last_change":"2024-02-13T00:29:55.909454+0000","last_active":"2024-02-13T00:30:07.986443+0000","last_peered":"2024-02-13T00:30:07.986443+0000","last_clean":"2024-02-13T00:30:07.986443+0000","last_became_active":"2024-02-13T00:29:55.909042+0000","last_became_peered":"2024-02-13T00:29:55.909042+0000","last_unstale":"2024-02-13T00:30:07.986443+0000","last_undegraded":"2024-02-13T00:30:07.986443+0000","last_fullsized":"2024-02-13T00:30:07.986443+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.983322+0000","last_change":"2024-02-13T00:29:52.062064+0000","last_active":"2024-02-13T00:30:07.983322+0000","last_peered":"2024-02-13T00:30:07.983322+0000","last_clean":"2024-02-13T00:30:07.983322+0000","last_became_active":"2024-02-13T00:29:52.061547+0000","last_became_peered":"2024-02-13T00:29:52.061547+0000","last_unstale":"2024-02-13T00:30:07.983322+0000","last_undegraded":"2024-02-13T00:30:07.983322+0000","last_fullsized":"2024-02-13T00:30:07.983322+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"60'15","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986098+0000","last_change":"2024-02-13T00:29:53.877025+0000","last_active":"2024-02-13T00:30:07.986098+0000","last_peered":"2024-02-13T00:30:07.986098+0000","last_clean":"2024-02-13T00:30:07.986098+0000","last_became_active":"2024-02-13T00:29:53.876734+0000","last_became_peered":"2024-02-13T00:29:53.876734+0000","last_unstale":"2024-02-13T00:30:07.986098+0000","last_undegraded":"2024-02-13T00:30:07.986098+0000","last_fullsized":"2024-02-13T00:30:07.986098+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":22,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.981089+0000","last_change":"2024-02-13T00:29:57.927332+0000","last_active":"2024-02-13T00:30:07.981089+0000","last_peered":"2024-02-13T00:30:07.981089+0000","last_clean":"2024-02-13T00:30:07.981089+0000","last_became_active":"2024-02-13T00:29:57.927013+0000","last_became_peered":"2024-02-13T00:29:57.927013+0000","last_unstale":"2024-02-13T00:30:07.981089+0000","last_undegraded":"2024-02-13T00:30:07.981089+0000","last_fullsized":"2024-02-13T00:30:07.981089+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986056+0000","last_change":"2024-02-13T00:29:55.901792+0000","last_active":"2024-02-13T00:30:07.986056+0000","last_peered":"2024-02-13T00:30:07.986056+0000","last_clean":"2024-02-13T00:30:07.986056+0000","last_became_active":"2024-02-13T00:29:55.901483+0000","last_became_peered":"2024-02-13T00:29:55.901483+0000","last_unstale":"2024-02-13T00:30:07.986056+0000","last_undegraded":"2024-02-13T00:30:07.986056+0000","last_fullsized":"2024-02-13T00:30:07.986056+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.980618+0000","last_change":"2024-02-13T00:29:52.058673+0000","last_active":"2024-02-13T00:30:07.980618+0000","last_peered":"2024-02-13T00:30:07.980618+0000","last_clean":"2024-02-13T00:30:07.980618+0000","last_became_active":"2024-02-13T00:29:52.058179+0000","last_became_peered":"2024-02-13T00:29:52.058179+0000","last_unstale":"2024-02-13T00:30:07.980618+0000","last_undegraded":"2024-02-13T00:30:07.980618+0000","last_fullsized":"2024-02-13T00:30:07.980618+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"60'39","reported_seq":102,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.980226+0000","last_change":"2024-02-13T00:29:53.889135+0000","last_active":"2024-02-13T00:30:07.980226+0000","last_peered":"2024-02-13T00:30:07.980226+0000","last_clean":"2024-02-13T00:30:07.980226+0000","last_became_active":"2024-02-13T00:29:53.888756+0000","last_became_peered":"2024-02-13T00:29:53.888756+0000","last_unstale":"2024-02-13T00:30:07.980226+0000","last_undegraded":"2024-02-13T00:30:07.980226+0000","last_fullsized":"2024-02-13T00:30:07.980226+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":39,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.978391+0000","last_change":"2024-02-13T00:29:57.931425+0000","last_active":"2024-02-13T00:30:07.978391+0000","last_peered":"2024-02-13T00:30:07.978391+0000","last_clean":"2024-02-13T00:30:07.978391+0000","last_became_active":"2024-02-13T00:29:57.930559+0000","last_became_peered":"2024-02-13T00:29:57.930559+0000","last_unstale":"2024-02-13T00:30:07.978391+0000","last_undegraded":"2024-02-13T00:30:07.978391+0000","last_fullsized":"2024-02-13T00:30:07.978391+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984172+0000","last_change":"2024-02-13T00:29:55.900974+0000","last_active":"2024-02-13T00:30:07.984172+0000","last_peered":"2024-02-13T00:30:07.984172+0000","last_clean":"2024-02-13T00:30:07.984172+0000","last_became_active":"2024-02-13T00:29:55.899685+0000","last_became_peered":"2024-02-13T00:29:55.899685+0000","last_unstale":"2024-02-13T00:30:07.984172+0000","last_undegraded":"2024-02-13T00:30:07.984172+0000","last_fullsized":"2024-02-13T00:30:07.984172+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984325+0000","last_change":"2024-02-13T00:29:51.860174+0000","last_active":"2024-02-13T00:30:07.984325+0000","last_peered":"2024-02-13T00:30:07.984325+0000","last_clean":"2024-02-13T00:30:07.984325+0000","last_became_active":"2024-02-13T00:29:51.859787+0000","last_became_peered":"2024-02-13T00:29:51.859787+0000","last_unstale":"2024-02-13T00:30:07.984325+0000","last_undegraded":"2024-02-13T00:30:07.984325+0000","last_fullsized":"2024-02-13T00:30:07.984325+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"60'21","reported_seq":63,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986632+0000","last_change":"2024-02-13T00:29:53.886764+0000","last_active":"2024-02-13T00:30:07.986632+0000","last_peered":"2024-02-13T00:30:07.986632+0000","last_clean":"2024-02-13T00:30:07.986632+0000","last_became_active":"2024-02-13T00:29:53.886454+0000","last_became_peered":"2024-02-13T00:29:53.886454+0000","last_unstale":"2024-02-13T00:30:07.986632+0000","last_undegraded":"2024-02-13T00:30:07.986632+0000","last_fullsized":"2024-02-13T00:30:07.986632+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.983640+0000","last_change":"2024-02-13T00:29:57.938198+0000","last_active":"2024-02-13T00:30:07.983640+0000","last_peered":"2024-02-13T00:30:07.983640+0000","last_clean":"2024-02-13T00:30:07.983640+0000","last_became_active":"2024-02-13T00:29:57.937829+0000","last_became_peered":"2024-02-13T00:29:57.937829+0000","last_unstale":"2024-02-13T00:30:07.983640+0000","last_undegraded":"2024-02-13T00:30:07.983640+0000","last_fullsized":"2024-02-13T00:30:07.983640+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.976233+0000","last_change":"2024-02-13T00:29:55.899658+0000","last_active":"2024-02-13T00:30:07.976233+0000","last_peered":"2024-02-13T00:30:07.976233+0000","last_clean":"2024-02-13T00:30:07.976233+0000","last_became_active":"2024-02-13T00:29:55.899296+0000","last_became_peered":"2024-02-13T00:29:55.899296+0000","last_unstale":"2024-02-13T00:30:07.976233+0000","last_undegraded":"2024-02-13T00:30:07.976233+0000","last_fullsized":"2024-02-13T00:30:07.976233+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984862+0000","last_change":"2024-02-13T00:29:51.860100+0000","last_active":"2024-02-13T00:30:07.984862+0000","last_peered":"2024-02-13T00:30:07.984862+0000","last_clean":"2024-02-13T00:30:07.984862+0000","last_became_active":"2024-02-13T00:29:51.859693+0000","last_became_peered":"2024-02-13T00:29:51.859693+0000","last_unstale":"2024-02-13T00:30:07.984862+0000","last_undegraded":"2024-02-13T00:30:07.984862+0000","last_fullsized":"2024-02-13T00:30:07.984862+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"60'11","reported_seq":42,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986483+0000","last_change":"2024-02-13T00:29:53.881210+0000","last_active":"2024-02-13T00:30:07.986483+0000","last_peered":"2024-02-13T00:30:07.986483+0000","last_clean":"2024-02-13T00:30:07.986483+0000","last_became_active":"2024-02-13T00:29:53.880882+0000","last_became_peered":"2024-02-13T00:29:53.880882+0000","last_unstale":"2024-02-13T00:30:07.986483+0000","last_undegraded":"2024-02-13T00:30:07.986483+0000","last_fullsized":"2024-02-13T00:30:07.986483+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":18,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.987358+0000","last_change":"2024-02-13T00:29:57.933192+0000","last_active":"2024-02-13T00:30:07.987358+0000","last_peered":"2024-02-13T00:30:07.987358+0000","last_clean":"2024-02-13T00:30:07.987358+0000","last_became_active":"2024-02-13T00:29:57.932838+0000","last_became_peered":"2024-02-13T00:29:57.932838+0000","last_unstale":"2024-02-13T00:30:07.987358+0000","last_undegraded":"2024-02-13T00:30:07.987358+0000","last_fullsized":"2024-02-13T00:30:07.987358+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.988320+0000","last_change":"2024-02-13T00:29:55.900852+0000","last_active":"2024-02-13T00:30:07.988320+0000","last_peered":"2024-02-13T00:30:07.988320+0000","last_clean":"2024-02-13T00:30:07.988320+0000","last_became_active":"2024-02-13T00:29:55.900488+0000","last_became_peered":"2024-02-13T00:29:55.900488+0000","last_unstale":"2024-02-13T00:30:07.988320+0000","last_undegraded":"2024-02-13T00:30:07.988320+0000","last_fullsized":"2024-02-13T00:30:07.988320+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.978876+0000","last_change":"2024-02-13T00:29:51.861278+0000","last_active":"2024-02-13T00:30:07.978876+0000","last_peered":"2024-02-13T00:30:07.978876+0000","last_clean":"2024-02-13T00:30:07.978876+0000","last_became_active":"2024-02-13T00:29:51.860894+0000","last_became_peered":"2024-02-13T00:29:51.860894+0000","last_unstale":"2024-02-13T00:30:07.978876+0000","last_undegraded":"2024-02-13T00:30:07.978876+0000","last_fullsized":"2024-02-13T00:30:07.978876+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"60'15","reported_seq":42,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.981851+0000","last_change":"2024-02-13T00:29:53.880898+0000","last_active":"2024-02-13T00:30:07.981851+0000","last_peered":"2024-02-13T00:30:07.981851+0000","last_clean":"2024-02-13T00:30:07.981851+0000","last_became_active":"2024-02-13T00:29:53.880522+0000","last_became_peered":"2024-02-13T00:29:53.880522+0000","last_unstale":"2024-02-13T00:30:07.981851+0000","last_undegraded":"2024-02-13T00:30:07.981851+0000","last_fullsized":"2024-02-13T00:30:07.981851+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.982413+0000","last_change":"2024-02-13T00:29:57.933154+0000","last_active":"2024-02-13T00:30:07.982413+0000","last_peered":"2024-02-13T00:30:07.982413+0000","last_clean":"2024-02-13T00:30:07.982413+0000","last_became_active":"2024-02-13T00:29:57.932823+0000","last_became_peered":"2024-02-13T00:29:57.932823+0000","last_unstale":"2024-02-13T00:30:07.982413+0000","last_undegraded":"2024-02-13T00:30:07.982413+0000","last_fullsized":"2024-02-13T00:30:07.982413+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986802+0000","last_change":"2024-02-13T00:29:55.900881+0000","last_active":"2024-02-13T00:30:07.986802+0000","last_peered":"2024-02-13T00:30:07.986802+0000","last_clean":"2024-02-13T00:30:07.986802+0000","last_became_active":"2024-02-13T00:29:55.900525+0000","last_became_peered":"2024-02-13T00:29:55.900525+0000","last_unstale":"2024-02-13T00:30:07.986802+0000","last_undegraded":"2024-02-13T00:30:07.986802+0000","last_fullsized":"2024-02-13T00:30:07.986802+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986611+0000","last_change":"2024-02-13T00:29:52.059970+0000","last_active":"2024-02-13T00:30:07.986611+0000","last_peered":"2024-02-13T00:30:07.986611+0000","last_clean":"2024-02-13T00:30:07.986611+0000","last_became_active":"2024-02-13T00:29:52.059469+0000","last_became_peered":"2024-02-13T00:29:52.059469+0000","last_unstale":"2024-02-13T00:30:07.986611+0000","last_undegraded":"2024-02-13T00:30:07.986611+0000","last_fullsized":"2024-02-13T00:30:07.986611+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"60'18","reported_seq":55,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.980848+0000","last_change":"2024-02-13T00:29:53.881771+0000","last_active":"2024-02-13T00:30:07.980848+0000","last_peered":"2024-02-13T00:30:07.980848+0000","last_clean":"2024-02-13T00:30:07.980848+0000","last_became_active":"2024-02-13T00:29:53.881458+0000","last_became_peered":"2024-02-13T00:29:53.881458+0000","last_unstale":"2024-02-13T00:30:07.980848+0000","last_undegraded":"2024-02-13T00:30:07.980848+0000","last_fullsized":"2024-02-13T00:30:07.980848+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":27,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"60'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.976834+0000","last_change":"2024-02-13T00:29:57.933281+0000","last_active":"2024-02-13T00:30:07.976834+0000","last_peered":"2024-02-13T00:30:07.976834+0000","last_clean":"2024-02-13T00:30:07.976834+0000","last_became_active":"2024-02-13T00:29:57.932941+0000","last_became_peered":"2024-02-13T00:29:57.932941+0000","last_unstale":"2024-02-13T00:30:07.976834+0000","last_undegraded":"2024-02-13T00:30:07.976834+0000","last_fullsized":"2024-02-13T00:30:07.976834+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"60'8","reported_seq":83,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-02-13T00:34:35.474309+0000","last_change":"2024-02-13T00:29:55.907594+0000","last_active":"2024-02-13T00:34:35.474309+0000","last_peered":"2024-02-13T00:34:35.474309+0000","last_clean":"2024-02-13T00:34:35.474309+0000","last_became_active":"2024-02-13T00:29:55.906029+0000","last_became_peered":"2024-02-13T00:29:55.906029+0000","last_unstale":"2024-02-13T00:34:35.474309+0000","last_undegraded":"2024-02-13T00:34:35.474309+0000","last_fullsized":"2024-02-13T00:34:35.474309+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986539+0000","last_change":"2024-02-13T00:29:51.858471+0000","last_active":"2024-02-13T00:30:07.986539+0000","last_peered":"2024-02-13T00:30:07.986539+0000","last_clean":"2024-02-13T00:30:07.986539+0000","last_became_active":"2024-02-13T00:29:51.858115+0000","last_became_peered":"2024-02-13T00:29:51.858115+0000","last_unstale":"2024-02-13T00:30:07.986539+0000","last_undegraded":"2024-02-13T00:30:07.986539+0000","last_fullsized":"2024-02-13T00:30:07.986539+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'16","reported_seq":47,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.981897+0000","last_change":"2024-02-13T00:29:54.019914+0000","last_active":"2024-02-13T00:30:07.981897+0000","last_peered":"2024-02-13T00:30:07.981897+0000","last_clean":"2024-02-13T00:30:07.981897+0000","last_became_active":"2024-02-13T00:29:54.019413+0000","last_became_peered":"2024-02-13T00:29:54.019413+0000","last_unstale":"2024-02-13T00:30:07.981897+0000","last_undegraded":"2024-02-13T00:30:07.981897+0000","last_fullsized":"2024-02-13T00:30:07.981897+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.988464+0000","last_change":"2024-02-13T00:29:57.932821+0000","last_active":"2024-02-13T00:30:07.988464+0000","last_peered":"2024-02-13T00:30:07.988464+0000","last_clean":"2024-02-13T00:30:07.988464+0000","last_became_active":"2024-02-13T00:29:57.932524+0000","last_became_peered":"2024-02-13T00:29:57.932524+0000","last_unstale":"2024-02-13T00:30:07.988464+0000","last_undegraded":"2024-02-13T00:30:07.988464+0000","last_fullsized":"2024-02-13T00:30:07.988464+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.982144+0000","last_change":"2024-02-13T00:29:55.895700+0000","last_active":"2024-02-13T00:30:07.982144+0000","last_peered":"2024-02-13T00:30:07.982144+0000","last_clean":"2024-02-13T00:30:07.982144+0000","last_became_active":"2024-02-13T00:29:55.895355+0000","last_became_peered":"2024-02-13T00:29:55.895355+0000","last_unstale":"2024-02-13T00:30:07.982144+0000","last_undegraded":"2024-02-13T00:30:07.982144+0000","last_fullsized":"2024-02-13T00:30:07.982144+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.979531+0000","last_change":"2024-02-13T00:29:51.854957+0000","last_active":"2024-02-13T00:30:07.979531+0000","last_peered":"2024-02-13T00:30:07.979531+0000","last_clean":"2024-02-13T00:30:07.979531+0000","last_became_active":"2024-02-13T00:29:51.854578+0000","last_became_peered":"2024-02-13T00:29:51.854578+0000","last_unstale":"2024-02-13T00:30:07.979531+0000","last_undegraded":"2024-02-13T00:30:07.979531+0000","last_fullsized":"2024-02-13T00:30:07.979531+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"60'17","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:08.056513+0000","last_change":"2024-02-13T00:29:53.877645+0000","last_active":"2024-02-13T00:30:08.056513+0000","last_peered":"2024-02-13T00:30:08.056513+0000","last_clean":"2024-02-13T00:30:08.056513+0000","last_became_active":"2024-02-13T00:29:53.877281+0000","last_became_peered":"2024-02-13T00:29:53.877281+0000","last_unstale":"2024-02-13T00:30:08.056513+0000","last_undegraded":"2024-02-13T00:30:08.056513+0000","last_fullsized":"2024-02-13T00:30:08.056513+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.976138+0000","last_change":"2024-02-13T00:29:57.935320+0000","last_active":"2024-02-13T00:30:07.976138+0000","last_peered":"2024-02-13T00:30:07.976138+0000","last_clean":"2024-02-13T00:30:07.976138+0000","last_became_active":"2024-02-13T00:29:57.934843+0000","last_became_peered":"2024-02-13T00:29:57.934843+0000","last_unstale":"2024-02-13T00:30:07.976138+0000","last_undegraded":"2024-02-13T00:30:07.976138+0000","last_fullsized":"2024-02-13T00:30:07.976138+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:08.055426+0000","last_change":"2024-02-13T00:29:55.898057+0000","last_active":"2024-02-13T00:30:08.055426+0000","last_peered":"2024-02-13T00:30:08.055426+0000","last_clean":"2024-02-13T00:30:08.055426+0000","last_became_active":"2024-02-13T00:29:55.897758+0000","last_became_peered":"2024-02-13T00:29:55.897758+0000","last_unstale":"2024-02-13T00:30:08.055426+0000","last_undegraded":"2024-02-13T00:30:08.055426+0000","last_fullsized":"2024-02-13T00:30:08.055426+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.983238+0000","last_change":"2024-02-13T00:29:51.855912+0000","last_active":"2024-02-13T00:30:07.983238+0000","last_peered":"2024-02-13T00:30:07.983238+0000","last_clean":"2024-02-13T00:30:07.983238+0000","last_became_active":"2024-02-13T00:29:51.855519+0000","last_became_peered":"2024-02-13T00:29:51.855519+0000","last_unstale":"2024-02-13T00:30:07.983238+0000","last_undegraded":"2024-02-13T00:30:07.983238+0000","last_fullsized":"2024-02-13T00:30:07.983238+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"60'4","reported_seq":23,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.979800+0000","last_change":"2024-02-13T00:29:53.878977+0000","last_active":"2024-02-13T00:30:07.979800+0000","last_peered":"2024-02-13T00:30:07.979800+0000","last_clean":"2024-02-13T00:30:07.979800+0000","last_became_active":"2024-02-13T00:29:53.878637+0000","last_became_peered":"2024-02-13T00:29:53.878637+0000","last_unstale":"2024-02-13T00:30:07.979800+0000","last_undegraded":"2024-02-13T00:30:07.979800+0000","last_fullsized":"2024-02-13T00:30:07.979800+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.980997+0000","last_change":"2024-02-13T00:29:57.929499+0000","last_active":"2024-02-13T00:30:07.980997+0000","last_peered":"2024-02-13T00:30:07.980997+0000","last_clean":"2024-02-13T00:30:07.980997+0000","last_became_active":"2024-02-13T00:29:57.929174+0000","last_became_peered":"2024-02-13T00:29:57.929174+0000","last_unstale":"2024-02-13T00:30:07.980997+0000","last_undegraded":"2024-02-13T00:30:07.980997+0000","last_fullsized":"2024-02-13T00:30:07.980997+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.976933+0000","last_change":"2024-02-13T00:29:55.905289+0000","last_active":"2024-02-13T00:30:07.976933+0000","last_peered":"2024-02-13T00:30:07.976933+0000","last_clean":"2024-02-13T00:30:07.976933+0000","last_became_active":"2024-02-13T00:29:55.904946+0000","last_became_peered":"2024-02-13T00:29:55.904946+0000","last_unstale":"2024-02-13T00:30:07.976933+0000","last_undegraded":"2024-02-13T00:30:07.976933+0000","last_fullsized":"2024-02-13T00:30:07.976933+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984569+0000","last_change":"2024-02-13T00:29:51.858907+0000","last_active":"2024-02-13T00:30:07.984569+0000","last_peered":"2024-02-13T00:30:07.984569+0000","last_clean":"2024-02-13T00:30:07.984569+0000","last_became_active":"2024-02-13T00:29:51.858385+0000","last_became_peered":"2024-02-13T00:29:51.858385+0000","last_unstale":"2024-02-13T00:30:07.984569+0000","last_undegraded":"2024-02-13T00:30:07.984569+0000","last_fullsized":"2024-02-13T00:30:07.984569+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"60'17","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.980102+0000","last_change":"2024-02-13T00:29:54.016865+0000","last_active":"2024-02-13T00:30:07.980102+0000","last_peered":"2024-02-13T00:30:07.980102+0000","last_clean":"2024-02-13T00:30:07.980102+0000","last_became_active":"2024-02-13T00:29:54.015668+0000","last_became_peered":"2024-02-13T00:29:54.015668+0000","last_unstale":"2024-02-13T00:30:07.980102+0000","last_undegraded":"2024-02-13T00:30:07.980102+0000","last_fullsized":"2024-02-13T00:30:07.980102+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.977416+0000","last_change":"2024-02-13T00:29:57.931638+0000","last_active":"2024-02-13T00:30:07.977416+0000","last_peered":"2024-02-13T00:30:07.977416+0000","last_clean":"2024-02-13T00:30:07.977416+0000","last_became_active":"2024-02-13T00:29:57.931092+0000","last_became_peered":"2024-02-13T00:29:57.931092+0000","last_unstale":"2024-02-13T00:30:07.977416+0000","last_undegraded":"2024-02-13T00:30:07.977416+0000","last_fullsized":"2024-02-13T00:30:07.977416+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.981131+0000","last_change":"2024-02-13T00:29:55.896819+0000","last_active":"2024-02-13T00:30:07.981131+0000","last_peered":"2024-02-13T00:30:07.981131+0000","last_clean":"2024-02-13T00:30:07.981131+0000","last_became_active":"2024-02-13T00:29:55.896473+0000","last_became_peered":"2024-02-13T00:29:55.896473+0000","last_unstale":"2024-02-13T00:30:07.981131+0000","last_undegraded":"2024-02-13T00:30:07.981131+0000","last_fullsized":"2024-02-13T00:30:07.981131+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.977407+0000","last_change":"2024-02-13T00:29:51.868290+0000","last_active":"2024-02-13T00:30:07.977407+0000","last_peered":"2024-02-13T00:30:07.977407+0000","last_clean":"2024-02-13T00:30:07.977407+0000","last_became_active":"2024-02-13T00:29:51.868004+0000","last_became_peered":"2024-02-13T00:29:51.868004+0000","last_unstale":"2024-02-13T00:30:07.977407+0000","last_undegraded":"2024-02-13T00:30:07.977407+0000","last_fullsized":"2024-02-13T00:30:07.977407+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"60'9","reported_seq":33,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.988319+0000","last_change":"2024-02-13T00:29:53.879698+0000","last_active":"2024-02-13T00:30:07.988319+0000","last_peered":"2024-02-13T00:30:07.988319+0000","last_clean":"2024-02-13T00:30:07.988319+0000","last_became_active":"2024-02-13T00:29:53.879421+0000","last_became_peered":"2024-02-13T00:29:53.879421+0000","last_unstale":"2024-02-13T00:30:07.988319+0000","last_undegraded":"2024-02-13T00:30:07.988319+0000","last_fullsized":"2024-02-13T00:30:07.988319+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.979685+0000","last_change":"2024-02-13T00:29:57.932666+0000","last_active":"2024-02-13T00:30:07.979685+0000","last_peered":"2024-02-13T00:30:07.979685+0000","last_clean":"2024-02-13T00:30:07.979685+0000","last_became_active":"2024-02-13T00:29:57.932343+0000","last_became_peered":"2024-02-13T00:29:57.932343+0000","last_unstale":"2024-02-13T00:30:07.979685+0000","last_undegraded":"2024-02-13T00:30:07.979685+0000","last_fullsized":"2024-02-13T00:30:07.979685+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.988213+0000","last_change":"2024-02-13T00:29:55.899763+0000","last_active":"2024-02-13T00:30:07.988213+0000","last_peered":"2024-02-13T00:30:07.988213+0000","last_clean":"2024-02-13T00:30:07.988213+0000","last_became_active":"2024-02-13T00:29:55.899448+0000","last_became_peered":"2024-02-13T00:29:55.899448+0000","last_unstale":"2024-02-13T00:30:07.988213+0000","last_undegraded":"2024-02-13T00:30:07.988213+0000","last_fullsized":"2024-02-13T00:30:07.988213+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.987006+0000","last_change":"2024-02-13T00:29:51.864947+0000","last_active":"2024-02-13T00:30:07.987006+0000","last_peered":"2024-02-13T00:30:07.987006+0000","last_clean":"2024-02-13T00:30:07.987006+0000","last_became_active":"2024-02-13T00:29:51.864604+0000","last_became_peered":"2024-02-13T00:29:51.864604+0000","last_unstale":"2024-02-13T00:30:07.987006+0000","last_undegraded":"2024-02-13T00:30:07.987006+0000","last_fullsized":"2024-02-13T00:30:07.987006+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"60'11","reported_seq":36,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986869+0000","last_change":"2024-02-13T00:29:53.876604+0000","last_active":"2024-02-13T00:30:07.986869+0000","last_peered":"2024-02-13T00:30:07.986869+0000","last_clean":"2024-02-13T00:30:07.986869+0000","last_became_active":"2024-02-13T00:29:53.876163+0000","last_became_peered":"2024-02-13T00:29:53.876163+0000","last_unstale":"2024-02-13T00:30:07.986869+0000","last_undegraded":"2024-02-13T00:30:07.986869+0000","last_fullsized":"2024-02-13T00:30:07.986869+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.978937+0000","last_change":"2024-02-13T00:29:57.934015+0000","last_active":"2024-02-13T00:30:07.978937+0000","last_peered":"2024-02-13T00:30:07.978937+0000","last_clean":"2024-02-13T00:30:07.978937+0000","last_became_active":"2024-02-13T00:29:57.932501+0000","last_became_peered":"2024-02-13T00:29:57.932501+0000","last_unstale":"2024-02-13T00:30:07.978937+0000","last_undegraded":"2024-02-13T00:30:07.978937+0000","last_fullsized":"2024-02-13T00:30:07.978937+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"60'8","reported_seq":83,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-02-13T00:34:35.474233+0000","last_change":"2024-02-13T00:29:55.911733+0000","last_active":"2024-02-13T00:34:35.474233+0000","last_peered":"2024-02-13T00:34:35.474233+0000","last_clean":"2024-02-13T00:34:35.474233+0000","last_became_active":"2024-02-13T00:29:55.910910+0000","last_became_peered":"2024-02-13T00:29:55.910910+0000","last_unstale":"2024-02-13T00:34:35.474233+0000","last_undegraded":"2024-02-13T00:34:35.474233+0000","last_fullsized":"2024-02-13T00:34:35.474233+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.976484+0000","last_change":"2024-02-13T00:29:52.061256+0000","last_active":"2024-02-13T00:30:07.976484+0000","last_peered":"2024-02-13T00:30:07.976484+0000","last_clean":"2024-02-13T00:30:07.976484+0000","last_became_active":"2024-02-13T00:29:52.060103+0000","last_became_peered":"2024-02-13T00:29:52.060103+0000","last_unstale":"2024-02-13T00:30:07.976484+0000","last_undegraded":"2024-02-13T00:30:07.976484+0000","last_fullsized":"2024-02-13T00:30:07.976484+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"60'22","reported_seq":62,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.981389+0000","last_change":"2024-02-13T00:29:54.016757+0000","last_active":"2024-02-13T00:30:07.981389+0000","last_peered":"2024-02-13T00:30:07.981389+0000","last_clean":"2024-02-13T00:30:07.981389+0000","last_became_active":"2024-02-13T00:29:54.015923+0000","last_became_peered":"2024-02-13T00:29:54.015923+0000","last_unstale":"2024-02-13T00:30:07.981389+0000","last_undegraded":"2024-02-13T00:30:07.981389+0000","last_fullsized":"2024-02-13T00:30:07.981389+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":32,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.987593+0000","last_change":"2024-02-13T00:29:57.933964+0000","last_active":"2024-02-13T00:30:07.987593+0000","last_peered":"2024-02-13T00:30:07.987593+0000","last_clean":"2024-02-13T00:30:07.987593+0000","last_became_active":"2024-02-13T00:29:57.933656+0000","last_became_peered":"2024-02-13T00:29:57.933656+0000","last_unstale":"2024-02-13T00:30:07.987593+0000","last_undegraded":"2024-02-13T00:30:07.987593+0000","last_fullsized":"2024-02-13T00:30:07.987593+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"60'8","reported_seq":80,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-02-13T00:34:35.473214+0000","last_change":"2024-02-13T00:29:55.893134+0000","last_active":"2024-02-13T00:34:35.473214+0000","last_peered":"2024-02-13T00:34:35.473214+0000","last_clean":"2024-02-13T00:34:35.473214+0000","last_became_active":"2024-02-13T00:29:55.892794+0000","last_became_peered":"2024-02-13T00:29:55.892794+0000","last_unstale":"2024-02-13T00:34:35.473214+0000","last_undegraded":"2024-02-13T00:34:35.473214+0000","last_fullsized":"2024-02-13T00:34:35.473214+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.982395+0000","last_change":"2024-02-13T00:29:51.854860+0000","last_active":"2024-02-13T00:30:07.982395+0000","last_peered":"2024-02-13T00:30:07.982395+0000","last_clean":"2024-02-13T00:30:07.982395+0000","last_became_active":"2024-02-13T00:29:51.854498+0000","last_became_peered":"2024-02-13T00:29:51.854498+0000","last_unstale":"2024-02-13T00:30:07.982395+0000","last_undegraded":"2024-02-13T00:30:07.982395+0000","last_fullsized":"2024-02-13T00:30:07.982395+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"60'15","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984697+0000","last_change":"2024-02-13T00:29:54.018919+0000","last_active":"2024-02-13T00:30:07.984697+0000","last_peered":"2024-02-13T00:30:07.984697+0000","last_clean":"2024-02-13T00:30:07.984697+0000","last_became_active":"2024-02-13T00:29:54.018432+0000","last_became_peered":"2024-02-13T00:29:54.018432+0000","last_unstale":"2024-02-13T00:30:07.984697+0000","last_undegraded":"2024-02-13T00:30:07.984697+0000","last_fullsized":"2024-02-13T00:30:07.984697+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":22,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.982405+0000","last_change":"2024-02-13T00:29:57.933693+0000","last_active":"2024-02-13T00:30:07.982405+0000","last_peered":"2024-02-13T00:30:07.982405+0000","last_clean":"2024-02-13T00:30:07.982405+0000","last_became_active":"2024-02-13T00:29:57.933131+0000","last_became_peered":"2024-02-13T00:29:57.933131+0000","last_unstale":"2024-02-13T00:30:07.982405+0000","last_undegraded":"2024-02-13T00:30:07.982405+0000","last_fullsized":"2024-02-13T00:30:07.982405+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.982256+0000","last_change":"2024-02-13T00:29:55.895202+0000","last_active":"2024-02-13T00:30:07.982256+0000","last_peered":"2024-02-13T00:30:07.982256+0000","last_clean":"2024-02-13T00:30:07.982256+0000","last_became_active":"2024-02-13T00:29:55.894865+0000","last_became_peered":"2024-02-13T00:29:55.894865+0000","last_unstale":"2024-02-13T00:30:07.982256+0000","last_undegraded":"2024-02-13T00:30:07.982256+0000","last_fullsized":"2024-02-13T00:30:07.982256+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.976203+0000","last_change":"2024-02-13T00:29:51.868019+0000","last_active":"2024-02-13T00:30:07.976203+0000","last_peered":"2024-02-13T00:30:07.976203+0000","last_clean":"2024-02-13T00:30:07.976203+0000","last_became_active":"2024-02-13T00:29:51.867725+0000","last_became_peered":"2024-02-13T00:29:51.867725+0000","last_unstale":"2024-02-13T00:30:07.976203+0000","last_undegraded":"2024-02-13T00:30:07.976203+0000","last_fullsized":"2024-02-13T00:30:07.976203+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"60'22","reported_seq":64,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.982003+0000","last_change":"2024-02-13T00:29:54.018581+0000","last_active":"2024-02-13T00:30:07.982003+0000","last_peered":"2024-02-13T00:30:07.982003+0000","last_clean":"2024-02-13T00:30:07.982003+0000","last_became_active":"2024-02-13T00:29:54.018012+0000","last_became_peered":"2024-02-13T00:29:54.018012+0000","last_unstale":"2024-02-13T00:30:07.982003+0000","last_undegraded":"2024-02-13T00:30:07.982003+0000","last_fullsized":"2024-02-13T00:30:07.982003+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.977122+0000","last_change":"2024-02-13T00:29:57.934592+0000","last_active":"2024-02-13T00:30:07.977122+0000","last_peered":"2024-02-13T00:30:07.977122+0000","last_clean":"2024-02-13T00:30:07.977122+0000","last_became_active":"2024-02-13T00:29:57.934195+0000","last_became_peered":"2024-02-13T00:29:57.934195+0000","last_unstale":"2024-02-13T00:30:07.977122+0000","last_undegraded":"2024-02-13T00:30:07.977122+0000","last_fullsized":"2024-02-13T00:30:07.977122+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984694+0000","last_change":"2024-02-13T00:29:55.905190+0000","last_active":"2024-02-13T00:30:07.984694+0000","last_peered":"2024-02-13T00:30:07.984694+0000","last_clean":"2024-02-13T00:30:07.984694+0000","last_became_active":"2024-02-13T00:29:55.904836+0000","last_became_peered":"2024-02-13T00:29:55.904836+0000","last_unstale":"2024-02-13T00:30:07.984694+0000","last_undegraded":"2024-02-13T00:30:07.984694+0000","last_fullsized":"2024-02-13T00:30:07.984694+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:08.055370+0000","last_change":"2024-02-13T00:29:51.853440+0000","last_active":"2024-02-13T00:30:08.055370+0000","last_peered":"2024-02-13T00:30:08.055370+0000","last_clean":"2024-02-13T00:30:08.055370+0000","last_became_active":"2024-02-13T00:29:51.852941+0000","last_became_peered":"2024-02-13T00:29:51.852941+0000","last_unstale":"2024-02-13T00:30:08.055370+0000","last_undegraded":"2024-02-13T00:30:08.055370+0000","last_fullsized":"2024-02-13T00:30:08.055370+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"60'13","reported_seq":61,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:09.216330+0000","last_change":"2024-02-13T00:30:09.216038+0000","last_active":"2024-02-13T00:30:09.216330+0000","last_peered":"2024-02-13T00:30:09.216330+0000","last_clean":"2024-02-13T00:30:09.216330+0000","last_became_active":"2024-02-13T00:30:07.985862+0000","last_became_peered":"2024-02-13T00:30:07.985862+0000","last_unstale":"2024-02-13T00:30:09.216330+0000","last_undegraded":"2024-02-13T00:30:09.216330+0000","last_fullsized":"2024-02-13T00:30:09.216330+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984054+0000","last_change":"2024-02-13T00:29:57.936683+0000","last_active":"2024-02-13T00:30:07.984054+0000","last_peered":"2024-02-13T00:30:07.984054+0000","last_clean":"2024-02-13T00:30:07.984054+0000","last_became_active":"2024-02-13T00:29:57.936306+0000","last_became_peered":"2024-02-13T00:29:57.936306+0000","last_unstale":"2024-02-13T00:30:07.984054+0000","last_undegraded":"2024-02-13T00:30:07.984054+0000","last_fullsized":"2024-02-13T00:30:07.984054+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"53'2","reported_seq":32,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.977636+0000","last_change":"2024-02-13T00:29:51.869126+0000","last_active":"2024-02-13T00:30:07.977636+0000","last_peered":"2024-02-13T00:30:07.977636+0000","last_clean":"2024-02-13T00:30:07.977636+0000","last_became_active":"2024-02-13T00:29:51.868821+0000","last_became_peered":"2024-02-13T00:29:51.868821+0000","last_unstale":"2024-02-13T00:30:07.977636+0000","last_undegraded":"2024-02-13T00:30:07.977636+0000","last_fullsized":"2024-02-13T00:30:07.977636+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"60'27","reported_seq":72,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.983636+0000","last_change":"2024-02-13T00:29:54.019697+0000","last_active":"2024-02-13T00:30:07.983636+0000","last_peered":"2024-02-13T00:30:07.983636+0000","last_clean":"2024-02-13T00:30:07.983636+0000","last_became_active":"2024-02-13T00:29:54.019229+0000","last_became_peered":"2024-02-13T00:29:54.019229+0000","last_unstale":"2024-02-13T00:30:07.983636+0000","last_undegraded":"2024-02-13T00:30:07.983636+0000","last_fullsized":"2024-02-13T00:30:07.983636+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"60'8","reported_seq":80,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-02-13T00:34:35.474285+0000","last_change":"2024-02-13T00:29:55.901899+0000","last_active":"2024-02-13T00:34:35.474285+0000","last_peered":"2024-02-13T00:34:35.474285+0000","last_clean":"2024-02-13T00:34:35.474285+0000","last_became_active":"2024-02-13T00:29:55.899216+0000","last_became_peered":"2024-02-13T00:29:55.899216+0000","last_unstale":"2024-02-13T00:34:35.474285+0000","last_undegraded":"2024-02-13T00:34:35.474285+0000","last_fullsized":"2024-02-13T00:34:35.474285+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.981043+0000","last_change":"2024-02-13T00:29:57.934046+0000","last_active":"2024-02-13T00:30:07.981043+0000","last_peered":"2024-02-13T00:30:07.981043+0000","last_clean":"2024-02-13T00:30:07.981043+0000","last_became_active":"2024-02-13T00:29:57.933582+0000","last_became_peered":"2024-02-13T00:29:57.933582+0000","last_unstale":"2024-02-13T00:30:07.981043+0000","last_undegraded":"2024-02-13T00:30:07.981043+0000","last_fullsized":"2024-02-13T00:30:07.981043+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.977200+0000","last_change":"2024-02-13T00:29:51.869095+0000","last_active":"2024-02-13T00:30:07.977200+0000","last_peered":"2024-02-13T00:30:07.977200+0000","last_clean":"2024-02-13T00:30:07.977200+0000","last_became_active":"2024-02-13T00:29:51.868777+0000","last_became_peered":"2024-02-13T00:29:51.868777+0000","last_unstale":"2024-02-13T00:30:07.977200+0000","last_undegraded":"2024-02-13T00:30:07.977200+0000","last_fullsized":"2024-02-13T00:30:07.977200+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"60'24","reported_seq":70,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986956+0000","last_change":"2024-02-13T00:29:53.881169+0000","last_active":"2024-02-13T00:30:07.986956+0000","last_peered":"2024-02-13T00:30:07.986956+0000","last_clean":"2024-02-13T00:30:07.986956+0000","last_became_active":"2024-02-13T00:29:53.880825+0000","last_became_peered":"2024-02-13T00:29:53.880825+0000","last_unstale":"2024-02-13T00:30:07.986956+0000","last_undegraded":"2024-02-13T00:30:07.986956+0000","last_fullsized":"2024-02-13T00:30:07.986956+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":38,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.977313+0000","last_change":"2024-02-13T00:29:55.897697+0000","last_active":"2024-02-13T00:30:07.977313+0000","last_peered":"2024-02-13T00:30:07.977313+0000","last_clean":"2024-02-13T00:30:07.977313+0000","last_became_active":"2024-02-13T00:29:55.896558+0000","last_became_peered":"2024-02-13T00:29:55.896558+0000","last_unstale":"2024-02-13T00:30:07.977313+0000","last_undegraded":"2024-02-13T00:30:07.977313+0000","last_fullsized":"2024-02-13T00:30:07.977313+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.976552+0000","last_change":"2024-02-13T00:29:57.938950+0000","last_active":"2024-02-13T00:30:07.976552+0000","last_peered":"2024-02-13T00:30:07.976552+0000","last_clean":"2024-02-13T00:30:07.976552+0000","last_became_active":"2024-02-13T00:29:57.938634+0000","last_became_peered":"2024-02-13T00:29:57.938634+0000","last_unstale":"2024-02-13T00:30:07.976552+0000","last_undegraded":"2024-02-13T00:30:07.976552+0000","last_fullsized":"2024-02-13T00:30:07.976552+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.978658+0000","last_change":"2024-02-13T00:29:55.897423+0000","last_active":"2024-02-13T00:30:07.978658+0000","last_peered":"2024-02-13T00:30:07.978658+0000","last_clean":"2024-02-13T00:30:07.978658+0000","last_became_active":"2024-02-13T00:29:55.897017+0000","last_became_peered":"2024-02-13T00:29:55.897017+0000","last_unstale":"2024-02-13T00:30:07.978658+0000","last_undegraded":"2024-02-13T00:30:07.978658+0000","last_fullsized":"2024-02-13T00:30:07.978658+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.978023+0000","last_change":"2024-02-13T00:29:51.866582+0000","last_active":"2024-02-13T00:30:07.978023+0000","last_peered":"2024-02-13T00:30:07.978023+0000","last_clean":"2024-02-13T00:30:07.978023+0000","last_became_active":"2024-02-13T00:29:51.866261+0000","last_became_peered":"2024-02-13T00:29:51.866261+0000","last_unstale":"2024-02-13T00:30:07.978023+0000","last_undegraded":"2024-02-13T00:30:07.978023+0000","last_fullsized":"2024-02-13T00:30:07.978023+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"60'25","reported_seq":63,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:08.055661+0000","last_change":"2024-02-13T00:29:54.018257+0000","last_active":"2024-02-13T00:30:08.055661+0000","last_peered":"2024-02-13T00:30:08.055661+0000","last_clean":"2024-02-13T00:30:08.055661+0000","last_became_active":"2024-02-13T00:29:54.017505+0000","last_became_peered":"2024-02-13T00:29:54.017505+0000","last_unstale":"2024-02-13T00:30:08.055661+0000","last_undegraded":"2024-02-13T00:30:08.055661+0000","last_fullsized":"2024-02-13T00:30:08.055661+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":44,"num_read_kb":32,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.977371+0000","last_change":"2024-02-13T00:29:57.934633+0000","last_active":"2024-02-13T00:30:07.977371+0000","last_peered":"2024-02-13T00:30:07.977371+0000","last_clean":"2024-02-13T00:30:07.977371+0000","last_became_active":"2024-02-13T00:29:57.934147+0000","last_became_peered":"2024-02-13T00:29:57.934147+0000","last_unstale":"2024-02-13T00:30:07.977371+0000","last_undegraded":"2024-02-13T00:30:07.977371+0000","last_fullsized":"2024-02-13T00:30:07.977371+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.978191+0000","last_change":"2024-02-13T00:29:55.891819+0000","last_active":"2024-02-13T00:30:07.978191+0000","last_peered":"2024-02-13T00:30:07.978191+0000","last_clean":"2024-02-13T00:30:07.978191+0000","last_became_active":"2024-02-13T00:29:55.890843+0000","last_became_peered":"2024-02-13T00:29:55.890843+0000","last_unstale":"2024-02-13T00:30:07.978191+0000","last_undegraded":"2024-02-13T00:30:07.978191+0000","last_fullsized":"2024-02-13T00:30:07.978191+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"53'1","reported_seq":25,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984938+0000","last_change":"2024-02-13T00:29:51.855439+0000","last_active":"2024-02-13T00:30:07.984938+0000","last_peered":"2024-02-13T00:30:07.984938+0000","last_clean":"2024-02-13T00:30:07.984938+0000","last_became_active":"2024-02-13T00:29:51.854933+0000","last_became_peered":"2024-02-13T00:29:51.854933+0000","last_unstale":"2024-02-13T00:30:07.984938+0000","last_undegraded":"2024-02-13T00:30:07.984938+0000","last_fullsized":"2024-02-13T00:30:07.984938+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"60'15","reported_seq":48,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.978588+0000","last_change":"2024-02-13T00:29:53.886296+0000","last_active":"2024-02-13T00:30:07.978588+0000","last_peered":"2024-02-13T00:30:07.978588+0000","last_clean":"2024-02-13T00:30:07.978588+0000","last_became_active":"2024-02-13T00:29:53.885914+0000","last_became_peered":"2024-02-13T00:29:53.885914+0000","last_unstale":"2024-02-13T00:30:07.978588+0000","last_undegraded":"2024-02-13T00:30:07.978588+0000","last_fullsized":"2024-02-13T00:30:07.978588+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":22,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.980316+0000","last_change":"2024-02-13T00:29:57.928794+0000","last_active":"2024-02-13T00:30:07.980316+0000","last_peered":"2024-02-13T00:30:07.980316+0000","last_clean":"2024-02-13T00:30:07.980316+0000","last_became_active":"2024-02-13T00:29:57.928471+0000","last_became_peered":"2024-02-13T00:29:57.928471+0000","last_unstale":"2024-02-13T00:30:07.980316+0000","last_undegraded":"2024-02-13T00:30:07.980316+0000","last_fullsized":"2024-02-13T00:30:07.980316+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.983906+0000","last_change":"2024-02-13T00:29:50.845936+0000","last_active":"2024-02-13T00:30:07.983906+0000","last_peered":"2024-02-13T00:30:07.983906+0000","last_clean":"2024-02-13T00:30:07.983906+0000","last_became_active":"2024-02-13T00:29:50.845548+0000","last_became_peered":"2024-02-13T00:29:50.845548+0000","last_unstale":"2024-02-13T00:30:07.983906+0000","last_undegraded":"2024-02-13T00:30:07.983906+0000","last_fullsized":"2024-02-13T00:30:07.983906+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:49.817545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:49.817545+0000","last_clean_scrub_stamp":"2024-02-13T00:29:49.817545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986512+0000","last_change":"2024-02-13T00:29:51.868180+0000","last_active":"2024-02-13T00:30:07.986512+0000","last_peered":"2024-02-13T00:30:07.986512+0000","last_clean":"2024-02-13T00:30:07.986512+0000","last_became_active":"2024-02-13T00:29:51.867847+0000","last_became_peered":"2024-02-13T00:29:51.867847+0000","last_unstale":"2024-02-13T00:30:07.986512+0000","last_undegraded":"2024-02-13T00:30:07.986512+0000","last_fullsized":"2024-02-13T00:30:07.986512+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"62'35","reported_seq":91,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-02-13T00:34:35.474753+0000","last_change":"2024-02-13T00:30:09.212086+0000","last_active":"2024-02-13T00:34:35.474753+0000","last_peered":"2024-02-13T00:34:35.474753+0000","last_clean":"2024-02-13T00:34:35.474753+0000","last_became_active":"2024-02-13T00:30:07.987864+0000","last_became_peered":"2024-02-13T00:30:07.987864+0000","last_unstale":"2024-02-13T00:34:35.474753+0000","last_undegraded":"2024-02-13T00:34:35.474753+0000","last_fullsized":"2024-02-13T00:34:35.474753+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":60,"num_read_kb":44,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.982672+0000","last_change":"2024-02-13T00:29:55.895518+0000","last_active":"2024-02-13T00:30:07.982672+0000","last_peered":"2024-02-13T00:30:07.982672+0000","last_clean":"2024-02-13T00:30:07.982672+0000","last_became_active":"2024-02-13T00:29:55.894925+0000","last_became_peered":"2024-02-13T00:29:55.894925+0000","last_unstale":"2024-02-13T00:30:07.982672+0000","last_undegraded":"2024-02-13T00:30:07.982672+0000","last_fullsized":"2024-02-13T00:30:07.982672+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"60'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.978459+0000","last_change":"2024-02-13T00:29:57.935922+0000","last_active":"2024-02-13T00:30:07.978459+0000","last_peered":"2024-02-13T00:30:07.978459+0000","last_clean":"2024-02-13T00:30:07.978459+0000","last_became_active":"2024-02-13T00:29:57.935576+0000","last_became_peered":"2024-02-13T00:29:57.935576+0000","last_unstale":"2024-02-13T00:30:07.978459+0000","last_undegraded":"2024-02-13T00:30:07.978459+0000","last_fullsized":"2024-02-13T00:30:07.978459+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.987068+0000","last_change":"2024-02-13T00:29:52.058691+0000","last_active":"2024-02-13T00:30:07.987068+0000","last_peered":"2024-02-13T00:30:07.987068+0000","last_clean":"2024-02-13T00:30:07.987068+0000","last_became_active":"2024-02-13T00:29:52.057462+0000","last_became_peered":"2024-02-13T00:29:52.057462+0000","last_unstale":"2024-02-13T00:30:07.987068+0000","last_undegraded":"2024-02-13T00:30:07.987068+0000","last_fullsized":"2024-02-13T00:30:07.987068+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.981462+0000","last_change":"2024-02-13T00:29:50.846750+0000","last_active":"2024-02-13T00:30:07.981462+0000","last_peered":"2024-02-13T00:30:07.981462+0000","last_clean":"2024-02-13T00:30:07.981462+0000","last_became_active":"2024-02-13T00:29:50.846411+0000","last_became_peered":"2024-02-13T00:29:50.846411+0000","last_unstale":"2024-02-13T00:30:07.981462+0000","last_undegraded":"2024-02-13T00:30:07.981462+0000","last_fullsized":"2024-02-13T00:30:07.981462+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:49.817545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:49.817545+0000","last_clean_scrub_stamp":"2024-02-13T00:29:49.817545+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'19","reported_seq":59,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.988859+0000","last_change":"2024-02-13T00:29:53.885430+0000","last_active":"2024-02-13T00:30:07.988859+0000","last_peered":"2024-02-13T00:30:07.988859+0000","last_clean":"2024-02-13T00:30:07.988859+0000","last_became_active":"2024-02-13T00:29:53.884985+0000","last_became_peered":"2024-02-13T00:29:53.884985+0000","last_unstale":"2024-02-13T00:30:07.988859+0000","last_undegraded":"2024-02-13T00:30:07.988859+0000","last_fullsized":"2024-02-13T00:30:07.988859+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":42,"num_read_kb":30,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.979271+0000","last_change":"2024-02-13T00:29:55.901379+0000","last_active":"2024-02-13T00:30:07.979271+0000","last_peered":"2024-02-13T00:30:07.979271+0000","last_clean":"2024-02-13T00:30:07.979271+0000","last_became_active":"2024-02-13T00:29:55.901059+0000","last_became_peered":"2024-02-13T00:29:55.901059+0000","last_unstale":"2024-02-13T00:30:07.979271+0000","last_undegraded":"2024-02-13T00:30:07.979271+0000","last_fullsized":"2024-02-13T00:30:07.979271+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.985089+0000","last_change":"2024-02-13T00:29:57.937448+0000","last_active":"2024-02-13T00:30:07.985089+0000","last_peered":"2024-02-13T00:30:07.985089+0000","last_clean":"2024-02-13T00:30:07.985089+0000","last_became_active":"2024-02-13T00:29:57.936964+0000","last_became_peered":"2024-02-13T00:29:57.936964+0000","last_unstale":"2024-02-13T00:30:07.985089+0000","last_undegraded":"2024-02-13T00:30:07.985089+0000","last_fullsized":"2024-02-13T00:30:07.985089+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":23,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.976383+0000","last_change":"2024-02-13T00:29:37.888561+0000","last_active":"2024-02-13T00:30:07.976383+0000","last_peered":"2024-02-13T00:30:07.976383+0000","last_clean":"2024-02-13T00:30:07.976383+0000","last_became_active":"2024-02-13T00:29:37.888117+0000","last_became_peered":"2024-02-13T00:29:37.888117+0000","last_unstale":"2024-02-13T00:30:07.976383+0000","last_undegraded":"2024-02-13T00:30:07.976383+0000","last_fullsized":"2024-02-13T00:30:07.976383+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:26:05.557302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:26:05.557302+0000","last_clean_scrub_stamp":"2024-02-13T00:26:05.557302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.981759+0000","last_change":"2024-02-13T00:29:51.857680+0000","last_active":"2024-02-13T00:30:07.981759+0000","last_peered":"2024-02-13T00:30:07.981759+0000","last_clean":"2024-02-13T00:30:07.981759+0000","last_became_active":"2024-02-13T00:29:51.857468+0000","last_became_peered":"2024-02-13T00:29:51.857468+0000","last_unstale":"2024-02-13T00:30:07.981759+0000","last_undegraded":"2024-02-13T00:30:07.981759+0000","last_fullsized":"2024-02-13T00:30:07.981759+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"60'14","reported_seq":39,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:08.056309+0000","last_change":"2024-02-13T00:29:54.018984+0000","last_active":"2024-02-13T00:30:08.056309+0000","last_peered":"2024-02-13T00:30:08.056309+0000","last_clean":"2024-02-13T00:30:08.056309+0000","last_became_active":"2024-02-13T00:29:54.018382+0000","last_became_peered":"2024-02-13T00:29:54.018382+0000","last_unstale":"2024-02-13T00:30:08.056309+0000","last_undegraded":"2024-02-13T00:30:08.056309+0000","last_fullsized":"2024-02-13T00:30:08.056309+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.977076+0000","last_change":"2024-02-13T00:29:55.902784+0000","last_active":"2024-02-13T00:30:07.977076+0000","last_peered":"2024-02-13T00:30:07.977076+0000","last_clean":"2024-02-13T00:30:07.977076+0000","last_became_active":"2024-02-13T00:29:55.902462+0000","last_became_peered":"2024-02-13T00:29:55.902462+0000","last_unstale":"2024-02-13T00:30:07.977076+0000","last_undegraded":"2024-02-13T00:30:07.977076+0000","last_fullsized":"2024-02-13T00:30:07.977076+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.988444+0000","last_change":"2024-02-13T00:29:57.932098+0000","last_active":"2024-02-13T00:30:07.988444+0000","last_peered":"2024-02-13T00:30:07.988444+0000","last_clean":"2024-02-13T00:30:07.988444+0000","last_became_active":"2024-02-13T00:29:57.931446+0000","last_became_peered":"2024-02-13T00:29:57.931446+0000","last_unstale":"2024-02-13T00:30:07.988444+0000","last_undegraded":"2024-02-13T00:30:07.988444+0000","last_fullsized":"2024-02-13T00:30:07.988444+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.977866+0000","last_change":"2024-02-13T00:29:51.860807+0000","last_active":"2024-02-13T00:30:07.977866+0000","last_peered":"2024-02-13T00:30:07.977866+0000","last_clean":"2024-02-13T00:30:07.977866+0000","last_became_active":"2024-02-13T00:29:51.860442+0000","last_became_peered":"2024-02-13T00:29:51.860442+0000","last_unstale":"2024-02-13T00:30:07.977866+0000","last_undegraded":"2024-02-13T00:30:07.977866+0000","last_fullsized":"2024-02-13T00:30:07.977866+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"60'5","reported_seq":304,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-02-13T00:34:40.883988+0000","last_change":"2024-02-13T00:29:50.846585+0000","last_active":"2024-02-13T00:34:40.883988+0000","last_peered":"2024-02-13T00:34:40.883988+0000","last_clean":"2024-02-13T00:34:40.883988+0000","last_became_active":"2024-02-13T00:29:50.846275+0000","last_became_peered":"2024-02-13T00:29:50.846275+0000","last_unstale":"2024-02-13T00:34:40.883988+0000","last_undegraded":"2024-02-13T00:34:40.883988+0000","last_fullsized":"2024-02-13T00:34:40.883988+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:49.817545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:49.817545+0000","last_clean_scrub_stamp":"2024-02-13T00:29:49.817545+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":281,"num_read_kb":276,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"60'12","reported_seq":35,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.979133+0000","last_change":"2024-02-13T00:29:53.887970+0000","last_active":"2024-02-13T00:30:07.979133+0000","last_peered":"2024-02-13T00:30:07.979133+0000","last_clean":"2024-02-13T00:30:07.979133+0000","last_became_active":"2024-02-13T00:29:53.887543+0000","last_became_peered":"2024-02-13T00:29:53.887543+0000","last_unstale":"2024-02-13T00:30:07.979133+0000","last_undegraded":"2024-02-13T00:30:07.979133+0000","last_fullsized":"2024-02-13T00:30:07.979133+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984954+0000","last_change":"2024-02-13T00:29:55.911189+0000","last_active":"2024-02-13T00:30:07.984954+0000","last_peered":"2024-02-13T00:30:07.984954+0000","last_clean":"2024-02-13T00:30:07.984954+0000","last_became_active":"2024-02-13T00:29:55.910875+0000","last_became_peered":"2024-02-13T00:29:55.910875+0000","last_unstale":"2024-02-13T00:30:07.984954+0000","last_undegraded":"2024-02-13T00:30:07.984954+0000","last_fullsized":"2024-02-13T00:30:07.984954+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986033+0000","last_change":"2024-02-13T00:29:57.930686+0000","last_active":"2024-02-13T00:30:07.986033+0000","last_peered":"2024-02-13T00:30:07.986033+0000","last_clean":"2024-02-13T00:30:07.986033+0000","last_became_active":"2024-02-13T00:29:57.929832+0000","last_became_peered":"2024-02-13T00:29:57.929832+0000","last_unstale":"2024-02-13T00:30:07.986033+0000","last_undegraded":"2024-02-13T00:30:07.986033+0000","last_fullsized":"2024-02-13T00:30:07.986033+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.988654+0000","last_change":"2024-02-13T00:29:52.059620+0000","last_active":"2024-02-13T00:30:07.988654+0000","last_peered":"2024-02-13T00:30:07.988654+0000","last_clean":"2024-02-13T00:30:07.988654+0000","last_became_active":"2024-02-13T00:29:52.058839+0000","last_became_peered":"2024-02-13T00:29:52.058839+0000","last_unstale":"2024-02-13T00:30:07.988654+0000","last_undegraded":"2024-02-13T00:30:07.988654+0000","last_fullsized":"2024-02-13T00:30:07.988654+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'25","reported_seq":68,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.979053+0000","last_change":"2024-02-13T00:29:54.016402+0000","last_active":"2024-02-13T00:30:07.979053+0000","last_peered":"2024-02-13T00:30:07.979053+0000","last_clean":"2024-02-13T00:30:07.979053+0000","last_became_active":"2024-02-13T00:29:54.015628+0000","last_became_peered":"2024-02-13T00:29:54.015628+0000","last_unstale":"2024-02-13T00:30:07.979053+0000","last_undegraded":"2024-02-13T00:30:07.979053+0000","last_fullsized":"2024-02-13T00:30:07.979053+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:08.055813+0000","last_change":"2024-02-13T00:29:55.907774+0000","last_active":"2024-02-13T00:30:08.055813+0000","last_peered":"2024-02-13T00:30:08.055813+0000","last_clean":"2024-02-13T00:30:08.055813+0000","last_became_active":"2024-02-13T00:29:55.907450+0000","last_became_peered":"2024-02-13T00:29:55.907450+0000","last_unstale":"2024-02-13T00:30:08.055813+0000","last_undegraded":"2024-02-13T00:30:08.055813+0000","last_fullsized":"2024-02-13T00:30:08.055813+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.977634+0000","last_change":"2024-02-13T00:29:57.933515+0000","last_active":"2024-02-13T00:30:07.977634+0000","last_peered":"2024-02-13T00:30:07.977634+0000","last_clean":"2024-02-13T00:30:07.977634+0000","last_became_active":"2024-02-13T00:29:57.933159+0000","last_became_peered":"2024-02-13T00:29:57.933159+0000","last_unstale":"2024-02-13T00:30:07.977634+0000","last_undegraded":"2024-02-13T00:30:07.977634+0000","last_fullsized":"2024-02-13T00:30:07.977634+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984673+0000","last_change":"2024-02-13T00:29:52.059873+0000","last_active":"2024-02-13T00:30:07.984673+0000","last_peered":"2024-02-13T00:30:07.984673+0000","last_clean":"2024-02-13T00:30:07.984673+0000","last_became_active":"2024-02-13T00:29:52.059460+0000","last_became_peered":"2024-02-13T00:29:52.059460+0000","last_unstale":"2024-02-13T00:30:07.984673+0000","last_undegraded":"2024-02-13T00:30:07.984673+0000","last_fullsized":"2024-02-13T00:30:07.984673+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"60'16","reported_seq":47,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.988232+0000","last_change":"2024-02-13T00:29:53.885962+0000","last_active":"2024-02-13T00:30:07.988232+0000","last_peered":"2024-02-13T00:30:07.988232+0000","last_clean":"2024-02-13T00:30:07.988232+0000","last_became_active":"2024-02-13T00:29:53.885452+0000","last_became_peered":"2024-02-13T00:29:53.885452+0000","last_unstale":"2024-02-13T00:30:07.988232+0000","last_undegraded":"2024-02-13T00:30:07.988232+0000","last_fullsized":"2024-02-13T00:30:07.988232+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"60'8","reported_seq":80,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-02-13T00:34:35.473388+0000","last_change":"2024-02-13T00:29:55.894896+0000","last_active":"2024-02-13T00:34:35.473388+0000","last_peered":"2024-02-13T00:34:35.473388+0000","last_clean":"2024-02-13T00:34:35.473388+0000","last_became_active":"2024-02-13T00:29:55.894537+0000","last_became_peered":"2024-02-13T00:29:55.894537+0000","last_unstale":"2024-02-13T00:34:35.473388+0000","last_undegraded":"2024-02-13T00:34:35.473388+0000","last_fullsized":"2024-02-13T00:34:35.473388+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.976745+0000","last_change":"2024-02-13T00:29:57.933576+0000","last_active":"2024-02-13T00:30:07.976745+0000","last_peered":"2024-02-13T00:30:07.976745+0000","last_clean":"2024-02-13T00:30:07.976745+0000","last_became_active":"2024-02-13T00:29:57.933073+0000","last_became_peered":"2024-02-13T00:29:57.933073+0000","last_unstale":"2024-02-13T00:30:07.976745+0000","last_undegraded":"2024-02-13T00:30:07.976745+0000","last_fullsized":"2024-02-13T00:30:07.976745+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.979324+0000","last_change":"2024-02-13T00:29:51.860843+0000","last_active":"2024-02-13T00:30:07.979324+0000","last_peered":"2024-02-13T00:30:07.979324+0000","last_clean":"2024-02-13T00:30:07.979324+0000","last_became_active":"2024-02-13T00:29:51.860440+0000","last_became_peered":"2024-02-13T00:29:51.860440+0000","last_unstale":"2024-02-13T00:30:07.979324+0000","last_undegraded":"2024-02-13T00:30:07.979324+0000","last_fullsized":"2024-02-13T00:30:07.979324+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"60'20","reported_seq":53,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986982+0000","last_change":"2024-02-13T00:29:53.876878+0000","last_active":"2024-02-13T00:30:07.986982+0000","last_peered":"2024-02-13T00:30:07.986982+0000","last_clean":"2024-02-13T00:30:07.986982+0000","last_became_active":"2024-02-13T00:29:53.876518+0000","last_became_peered":"2024-02-13T00:29:53.876518+0000","last_unstale":"2024-02-13T00:30:07.986982+0000","last_undegraded":"2024-02-13T00:30:07.986982+0000","last_fullsized":"2024-02-13T00:30:07.986982+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"60'8","reported_seq":80,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-02-13T00:34:35.473345+0000","last_change":"2024-02-13T00:29:55.894408+0000","last_active":"2024-02-13T00:34:35.473345+0000","last_peered":"2024-02-13T00:34:35.473345+0000","last_clean":"2024-02-13T00:34:35.473345+0000","last_became_active":"2024-02-13T00:29:55.894099+0000","last_became_peered":"2024-02-13T00:29:55.894099+0000","last_unstale":"2024-02-13T00:34:35.473345+0000","last_undegraded":"2024-02-13T00:34:35.473345+0000","last_fullsized":"2024-02-13T00:34:35.473345+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986346+0000","last_change":"2024-02-13T00:29:57.932671+0000","last_active":"2024-02-13T00:30:07.986346+0000","last_peered":"2024-02-13T00:30:07.986346+0000","last_clean":"2024-02-13T00:30:07.986346+0000","last_became_active":"2024-02-13T00:29:57.932347+0000","last_became_peered":"2024-02-13T00:29:57.932347+0000","last_unstale":"2024-02-13T00:30:07.986346+0000","last_undegraded":"2024-02-13T00:30:07.986346+0000","last_fullsized":"2024-02-13T00:30:07.986346+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"53'1","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.982048+0000","last_change":"2024-02-13T00:29:51.861926+0000","last_active":"2024-02-13T00:30:07.982048+0000","last_peered":"2024-02-13T00:30:07.982048+0000","last_clean":"2024-02-13T00:30:07.982048+0000","last_became_active":"2024-02-13T00:29:51.861557+0000","last_became_peered":"2024-02-13T00:29:51.861557+0000","last_unstale":"2024-02-13T00:30:07.982048+0000","last_undegraded":"2024-02-13T00:30:07.982048+0000","last_fullsized":"2024-02-13T00:30:07.982048+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":873,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"60'30","reported_seq":79,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.979961+0000","last_change":"2024-02-13T00:29:54.018457+0000","last_active":"2024-02-13T00:30:07.979961+0000","last_peered":"2024-02-13T00:30:07.979961+0000","last_clean":"2024-02-13T00:30:07.979961+0000","last_became_active":"2024-02-13T00:29:54.016352+0000","last_became_peered":"2024-02-13T00:29:54.016352+0000","last_unstale":"2024-02-13T00:30:07.979961+0000","last_undegraded":"2024-02-13T00:30:07.979961+0000","last_fullsized":"2024-02-13T00:30:07.979961+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":44,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986221+0000","last_change":"2024-02-13T00:29:55.896701+0000","last_active":"2024-02-13T00:30:07.986221+0000","last_peered":"2024-02-13T00:30:07.986221+0000","last_clean":"2024-02-13T00:30:07.986221+0000","last_became_active":"2024-02-13T00:29:55.895978+0000","last_became_peered":"2024-02-13T00:29:55.895978+0000","last_unstale":"2024-02-13T00:30:07.986221+0000","last_undegraded":"2024-02-13T00:30:07.986221+0000","last_fullsized":"2024-02-13T00:30:07.986221+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984317+0000","last_change":"2024-02-13T00:29:57.938930+0000","last_active":"2024-02-13T00:30:07.984317+0000","last_peered":"2024-02-13T00:30:07.984317+0000","last_clean":"2024-02-13T00:30:07.984317+0000","last_became_active":"2024-02-13T00:29:57.938451+0000","last_became_peered":"2024-02-13T00:29:57.938451+0000","last_unstale":"2024-02-13T00:30:07.984317+0000","last_undegraded":"2024-02-13T00:30:07.984317+0000","last_fullsized":"2024-02-13T00:30:07.984317+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"60'8","reported_seq":80,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-02-13T00:34:35.474237+0000","last_change":"2024-02-13T00:29:55.905253+0000","last_active":"2024-02-13T00:34:35.474237+0000","last_peered":"2024-02-13T00:34:35.474237+0000","last_clean":"2024-02-13T00:34:35.474237+0000","last_became_active":"2024-02-13T00:29:55.905024+0000","last_became_peered":"2024-02-13T00:29:55.905024+0000","last_unstale":"2024-02-13T00:34:35.474237+0000","last_undegraded":"2024-02-13T00:34:35.474237+0000","last_fullsized":"2024-02-13T00:34:35.474237+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.981835+0000","last_change":"2024-02-13T00:29:51.862577+0000","last_active":"2024-02-13T00:30:07.981835+0000","last_peered":"2024-02-13T00:30:07.981835+0000","last_clean":"2024-02-13T00:30:07.981835+0000","last_became_active":"2024-02-13T00:29:51.862174+0000","last_became_peered":"2024-02-13T00:29:51.862174+0000","last_unstale":"2024-02-13T00:30:07.981835+0000","last_undegraded":"2024-02-13T00:30:07.981835+0000","last_fullsized":"2024-02-13T00:30:07.981835+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"60'15","reported_seq":27,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:09.194458+0000","last_change":"2024-02-13T00:30:09.194008+0000","last_active":"2024-02-13T00:30:09.194458+0000","last_peered":"2024-02-13T00:30:09.194458+0000","last_clean":"2024-02-13T00:30:09.194458+0000","last_became_active":"2024-02-13T00:30:07.986058+0000","last_became_peered":"2024-02-13T00:30:07.986058+0000","last_unstale":"2024-02-13T00:30:09.194458+0000","last_undegraded":"2024-02-13T00:30:09.194458+0000","last_fullsized":"2024-02-13T00:30:09.194458+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.981306+0000","last_change":"2024-02-13T00:29:57.935164+0000","last_active":"2024-02-13T00:30:07.981306+0000","last_peered":"2024-02-13T00:30:07.981306+0000","last_clean":"2024-02-13T00:30:07.981306+0000","last_became_active":"2024-02-13T00:29:57.934643+0000","last_became_peered":"2024-02-13T00:29:57.934643+0000","last_unstale":"2024-02-13T00:30:07.981306+0000","last_undegraded":"2024-02-13T00:30:07.981306+0000","last_fullsized":"2024-02-13T00:30:07.981306+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.984878+0000","last_change":"2024-02-13T00:29:55.908938+0000","last_active":"2024-02-13T00:30:07.984878+0000","last_peered":"2024-02-13T00:30:07.984878+0000","last_clean":"2024-02-13T00:30:07.984878+0000","last_became_active":"2024-02-13T00:29:55.908549+0000","last_became_peered":"2024-02-13T00:29:55.908549+0000","last_unstale":"2024-02-13T00:30:07.984878+0000","last_undegraded":"2024-02-13T00:30:07.984878+0000","last_fullsized":"2024-02-13T00:30:07.984878+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986460+0000","last_change":"2024-02-13T00:29:52.060739+0000","last_active":"2024-02-13T00:30:07.986460+0000","last_peered":"2024-02-13T00:30:07.986460+0000","last_clean":"2024-02-13T00:30:07.986460+0000","last_became_active":"2024-02-13T00:29:52.059723+0000","last_became_peered":"2024-02-13T00:29:52.059723+0000","last_unstale":"2024-02-13T00:30:07.986460+0000","last_undegraded":"2024-02-13T00:30:07.986460+0000","last_fullsized":"2024-02-13T00:30:07.986460+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"60'17","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.987306+0000","last_change":"2024-02-13T00:29:53.876749+0000","last_active":"2024-02-13T00:30:07.987306+0000","last_peered":"2024-02-13T00:30:07.987306+0000","last_clean":"2024-02-13T00:30:07.987306+0000","last_became_active":"2024-02-13T00:29:53.876306+0000","last_became_peered":"2024-02-13T00:29:53.876306+0000","last_unstale":"2024-02-13T00:30:07.987306+0000","last_undegraded":"2024-02-13T00:30:07.987306+0000","last_fullsized":"2024-02-13T00:30:07.987306+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.980921+0000","last_change":"2024-02-13T00:29:57.936114+0000","last_active":"2024-02-13T00:30:07.980921+0000","last_peered":"2024-02-13T00:30:07.980921+0000","last_clean":"2024-02-13T00:30:07.980921+0000","last_became_active":"2024-02-13T00:29:57.935637+0000","last_became_peered":"2024-02-13T00:29:57.935637+0000","last_unstale":"2024-02-13T00:30:07.980921+0000","last_undegraded":"2024-02-13T00:30:07.980921+0000","last_fullsized":"2024-02-13T00:30:07.980921+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.990444+0000","last_change":"2024-02-13T00:29:55.900894+0000","last_active":"2024-02-13T00:30:07.990444+0000","last_peered":"2024-02-13T00:30:07.990444+0000","last_clean":"2024-02-13T00:30:07.990444+0000","last_became_active":"2024-02-13T00:29:55.900523+0000","last_became_peered":"2024-02-13T00:29:55.900523+0000","last_unstale":"2024-02-13T00:30:07.990444+0000","last_undegraded":"2024-02-13T00:30:07.990444+0000","last_fullsized":"2024-02-13T00:30:07.990444+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:08.055784+0000","last_change":"2024-02-13T00:29:51.862699+0000","last_active":"2024-02-13T00:30:08.055784+0000","last_peered":"2024-02-13T00:30:08.055784+0000","last_clean":"2024-02-13T00:30:08.055784+0000","last_became_active":"2024-02-13T00:29:51.862376+0000","last_became_peered":"2024-02-13T00:29:51.862376+0000","last_unstale":"2024-02-13T00:30:08.055784+0000","last_undegraded":"2024-02-13T00:30:08.055784+0000","last_fullsized":"2024-02-13T00:30:08.055784+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"60'17","reported_seq":45,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.988212+0000","last_change":"2024-02-13T00:29:53.881759+0000","last_active":"2024-02-13T00:30:07.988212+0000","last_peered":"2024-02-13T00:30:07.988212+0000","last_clean":"2024-02-13T00:30:07.988212+0000","last_became_active":"2024-02-13T00:29:53.881426+0000","last_became_peered":"2024-02-13T00:29:53.881426+0000","last_unstale":"2024-02-13T00:30:07.988212+0000","last_undegraded":"2024-02-13T00:30:07.988212+0000","last_fullsized":"2024-02-13T00:30:07.988212+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.987486+0000","last_change":"2024-02-13T00:29:57.938135+0000","last_active":"2024-02-13T00:30:07.987486+0000","last_peered":"2024-02-13T00:30:07.987486+0000","last_clean":"2024-02-13T00:30:07.987486+0000","last_became_active":"2024-02-13T00:29:57.937808+0000","last_became_peered":"2024-02-13T00:29:57.937808+0000","last_unstale":"2024-02-13T00:30:07.987486+0000","last_undegraded":"2024-02-13T00:30:07.987486+0000","last_fullsized":"2024-02-13T00:30:07.987486+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:56.902020+0000","last_clean_scrub_stamp":"2024-02-13T00:29:56.902020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"60'8","reported_seq":80,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-02-13T00:34:35.473907+0000","last_change":"2024-02-13T00:29:55.902644+0000","last_active":"2024-02-13T00:34:35.473907+0000","last_peered":"2024-02-13T00:34:35.473907+0000","last_clean":"2024-02-13T00:34:35.473907+0000","last_became_active":"2024-02-13T00:29:55.902213+0000","last_became_peered":"2024-02-13T00:29:55.902213+0000","last_unstale":"2024-02-13T00:34:35.473907+0000","last_undegraded":"2024-02-13T00:34:35.473907+0000","last_fullsized":"2024-02-13T00:34:35.473907+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:54.870113+0000","last_clean_scrub_stamp":"2024-02-13T00:29:54.870113+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.981173+0000","last_change":"2024-02-13T00:29:51.858677+0000","last_active":"2024-02-13T00:30:07.981173+0000","last_peered":"2024-02-13T00:30:07.981173+0000","last_clean":"2024-02-13T00:30:07.981173+0000","last_became_active":"2024-02-13T00:29:51.858230+0000","last_became_peered":"2024-02-13T00:29:51.858230+0000","last_unstale":"2024-02-13T00:30:07.981173+0000","last_undegraded":"2024-02-13T00:30:07.981173+0000","last_fullsized":"2024-02-13T00:30:07.981173+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:50.826115+0000","last_clean_scrub_stamp":"2024-02-13T00:29:50.826115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"60'10","reported_seq":32,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-02-13T00:30:07.986733+0000","last_change":"2024-02-13T00:29:53.881168+0000","last_active":"2024-02-13T00:30:07.986733+0000","last_peered":"2024-02-13T00:30:07.986733+0000","last_clean":"2024-02-13T00:30:07.986733+0000","last_became_active":"2024-02-13T00:29:53.880821+0000","last_became_peered":"2024-02-13T00:29:53.880821+0000","last_unstale":"2024-02-13T00:30:07.986733+0000","last_undegraded":"2024-02-13T00:30:07.986733+0000","last_fullsized":"2024-02-13T00:30:07.986733+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T00:29:52.849329+0000","last_clean_scrub_stamp":"2024-02-13T00:29:52.849329+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":209,"num_object_clones":0,"num_object_copies":627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":209,"num_whiteouts":0,"num_read":1082,"num_read_kb":807,"num_write":609,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":468,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":586,"ondisk_log_size":586,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1323,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":281,"num_read_kb":276,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":48,"seq":206158430272,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297788,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447364,"statfs":{"total":95995035648,"available":95690100736,"internally_reserved":0,"allocated":708608,"data_stored":289107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 00:33:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.83899999999999997,"15min":0.81999999999999995},"min":{"1min":0.63400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.89100000000000001,"15min":0.83299999999999996},"min":{"1min":0.60299999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.236,"5min":1.333,"15min":1.333},"last":0.89000000000000001}]},{"osd":1,"last update":"Tue Feb 13 00:33:44 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.90000000000000002,"15min":0.88600000000000001},"min":{"1min":0.63600000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.008,"5min":0.92700000000000005,"15min":0.89000000000000001},"min":{"1min":0.73499999999999999,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2110000000000001,"5min":1.302,"15min":1.302},"last":0.79800000000000004}]},{"osd":2,"last update":"Tue Feb 13 00:33:44 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.90300000000000002,"15min":0.873},"min":{"1min":0.69299999999999995,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.93000000000000005,"15min":0.90400000000000003},"min":{"1min":0.73499999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3049999999999999,"5min":1.387,"15min":1.387},"last":1.1659999999999999}]},{"osd":3,"last update":"Tue Feb 13 00:33:44 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.871,"15min":0.86799999999999999},"min":{"1min":0.71199999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.113,"5min":1.204,"15min":1.204},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.006,"5min":0.94899999999999995,"15min":0.93700000000000006},"min":{"1min":0.77600000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.284,"5min":1.339,"15min":1.339},"last":0.85799999999999998}]},{"osd":4,"last update":"Tue Feb 13 00:33:44 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.92000000000000004,"15min":0.84299999999999997},"min":{"1min":0.623,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.282,"5min":1.627,"15min":1.627},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.86099999999999999,"15min":0.80000000000000004},"min":{"1min":0.61499999999999999,"5min":0.433,"15min":0.433},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.83299999999999996}]},{"osd":5,"last update":"Tue Feb 13 00:33:44 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.91000000000000003,"15min":0.85399999999999998},"min":{"1min":0.72699999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.091,"5min":0.98599999999999999,"15min":0.90600000000000003},"min":{"1min":0.88300000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3999999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.1080000000000001}]},{"osd":6,"last update":"Tue Feb 13 00:33:44 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":0.996,"15min":0.92000000000000004},"min":{"1min":0.83399999999999996,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3740000000000001,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.0509999999999999,"15min":0.95599999999999996},"min":{"1min":0.93200000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4790000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.208}]}]},{"osd":6,"up_from":42,"seq":180388626504,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297760,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447392,"statfs":{"total":95995035648,"available":95690129408,"internally_reserved":0,"allocated":679936,"data_stored":287207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 00:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.84799999999999998,"15min":0.85199999999999998},"min":{"1min":0.55100000000000005,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.82699999999999996,"15min":0.81499999999999995},"min":{"1min":0.58799999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.165,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.80700000000000005}]},{"osd":1,"last update":"Tue Feb 13 00:34:04 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.93500000000000005,"15min":0.92100000000000004},"min":{"1min":0.50800000000000001,"5min":0.308,"15min":0.308},"max":{"1min":1.2569999999999999,"5min":1.427,"15min":1.427},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.90600000000000003,"15min":0.93600000000000005},"min":{"1min":0.65700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0780000000000001,"5min":1.419,"15min":1.419},"last":0.752}]},{"osd":2,"last update":"Tue Feb 13 00:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.84999999999999998,"15min":0.86399999999999999},"min":{"1min":0.60699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1879999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.86299999999999999,"15min":0.85899999999999999},"min":{"1min":0.69899999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0800000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.88200000000000001}]},{"osd":3,"last update":"Tue Feb 13 00:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.90800000000000003,"15min":0.91500000000000004},"min":{"1min":0.65700000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.2569999999999999,"5min":1.296,"15min":1.296},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.72399999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1120000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.78600000000000003}]},{"osd":4,"last update":"Tue Feb 13 00:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.81399999999999995,"15min":0.74199999999999999},"min":{"1min":0.63500000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.2749999999999999,"5min":1.288,"15min":1.288},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.86699999999999999,"15min":0.79600000000000004},"min":{"1min":0.66100000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.3740000000000001,"5min":1.415,"15min":1.415},"last":0.93999999999999995}]},{"osd":5,"last update":"Tue Feb 13 00:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.875,"15min":0.79900000000000004},"min":{"1min":0.61699999999999999,"5min":0.434,"15min":0.434},"max":{"1min":1.2030000000000001,"5min":1.22,"15min":1.22},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.0509999999999999,"5min":0.92700000000000005,"15min":0.86799999999999999},"min":{"1min":0.76700000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.89900000000000002}]},{"osd":7,"last update":"Tue Feb 13 00:33:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.91000000000000003,"15min":0.83899999999999997},"min":{"1min":0.68700000000000006,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.02,"15min":0.98399999999999999},"min":{"1min":0.84299999999999997,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.98899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297788,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447364,"statfs":{"total":95995035648,"available":95690100736,"internally_reserved":0,"allocated":708608,"data_stored":288061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 00:33:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.68600000000000005,"15min":0.57199999999999995},"min":{"1min":0.47299999999999998,"5min":0.40899999999999997,"15min":0.33000000000000002},"max":{"1min":0.88800000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73199999999999998,"15min":0.59899999999999998},"min":{"1min":0.51600000000000001,"5min":0.38100000000000001,"15min":0.34200000000000003},"max":{"1min":0.96499999999999997,"5min":1.294,"15min":1.294},"last":0.63400000000000001}]},{"osd":2,"last update":"Tue Feb 13 00:34:19 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.751,"15min":0.69699999999999995},"min":{"1min":0.57199999999999995,"5min":0.47299999999999998,"15min":0.39800000000000002},"max":{"1min":1.0069999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.755,"15min":0.69799999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.41399999999999998},"max":{"1min":1.147,"5min":1.149,"15min":1.5169999999999999},"last":0.80300000000000005}]},{"osd":3,"last update":"Tue Feb 13 00:33:56 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.82499999999999996,"15min":0.88400000000000001},"min":{"1min":0.63500000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.998,"5min":1.1799999999999999,"15min":2.9889999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56100000000000005,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0369999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.878}]},{"osd":4,"last update":"Tue Feb 13 00:33:44 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.95199999999999996,"15min":0.97599999999999998},"min":{"1min":0.70199999999999996,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.286,"5min":1.3009999999999999,"15min":1.9419999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.96699999999999997,"15min":0.95099999999999996},"min":{"1min":0.79500000000000004,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.3380000000000001,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.93700000000000006}]},{"osd":5,"last update":"Tue Feb 13 00:34:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0009999999999999,"15min":0.95499999999999996},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.03,"15min":1.0269999999999999},"min":{"1min":0.76600000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3140000000000001,"5min":1.597,"15min":1.597},"last":1.268}]},{"osd":6,"last update":"Tue Feb 13 00:33:56 2024","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.048,"15min":1.0409999999999999},"min":{"1min":0.82699999999999996,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.069},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.081,"15min":1.123},"min":{"1min":0.82099999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.3240000000000001,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.127}]},{"osd":7,"last update":"Tue Feb 13 00:33:44 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.099,"15min":1.1060000000000001},"min":{"1min":0.85799999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.3700000000000001,"5min":1.595,"15min":1.595},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.101,"15min":1.1100000000000001},"min":{"1min":0.86799999999999999,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.3080000000000001,"5min":1.625,"15min":1.625},"last":1.177}]}]},{"osd":0,"up_from":8,"seq":34359738490,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297784,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447368,"statfs":{"total":95995035648,"available":95690104832,"internally_reserved":0,"allocated":704512,"data_stored":288791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Feb 13 00:34:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.68700000000000006,"15min":0.60099999999999998},"min":{"1min":0.435,"5min":0.34000000000000002,"15min":0.30499999999999999},"max":{"1min":0.94899999999999995,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.63800000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.35899999999999999},"max":{"1min":1.036,"5min":1.149,"15min":1.173},"last":0.76000000000000001}]},{"osd":2,"last update":"Tue Feb 13 00:34:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.65600000000000003},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40500000000000003},"max":{"1min":0.86699999999999999,"5min":1.141,"15min":1.141},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.81000000000000005,"15min":0.72699999999999998},"min":{"1min":0.53900000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.0189999999999999,"5min":1.22,"15min":1.2829999999999999},"last":0.86899999999999999}]},{"osd":3,"last update":"Tue Feb 13 00:34:00 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.84099999999999997,"15min":0.79600000000000004},"min":{"1min":0.497,"5min":0.433,"15min":0.433},"max":{"1min":1.0940000000000001,"5min":1.175,"15min":1.175},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82499999999999996,"15min":0.78400000000000003},"min":{"1min":0.56299999999999994,"5min":0.45900000000000002,"15min":0.41399999999999998},"max":{"1min":1.1950000000000001,"5min":1.244,"15min":1.244},"last":0.97099999999999997}]},{"osd":4,"last update":"Tue Feb 13 00:33:41 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.98599999999999999,"15min":0.95899999999999996},"min":{"1min":0.69499999999999995,"5min":0.64400000000000002,"15min":0.58799999999999997},"max":{"1min":1.3149999999999999,"5min":1.431,"15min":1.431},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.96699999999999997,"15min":0.92000000000000004},"min":{"1min":0.70199999999999996,"5min":0.66500000000000004,"15min":0.55400000000000005},"max":{"1min":1.226,"5min":1.349,"15min":1.349},"last":0.95299999999999996}]},{"osd":5,"last update":"Tue Feb 13 00:34:21 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.0469999999999999,"15min":1.014},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1890000000000001,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.014,"15min":0.99399999999999999},"min":{"1min":0.80000000000000004,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.173,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.163}]},{"osd":6,"last update":"Tue Feb 13 00:34:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0660000000000001,"15min":1.0680000000000001},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.21},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.111,"15min":1.135},"min":{"1min":0.82099999999999995,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.4430000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.042}]},{"osd":7,"last update":"Tue Feb 13 00:33:52 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2070000000000001,"15min":1.2110000000000001},"min":{"1min":0.77500000000000002,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":3.1789999999999998,"5min":3.1789999999999998,"15min":3.1789999999999998},"last":1.077},{"interface":"front","average":{"1min":1.248,"5min":1.1859999999999999,"15min":1.1839999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.21,"5min":3.21,"15min":3.21},"last":1.0640000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411433,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297760,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447392,"statfs":{"total":95995035648,"available":95690129408,"internally_reserved":0,"allocated":679936,"data_stored":287394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 00:34:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67000000000000004,"15min":0.626},"min":{"1min":0.45000000000000001,"5min":0.433,"15min":0.41199999999999998},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76200000000000001,"15min":0.69299999999999995},"min":{"1min":0.57599999999999996,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.117,"5min":1.135,"15min":1.165},"last":0.80200000000000005}]},{"osd":1,"last update":"Tue Feb 13 00:34:15 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72099999999999997,"15min":0.67200000000000004},"min":{"1min":0.54400000000000004,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.2330000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77700000000000002,"15min":0.70399999999999996},"min":{"1min":0.53400000000000003,"5min":0.313,"15min":0.313},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.92900000000000005}]},{"osd":3,"last update":"Tue Feb 13 00:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79500000000000004,"15min":0.76400000000000001},"min":{"1min":0.53200000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.997},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79500000000000004,"15min":0.78700000000000003},"min":{"1min":0.58799999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.407},"last":0.95499999999999996}]},{"osd":4,"last update":"Tue Feb 13 00:34:41 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.98399999999999999,"15min":0.95099999999999996},"min":{"1min":0.68700000000000006,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.1259999999999999,"5min":1.429,"15min":1.429},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.93500000000000005,"15min":0.95399999999999996},"min":{"1min":0.72699999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0820000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.018}]},{"osd":5,"last update":"Tue Feb 13 00:34:18 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":0.99099999999999999,"15min":1.022},"min":{"1min":0.745,"5min":0.622,"15min":0.622},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0609999999999999,"15min":1.075},"min":{"1min":0.79100000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6319999999999999,"5min":1.6519999999999999,"15min":1.6870000000000001},"last":1.173}]},{"osd":6,"last update":"Tue Feb 13 00:34:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.103,"15min":1.097},"min":{"1min":0.86199999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.069,"15min":1.0469999999999999},"min":{"1min":0.86499999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.1479999999999999}]},{"osd":7,"last update":"Tue Feb 13 00:33:49 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1040000000000001,"15min":1.0629999999999999},"min":{"1min":0.72799999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.2},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.167,"15min":1.125},"min":{"1min":0.98799999999999999,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.3049999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182497,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297804,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447348,"statfs":{"total":95995035648,"available":95690084352,"internally_reserved":0,"allocated":724992,"data_stored":289259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 00:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67700000000000005,"15min":0.64500000000000002},"min":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73999999999999999,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.034,"5min":1.214,"15min":1.214},"last":0.91300000000000003}]},{"osd":1,"last update":"Tue Feb 13 00:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.755,"15min":0.73699999999999999},"min":{"1min":0.51200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0269999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.54700000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.96999999999999997}]},{"osd":2,"last update":"Tue Feb 13 00:34:04 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.80300000000000005,"15min":0.79800000000000004},"min":{"1min":0.57199999999999995,"5min":0.379,"15min":0.379},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.77800000000000002,"15min":0.76500000000000001},"min":{"1min":0.54400000000000004,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.109,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.71399999999999997}]},{"osd":4,"last update":"Tue Feb 13 00:33:43 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.93700000000000006,"15min":0.92300000000000004},"min":{"1min":0.80200000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2030000000000001,"5min":1.2290000000000001,"15min":1.2649999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.036,"5min":0.98699999999999999,"15min":0.93300000000000005},"min":{"1min":0.81499999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.0529999999999999}]},{"osd":5,"last update":"Tue Feb 13 00:34:16 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.96999999999999997,"15min":0.98599999999999999},"min":{"1min":0.68500000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.411,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.024,"15min":1.038},"min":{"1min":0.72399999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.351}]},{"osd":6,"last update":"Tue Feb 13 00:34:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0309999999999999,"15min":1.075},"min":{"1min":0.74299999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.052,"15min":1.1100000000000001},"min":{"1min":0.78100000000000003,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.1819999999999999}]},{"osd":7,"last update":"Tue Feb 13 00:33:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.115,"15min":1.1160000000000001},"min":{"1min":0.93300000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3069999999999999,"5min":1.347,"15min":1.347},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.125,"15min":1.1379999999999999},"min":{"1min":0.85999999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4059999999999999,"5min":1.488,"15min":1.488},"last":1.1579999999999999}]}]},{"osd":4,"up_from":30,"seq":128849018969,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297780,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447372,"statfs":{"total":95995035648,"available":95690108928,"internally_reserved":0,"allocated":700416,"data_stored":287683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 00:34:40 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.89600000000000002,"15min":0.91100000000000003},"min":{"1min":0.627,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.2130000000000001,"5min":1.341,"15min":1.341},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.052,"5min":0.93500000000000005,"15min":0.96799999999999997},"min":{"1min":0.58999999999999997,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.74399999999999999}]},{"osd":1,"last update":"Tue Feb 13 00:34:40 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.84899999999999998,"15min":0.82999999999999996},"min":{"1min":0.70499999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1679999999999999,"5min":1.333,"15min":1.333},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.85099999999999998,"15min":0.85599999999999998},"min":{"1min":0.64700000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.167,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.64700000000000002}]},{"osd":2,"last update":"Tue Feb 13 00:34:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.86199999999999999,"15min":0.85199999999999998},"min":{"1min":0.66900000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.872,"15min":0.87},"min":{"1min":0.70499999999999996,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2390000000000001,"5min":1.371,"15min":1.371},"last":0.97999999999999998}]},{"osd":3,"last update":"Tue Feb 13 00:34:40 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.89800000000000002,"15min":0.88800000000000001},"min":{"1min":0.747,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1679999999999999,"5min":1.45,"15min":1.45},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.0669999999999999,"5min":0.94899999999999995,"15min":0.93600000000000005},"min":{"1min":0.92200000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.198,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":1.016}]},{"osd":5,"last update":"Tue Feb 13 00:34:27 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.87,"15min":0.82299999999999995},"min":{"1min":0.77200000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.345,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.97699999999999998,"15min":0.91300000000000003},"min":{"1min":0.71499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.274,"5min":1.298,"15min":1.298},"last":1.085}]},{"osd":6,"last update":"Tue Feb 13 00:34:01 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.86899999999999999,"15min":0.83599999999999997},"min":{"1min":0.64700000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.258,"5min":1.425,"15min":1.425},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.113,"5min":1.0149999999999999,"15min":0.99099999999999999},"min":{"1min":0.70699999999999996,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3080000000000001,"5min":1.415,"15min":1.415},"last":1.0660000000000001}]},{"osd":7,"last update":"Tue Feb 13 00:33:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":0.93400000000000005,"15min":0.85399999999999998},"min":{"1min":0.71699999999999997,"5min":0.435,"15min":0.435},"max":{"1min":1.3200000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.92900000000000005,"15min":0.86299999999999999},"min":{"1min":0.82499999999999996,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.282,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.89100000000000001}]}]},{"osd":5,"up_from":36,"seq":154618822737,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297776,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447376,"statfs":{"total":95995035648,"available":95690113024,"internally_reserved":0,"allocated":696320,"data_stored":287877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 00:34:21 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.85499999999999998,"15min":0.84099999999999997},"min":{"1min":0.68300000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.2310000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.87,"15min":0.93400000000000005},"min":{"1min":0.61099999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2010000000000001,"5min":1.236,"15min":1.236},"last":0.86399999999999999}]},{"osd":1,"last update":"Tue Feb 13 00:34:21 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.88800000000000001,"15min":0.876},"min":{"1min":0.61599999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.85999999999999999,"15min":0.84099999999999997},"min":{"1min":0.63400000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.256,"5min":1.284,"15min":1.284},"last":0.72699999999999998}]},{"osd":2,"last update":"Tue Feb 13 00:34:21 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.88600000000000001,"15min":0.89500000000000002},"min":{"1min":0.63200000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1799999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.01,"5min":0.93799999999999994,"15min":0.95799999999999996},"min":{"1min":0.71299999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2290000000000001,"5min":1.359,"15min":1.546},"last":0.66400000000000003}]},{"osd":3,"last update":"Tue Feb 13 00:34:21 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.91300000000000003,"15min":0.93999999999999995},"min":{"1min":0.70299999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.238,"5min":1.849,"15min":1.849},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.99099999999999999,"15min":0.98899999999999999},"min":{"1min":0.75900000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.4590000000000001},"last":0.753}]},{"osd":4,"last update":"Tue Feb 13 00:34:21 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.80400000000000005,"15min":0.76900000000000002},"min":{"1min":0.60199999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.89500000000000002,"15min":0.83899999999999997},"min":{"1min":0.745,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.0509999999999999}]},{"osd":6,"last update":"Tue Feb 13 00:34:03 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":0.89700000000000002,"15min":0.81200000000000006},"min":{"1min":0.79100000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.036,"5min":0.90200000000000002,"15min":0.86499999999999999},"min":{"1min":0.81999999999999995,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.2629999999999999,"5min":1.363,"15min":1.363},"last":1.0940000000000001}]},{"osd":7,"last update":"Tue Feb 13 00:33:44 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.048,"15min":0.91700000000000004},"min":{"1min":0.71799999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.403,"5min":6.0039999999999996,"15min":6.0039999999999996},"last":1.004},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0169999999999999,"15min":0.92500000000000004},"min":{"1min":0.79600000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.323,"5min":5.04,"15min":5.04},"last":1.0289999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-13T00:34:43.695 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-13T00:34:43.695 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-13T00:34:43.695 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-13T00:34:43.696 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 -- ceph health --format=json 2024-02-13T00:34:44.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:43 smithi080 bash[17386]: cluster 2024-02-13T00:34:42.774399+0000 mgr.y (mgr.24461) 188 : cluster [DBG] pgmap v136: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:44.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:43 smithi080 bash[17386]: audit 2024-02-13T00:34:42.940245+0000 mgr.y (mgr.24461) 189 : audit [DBG] from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-13T00:34:44.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:43 smithi080 bash[24237]: cluster 2024-02-13T00:34:42.774399+0000 mgr.y (mgr.24461) 188 : cluster [DBG] pgmap v136: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:44.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:43 smithi080 bash[24237]: audit 2024-02-13T00:34:42.940245+0000 mgr.y (mgr.24461) 189 : audit [DBG] from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-13T00:34:44.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:43 smithi106 bash[18459]: cluster 2024-02-13T00:34:42.774399+0000 mgr.y (mgr.24461) 188 : cluster [DBG] pgmap v136: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:44.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:43 smithi106 bash[18459]: audit 2024-02-13T00:34:42.940245+0000 mgr.y (mgr.24461) 189 : audit [DBG] from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-13T00:34:46.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:45 smithi106 bash[18459]: cluster 2024-02-13T00:34:44.775127+0000 mgr.y (mgr.24461) 190 : cluster [DBG] pgmap v137: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:46.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:45 smithi080 bash[17386]: cluster 2024-02-13T00:34:44.775127+0000 mgr.y (mgr.24461) 190 : cluster [DBG] pgmap v137: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:46.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:45 smithi080 bash[24237]: cluster 2024-02-13T00:34:44.775127+0000 mgr.y (mgr.24461) 190 : cluster [DBG] pgmap v137: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:48.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:47 smithi106 bash[18459]: cluster 2024-02-13T00:34:46.775828+0000 mgr.y (mgr.24461) 191 : cluster [DBG] pgmap v138: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:48.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:34:47 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:34:48.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:47 smithi080 bash[17386]: cluster 2024-02-13T00:34:46.775828+0000 mgr.y (mgr.24461) 191 : cluster [DBG] pgmap v138: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:48.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:47 smithi080 bash[24237]: cluster 2024-02-13T00:34:46.775828+0000 mgr.y (mgr.24461) 191 : cluster [DBG] pgmap v138: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:48.479 INFO:teuthology.orchestra.run.smithi080.stderr:Inferring config /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T00:34:49.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:48 smithi106 bash[18459]: audit 2024-02-13T00:34:47.909363+0000 mgr.y (mgr.24461) 192 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:34:49.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:48 smithi080 bash[17386]: audit 2024-02-13T00:34:47.909363+0000 mgr.y (mgr.24461) 192 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:34:49.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:48 smithi080 bash[24237]: audit 2024-02-13T00:34:47.909363+0000 mgr.y (mgr.24461) 192 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:34:50.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:49 smithi106 bash[18459]: cluster 2024-02-13T00:34:48.776625+0000 mgr.y (mgr.24461) 193 : cluster [DBG] pgmap v139: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:50.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:49 smithi080 bash[17386]: cluster 2024-02-13T00:34:48.776625+0000 mgr.y (mgr.24461) 193 : cluster [DBG] pgmap v139: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:50.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:49 smithi080 bash[24237]: cluster 2024-02-13T00:34:48.776625+0000 mgr.y (mgr.24461) 193 : cluster [DBG] pgmap v139: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:50.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:34:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:34:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:34:51.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75b69ee700 1 -- 172.21.15.80:0/967854370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75b00f68d0 msgr2=0x7f75b0104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:51.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75b69ee700 1 --2- 172.21.15.80:0/967854370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75b00f68d0 0x7f75b0104b80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f75a8009be0 tx=0x7f75a8004d10).stop 2024-02-13T00:34:51.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75b69ee700 1 -- 172.21.15.80:0/967854370 shutdown_connections 2024-02-13T00:34:51.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75b69ee700 1 --2- 172.21.15.80:0/967854370 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75b00f68d0 0x7f75b0104b80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:51.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75b69ee700 1 --2- 172.21.15.80:0/967854370 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75b00fdd10 0x7f75b00fe0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:51.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75b69ee700 1 --2- 172.21.15.80:0/967854370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75b00fe670 0x7f75b00f61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:51.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75b69ee700 1 -- 172.21.15.80:0/967854370 >> 172.21.15.80:0/967854370 conn(0x7f75b00701f0 msgr2=0x7f75b00f4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:34:51.367 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75b69ee700 1 -- 172.21.15.80:0/967854370 shutdown_connections 2024-02-13T00:34:51.368 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75b69ee700 1 -- 172.21.15.80:0/967854370 wait complete. 2024-02-13T00:34:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75b69ee700 1 Processor -- start 2024-02-13T00:34:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75b69ee700 1 -- start start 2024-02-13T00:34:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75b69ee700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75b00f68d0 0x7f75b00f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75b69ee700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75b00fdd10 0x7f75b00f79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75b69ee700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75b00fe670 0x7f75b00f7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75b69ee700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b0116270 con 0x7f75b00fdd10 2024-02-13T00:34:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75b69ee700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b01163e0 con 0x7f75b00fe670 2024-02-13T00:34:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75b69ee700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b01165a0 con 0x7f75b00f68d0 2024-02-13T00:34:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75affff700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75b00f68d0 0x7f75b00f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75a77fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75b00fdd10 0x7f75b00f79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75affff700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75b00f68d0 0x7f75b00f74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:44380/0 (socket says 172.21.15.80:44380) 2024-02-13T00:34:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75affff700 1 -- 172.21.15.80:0/3705680714 learned_addr learned my addr 172.21.15.80:0/3705680714 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:34:51.369 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75b4f8b700 1 --2- 172.21.15.80:0/3705680714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75b00fe670 0x7f75b00f7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:51.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75affff700 1 -- 172.21.15.80:0/3705680714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75b00fe670 msgr2=0x7f75b00f7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:51.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75affff700 1 --2- 172.21.15.80:0/3705680714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75b00fe670 0x7f75b00f7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:51.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75affff700 1 -- 172.21.15.80:0/3705680714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75b00fdd10 msgr2=0x7f75b00f79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:51.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75affff700 1 --2- 172.21.15.80:0/3705680714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75b00fdd10 0x7f75b00f79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:51.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75affff700 1 -- 172.21.15.80:0/3705680714 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a80097c0 con 0x7f75b00f68d0 2024-02-13T00:34:51.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75a77fe700 1 --2- 172.21.15.80:0/3705680714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75b00fdd10 0x7f75b00f79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:34:51.370 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75affff700 1 --2- 172.21.15.80:0/3705680714 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75b00f68d0 0x7f75b00f74c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f75a000e970 tx=0x7f75a000b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:34:51.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75adffb700 1 -- 172.21.15.80:0/3705680714 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a0004660 con 0x7f75b00f68d0 2024-02-13T00:34:51.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75adffb700 1 -- 172.21.15.80:0/3705680714 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f75a000f040 con 0x7f75b00f68d0 2024-02-13T00:34:51.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75b69ee700 1 -- 172.21.15.80:0/3705680714 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b0116880 con 0x7f75b00f68d0 2024-02-13T00:34:51.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75b69ee700 1 -- 172.21.15.80:0/3705680714 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b0116e40 con 0x7f75b00f68d0 2024-02-13T00:34:51.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.362+0000 7f75adffb700 1 -- 172.21.15.80:0/3705680714 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a00146f0 con 0x7f75b00f68d0 2024-02-13T00:34:51.371 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.366+0000 7f75b69ee700 1 -- 172.21.15.80:0/3705680714 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b005fad0 con 0x7f75b00f68d0 2024-02-13T00:34:51.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.366+0000 7f75adffb700 1 -- 172.21.15.80:0/3705680714 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f75a0007b40 con 0x7f75b00f68d0 2024-02-13T00:34:51.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.366+0000 7f75adffb700 1 --2- 172.21.15.80:0/3705680714 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f759c061340 0x7f759c063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:34:51.372 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.366+0000 7f75adffb700 1 -- 172.21.15.80:0/3705680714 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 7392+0+0 (secure 0 0 0) 0x7f75a007c8c0 con 0x7f75b00f68d0 2024-02-13T00:34:51.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.366+0000 7f75a77fe700 1 --2- 172.21.15.80:0/3705680714 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f759c061340 0x7f759c063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:34:51.373 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.366+0000 7f75a77fe700 1 --2- 172.21.15.80:0/3705680714 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f759c061340 0x7f759c063800 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f75b00f8c60 tx=0x7f759800b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:34:51.380 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.374+0000 7f75adffb700 1 -- 172.21.15.80:0/3705680714 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f75a004c7b0 con 0x7f75b00f68d0 2024-02-13T00:34:51.604 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.598+0000 7f75b69ee700 1 -- 172.21.15.80:0/3705680714 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f75b00f89a0 con 0x7f75b00f68d0 2024-02-13T00:34:51.605 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.598+0000 7f75adffb700 1 -- 172.21.15.80:0/3705680714 <== mon.2 v2:172.21.15.80:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f75a0019040 con 0x7f75b00f68d0 2024-02-13T00:34:51.605 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-13T00:34:51.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.602+0000 7f75b69ee700 1 -- 172.21.15.80:0/3705680714 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f759c061340 msgr2=0x7f759c063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:51.607 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.602+0000 7f75b69ee700 1 --2- 172.21.15.80:0/3705680714 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f759c061340 0x7f759c063800 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f75b00f8c60 tx=0x7f759800b040).stop 2024-02-13T00:34:51.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.602+0000 7f75b69ee700 1 -- 172.21.15.80:0/3705680714 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75b00f68d0 msgr2=0x7f75b00f74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:34:51.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.602+0000 7f75b69ee700 1 --2- 172.21.15.80:0/3705680714 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75b00f68d0 0x7f75b00f74c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f75a000e970 tx=0x7f75a000b040).stop 2024-02-13T00:34:51.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.602+0000 7f75b69ee700 1 -- 172.21.15.80:0/3705680714 shutdown_connections 2024-02-13T00:34:51.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.602+0000 7f75b69ee700 1 --2- 172.21.15.80:0/3705680714 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f759c061340 0x7f759c063800 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:51.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.602+0000 7f75b69ee700 1 --2- 172.21.15.80:0/3705680714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75b00fe670 0x7f75b00f7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:51.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.602+0000 7f75b69ee700 1 --2- 172.21.15.80:0/3705680714 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f75b00f68d0 0x7f75b00f74c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:51.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.602+0000 7f75b69ee700 1 --2- 172.21.15.80:0/3705680714 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f75b00fdd10 0x7f75b00f79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:34:51.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.602+0000 7f75b69ee700 1 -- 172.21.15.80:0/3705680714 >> 172.21.15.80:0/3705680714 conn(0x7f75b00701f0 msgr2=0x7f75b006d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:34:51.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.602+0000 7f75b69ee700 1 -- 172.21.15.80:0/3705680714 shutdown_connections 2024-02-13T00:34:51.608 INFO:teuthology.orchestra.run.smithi080.stderr:2024-02-13T00:34:51.602+0000 7f75b69ee700 1 -- 172.21.15.80:0/3705680714 wait complete. 2024-02-13T00:34:52.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:51 smithi080 bash[17386]: cluster 2024-02-13T00:34:50.777290+0000 mgr.y (mgr.24461) 194 : cluster [DBG] pgmap v140: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:52.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:51 smithi080 bash[17386]: audit 2024-02-13T00:34:51.602879+0000 mon.c (mon.2) 66 : audit [DBG] from='client.? 172.21.15.80:0/3705680714' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-13T00:34:52.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:51 smithi080 bash[24237]: cluster 2024-02-13T00:34:50.777290+0000 mgr.y (mgr.24461) 194 : cluster [DBG] pgmap v140: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:52.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:51 smithi080 bash[24237]: audit 2024-02-13T00:34:51.602879+0000 mon.c (mon.2) 66 : audit [DBG] from='client.? 172.21.15.80:0/3705680714' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-13T00:34:52.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:51 smithi106 bash[18459]: cluster 2024-02-13T00:34:50.777290+0000 mgr.y (mgr.24461) 194 : cluster [DBG] pgmap v140: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:52.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:51 smithi106 bash[18459]: audit 2024-02-13T00:34:51.602879+0000 mon.c (mon.2) 66 : audit [DBG] from='client.? 172.21.15.80:0/3705680714' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-13T00:34:52.400 INFO:teuthology.orchestra.run.smithi080.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-13T00:34:52.401 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-13T00:34:52.401 INFO:tasks.cephadm:Setup complete, yielding 2024-02-13T00:34:52.401 INFO:teuthology.run_tasks:Running task workunit... 2024-02-13T00:34:52.416 INFO:tasks.workunit:Pulling workunits from ref 84e714279aa684636ac645daf0a1a85c2094cfb3 2024-02-13T00:34:52.416 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-13T00:34:52.416 DEBUG:teuthology.orchestra.run.smithi080:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-13T00:34:52.424 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-13T00:34:52.424 INFO:teuthology.orchestra.run.smithi080.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-02-13T00:34:52.425 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-02-13T00:34:52.473 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-02-13T00:34:52.473 DEBUG:teuthology.orchestra.run.smithi080:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-02-13T00:34:52.523 INFO:tasks.workunit:timeout=3h 2024-02-13T00:34:52.523 INFO:tasks.workunit:cleanup=True 2024-02-13T00:34:52.523 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ljflores/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 84e714279aa684636ac645daf0a1a85c2094cfb3 2024-02-13T00:34:52.575 INFO:tasks.workunit.client.0.smithi080.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-13T00:34:53.116 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:52 smithi080 bash[17386]: audit 2024-02-13T00:34:52.431828+0000 mon.c (mon.2) 67 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:34:53.116 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:52 smithi080 bash[17386]: audit 2024-02-13T00:34:52.733687+0000 mon.c (mon.2) 68 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:34:53.116 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:52 smithi080 bash[17386]: audit 2024-02-13T00:34:52.735366+0000 mon.c (mon.2) 69 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:34:53.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:52 smithi080 bash[17386]: audit 2024-02-13T00:34:52.743595+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:34:53.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:52 smithi080 bash[24237]: audit 2024-02-13T00:34:52.431828+0000 mon.c (mon.2) 67 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:34:53.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:52 smithi080 bash[24237]: audit 2024-02-13T00:34:52.733687+0000 mon.c (mon.2) 68 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:34:53.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:52 smithi080 bash[24237]: audit 2024-02-13T00:34:52.735366+0000 mon.c (mon.2) 69 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:34:53.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:52 smithi080 bash[24237]: audit 2024-02-13T00:34:52.743595+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:34:53.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:52 smithi106 bash[18459]: audit 2024-02-13T00:34:52.431828+0000 mon.c (mon.2) 67 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:34:53.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:52 smithi106 bash[18459]: audit 2024-02-13T00:34:52.733687+0000 mon.c (mon.2) 68 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:34:53.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:52 smithi106 bash[18459]: audit 2024-02-13T00:34:52.735366+0000 mon.c (mon.2) 69 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:34:53.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:52 smithi106 bash[18459]: audit 2024-02-13T00:34:52.743595+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:34:53.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:34:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:34:53] "GET /metrics HTTP/1.1" 200 172239 "" "Prometheus/2.33.4" 2024-02-13T00:34:54.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:53 smithi106 bash[18459]: cluster 2024-02-13T00:34:52.778798+0000 mgr.y (mgr.24461) 195 : cluster [DBG] pgmap v141: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:54.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:53 smithi080 bash[17386]: cluster 2024-02-13T00:34:52.778798+0000 mgr.y (mgr.24461) 195 : cluster [DBG] pgmap v141: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:54.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:53 smithi080 bash[24237]: cluster 2024-02-13T00:34:52.778798+0000 mgr.y (mgr.24461) 195 : cluster [DBG] pgmap v141: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:34:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:55 smithi106 bash[18459]: cluster 2024-02-13T00:34:54.779570+0000 mgr.y (mgr.24461) 196 : cluster [DBG] pgmap v142: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:55 smithi080 bash[17386]: cluster 2024-02-13T00:34:54.779570+0000 mgr.y (mgr.24461) 196 : cluster [DBG] pgmap v142: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:56.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:55 smithi080 bash[24237]: cluster 2024-02-13T00:34:54.779570+0000 mgr.y (mgr.24461) 196 : cluster [DBG] pgmap v142: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:57 smithi106 bash[18459]: cluster 2024-02-13T00:34:56.780018+0000 mgr.y (mgr.24461) 197 : cluster [DBG] pgmap v143: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:58.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:34:57 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:34:58.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:57 smithi080 bash[24237]: cluster 2024-02-13T00:34:56.780018+0000 mgr.y (mgr.24461) 197 : cluster [DBG] pgmap v143: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:58.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:57 smithi080 bash[17386]: cluster 2024-02-13T00:34:56.780018+0000 mgr.y (mgr.24461) 197 : cluster [DBG] pgmap v143: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:34:59.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:58 smithi106 bash[18459]: audit 2024-02-13T00:34:57.917343+0000 mgr.y (mgr.24461) 198 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:34:59.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:58 smithi080 bash[17386]: audit 2024-02-13T00:34:57.917343+0000 mgr.y (mgr.24461) 198 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:34:59.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:58 smithi080 bash[24237]: audit 2024-02-13T00:34:57.917343+0000 mgr.y (mgr.24461) 198 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:35:00.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:34:59 smithi106 bash[18459]: cluster 2024-02-13T00:34:58.780938+0000 mgr.y (mgr.24461) 199 : cluster [DBG] pgmap v144: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:00.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:34:59 smithi080 bash[17386]: cluster 2024-02-13T00:34:58.780938+0000 mgr.y (mgr.24461) 199 : cluster [DBG] pgmap v144: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:00.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:34:59 smithi080 bash[24237]: cluster 2024-02-13T00:34:58.780938+0000 mgr.y (mgr.24461) 199 : cluster [DBG] pgmap v144: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:00.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:35:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:35:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:35:02.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:01 smithi106 bash[18459]: cluster 2024-02-13T00:35:00.781494+0000 mgr.y (mgr.24461) 200 : cluster [DBG] pgmap v145: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:02.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:01 smithi080 bash[24237]: cluster 2024-02-13T00:35:00.781494+0000 mgr.y (mgr.24461) 200 : cluster [DBG] pgmap v145: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:02.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:01 smithi080 bash[17386]: cluster 2024-02-13T00:35:00.781494+0000 mgr.y (mgr.24461) 200 : cluster [DBG] pgmap v145: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:03.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:35:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:35:03] "GET /metrics HTTP/1.1" 200 172240 "" "Prometheus/2.33.4" 2024-02-13T00:35:04.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:03 smithi106 bash[18459]: cluster 2024-02-13T00:35:02.782908+0000 mgr.y (mgr.24461) 201 : cluster [DBG] pgmap v146: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:04.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:03 smithi080 bash[17386]: cluster 2024-02-13T00:35:02.782908+0000 mgr.y (mgr.24461) 201 : cluster [DBG] pgmap v146: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:04.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:03 smithi080 bash[24237]: cluster 2024-02-13T00:35:02.782908+0000 mgr.y (mgr.24461) 201 : cluster [DBG] pgmap v146: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:06.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:05 smithi106 bash[18459]: cluster 2024-02-13T00:35:04.783719+0000 mgr.y (mgr.24461) 202 : cluster [DBG] pgmap v147: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:06.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:05 smithi080 bash[17386]: cluster 2024-02-13T00:35:04.783719+0000 mgr.y (mgr.24461) 202 : cluster [DBG] pgmap v147: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:06.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:05 smithi080 bash[24237]: cluster 2024-02-13T00:35:04.783719+0000 mgr.y (mgr.24461) 202 : cluster [DBG] pgmap v147: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:08.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:35:07 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:35:08.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:07 smithi106 bash[18459]: cluster 2024-02-13T00:35:06.784384+0000 mgr.y (mgr.24461) 203 : cluster [DBG] pgmap v148: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:08.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:07 smithi080 bash[17386]: cluster 2024-02-13T00:35:06.784384+0000 mgr.y (mgr.24461) 203 : cluster [DBG] pgmap v148: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:08.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:07 smithi080 bash[24237]: cluster 2024-02-13T00:35:06.784384+0000 mgr.y (mgr.24461) 203 : cluster [DBG] pgmap v148: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:09.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:08 smithi106 bash[18459]: audit 2024-02-13T00:35:07.925368+0000 mgr.y (mgr.24461) 204 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:35:09.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:08 smithi080 bash[17386]: audit 2024-02-13T00:35:07.925368+0000 mgr.y (mgr.24461) 204 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:35:09.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:08 smithi080 bash[24237]: audit 2024-02-13T00:35:07.925368+0000 mgr.y (mgr.24461) 204 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:35:10.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:09 smithi106 bash[18459]: cluster 2024-02-13T00:35:08.785723+0000 mgr.y (mgr.24461) 205 : cluster [DBG] pgmap v149: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:10.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:09 smithi080 bash[17386]: cluster 2024-02-13T00:35:08.785723+0000 mgr.y (mgr.24461) 205 : cluster [DBG] pgmap v149: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:10.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:09 smithi080 bash[24237]: cluster 2024-02-13T00:35:08.785723+0000 mgr.y (mgr.24461) 205 : cluster [DBG] pgmap v149: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:10.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:35:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:35:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:35:12.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:11 smithi106 bash[18459]: cluster 2024-02-13T00:35:10.786357+0000 mgr.y (mgr.24461) 206 : cluster [DBG] pgmap v150: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:12.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:11 smithi080 bash[17386]: cluster 2024-02-13T00:35:10.786357+0000 mgr.y (mgr.24461) 206 : cluster [DBG] pgmap v150: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:12.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:11 smithi080 bash[24237]: cluster 2024-02-13T00:35:10.786357+0000 mgr.y (mgr.24461) 206 : cluster [DBG] pgmap v150: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:13.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:35:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:35:13] "GET /metrics HTTP/1.1" 200 172240 "" "Prometheus/2.33.4" 2024-02-13T00:35:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:13 smithi106 bash[18459]: cluster 2024-02-13T00:35:12.787595+0000 mgr.y (mgr.24461) 207 : cluster [DBG] pgmap v151: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:14.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:13 smithi080 bash[17386]: cluster 2024-02-13T00:35:12.787595+0000 mgr.y (mgr.24461) 207 : cluster [DBG] pgmap v151: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:14.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:13 smithi080 bash[24237]: cluster 2024-02-13T00:35:12.787595+0000 mgr.y (mgr.24461) 207 : cluster [DBG] pgmap v151: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:16.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:15 smithi106 bash[18459]: cluster 2024-02-13T00:35:14.788252+0000 mgr.y (mgr.24461) 208 : cluster [DBG] pgmap v152: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:16.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:15 smithi080 bash[17386]: cluster 2024-02-13T00:35:14.788252+0000 mgr.y (mgr.24461) 208 : cluster [DBG] pgmap v152: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:16.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:15 smithi080 bash[24237]: cluster 2024-02-13T00:35:14.788252+0000 mgr.y (mgr.24461) 208 : cluster [DBG] pgmap v152: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:18.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:17 smithi106 bash[18459]: cluster 2024-02-13T00:35:16.788881+0000 mgr.y (mgr.24461) 209 : cluster [DBG] pgmap v153: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:18.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:35:17 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:35:18.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:17 smithi080 bash[17386]: cluster 2024-02-13T00:35:16.788881+0000 mgr.y (mgr.24461) 209 : cluster [DBG] pgmap v153: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:18.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:17 smithi080 bash[24237]: cluster 2024-02-13T00:35:16.788881+0000 mgr.y (mgr.24461) 209 : cluster [DBG] pgmap v153: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:19.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:18 smithi106 bash[18459]: audit 2024-02-13T00:35:17.933434+0000 mgr.y (mgr.24461) 210 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:35:19.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:18 smithi080 bash[17386]: audit 2024-02-13T00:35:17.933434+0000 mgr.y (mgr.24461) 210 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:35:19.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:18 smithi080 bash[24237]: audit 2024-02-13T00:35:17.933434+0000 mgr.y (mgr.24461) 210 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:35:20.142 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:19 smithi106 bash[18459]: cluster 2024-02-13T00:35:18.790329+0000 mgr.y (mgr.24461) 211 : cluster [DBG] pgmap v154: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:20.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:19 smithi080 bash[17386]: cluster 2024-02-13T00:35:18.790329+0000 mgr.y (mgr.24461) 211 : cluster [DBG] pgmap v154: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:20.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:19 smithi080 bash[24237]: cluster 2024-02-13T00:35:18.790329+0000 mgr.y (mgr.24461) 211 : cluster [DBG] pgmap v154: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:20.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:35:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:35:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:35:22.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:21 smithi106 bash[18459]: cluster 2024-02-13T00:35:20.790935+0000 mgr.y (mgr.24461) 212 : cluster [DBG] pgmap v155: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:22.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:21 smithi080 bash[17386]: cluster 2024-02-13T00:35:20.790935+0000 mgr.y (mgr.24461) 212 : cluster [DBG] pgmap v155: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:22.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:21 smithi080 bash[24237]: cluster 2024-02-13T00:35:20.790935+0000 mgr.y (mgr.24461) 212 : cluster [DBG] pgmap v155: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:23.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:35:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:35:23] "GET /metrics HTTP/1.1" 200 172241 "" "Prometheus/2.33.4" 2024-02-13T00:35:24.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:23 smithi106 bash[18459]: cluster 2024-02-13T00:35:22.792394+0000 mgr.y (mgr.24461) 213 : cluster [DBG] pgmap v156: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:24.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:23 smithi080 bash[17386]: cluster 2024-02-13T00:35:22.792394+0000 mgr.y (mgr.24461) 213 : cluster [DBG] pgmap v156: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:24.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:23 smithi080 bash[24237]: cluster 2024-02-13T00:35:22.792394+0000 mgr.y (mgr.24461) 213 : cluster [DBG] pgmap v156: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:26.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:25 smithi106 bash[18459]: cluster 2024-02-13T00:35:24.793064+0000 mgr.y (mgr.24461) 214 : cluster [DBG] pgmap v157: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:26.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:25 smithi080 bash[17386]: cluster 2024-02-13T00:35:24.793064+0000 mgr.y (mgr.24461) 214 : cluster [DBG] pgmap v157: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:26.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:25 smithi080 bash[24237]: cluster 2024-02-13T00:35:24.793064+0000 mgr.y (mgr.24461) 214 : cluster [DBG] pgmap v157: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:28.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:35:27 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:35:28.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:27 smithi106 bash[18459]: cluster 2024-02-13T00:35:26.794044+0000 mgr.y (mgr.24461) 215 : cluster [DBG] pgmap v158: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:28.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:27 smithi080 bash[17386]: cluster 2024-02-13T00:35:26.794044+0000 mgr.y (mgr.24461) 215 : cluster [DBG] pgmap v158: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:28.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:27 smithi080 bash[24237]: cluster 2024-02-13T00:35:26.794044+0000 mgr.y (mgr.24461) 215 : cluster [DBG] pgmap v158: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:29.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:28 smithi106 bash[18459]: audit 2024-02-13T00:35:27.944873+0000 mgr.y (mgr.24461) 216 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:35:29.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:28 smithi080 bash[17386]: audit 2024-02-13T00:35:27.944873+0000 mgr.y (mgr.24461) 216 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:35:29.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:28 smithi080 bash[24237]: audit 2024-02-13T00:35:27.944873+0000 mgr.y (mgr.24461) 216 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:35:30.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:29 smithi106 bash[18459]: cluster 2024-02-13T00:35:28.795475+0000 mgr.y (mgr.24461) 217 : cluster [DBG] pgmap v159: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:30.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:29 smithi080 bash[17386]: cluster 2024-02-13T00:35:28.795475+0000 mgr.y (mgr.24461) 217 : cluster [DBG] pgmap v159: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:30.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:29 smithi080 bash[24237]: cluster 2024-02-13T00:35:28.795475+0000 mgr.y (mgr.24461) 217 : cluster [DBG] pgmap v159: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:30.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:35:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:35:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:35:32.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:31 smithi106 bash[18459]: cluster 2024-02-13T00:35:30.796156+0000 mgr.y (mgr.24461) 218 : cluster [DBG] pgmap v160: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:32.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:31 smithi080 bash[17386]: cluster 2024-02-13T00:35:30.796156+0000 mgr.y (mgr.24461) 218 : cluster [DBG] pgmap v160: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:32.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:31 smithi080 bash[24237]: cluster 2024-02-13T00:35:30.796156+0000 mgr.y (mgr.24461) 218 : cluster [DBG] pgmap v160: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:33.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:35:33 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:35:33] "GET /metrics HTTP/1.1" 200 172245 "" "Prometheus/2.33.4" 2024-02-13T00:35:34.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:33 smithi106 bash[18459]: cluster 2024-02-13T00:35:32.797415+0000 mgr.y (mgr.24461) 219 : cluster [DBG] pgmap v161: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:34.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:33 smithi080 bash[17386]: cluster 2024-02-13T00:35:32.797415+0000 mgr.y (mgr.24461) 219 : cluster [DBG] pgmap v161: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:34.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:33 smithi080 bash[24237]: cluster 2024-02-13T00:35:32.797415+0000 mgr.y (mgr.24461) 219 : cluster [DBG] pgmap v161: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:36.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:35 smithi106 bash[18459]: cluster 2024-02-13T00:35:34.797932+0000 mgr.y (mgr.24461) 220 : cluster [DBG] pgmap v162: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:36.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:35 smithi080 bash[17386]: cluster 2024-02-13T00:35:34.797932+0000 mgr.y (mgr.24461) 220 : cluster [DBG] pgmap v162: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:36.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:35 smithi080 bash[24237]: cluster 2024-02-13T00:35:34.797932+0000 mgr.y (mgr.24461) 220 : cluster [DBG] pgmap v162: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:38.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:37 smithi106 bash[18459]: cluster 2024-02-13T00:35:36.798607+0000 mgr.y (mgr.24461) 221 : cluster [DBG] pgmap v163: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:38.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:35:37 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:35:38.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:37 smithi080 bash[17386]: cluster 2024-02-13T00:35:36.798607+0000 mgr.y (mgr.24461) 221 : cluster [DBG] pgmap v163: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:38.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:37 smithi080 bash[24237]: cluster 2024-02-13T00:35:36.798607+0000 mgr.y (mgr.24461) 221 : cluster [DBG] pgmap v163: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:39.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:38 smithi106 bash[18459]: audit 2024-02-13T00:35:37.953547+0000 mgr.y (mgr.24461) 222 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:35:39.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:38 smithi080 bash[17386]: audit 2024-02-13T00:35:37.953547+0000 mgr.y (mgr.24461) 222 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:35:39.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:38 smithi080 bash[24237]: audit 2024-02-13T00:35:37.953547+0000 mgr.y (mgr.24461) 222 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:35:40.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:39 smithi106 bash[18459]: cluster 2024-02-13T00:35:38.799969+0000 mgr.y (mgr.24461) 223 : cluster [DBG] pgmap v164: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:40.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:39 smithi080 bash[17386]: cluster 2024-02-13T00:35:38.799969+0000 mgr.y (mgr.24461) 223 : cluster [DBG] pgmap v164: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:40.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:39 smithi080 bash[24237]: cluster 2024-02-13T00:35:38.799969+0000 mgr.y (mgr.24461) 223 : cluster [DBG] pgmap v164: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:40.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:35:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:35:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:35:42.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:41 smithi106 bash[18459]: cluster 2024-02-13T00:35:40.800531+0000 mgr.y (mgr.24461) 224 : cluster [DBG] pgmap v165: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:42.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:41 smithi080 bash[17386]: cluster 2024-02-13T00:35:40.800531+0000 mgr.y (mgr.24461) 224 : cluster [DBG] pgmap v165: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:42.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:41 smithi080 bash[24237]: cluster 2024-02-13T00:35:40.800531+0000 mgr.y (mgr.24461) 224 : cluster [DBG] pgmap v165: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:43.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:35:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:35:43] "GET /metrics HTTP/1.1" 200 172245 "" "Prometheus/2.33.4" 2024-02-13T00:35:44.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:43 smithi106 bash[18459]: cluster 2024-02-13T00:35:42.801791+0000 mgr.y (mgr.24461) 225 : cluster [DBG] pgmap v166: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:44.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:43 smithi080 bash[17386]: cluster 2024-02-13T00:35:42.801791+0000 mgr.y (mgr.24461) 225 : cluster [DBG] pgmap v166: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:44.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:43 smithi080 bash[24237]: cluster 2024-02-13T00:35:42.801791+0000 mgr.y (mgr.24461) 225 : cluster [DBG] pgmap v166: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:46.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:45 smithi106 bash[18459]: cluster 2024-02-13T00:35:44.802281+0000 mgr.y (mgr.24461) 226 : cluster [DBG] pgmap v167: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:46.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:45 smithi080 bash[17386]: cluster 2024-02-13T00:35:44.802281+0000 mgr.y (mgr.24461) 226 : cluster [DBG] pgmap v167: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:46.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:45 smithi080 bash[24237]: cluster 2024-02-13T00:35:44.802281+0000 mgr.y (mgr.24461) 226 : cluster [DBG] pgmap v167: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:48.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:47 smithi106 bash[18459]: cluster 2024-02-13T00:35:46.802965+0000 mgr.y (mgr.24461) 227 : cluster [DBG] pgmap v168: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:48.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:35:47 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:35:48.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:47 smithi080 bash[17386]: cluster 2024-02-13T00:35:46.802965+0000 mgr.y (mgr.24461) 227 : cluster [DBG] pgmap v168: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:48.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:47 smithi080 bash[24237]: cluster 2024-02-13T00:35:46.802965+0000 mgr.y (mgr.24461) 227 : cluster [DBG] pgmap v168: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:49.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:48 smithi106 bash[18459]: audit 2024-02-13T00:35:47.957375+0000 mgr.y (mgr.24461) 228 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:35:49.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:48 smithi080 bash[17386]: audit 2024-02-13T00:35:47.957375+0000 mgr.y (mgr.24461) 228 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:35:49.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:48 smithi080 bash[24237]: audit 2024-02-13T00:35:47.957375+0000 mgr.y (mgr.24461) 228 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:35:50.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:49 smithi106 bash[18459]: cluster 2024-02-13T00:35:48.804122+0000 mgr.y (mgr.24461) 229 : cluster [DBG] pgmap v169: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:50.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:49 smithi080 bash[17386]: cluster 2024-02-13T00:35:48.804122+0000 mgr.y (mgr.24461) 229 : cluster [DBG] pgmap v169: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:50.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:49 smithi080 bash[24237]: cluster 2024-02-13T00:35:48.804122+0000 mgr.y (mgr.24461) 229 : cluster [DBG] pgmap v169: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:50.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:35:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:35:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:35:52.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:51 smithi106 bash[18459]: cluster 2024-02-13T00:35:50.804766+0000 mgr.y (mgr.24461) 230 : cluster [DBG] pgmap v170: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:52.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:51 smithi080 bash[17386]: cluster 2024-02-13T00:35:50.804766+0000 mgr.y (mgr.24461) 230 : cluster [DBG] pgmap v170: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:52.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:51 smithi080 bash[24237]: cluster 2024-02-13T00:35:50.804766+0000 mgr.y (mgr.24461) 230 : cluster [DBG] pgmap v170: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:53.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:52 smithi106 bash[18459]: audit 2024-02-13T00:35:52.752520+0000 mon.c (mon.2) 70 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:35:53.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:52 smithi080 bash[17386]: audit 2024-02-13T00:35:52.752520+0000 mon.c (mon.2) 70 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:35:53.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:52 smithi080 bash[24237]: audit 2024-02-13T00:35:52.752520+0000 mon.c (mon.2) 70 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:35:53.258 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:35:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:35:53] "GET /metrics HTTP/1.1" 200 172246 "" "Prometheus/2.33.4" 2024-02-13T00:35:54.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:53 smithi106 bash[18459]: cluster 2024-02-13T00:35:52.806266+0000 mgr.y (mgr.24461) 231 : cluster [DBG] pgmap v171: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:54.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:53 smithi106 bash[18459]: audit 2024-02-13T00:35:53.049035+0000 mon.c (mon.2) 71 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:35:54.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:53 smithi106 bash[18459]: audit 2024-02-13T00:35:53.050612+0000 mon.c (mon.2) 72 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:35:54.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:53 smithi106 bash[18459]: audit 2024-02-13T00:35:53.059993+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:35:54.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:53 smithi080 bash[17386]: cluster 2024-02-13T00:35:52.806266+0000 mgr.y (mgr.24461) 231 : cluster [DBG] pgmap v171: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:54.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:53 smithi080 bash[17386]: audit 2024-02-13T00:35:53.049035+0000 mon.c (mon.2) 71 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:35:54.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:53 smithi080 bash[17386]: audit 2024-02-13T00:35:53.050612+0000 mon.c (mon.2) 72 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:35:54.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:53 smithi080 bash[17386]: audit 2024-02-13T00:35:53.059993+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:35:54.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:53 smithi080 bash[24237]: cluster 2024-02-13T00:35:52.806266+0000 mgr.y (mgr.24461) 231 : cluster [DBG] pgmap v171: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:35:54.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:53 smithi080 bash[24237]: audit 2024-02-13T00:35:53.049035+0000 mon.c (mon.2) 71 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:35:54.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:53 smithi080 bash[24237]: audit 2024-02-13T00:35:53.050612+0000 mon.c (mon.2) 72 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:35:54.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:53 smithi080 bash[24237]: audit 2024-02-13T00:35:53.059993+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:35:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:55 smithi106 bash[18459]: cluster 2024-02-13T00:35:54.806944+0000 mgr.y (mgr.24461) 232 : cluster [DBG] pgmap v172: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:56.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:55 smithi080 bash[17386]: cluster 2024-02-13T00:35:54.806944+0000 mgr.y (mgr.24461) 232 : cluster [DBG] pgmap v172: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:56.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:55 smithi080 bash[24237]: cluster 2024-02-13T00:35:54.806944+0000 mgr.y (mgr.24461) 232 : cluster [DBG] pgmap v172: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:57 smithi106 bash[18459]: cluster 2024-02-13T00:35:56.807639+0000 mgr.y (mgr.24461) 233 : cluster [DBG] pgmap v173: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:58.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:35:57 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:35:58.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:57 smithi080 bash[17386]: cluster 2024-02-13T00:35:56.807639+0000 mgr.y (mgr.24461) 233 : cluster [DBG] pgmap v173: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:58.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:57 smithi080 bash[24237]: cluster 2024-02-13T00:35:56.807639+0000 mgr.y (mgr.24461) 233 : cluster [DBG] pgmap v173: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:35:59.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:58 smithi106 bash[18459]: audit 2024-02-13T00:35:57.968086+0000 mgr.y (mgr.24461) 234 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:35:59.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:58 smithi080 bash[17386]: audit 2024-02-13T00:35:57.968086+0000 mgr.y (mgr.24461) 234 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:35:59.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:58 smithi080 bash[24237]: audit 2024-02-13T00:35:57.968086+0000 mgr.y (mgr.24461) 234 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:36:00.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:35:59 smithi106 bash[18459]: cluster 2024-02-13T00:35:58.808930+0000 mgr.y (mgr.24461) 235 : cluster [DBG] pgmap v174: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:00.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:35:59 smithi080 bash[17386]: cluster 2024-02-13T00:35:58.808930+0000 mgr.y (mgr.24461) 235 : cluster [DBG] pgmap v174: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:00.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:35:59 smithi080 bash[24237]: cluster 2024-02-13T00:35:58.808930+0000 mgr.y (mgr.24461) 235 : cluster [DBG] pgmap v174: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:00.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:36:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:36:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:36:02.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:01 smithi106 bash[18459]: cluster 2024-02-13T00:36:00.809645+0000 mgr.y (mgr.24461) 236 : cluster [DBG] pgmap v175: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:02.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:01 smithi080 bash[17386]: cluster 2024-02-13T00:36:00.809645+0000 mgr.y (mgr.24461) 236 : cluster [DBG] pgmap v175: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:02.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:01 smithi080 bash[24237]: cluster 2024-02-13T00:36:00.809645+0000 mgr.y (mgr.24461) 236 : cluster [DBG] pgmap v175: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:03.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:36:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:36:03] "GET /metrics HTTP/1.1" 200 172235 "" "Prometheus/2.33.4" 2024-02-13T00:36:04.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:03 smithi106 bash[18459]: cluster 2024-02-13T00:36:02.810886+0000 mgr.y (mgr.24461) 237 : cluster [DBG] pgmap v176: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:04.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:03 smithi080 bash[17386]: cluster 2024-02-13T00:36:02.810886+0000 mgr.y (mgr.24461) 237 : cluster [DBG] pgmap v176: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:04.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:03 smithi080 bash[24237]: cluster 2024-02-13T00:36:02.810886+0000 mgr.y (mgr.24461) 237 : cluster [DBG] pgmap v176: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:06.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:05 smithi106 bash[18459]: cluster 2024-02-13T00:36:04.811606+0000 mgr.y (mgr.24461) 238 : cluster [DBG] pgmap v177: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:06.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:05 smithi080 bash[17386]: cluster 2024-02-13T00:36:04.811606+0000 mgr.y (mgr.24461) 238 : cluster [DBG] pgmap v177: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:06.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:05 smithi080 bash[24237]: cluster 2024-02-13T00:36:04.811606+0000 mgr.y (mgr.24461) 238 : cluster [DBG] pgmap v177: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:08.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:07 smithi106 bash[18459]: cluster 2024-02-13T00:36:06.812353+0000 mgr.y (mgr.24461) 239 : cluster [DBG] pgmap v178: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:08.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:36:07 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:36:08.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:07 smithi080 bash[17386]: cluster 2024-02-13T00:36:06.812353+0000 mgr.y (mgr.24461) 239 : cluster [DBG] pgmap v178: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:08.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:07 smithi080 bash[24237]: cluster 2024-02-13T00:36:06.812353+0000 mgr.y (mgr.24461) 239 : cluster [DBG] pgmap v178: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:09.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:08 smithi106 bash[18459]: audit 2024-02-13T00:36:07.979532+0000 mgr.y (mgr.24461) 240 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:36:09.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:08 smithi080 bash[17386]: audit 2024-02-13T00:36:07.979532+0000 mgr.y (mgr.24461) 240 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:36:09.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:08 smithi080 bash[24237]: audit 2024-02-13T00:36:07.979532+0000 mgr.y (mgr.24461) 240 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:36:10.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:09 smithi106 bash[18459]: cluster 2024-02-13T00:36:08.813795+0000 mgr.y (mgr.24461) 241 : cluster [DBG] pgmap v179: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:10.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:09 smithi080 bash[17386]: cluster 2024-02-13T00:36:08.813795+0000 mgr.y (mgr.24461) 241 : cluster [DBG] pgmap v179: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:10.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:09 smithi080 bash[24237]: cluster 2024-02-13T00:36:08.813795+0000 mgr.y (mgr.24461) 241 : cluster [DBG] pgmap v179: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:10.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:36:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:36:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:36:12.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:11 smithi106 bash[18459]: cluster 2024-02-13T00:36:10.814452+0000 mgr.y (mgr.24461) 242 : cluster [DBG] pgmap v180: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:12.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:11 smithi080 bash[17386]: cluster 2024-02-13T00:36:10.814452+0000 mgr.y (mgr.24461) 242 : cluster [DBG] pgmap v180: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:12.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:11 smithi080 bash[24237]: cluster 2024-02-13T00:36:10.814452+0000 mgr.y (mgr.24461) 242 : cluster [DBG] pgmap v180: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:13.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:36:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:36:13] "GET /metrics HTTP/1.1" 200 172235 "" "Prometheus/2.33.4" 2024-02-13T00:36:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:13 smithi106 bash[18459]: cluster 2024-02-13T00:36:12.815838+0000 mgr.y (mgr.24461) 243 : cluster [DBG] pgmap v181: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:14.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:13 smithi080 bash[17386]: cluster 2024-02-13T00:36:12.815838+0000 mgr.y (mgr.24461) 243 : cluster [DBG] pgmap v181: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:14.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:13 smithi080 bash[24237]: cluster 2024-02-13T00:36:12.815838+0000 mgr.y (mgr.24461) 243 : cluster [DBG] pgmap v181: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:16.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:15 smithi106 bash[18459]: cluster 2024-02-13T00:36:14.816468+0000 mgr.y (mgr.24461) 244 : cluster [DBG] pgmap v182: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:16.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:15 smithi080 bash[17386]: cluster 2024-02-13T00:36:14.816468+0000 mgr.y (mgr.24461) 244 : cluster [DBG] pgmap v182: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:16.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:15 smithi080 bash[24237]: cluster 2024-02-13T00:36:14.816468+0000 mgr.y (mgr.24461) 244 : cluster [DBG] pgmap v182: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:18.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:17 smithi106 bash[18459]: cluster 2024-02-13T00:36:16.817066+0000 mgr.y (mgr.24461) 245 : cluster [DBG] pgmap v183: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:18.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:36:17 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:36:18.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:17 smithi080 bash[17386]: cluster 2024-02-13T00:36:16.817066+0000 mgr.y (mgr.24461) 245 : cluster [DBG] pgmap v183: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:18.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:17 smithi080 bash[24237]: cluster 2024-02-13T00:36:16.817066+0000 mgr.y (mgr.24461) 245 : cluster [DBG] pgmap v183: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:19.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:18 smithi106 bash[18459]: audit 2024-02-13T00:36:17.990965+0000 mgr.y (mgr.24461) 246 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:36:19.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:18 smithi080 bash[17386]: audit 2024-02-13T00:36:17.990965+0000 mgr.y (mgr.24461) 246 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:36:19.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:18 smithi080 bash[24237]: audit 2024-02-13T00:36:17.990965+0000 mgr.y (mgr.24461) 246 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:36:20.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:19 smithi106 bash[18459]: cluster 2024-02-13T00:36:18.818499+0000 mgr.y (mgr.24461) 247 : cluster [DBG] pgmap v184: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:20.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:19 smithi080 bash[17386]: cluster 2024-02-13T00:36:18.818499+0000 mgr.y (mgr.24461) 247 : cluster [DBG] pgmap v184: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:20.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:19 smithi080 bash[24237]: cluster 2024-02-13T00:36:18.818499+0000 mgr.y (mgr.24461) 247 : cluster [DBG] pgmap v184: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:20.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:36:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:36:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:36:22.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:21 smithi106 bash[18459]: cluster 2024-02-13T00:36:20.819212+0000 mgr.y (mgr.24461) 248 : cluster [DBG] pgmap v185: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:22.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:21 smithi080 bash[17386]: cluster 2024-02-13T00:36:20.819212+0000 mgr.y (mgr.24461) 248 : cluster [DBG] pgmap v185: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:22.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:21 smithi080 bash[24237]: cluster 2024-02-13T00:36:20.819212+0000 mgr.y (mgr.24461) 248 : cluster [DBG] pgmap v185: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:23.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:36:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:36:23] "GET /metrics HTTP/1.1" 200 172243 "" "Prometheus/2.33.4" 2024-02-13T00:36:24.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:23 smithi106 bash[18459]: cluster 2024-02-13T00:36:22.820304+0000 mgr.y (mgr.24461) 249 : cluster [DBG] pgmap v186: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:24.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:23 smithi080 bash[17386]: cluster 2024-02-13T00:36:22.820304+0000 mgr.y (mgr.24461) 249 : cluster [DBG] pgmap v186: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:24.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:23 smithi080 bash[24237]: cluster 2024-02-13T00:36:22.820304+0000 mgr.y (mgr.24461) 249 : cluster [DBG] pgmap v186: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:26.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:25 smithi106 bash[18459]: cluster 2024-02-13T00:36:24.820982+0000 mgr.y (mgr.24461) 250 : cluster [DBG] pgmap v187: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:26.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:25 smithi080 bash[17386]: cluster 2024-02-13T00:36:24.820982+0000 mgr.y (mgr.24461) 250 : cluster [DBG] pgmap v187: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:26.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:25 smithi080 bash[24237]: cluster 2024-02-13T00:36:24.820982+0000 mgr.y (mgr.24461) 250 : cluster [DBG] pgmap v187: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:28.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:27 smithi106 bash[18459]: cluster 2024-02-13T00:36:26.821698+0000 mgr.y (mgr.24461) 251 : cluster [DBG] pgmap v188: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:28.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:36:28 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:36:28.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:27 smithi080 bash[17386]: cluster 2024-02-13T00:36:26.821698+0000 mgr.y (mgr.24461) 251 : cluster [DBG] pgmap v188: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:28.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:27 smithi080 bash[24237]: cluster 2024-02-13T00:36:26.821698+0000 mgr.y (mgr.24461) 251 : cluster [DBG] pgmap v188: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:29.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:28 smithi106 bash[18459]: audit 2024-02-13T00:36:28.001513+0000 mgr.y (mgr.24461) 252 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:36:29.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:28 smithi080 bash[17386]: audit 2024-02-13T00:36:28.001513+0000 mgr.y (mgr.24461) 252 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:36:29.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:28 smithi080 bash[24237]: audit 2024-02-13T00:36:28.001513+0000 mgr.y (mgr.24461) 252 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:36:30.255 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:36:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:36:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:36:30.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:29 smithi106 bash[18459]: cluster 2024-02-13T00:36:28.823066+0000 mgr.y (mgr.24461) 253 : cluster [DBG] pgmap v189: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:30.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:29 smithi080 bash[17386]: cluster 2024-02-13T00:36:28.823066+0000 mgr.y (mgr.24461) 253 : cluster [DBG] pgmap v189: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:30.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:29 smithi080 bash[24237]: cluster 2024-02-13T00:36:28.823066+0000 mgr.y (mgr.24461) 253 : cluster [DBG] pgmap v189: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:32.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:31 smithi106 bash[18459]: cluster 2024-02-13T00:36:30.823857+0000 mgr.y (mgr.24461) 254 : cluster [DBG] pgmap v190: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:32.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:31 smithi080 bash[17386]: cluster 2024-02-13T00:36:30.823857+0000 mgr.y (mgr.24461) 254 : cluster [DBG] pgmap v190: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:32.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:31 smithi080 bash[24237]: cluster 2024-02-13T00:36:30.823857+0000 mgr.y (mgr.24461) 254 : cluster [DBG] pgmap v190: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:33.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:36:33 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:36:33] "GET /metrics HTTP/1.1" 200 172244 "" "Prometheus/2.33.4" 2024-02-13T00:36:34.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:33 smithi106 bash[18459]: cluster 2024-02-13T00:36:32.825158+0000 mgr.y (mgr.24461) 255 : cluster [DBG] pgmap v191: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:34.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:33 smithi080 bash[17386]: cluster 2024-02-13T00:36:32.825158+0000 mgr.y (mgr.24461) 255 : cluster [DBG] pgmap v191: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:34.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:33 smithi080 bash[24237]: cluster 2024-02-13T00:36:32.825158+0000 mgr.y (mgr.24461) 255 : cluster [DBG] pgmap v191: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:36.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:35 smithi106 bash[18459]: cluster 2024-02-13T00:36:34.825792+0000 mgr.y (mgr.24461) 256 : cluster [DBG] pgmap v192: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:36.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:35 smithi080 bash[17386]: cluster 2024-02-13T00:36:34.825792+0000 mgr.y (mgr.24461) 256 : cluster [DBG] pgmap v192: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:36.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:35 smithi080 bash[24237]: cluster 2024-02-13T00:36:34.825792+0000 mgr.y (mgr.24461) 256 : cluster [DBG] pgmap v192: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:38.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:36:38 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:36:38.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:37 smithi106 bash[18459]: cluster 2024-02-13T00:36:36.826454+0000 mgr.y (mgr.24461) 257 : cluster [DBG] pgmap v193: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:38.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:37 smithi080 bash[17386]: cluster 2024-02-13T00:36:36.826454+0000 mgr.y (mgr.24461) 257 : cluster [DBG] pgmap v193: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:38.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:37 smithi080 bash[24237]: cluster 2024-02-13T00:36:36.826454+0000 mgr.y (mgr.24461) 257 : cluster [DBG] pgmap v193: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:39.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:38 smithi106 bash[18459]: audit 2024-02-13T00:36:38.009456+0000 mgr.y (mgr.24461) 258 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:36:39.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:38 smithi080 bash[17386]: audit 2024-02-13T00:36:38.009456+0000 mgr.y (mgr.24461) 258 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:36:39.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:38 smithi080 bash[24237]: audit 2024-02-13T00:36:38.009456+0000 mgr.y (mgr.24461) 258 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:36:40.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:39 smithi106 bash[18459]: cluster 2024-02-13T00:36:38.827834+0000 mgr.y (mgr.24461) 259 : cluster [DBG] pgmap v194: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:40.257 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:36:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:36:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:36:40.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:39 smithi080 bash[17386]: cluster 2024-02-13T00:36:38.827834+0000 mgr.y (mgr.24461) 259 : cluster [DBG] pgmap v194: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:40.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:39 smithi080 bash[24237]: cluster 2024-02-13T00:36:38.827834+0000 mgr.y (mgr.24461) 259 : cluster [DBG] pgmap v194: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:42.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:41 smithi106 bash[18459]: cluster 2024-02-13T00:36:40.828597+0000 mgr.y (mgr.24461) 260 : cluster [DBG] pgmap v195: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:42.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:41 smithi080 bash[17386]: cluster 2024-02-13T00:36:40.828597+0000 mgr.y (mgr.24461) 260 : cluster [DBG] pgmap v195: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:42.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:41 smithi080 bash[24237]: cluster 2024-02-13T00:36:40.828597+0000 mgr.y (mgr.24461) 260 : cluster [DBG] pgmap v195: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:43.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:36:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:36:43] "GET /metrics HTTP/1.1" 200 172244 "" "Prometheus/2.33.4" 2024-02-13T00:36:44.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:43 smithi106 bash[18459]: cluster 2024-02-13T00:36:42.829818+0000 mgr.y (mgr.24461) 261 : cluster [DBG] pgmap v196: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:44.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:43 smithi080 bash[17386]: cluster 2024-02-13T00:36:42.829818+0000 mgr.y (mgr.24461) 261 : cluster [DBG] pgmap v196: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:44.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:43 smithi080 bash[24237]: cluster 2024-02-13T00:36:42.829818+0000 mgr.y (mgr.24461) 261 : cluster [DBG] pgmap v196: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:46.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:45 smithi106 bash[18459]: cluster 2024-02-13T00:36:44.830507+0000 mgr.y (mgr.24461) 262 : cluster [DBG] pgmap v197: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:46.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:45 smithi080 bash[17386]: cluster 2024-02-13T00:36:44.830507+0000 mgr.y (mgr.24461) 262 : cluster [DBG] pgmap v197: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:46.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:45 smithi080 bash[24237]: cluster 2024-02-13T00:36:44.830507+0000 mgr.y (mgr.24461) 262 : cluster [DBG] pgmap v197: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:48.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:36:48 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:36:48.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:47 smithi106 bash[18459]: cluster 2024-02-13T00:36:46.831119+0000 mgr.y (mgr.24461) 263 : cluster [DBG] pgmap v198: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:48.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:47 smithi080 bash[17386]: cluster 2024-02-13T00:36:46.831119+0000 mgr.y (mgr.24461) 263 : cluster [DBG] pgmap v198: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:48.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:47 smithi080 bash[24237]: cluster 2024-02-13T00:36:46.831119+0000 mgr.y (mgr.24461) 263 : cluster [DBG] pgmap v198: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:49.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:48 smithi106 bash[18459]: audit 2024-02-13T00:36:48.019878+0000 mgr.y (mgr.24461) 264 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:36:49.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:48 smithi080 bash[17386]: audit 2024-02-13T00:36:48.019878+0000 mgr.y (mgr.24461) 264 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:36:49.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:48 smithi080 bash[24237]: audit 2024-02-13T00:36:48.019878+0000 mgr.y (mgr.24461) 264 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:36:50.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:49 smithi106 bash[18459]: cluster 2024-02-13T00:36:48.832434+0000 mgr.y (mgr.24461) 265 : cluster [DBG] pgmap v199: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:50.255 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:36:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:36:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:36:50.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:49 smithi080 bash[17386]: cluster 2024-02-13T00:36:48.832434+0000 mgr.y (mgr.24461) 265 : cluster [DBG] pgmap v199: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:50.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:49 smithi080 bash[24237]: cluster 2024-02-13T00:36:48.832434+0000 mgr.y (mgr.24461) 265 : cluster [DBG] pgmap v199: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:52.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:51 smithi106 bash[18459]: cluster 2024-02-13T00:36:50.833171+0000 mgr.y (mgr.24461) 266 : cluster [DBG] pgmap v200: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:52.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:51 smithi080 bash[17386]: cluster 2024-02-13T00:36:50.833171+0000 mgr.y (mgr.24461) 266 : cluster [DBG] pgmap v200: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:52.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:51 smithi080 bash[24237]: cluster 2024-02-13T00:36:50.833171+0000 mgr.y (mgr.24461) 266 : cluster [DBG] pgmap v200: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:53.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:36:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:36:53] "GET /metrics HTTP/1.1" 200 172242 "" "Prometheus/2.33.4" 2024-02-13T00:36:54.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:53 smithi106 bash[18459]: cluster 2024-02-13T00:36:52.834259+0000 mgr.y (mgr.24461) 267 : cluster [DBG] pgmap v201: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:54.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:53 smithi106 bash[18459]: audit 2024-02-13T00:36:53.069639+0000 mon.c (mon.2) 73 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:36:54.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:53 smithi106 bash[18459]: audit 2024-02-13T00:36:53.360209+0000 mon.c (mon.2) 74 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:36:54.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:53 smithi106 bash[18459]: audit 2024-02-13T00:36:53.361290+0000 mon.c (mon.2) 75 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:36:54.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:53 smithi106 bash[18459]: audit 2024-02-13T00:36:53.367867+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:36:54.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:53 smithi080 bash[17386]: cluster 2024-02-13T00:36:52.834259+0000 mgr.y (mgr.24461) 267 : cluster [DBG] pgmap v201: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:54.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:53 smithi080 bash[17386]: audit 2024-02-13T00:36:53.069639+0000 mon.c (mon.2) 73 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:36:54.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:53 smithi080 bash[17386]: audit 2024-02-13T00:36:53.360209+0000 mon.c (mon.2) 74 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:36:54.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:53 smithi080 bash[17386]: audit 2024-02-13T00:36:53.361290+0000 mon.c (mon.2) 75 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:36:54.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:53 smithi080 bash[17386]: audit 2024-02-13T00:36:53.367867+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:36:54.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:53 smithi080 bash[24237]: cluster 2024-02-13T00:36:52.834259+0000 mgr.y (mgr.24461) 267 : cluster [DBG] pgmap v201: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:36:54.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:53 smithi080 bash[24237]: audit 2024-02-13T00:36:53.069639+0000 mon.c (mon.2) 73 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:36:54.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:53 smithi080 bash[24237]: audit 2024-02-13T00:36:53.360209+0000 mon.c (mon.2) 74 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:36:54.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:53 smithi080 bash[24237]: audit 2024-02-13T00:36:53.361290+0000 mon.c (mon.2) 75 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:36:54.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:53 smithi080 bash[24237]: audit 2024-02-13T00:36:53.367867+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:36:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:55 smithi106 bash[18459]: cluster 2024-02-13T00:36:54.834899+0000 mgr.y (mgr.24461) 268 : cluster [DBG] pgmap v202: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:56.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:55 smithi080 bash[17386]: cluster 2024-02-13T00:36:54.834899+0000 mgr.y (mgr.24461) 268 : cluster [DBG] pgmap v202: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:56.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:55 smithi080 bash[24237]: cluster 2024-02-13T00:36:54.834899+0000 mgr.y (mgr.24461) 268 : cluster [DBG] pgmap v202: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:57 smithi106 bash[18459]: cluster 2024-02-13T00:36:56.835612+0000 mgr.y (mgr.24461) 269 : cluster [DBG] pgmap v203: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:58.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:36:58 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:36:58.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:57 smithi080 bash[17386]: cluster 2024-02-13T00:36:56.835612+0000 mgr.y (mgr.24461) 269 : cluster [DBG] pgmap v203: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:58.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:57 smithi080 bash[24237]: cluster 2024-02-13T00:36:56.835612+0000 mgr.y (mgr.24461) 269 : cluster [DBG] pgmap v203: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:36:59.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:58 smithi106 bash[18459]: audit 2024-02-13T00:36:58.031328+0000 mgr.y (mgr.24461) 270 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:36:59.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:58 smithi080 bash[17386]: audit 2024-02-13T00:36:58.031328+0000 mgr.y (mgr.24461) 270 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:36:59.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:58 smithi080 bash[24237]: audit 2024-02-13T00:36:58.031328+0000 mgr.y (mgr.24461) 270 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:37:00.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:36:59 smithi106 bash[18459]: cluster 2024-02-13T00:36:58.836635+0000 mgr.y (mgr.24461) 271 : cluster [DBG] pgmap v204: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:00.255 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:37:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:37:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:37:00.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:36:59 smithi080 bash[17386]: cluster 2024-02-13T00:36:58.836635+0000 mgr.y (mgr.24461) 271 : cluster [DBG] pgmap v204: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:00.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:36:59 smithi080 bash[24237]: cluster 2024-02-13T00:36:58.836635+0000 mgr.y (mgr.24461) 271 : cluster [DBG] pgmap v204: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:02.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:01 smithi106 bash[18459]: cluster 2024-02-13T00:37:00.837299+0000 mgr.y (mgr.24461) 272 : cluster [DBG] pgmap v205: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:37:02.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:01 smithi080 bash[24237]: cluster 2024-02-13T00:37:00.837299+0000 mgr.y (mgr.24461) 272 : cluster [DBG] pgmap v205: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:37:02.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:01 smithi080 bash[17386]: cluster 2024-02-13T00:37:00.837299+0000 mgr.y (mgr.24461) 272 : cluster [DBG] pgmap v205: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:37:03.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:37:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:37:03] "GET /metrics HTTP/1.1" 200 172243 "" "Prometheus/2.33.4" 2024-02-13T00:37:04.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:03 smithi106 bash[18459]: cluster 2024-02-13T00:37:02.838657+0000 mgr.y (mgr.24461) 273 : cluster [DBG] pgmap v206: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:04.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:03 smithi080 bash[17386]: cluster 2024-02-13T00:37:02.838657+0000 mgr.y (mgr.24461) 273 : cluster [DBG] pgmap v206: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:04.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:03 smithi080 bash[24237]: cluster 2024-02-13T00:37:02.838657+0000 mgr.y (mgr.24461) 273 : cluster [DBG] pgmap v206: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:06.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:05 smithi106 bash[18459]: cluster 2024-02-13T00:37:04.839225+0000 mgr.y (mgr.24461) 274 : cluster [DBG] pgmap v207: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:37:06.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:05 smithi080 bash[17386]: cluster 2024-02-13T00:37:04.839225+0000 mgr.y (mgr.24461) 274 : cluster [DBG] pgmap v207: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:37:06.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:05 smithi080 bash[24237]: cluster 2024-02-13T00:37:04.839225+0000 mgr.y (mgr.24461) 274 : cluster [DBG] pgmap v207: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:37:08.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:07 smithi106 bash[18459]: cluster 2024-02-13T00:37:06.839855+0000 mgr.y (mgr.24461) 275 : cluster [DBG] pgmap v208: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:37:08.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:37:08 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:37:08.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:07 smithi080 bash[17386]: cluster 2024-02-13T00:37:06.839855+0000 mgr.y (mgr.24461) 275 : cluster [DBG] pgmap v208: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:37:08.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:07 smithi080 bash[24237]: cluster 2024-02-13T00:37:06.839855+0000 mgr.y (mgr.24461) 275 : cluster [DBG] pgmap v208: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:37:09.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:08 smithi106 bash[18459]: audit 2024-02-13T00:37:08.041396+0000 mgr.y (mgr.24461) 276 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:37:09.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:08 smithi080 bash[17386]: audit 2024-02-13T00:37:08.041396+0000 mgr.y (mgr.24461) 276 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:37:09.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:08 smithi080 bash[24237]: audit 2024-02-13T00:37:08.041396+0000 mgr.y (mgr.24461) 276 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:37:10.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:09 smithi106 bash[18459]: cluster 2024-02-13T00:37:08.841109+0000 mgr.y (mgr.24461) 277 : cluster [DBG] pgmap v209: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:10.255 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:37:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:37:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:37:10.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:09 smithi080 bash[17386]: cluster 2024-02-13T00:37:08.841109+0000 mgr.y (mgr.24461) 277 : cluster [DBG] pgmap v209: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:10.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:09 smithi080 bash[24237]: cluster 2024-02-13T00:37:08.841109+0000 mgr.y (mgr.24461) 277 : cluster [DBG] pgmap v209: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:12.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:11 smithi106 bash[18459]: cluster 2024-02-13T00:37:10.841741+0000 mgr.y (mgr.24461) 278 : cluster [DBG] pgmap v210: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:37:12.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:11 smithi080 bash[17386]: cluster 2024-02-13T00:37:10.841741+0000 mgr.y (mgr.24461) 278 : cluster [DBG] pgmap v210: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:37:12.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:11 smithi080 bash[24237]: cluster 2024-02-13T00:37:10.841741+0000 mgr.y (mgr.24461) 278 : cluster [DBG] pgmap v210: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:37:13.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:37:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:37:13] "GET /metrics HTTP/1.1" 200 172243 "" "Prometheus/2.33.4" 2024-02-13T00:37:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:13 smithi106 bash[18459]: cluster 2024-02-13T00:37:12.842553+0000 mgr.y (mgr.24461) 279 : cluster [DBG] pgmap v211: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:14.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:13 smithi080 bash[17386]: cluster 2024-02-13T00:37:12.842553+0000 mgr.y (mgr.24461) 279 : cluster [DBG] pgmap v211: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:14.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:13 smithi080 bash[24237]: cluster 2024-02-13T00:37:12.842553+0000 mgr.y (mgr.24461) 279 : cluster [DBG] pgmap v211: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:16.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:15 smithi106 bash[18459]: cluster 2024-02-13T00:37:14.842952+0000 mgr.y (mgr.24461) 280 : cluster [DBG] pgmap v212: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:37:16.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:15 smithi080 bash[17386]: cluster 2024-02-13T00:37:14.842952+0000 mgr.y (mgr.24461) 280 : cluster [DBG] pgmap v212: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:37:16.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:15 smithi080 bash[24237]: cluster 2024-02-13T00:37:14.842952+0000 mgr.y (mgr.24461) 280 : cluster [DBG] pgmap v212: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:37:18.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:17 smithi106 bash[18459]: cluster 2024-02-13T00:37:16.843495+0000 mgr.y (mgr.24461) 281 : cluster [DBG] pgmap v213: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T00:37:18.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:37:18 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:37:18.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:17 smithi080 bash[24237]: cluster 2024-02-13T00:37:16.843495+0000 mgr.y (mgr.24461) 281 : cluster [DBG] pgmap v213: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T00:37:18.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:17 smithi080 bash[17386]: cluster 2024-02-13T00:37:16.843495+0000 mgr.y (mgr.24461) 281 : cluster [DBG] pgmap v213: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T00:37:19.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:18 smithi106 bash[18459]: audit 2024-02-13T00:37:18.052614+0000 mgr.y (mgr.24461) 282 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:37:19.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:18 smithi080 bash[24237]: audit 2024-02-13T00:37:18.052614+0000 mgr.y (mgr.24461) 282 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:37:19.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:18 smithi080 bash[17386]: audit 2024-02-13T00:37:18.052614+0000 mgr.y (mgr.24461) 282 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:37:20.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:19 smithi106 bash[18459]: cluster 2024-02-13T00:37:18.844214+0000 mgr.y (mgr.24461) 283 : cluster [DBG] pgmap v214: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:20.255 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:37:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:37:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:37:20.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:19 smithi080 bash[24237]: cluster 2024-02-13T00:37:18.844214+0000 mgr.y (mgr.24461) 283 : cluster [DBG] pgmap v214: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:20.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:19 smithi080 bash[17386]: cluster 2024-02-13T00:37:18.844214+0000 mgr.y (mgr.24461) 283 : cluster [DBG] pgmap v214: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:22.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:21 smithi106 bash[18459]: cluster 2024-02-13T00:37:20.844813+0000 mgr.y (mgr.24461) 284 : cluster [DBG] pgmap v215: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T00:37:22.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:21 smithi080 bash[17386]: cluster 2024-02-13T00:37:20.844813+0000 mgr.y (mgr.24461) 284 : cluster [DBG] pgmap v215: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T00:37:22.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:21 smithi080 bash[24237]: cluster 2024-02-13T00:37:20.844813+0000 mgr.y (mgr.24461) 284 : cluster [DBG] pgmap v215: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T00:37:23.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:37:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:37:23] "GET /metrics HTTP/1.1" 200 172236 "" "Prometheus/2.33.4" 2024-02-13T00:37:24.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:23 smithi106 bash[18459]: cluster 2024-02-13T00:37:22.846062+0000 mgr.y (mgr.24461) 285 : cluster [DBG] pgmap v216: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:24.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:23 smithi080 bash[24237]: cluster 2024-02-13T00:37:22.846062+0000 mgr.y (mgr.24461) 285 : cluster [DBG] pgmap v216: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:24.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:23 smithi080 bash[17386]: cluster 2024-02-13T00:37:22.846062+0000 mgr.y (mgr.24461) 285 : cluster [DBG] pgmap v216: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:26.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:25 smithi106 bash[18459]: cluster 2024-02-13T00:37:24.846491+0000 mgr.y (mgr.24461) 286 : cluster [DBG] pgmap v217: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T00:37:26.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:25 smithi080 bash[24237]: cluster 2024-02-13T00:37:24.846491+0000 mgr.y (mgr.24461) 286 : cluster [DBG] pgmap v217: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T00:37:26.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:25 smithi080 bash[17386]: cluster 2024-02-13T00:37:24.846491+0000 mgr.y (mgr.24461) 286 : cluster [DBG] pgmap v217: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T00:37:27.659 INFO:tasks.workunit.client.0.smithi080.stderr:Note: switching to '84e714279aa684636ac645daf0a1a85c2094cfb3'. 2024-02-13T00:37:27.659 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-02-13T00:37:27.659 INFO:tasks.workunit.client.0.smithi080.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-13T00:37:27.659 INFO:tasks.workunit.client.0.smithi080.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-13T00:37:27.660 INFO:tasks.workunit.client.0.smithi080.stderr:state without impacting any branches by switching back to a branch. 2024-02-13T00:37:27.660 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-02-13T00:37:27.660 INFO:tasks.workunit.client.0.smithi080.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-13T00:37:27.660 INFO:tasks.workunit.client.0.smithi080.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-13T00:37:27.660 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-02-13T00:37:27.660 INFO:tasks.workunit.client.0.smithi080.stderr: git switch -c 2024-02-13T00:37:27.660 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-02-13T00:37:27.660 INFO:tasks.workunit.client.0.smithi080.stderr:Or undo this operation with: 2024-02-13T00:37:27.660 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-02-13T00:37:27.660 INFO:tasks.workunit.client.0.smithi080.stderr: git switch - 2024-02-13T00:37:27.660 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-02-13T00:37:27.660 INFO:tasks.workunit.client.0.smithi080.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-13T00:37:27.660 INFO:tasks.workunit.client.0.smithi080.stderr: 2024-02-13T00:37:27.660 INFO:tasks.workunit.client.0.smithi080.stderr:HEAD is now at 84e714279aa qa/suites/orch: whitelist warnings that are expected in test environments 2024-02-13T00:37:27.667 DEBUG:teuthology.orchestra.run.smithi080:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-13T00:37:27.723 INFO:tasks.workunit.client.0.smithi080.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-13T00:37:27.727 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-13T00:37:27.727 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-13T00:37:28.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:27 smithi106 bash[18459]: cluster 2024-02-13T00:37:26.846899+0000 mgr.y (mgr.24461) 287 : cluster [DBG] pgmap v218: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T00:37:28.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:37:28 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:37:28.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:27 smithi080 bash[17386]: cluster 2024-02-13T00:37:26.846899+0000 mgr.y (mgr.24461) 287 : cluster [DBG] pgmap v218: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T00:37:28.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:27 smithi080 bash[24237]: cluster 2024-02-13T00:37:26.846899+0000 mgr.y (mgr.24461) 287 : cluster [DBG] pgmap v218: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T00:37:28.583 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-13T00:37:28.662 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-13T00:37:28.721 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-13T00:37:28.722 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-13T00:37:28.722 INFO:tasks.workunit.client.0.smithi080.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-13T00:37:28.788 INFO:tasks.workunit.client.0.smithi080.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-13T00:37:28.792 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-13T00:37:28.792 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-13T00:37:28.845 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-02-13T00:37:28.846 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-02-13T00:37:28.846 DEBUG:teuthology.orchestra.run.smithi080:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=84e714279aa684636ac645daf0a1a85c2094cfb3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2024-02-13T00:37:28.899 INFO:tasks.workunit.client.0.smithi080.stderr:+ parallel=1 2024-02-13T00:37:28.900 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' '' = --serial ']' 2024-02-13T00:37:28.900 INFO:tasks.workunit.client.0.smithi080.stderr:+ color= 2024-02-13T00:37:28.900 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -t 1 ']' 2024-02-13T00:37:28.900 INFO:tasks.workunit.client.0.smithi080.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-02-13T00:37:28.900 INFO:tasks.workunit.client.0.smithi080.stderr:+ declare -A pids 2024-02-13T00:37:28.900 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:28.900 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:28.901 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_aio 2024-02-13T00:37:28.901 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_aio' 2024-02-13T00:37:28.901 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_aio 2024-02-13T00:37:28.901 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:28.904 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_aio 2024-02-13T00:37:28.904 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54170 2024-02-13T00:37:28.904 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_aio on pid 54170' 2024-02-13T00:37:28.904 INFO:tasks.workunit.client.0.smithi080.stdout:test api_aio on pid 54170 2024-02-13T00:37:28.905 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54170 2024-02-13T00:37:28.905 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:28.905 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:28.905 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2024-02-13T00:37:28.906 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_aio_pp 2024-02-13T00:37:28.906 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_aio_pp' 2024-02-13T00:37:28.907 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_aio_pp 2024-02-13T00:37:28.907 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:28.907 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:28.907 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.907 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:28.907 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.908 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_aio 2024-02-13T00:37:28.908 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_aio.log 2024-02-13T00:37:28.908 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_aio: /' 2024-02-13T00:37:28.909 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_aio_pp 2024-02-13T00:37:28.910 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54178 2024-02-13T00:37:28.910 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_aio_pp on pid 54178' 2024-02-13T00:37:28.910 INFO:tasks.workunit.client.0.smithi080.stdout:test api_aio_pp on pid 54178 2024-02-13T00:37:28.912 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54178 2024-02-13T00:37:28.912 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:28.912 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:28.912 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2024-02-13T00:37:28.912 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_io 2024-02-13T00:37:28.912 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_io' 2024-02-13T00:37:28.912 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_io 2024-02-13T00:37:28.913 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:28.913 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:28.913 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.913 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:28.913 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.913 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_aio_pp 2024-02-13T00:37:28.913 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_aio_pp.log 2024-02-13T00:37:28.913 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_aio_pp: /' 2024-02-13T00:37:28.914 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_io 2024-02-13T00:37:28.914 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54186 2024-02-13T00:37:28.915 INFO:tasks.workunit.client.0.smithi080.stdout:test api_io on pid 54186 2024-02-13T00:37:28.915 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2024-02-13T00:37:28.915 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_io on pid 54186' 2024-02-13T00:37:28.916 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54186 2024-02-13T00:37:28.916 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:28.916 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:28.916 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_io_pp 2024-02-13T00:37:28.916 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_io_pp' 2024-02-13T00:37:28.917 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_io_pp 2024-02-13T00:37:28.917 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:28.917 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:28.917 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.917 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:28.917 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.917 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_io 2024-02-13T00:37:28.917 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_io.log 2024-02-13T00:37:28.918 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_io: /' 2024-02-13T00:37:28.919 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_io_pp 2024-02-13T00:37:28.919 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54194 2024-02-13T00:37:28.919 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_io_pp on pid 54194' 2024-02-13T00:37:28.919 INFO:tasks.workunit.client.0.smithi080.stdout:test api_io_pp on pid 54194 2024-02-13T00:37:28.920 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54194 2024-02-13T00:37:28.920 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:28.921 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:28.921 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2024-02-13T00:37:28.921 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_asio 2024-02-13T00:37:28.921 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_asio' 2024-02-13T00:37:28.921 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_asio 2024-02-13T00:37:28.921 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:28.921 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:28.921 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.921 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:28.921 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.921 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_io_pp 2024-02-13T00:37:28.921 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_io_pp.log 2024-02-13T00:37:28.921 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_io_pp: /' 2024-02-13T00:37:28.922 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_asio 2024-02-13T00:37:28.922 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54202 2024-02-13T00:37:28.922 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_asio on pid 54202' 2024-02-13T00:37:28.923 INFO:tasks.workunit.client.0.smithi080.stdout:test api_asio on pid 54202 2024-02-13T00:37:28.924 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54202 2024-02-13T00:37:28.924 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:28.924 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2024-02-13T00:37:28.924 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:28.924 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_list 2024-02-13T00:37:28.924 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_list' 2024-02-13T00:37:28.924 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:28.924 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.924 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_list 2024-02-13T00:37:28.924 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:28.925 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.925 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:28.925 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_asio 2024-02-13T00:37:28.925 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_asio.log 2024-02-13T00:37:28.925 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_asio: /' 2024-02-13T00:37:28.925 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_list 2024-02-13T00:37:28.926 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54210 2024-02-13T00:37:28.926 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_list on pid 54210' 2024-02-13T00:37:28.926 INFO:tasks.workunit.client.0.smithi080.stdout:test api_list on pid 54210 2024-02-13T00:37:28.927 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54210 2024-02-13T00:37:28.927 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2024-02-13T00:37:28.927 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:28.928 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:28.928 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_lock 2024-02-13T00:37:28.928 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_lock' 2024-02-13T00:37:28.928 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_lock 2024-02-13T00:37:28.928 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:28.928 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.928 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:28.928 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.928 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:28.928 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_list 2024-02-13T00:37:28.928 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_list.log 2024-02-13T00:37:28.928 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_list: /' 2024-02-13T00:37:28.929 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_lock 2024-02-13T00:37:28.929 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54218 2024-02-13T00:37:28.929 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_lock on pid 54218' 2024-02-13T00:37:28.930 INFO:tasks.workunit.client.0.smithi080.stdout:test api_lock on pid 54218 2024-02-13T00:37:28.931 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54218 2024-02-13T00:37:28.931 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2024-02-13T00:37:28.931 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:28.931 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:28.931 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_lock_pp 2024-02-13T00:37:28.931 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_lock_pp' 2024-02-13T00:37:28.931 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_lock_pp 2024-02-13T00:37:28.932 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:28.932 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:28.932 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.932 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:28.932 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.932 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_lock 2024-02-13T00:37:28.932 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_lock.log 2024-02-13T00:37:28.932 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_lock: /' 2024-02-13T00:37:28.933 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_lock_pp 2024-02-13T00:37:28.933 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54226 2024-02-13T00:37:28.933 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_lock_pp on pid 54226' 2024-02-13T00:37:28.933 INFO:tasks.workunit.client.0.smithi080.stdout:test api_lock_pp on pid 54226 2024-02-13T00:37:28.935 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54226 2024-02-13T00:37:28.935 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:28.935 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:28.935 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2024-02-13T00:37:28.935 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_misc 2024-02-13T00:37:28.935 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_misc' 2024-02-13T00:37:28.935 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_misc 2024-02-13T00:37:28.935 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:28.935 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:28.935 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.935 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:28.935 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.936 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_lock_pp 2024-02-13T00:37:28.936 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_lock_pp.log 2024-02-13T00:37:28.936 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_lock_pp: /' 2024-02-13T00:37:28.936 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_misc 2024-02-13T00:37:28.936 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54234 2024-02-13T00:37:28.937 INFO:tasks.workunit.client.0.smithi080.stdout:test api_misc on pid 54234 2024-02-13T00:37:28.938 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_misc on pid 54234' 2024-02-13T00:37:28.938 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54234 2024-02-13T00:37:28.938 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2024-02-13T00:37:28.938 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:28.938 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:28.938 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_misc_pp 2024-02-13T00:37:28.938 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_misc_pp' 2024-02-13T00:37:28.938 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:28.939 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_misc_pp 2024-02-13T00:37:28.939 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.939 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:28.939 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.939 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:28.939 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_misc 2024-02-13T00:37:28.939 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_misc: /' 2024-02-13T00:37:28.939 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_misc.log 2024-02-13T00:37:28.942 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_misc_pp 2024-02-13T00:37:28.942 INFO:tasks.workunit.client.0.smithi080.stdout:test api_misc_pp on pid 54242 2024-02-13T00:37:28.944 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54242 2024-02-13T00:37:28.944 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_misc_pp on pid 54242' 2024-02-13T00:37:28.944 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2024-02-13T00:37:28.944 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54242 2024-02-13T00:37:28.944 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:28.944 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:28.944 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_tier_pp 2024-02-13T00:37:28.944 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_tier_pp' 2024-02-13T00:37:28.944 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_tier_pp 2024-02-13T00:37:28.944 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:28.944 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.944 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:28.944 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:28.944 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.945 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_misc_pp 2024-02-13T00:37:28.945 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_misc_pp.log 2024-02-13T00:37:28.945 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_misc_pp: /' 2024-02-13T00:37:28.945 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_tier_pp 2024-02-13T00:37:28.945 INFO:tasks.workunit.client.0.smithi080.stdout:test api_tier_pp on pid 54250 2024-02-13T00:37:28.947 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54250 2024-02-13T00:37:28.947 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_tier_pp on pid 54250' 2024-02-13T00:37:28.947 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54250 2024-02-13T00:37:28.947 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:28.947 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:28.947 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2024-02-13T00:37:28.947 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_pool 2024-02-13T00:37:28.947 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_pool' 2024-02-13T00:37:28.947 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_pool 2024-02-13T00:37:28.947 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:28.947 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.947 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:28.947 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.947 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:28.948 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_tier_pp 2024-02-13T00:37:28.948 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_tier_pp.log 2024-02-13T00:37:28.948 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_tier_pp: /' 2024-02-13T00:37:28.948 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_pool 2024-02-13T00:37:28.948 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54258 2024-02-13T00:37:28.949 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_pool on pid 54258' 2024-02-13T00:37:28.949 INFO:tasks.workunit.client.0.smithi080.stdout:test api_pool on pid 54258 2024-02-13T00:37:28.949 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54258 2024-02-13T00:37:28.949 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:28.949 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:28.950 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2024-02-13T00:37:28.950 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:28.950 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.950 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:28.950 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.951 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_pool 2024-02-13T00:37:28.951 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_pool.log 2024-02-13T00:37:28.962 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_pool: /' 2024-02-13T00:37:28.970 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_snapshots 2024-02-13T00:37:28.974 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_snapshots' 2024-02-13T00:37:28.983 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:28.986 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_snapshots 2024-02-13T00:37:28.988 INFO:tasks.workunit.client.0.smithi080.stdout:test api_snapshots on pid 54337 2024-02-13T00:37:28.988 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_snapshots 2024-02-13T00:37:28.988 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54337 2024-02-13T00:37:28.988 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_snapshots on pid 54337' 2024-02-13T00:37:28.989 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54337 2024-02-13T00:37:28.989 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:28.989 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:28.989 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2024-02-13T00:37:28.990 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:28.990 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.990 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:28.990 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:28.991 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_snapshots_pp 2024-02-13T00:37:28.991 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_snapshots_pp' 2024-02-13T00:37:28.991 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_snapshots: /' 2024-02-13T00:37:28.992 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_snapshots_pp 2024-02-13T00:37:28.997 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:28.997 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_snapshots 2024-02-13T00:37:28.998 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_snapshots.log 2024-02-13T00:37:29.005 INFO:tasks.workunit.client.0.smithi080.stdout:test api_snapshots_pp on pid 54423 2024-02-13T00:37:29.005 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_snapshots_pp 2024-02-13T00:37:29.005 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54423 2024-02-13T00:37:29.005 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_snapshots_pp on pid 54423' 2024-02-13T00:37:29.005 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54423 2024-02-13T00:37:29.005 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:29.005 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:29.007 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_stat 2024-02-13T00:37:29.008 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_stat' 2024-02-13T00:37:29.009 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_stat 2024-02-13T00:37:29.009 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2024-02-13T00:37:29.010 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:29.011 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:29.012 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.012 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:29.012 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.014 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_snapshots_pp 2024-02-13T00:37:29.014 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2024-02-13T00:37:29.014 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_snapshots_pp: /' 2024-02-13T00:37:29.015 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_stat 2024-02-13T00:37:29.015 INFO:tasks.workunit.client.0.smithi080.stdout:test api_stat on pid 54460 2024-02-13T00:37:29.015 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54460 2024-02-13T00:37:29.016 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_stat on pid 54460' 2024-02-13T00:37:29.016 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54460 2024-02-13T00:37:29.016 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:29.016 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:29.016 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_stat_pp 2024-02-13T00:37:29.016 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_stat_pp' 2024-02-13T00:37:29.017 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_stat_pp 2024-02-13T00:37:29.017 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:29.021 INFO:tasks.workunit.client.0.smithi080.stdout:test api_stat_pp on pid 54470 2024-02-13T00:37:29.023 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_stat_pp 2024-02-13T00:37:29.023 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54470 2024-02-13T00:37:29.023 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2024-02-13T00:37:29.023 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_stat_pp on pid 54470' 2024-02-13T00:37:29.023 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54470 2024-02-13T00:37:29.023 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:29.023 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:29.023 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_watch_notify 2024-02-13T00:37:29.023 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_watch_notify' 2024-02-13T00:37:29.023 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2024-02-13T00:37:29.023 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:29.023 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.024 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:29.024 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.024 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_watch_notify 2024-02-13T00:37:29.024 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_stat_pp: /' 2024-02-13T00:37:29.024 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:29.024 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:29.024 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.024 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:29.024 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.024 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_stat 2024-02-13T00:37:29.025 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_stat_pp 2024-02-13T00:37:29.025 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_stat.log 2024-02-13T00:37:29.025 INFO:tasks.workunit.client.0.smithi080.stdout:test api_watch_notify on pid 54481 2024-02-13T00:37:29.025 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_watch_notify 2024-02-13T00:37:29.025 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54481 2024-02-13T00:37:29.026 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_watch_notify on pid 54481' 2024-02-13T00:37:29.026 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54481 2024-02-13T00:37:29.026 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:29.026 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:29.026 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2024-02-13T00:37:29.027 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:29.027 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.027 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:29.027 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.027 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_watch_notify 2024-02-13T00:37:29.027 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_watch_notify.log 2024-02-13T00:37:29.028 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_watch_notify_pp 2024-02-13T00:37:29.028 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_watch_notify_pp' 2024-02-13T00:37:29.028 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_watch_notify: /' 2024-02-13T00:37:29.030 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_stat_pp.log 2024-02-13T00:37:29.030 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:29.032 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_watch_notify_pp 2024-02-13T00:37:29.032 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_stat: /' 2024-02-13T00:37:29.034 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_watch_notify_pp 2024-02-13T00:37:29.034 INFO:tasks.workunit.client.0.smithi080.stdout:test api_watch_notify_pp on pid 54491 2024-02-13T00:37:29.035 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54491 2024-02-13T00:37:29.035 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_watch_notify_pp on pid 54491' 2024-02-13T00:37:29.035 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54491 2024-02-13T00:37:29.035 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:29.035 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2024-02-13T00:37:29.035 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:29.035 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_cmd 2024-02-13T00:37:29.036 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_cmd' 2024-02-13T00:37:29.036 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:29.036 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.036 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:29.036 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_cmd 2024-02-13T00:37:29.036 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.036 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2024-02-13T00:37:29.036 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_watch_notify_pp 2024-02-13T00:37:29.037 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2024-02-13T00:37:29.040 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:29.043 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_cmd 2024-02-13T00:37:29.043 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54510 2024-02-13T00:37:29.043 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_cmd on pid 54510' 2024-02-13T00:37:29.043 INFO:tasks.workunit.client.0.smithi080.stdout:test api_cmd on pid 54510 2024-02-13T00:37:29.044 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54510 2024-02-13T00:37:29.044 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:29.044 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:29.044 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2024-02-13T00:37:29.044 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_cmd_pp 2024-02-13T00:37:29.044 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_cmd_pp' 2024-02-13T00:37:29.045 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:29.046 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.046 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:29.046 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.046 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_cmd 2024-02-13T00:37:29.046 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_cmd: /' 2024-02-13T00:37:29.046 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_cmd.log 2024-02-13T00:37:29.048 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:29.048 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_cmd_pp 2024-02-13T00:37:29.050 INFO:tasks.workunit.client.0.smithi080.stdout:test api_cmd_pp on pid 54524 2024-02-13T00:37:29.051 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_cmd_pp 2024-02-13T00:37:29.051 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54524 2024-02-13T00:37:29.051 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_cmd_pp on pid 54524' 2024-02-13T00:37:29.051 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54524 2024-02-13T00:37:29.051 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:29.051 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:29.051 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2024-02-13T00:37:29.052 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:29.052 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.052 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_service 2024-02-13T00:37:29.053 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:29.053 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.053 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_service' 2024-02-13T00:37:29.055 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_cmd_pp 2024-02-13T00:37:29.057 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2024-02-13T00:37:29.058 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_cmd_pp: /' 2024-02-13T00:37:29.059 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:29.062 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_service 2024-02-13T00:37:29.063 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_service 2024-02-13T00:37:29.063 INFO:tasks.workunit.client.0.smithi080.stdout:test api_service on pid 54571 2024-02-13T00:37:29.064 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54571 2024-02-13T00:37:29.064 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_service on pid 54571' 2024-02-13T00:37:29.064 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54571 2024-02-13T00:37:29.064 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:29.064 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:29.064 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_service_pp 2024-02-13T00:37:29.065 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_service_pp' 2024-02-13T00:37:29.065 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_service_pp 2024-02-13T00:37:29.065 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2024-02-13T00:37:29.066 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:29.067 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:29.067 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.067 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:29.067 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.070 INFO:tasks.workunit.client.0.smithi080.stdout:test api_service_pp on pid 54592 2024-02-13T00:37:29.070 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_service_pp 2024-02-13T00:37:29.070 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54592 2024-02-13T00:37:29.070 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_service_pp on pid 54592' 2024-02-13T00:37:29.070 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54592 2024-02-13T00:37:29.070 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:29.070 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:29.070 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2024-02-13T00:37:29.071 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_service: /' 2024-02-13T00:37:29.071 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_service.log 2024-02-13T00:37:29.071 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_service 2024-02-13T00:37:29.073 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:29.073 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.073 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:29.073 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.074 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_service_pp 2024-02-13T00:37:29.074 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_service_pp: /' 2024-02-13T00:37:29.074 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_service_pp.log 2024-02-13T00:37:29.074 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_c_write_operations 2024-02-13T00:37:29.074 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_c_write_operations' 2024-02-13T00:37:29.077 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_c_write_operations 2024-02-13T00:37:29.078 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:29.080 INFO:tasks.workunit.client.0.smithi080.stdout:test api_c_write_operations on pid 54618 2024-02-13T00:37:29.081 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_c_write_operations 2024-02-13T00:37:29.081 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54618 2024-02-13T00:37:29.081 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_c_write_operations on pid 54618' 2024-02-13T00:37:29.081 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54618 2024-02-13T00:37:29.081 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:29.081 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2024-02-13T00:37:29.081 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:29.081 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s api_c_read_operations 2024-02-13T00:37:29.081 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' api_c_read_operations' 2024-02-13T00:37:29.082 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:29.082 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo api_c_read_operations 2024-02-13T00:37:29.082 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.083 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:29.083 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.083 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:29.083 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_c_write_operations 2024-02-13T00:37:29.083 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_c_write_operations: /' 2024-02-13T00:37:29.084 INFO:tasks.workunit.client.0.smithi080.stdout:test api_c_read_operations on pid 54632 2024-02-13T00:37:29.085 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=api_c_read_operations 2024-02-13T00:37:29.085 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2024-02-13T00:37:29.085 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54632 2024-02-13T00:37:29.085 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test api_c_read_operations on pid 54632' 2024-02-13T00:37:29.085 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54632 2024-02-13T00:37:29.085 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:29.085 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:29.095 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2024-02-13T00:37:29.096 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s list_parallel 2024-02-13T00:37:29.096 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' list_parallel' 2024-02-13T00:37:29.096 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo list_parallel 2024-02-13T00:37:29.098 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:29.098 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:29.098 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.099 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:29.099 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.099 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2024-02-13T00:37:29.099 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ api_c_read_operations: /' 2024-02-13T00:37:29.101 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=list_parallel 2024-02-13T00:37:29.101 INFO:tasks.workunit.client.0.smithi080.stdout:test list_parallel on pid 54668 2024-02-13T00:37:29.101 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54668 2024-02-13T00:37:29.102 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test list_parallel on pid 54668' 2024-02-13T00:37:29.102 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54668 2024-02-13T00:37:29.102 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:29.102 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2024-02-13T00:37:29.102 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:29.103 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:29.103 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.103 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:29.103 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.103 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_list_parallel 2024-02-13T00:37:29.103 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ list_parallel: /' 2024-02-13T00:37:29.103 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_list_parallel.log 2024-02-13T00:37:29.106 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_api_c_read_operations 2024-02-13T00:37:29.112 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s open_pools_parallel 2024-02-13T00:37:29.112 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' open_pools_parallel' 2024-02-13T00:37:29.112 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo open_pools_parallel 2024-02-13T00:37:29.112 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:29.113 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=open_pools_parallel 2024-02-13T00:37:29.114 INFO:tasks.workunit.client.0.smithi080.stdout:test open_pools_parallel on pid 54685 2024-02-13T00:37:29.114 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54685 2024-02-13T00:37:29.114 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test open_pools_parallel on pid 54685' 2024-02-13T00:37:29.114 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54685 2024-02-13T00:37:29.114 INFO:tasks.workunit.client.0.smithi080.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T00:37:29.114 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:29.115 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2024-02-13T00:37:29.116 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:29.116 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.116 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:29.116 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.116 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_open_pools_parallel 2024-02-13T00:37:29.117 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2024-02-13T00:37:29.117 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ open_pools_parallel: /' 2024-02-13T00:37:29.123 INFO:tasks.workunit.client.0.smithi080.stderr:++ printf %25s delete_pools_parallel 2024-02-13T00:37:29.124 INFO:tasks.workunit.client.0.smithi080.stderr:+ r=' delete_pools_parallel' 2024-02-13T00:37:29.134 INFO:tasks.workunit.client.0.smithi080.stderr:++ echo delete_pools_parallel 2024-02-13T00:37:29.135 INFO:tasks.workunit.client.0.smithi080.stderr:++ awk '{print $1}' 2024-02-13T00:37:29.138 INFO:tasks.workunit.client.0.smithi080.stdout:test delete_pools_parallel on pid 54740 2024-02-13T00:37:29.138 INFO:tasks.workunit.client.0.smithi080.stderr:+ ff=delete_pools_parallel 2024-02-13T00:37:29.138 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54740 2024-02-13T00:37:29.138 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo 'test delete_pools_parallel on pid 54740' 2024-02-13T00:37:29.138 INFO:tasks.workunit.client.0.smithi080.stderr:+ pids[$f]=54740 2024-02-13T00:37:29.138 INFO:tasks.workunit.client.0.smithi080.stderr:+ ret=0 2024-02-13T00:37:29.139 INFO:tasks.workunit.client.0.smithi080.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2024-02-13T00:37:29.139 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T00:37:29.139 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:37:29.139 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54170 2024-02-13T00:37:29.139 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54170 2024-02-13T00:37:29.142 INFO:tasks.workunit.client.0.smithi080.stderr:+ '[' -z '' ']' 2024-02-13T00:37:29.143 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.143 INFO:tasks.workunit.client.0.smithi080.stderr:+ case $- in 2024-02-13T00:37:29.143 INFO:tasks.workunit.client.0.smithi080.stderr:+ return 2024-02-13T00:37:29.143 INFO:tasks.workunit.client.0.smithi080.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2024-02-13T00:37:29.143 INFO:tasks.workunit.client.0.smithi080.stderr:+ sed 's/^/ delete_pools_parallel: /' 2024-02-13T00:37:29.144 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph_test_rados_delete_pools_parallel 2024-02-13T00:37:29.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:28 smithi106 bash[18459]: audit 2024-02-13T00:37:28.063893+0000 mgr.y (mgr.24461) 288 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:37:29.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:28 smithi080 bash[17386]: audit 2024-02-13T00:37:28.063893+0000 mgr.y (mgr.24461) 288 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:37:29.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:28 smithi080 bash[24237]: audit 2024-02-13T00:37:28.063893+0000 mgr.y (mgr.24461) 288 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:37:30.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:30 smithi106 bash[18459]: audit 2024-02-13T00:37:29.120736+0000 mon.b (mon.1) 33 : audit [DBG] from='client.? 172.21.15.80:0/2377398986' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-02-13T00:37:30.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:37:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:37:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:37:30.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:30 smithi080 bash[17386]: audit 2024-02-13T00:37:29.120736+0000 mon.b (mon.1) 33 : audit [DBG] from='client.? 172.21.15.80:0/2377398986' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-02-13T00:37:30.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:30 smithi080 bash[24237]: audit 2024-02-13T00:37:29.120736+0000 mon.b (mon.1) 33 : audit [DBG] from='client.? 172.21.15.80:0/2377398986' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-02-13T00:37:33.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:37:33 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:37:33] "GET /metrics HTTP/1.1" 200 179507 "" "Prometheus/2.33.4" 2024-02-13T00:37:36.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:35 smithi106 bash[18459]: cluster 2024-02-13T00:37:28.847807+0000 mgr.y (mgr.24461) 289 : cluster [DBG] pgmap v219: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:36.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:35 smithi080 bash[17386]: cluster 2024-02-13T00:37:28.847807+0000 mgr.y (mgr.24461) 289 : cluster [DBG] pgmap v219: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:36.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:35 smithi080 bash[24237]: cluster 2024-02-13T00:37:28.847807+0000 mgr.y (mgr.24461) 289 : cluster [DBG] pgmap v219: 132 pgs: 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:38.505 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:37:38 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:37:39.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:39 smithi106 bash[18459]: audit 2024-02-13T00:37:30.363535+0000 mon.c (mon.2) 76 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-13T00:37:39.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:39 smithi106 bash[18459]: audit 2024-02-13T00:37:30.364485+0000 mon.c (mon.2) 77 : audit [INF] from='client.? 172.21.15.80:0/1117570004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:39.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:39 smithi106 bash[18459]: audit 2024-02-13T00:37:30.366754+0000 mon.c (mon.2) 78 : audit [INF] from='client.? 172.21.15.80:0/3284140340' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi080-54223-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:39.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:39 smithi106 bash[18459]: audit 2024-02-13T00:37:30.370596+0000 mon.b (mon.1) 34 : audit [INF] from='client.? 172.21.15.80:0/3996660139' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi080-54175-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:39.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:39 smithi106 bash[18459]: cluster 2024-02-13T00:37:30.848549+0000 mgr.y (mgr.24461) 290 : cluster [DBG] pgmap v221: 228 pgs: 96 unknown, 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:37:39.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:39 smithi106 bash[18459]: cluster 2024-02-13T00:37:32.850265+0000 mgr.y (mgr.24461) 291 : cluster [DBG] pgmap v222: 228 pgs: 65 creating+peering, 132 active+clean, 31 unknown; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:37:39.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:39 smithi106 bash[18459]: cluster 2024-02-13T00:37:34.851037+0000 mgr.y (mgr.24461) 292 : cluster [DBG] pgmap v223: 228 pgs: 65 creating+peering, 132 active+clean, 31 unknown; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:37:39.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:39 smithi106 bash[18459]: cluster 2024-02-13T00:37:35.595183+0000 mon.a (mon.0) 689 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-02-13T00:37:39.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:39 smithi106 bash[18459]: audit 2024-02-13T00:37:35.615374+0000 mon.a (mon.0) 690 : audit [INF] from='client.? 172.21.15.80:0/1728366775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi080-54183-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:39.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:39 smithi106 bash[18459]: audit 2024-02-13T00:37:35.617941+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-13T00:37:39.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:39 smithi106 bash[18459]: audit 2024-02-13T00:37:35.618368+0000 mon.a (mon.0) 692 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:39.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:39 smithi106 bash[18459]: audit 2024-02-13T00:37:35.618509+0000 mon.a (mon.0) 693 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi080-54175-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:39.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:39 smithi106 bash[18459]: audit 2024-02-13T00:37:35.618674+0000 mon.a (mon.0) 694 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi080-54223-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:39.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[17386]: audit 2024-02-13T00:37:30.363535+0000 mon.c (mon.2) 76 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-13T00:37:39.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[17386]: audit 2024-02-13T00:37:30.364485+0000 mon.c (mon.2) 77 : audit [INF] from='client.? 172.21.15.80:0/1117570004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:39.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[17386]: audit 2024-02-13T00:37:30.366754+0000 mon.c (mon.2) 78 : audit [INF] from='client.? 172.21.15.80:0/3284140340' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi080-54223-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:39.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[17386]: audit 2024-02-13T00:37:30.370596+0000 mon.b (mon.1) 34 : audit [INF] from='client.? 172.21.15.80:0/3996660139' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi080-54175-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:39.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[17386]: cluster 2024-02-13T00:37:30.848549+0000 mgr.y (mgr.24461) 290 : cluster [DBG] pgmap v221: 228 pgs: 96 unknown, 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:37:39.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[17386]: cluster 2024-02-13T00:37:32.850265+0000 mgr.y (mgr.24461) 291 : cluster [DBG] pgmap v222: 228 pgs: 65 creating+peering, 132 active+clean, 31 unknown; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:37:39.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[17386]: cluster 2024-02-13T00:37:34.851037+0000 mgr.y (mgr.24461) 292 : cluster [DBG] pgmap v223: 228 pgs: 65 creating+peering, 132 active+clean, 31 unknown; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:37:39.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[17386]: cluster 2024-02-13T00:37:35.595183+0000 mon.a (mon.0) 689 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-02-13T00:37:39.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[17386]: audit 2024-02-13T00:37:35.615374+0000 mon.a (mon.0) 690 : audit [INF] from='client.? 172.21.15.80:0/1728366775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi080-54183-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:39.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[17386]: audit 2024-02-13T00:37:35.617941+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-13T00:37:39.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[17386]: audit 2024-02-13T00:37:35.618368+0000 mon.a (mon.0) 692 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:39.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[17386]: audit 2024-02-13T00:37:35.618509+0000 mon.a (mon.0) 693 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi080-54175-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:39.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[17386]: audit 2024-02-13T00:37:35.618674+0000 mon.a (mon.0) 694 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi080-54223-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:39.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[24237]: audit 2024-02-13T00:37:30.363535+0000 mon.c (mon.2) 76 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-13T00:37:39.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[24237]: audit 2024-02-13T00:37:30.364485+0000 mon.c (mon.2) 77 : audit [INF] from='client.? 172.21.15.80:0/1117570004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:39.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[24237]: audit 2024-02-13T00:37:30.366754+0000 mon.c (mon.2) 78 : audit [INF] from='client.? 172.21.15.80:0/3284140340' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi080-54223-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:39.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[24237]: audit 2024-02-13T00:37:30.370596+0000 mon.b (mon.1) 34 : audit [INF] from='client.? 172.21.15.80:0/3996660139' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi080-54175-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:39.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[24237]: cluster 2024-02-13T00:37:30.848549+0000 mgr.y (mgr.24461) 290 : cluster [DBG] pgmap v221: 228 pgs: 96 unknown, 132 active+clean; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:37:39.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[24237]: cluster 2024-02-13T00:37:32.850265+0000 mgr.y (mgr.24461) 291 : cluster [DBG] pgmap v222: 228 pgs: 65 creating+peering, 132 active+clean, 31 unknown; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:37:39.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[24237]: cluster 2024-02-13T00:37:34.851037+0000 mgr.y (mgr.24461) 292 : cluster [DBG] pgmap v223: 228 pgs: 65 creating+peering, 132 active+clean, 31 unknown; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:37:39.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[24237]: cluster 2024-02-13T00:37:35.595183+0000 mon.a (mon.0) 689 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-02-13T00:37:39.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[24237]: audit 2024-02-13T00:37:35.615374+0000 mon.a (mon.0) 690 : audit [INF] from='client.? 172.21.15.80:0/1728366775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi080-54183-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:39.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[24237]: audit 2024-02-13T00:37:35.617941+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-13T00:37:39.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[24237]: audit 2024-02-13T00:37:35.618368+0000 mon.a (mon.0) 692 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:39.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[24237]: audit 2024-02-13T00:37:35.618509+0000 mon.a (mon.0) 693 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi080-54175-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:39.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:39 smithi080 bash[24237]: audit 2024-02-13T00:37:35.618674+0000 mon.a (mon.0) 694 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi080-54223-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:35.631309+0000 mon.c (mon.2) 79 : audit [INF] from='client.? 172.21.15.80:0/1686834050' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi080-54231-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:35.631763+0000 mon.c (mon.2) 80 : audit [INF] from='client.? 172.21.15.80:0/3266209987' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi080-54255-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:35.632153+0000 mon.c (mon.2) 81 : audit [INF] from='client.? 172.21.15.80:0/2081649122' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi080-54191-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:35.632790+0000 mon.c (mon.2) 82 : audit [INF] from='client.? 172.21.15.80:0/1566198701' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi080-54483-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:35.633075+0000 mon.c (mon.2) 83 : audit [INF] from='client.? 172.21.15.80:0/1995436239' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:35.636093+0000 mon.b (mon.1) 35 : audit [INF] from='client.? 172.21.15.80:0/1284809844' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi080-54474-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:35.636544+0000 mon.b (mon.1) 36 : audit [INF] from='client.? 172.21.15.80:0/4072998863' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi080-54454-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:35.637291+0000 mon.c (mon.2) 84 : audit [INF] from='client.? 172.21.15.80:0/640662995' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi080-54665-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:35.637744+0000 mon.c (mon.2) 85 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:35.644951+0000 mon.c (mon.2) 86 : audit [INF] from='client.? 172.21.15.80:0/2239853122' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi080-54478-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:35.681211+0000 mon.c (mon.2) 87 : audit [DBG] from='client.? 172.21.15.80:0/2401248328' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T00:37:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: cluster 2024-02-13T00:37:36.852196+0000 mgr.y (mgr.24461) 293 : cluster [DBG] pgmap v225: 612 pgs: 65 creating+peering, 132 active+clean, 415 unknown; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:37:40.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:37.709320+0000 mon.c (mon.2) 88 : audit [DBG] from='client.? 172.21.15.80:0/3835791519' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T00:37:40.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:38.075284+0000 mgr.y (mgr.24461) 294 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:37:40.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:38.682125+0000 mon.c (mon.2) 89 : audit [INF] from='client.? 172.21.15.80:0/1117570004' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:40.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:38.682602+0000 mon.c (mon.2) 90 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-13T00:37:40.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: cluster 2024-02-13T00:37:38.855907+0000 mgr.y (mgr.24461) 295 : cluster [DBG] pgmap v226: 612 pgs: 343 creating+peering, 132 active+clean, 137 unknown; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:40.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: cluster 2024-02-13T00:37:39.110175+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-13T00:37:40.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.122992+0000 mon.a (mon.0) 696 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi080-54474-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.123451+0000 mon.a (mon.0) 697 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi080-54231-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.123702+0000 mon.a (mon.0) 698 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi080-54454-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.123956+0000 mon.a (mon.0) 699 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi080-54255-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.124247+0000 mon.a (mon.0) 700 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi080-54191-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.124545+0000 mon.a (mon.0) 701 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi080-54483-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.136468+0000 mon.a (mon.0) 702 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.136878+0000 mon.a (mon.0) 703 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi080-54665-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.137219+0000 mon.a (mon.0) 704 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.137505+0000 mon.a (mon.0) 705 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi080-54478-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.141229+0000 mon.a (mon.0) 706 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:40.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.141511+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-13T00:37:40.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.154208+0000 mon.a (mon.0) 708 : audit [INF] from='client.? 172.21.15.80:0/1728366775' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi080-54183-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:40.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.154586+0000 mon.a (mon.0) 709 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi080-54175-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:40.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.154749+0000 mon.a (mon.0) 710 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi080-54223-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:40.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.175185+0000 mon.c (mon.2) 91 : audit [INF] from='client.? 172.21.15.80:0/221656257' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54516-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.175658+0000 mon.c (mon.2) 92 : audit [INF] from='client.? 172.21.15.80:0/3693664894' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi080-54199-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.176082+0000 mon.c (mon.2) 93 : audit [INF] from='client.? 172.21.15.80:0/891818214' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54533-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: cluster 2024-02-13T00:37:39.599160+0000 mon.a (mon.0) 711 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-13T00:37:40.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.600188+0000 mon.c (mon.2) 94 : audit [INF] from='client.? 172.21.15.80:0/1117570004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:40.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.605068+0000 mon.a (mon.0) 712 : audit [INF] from='client.? 172.21.15.80:0/1901790603' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi080-54340-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.509 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.606631+0000 mon.a (mon.0) 713 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54516-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.509 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.609305+0000 mon.a (mon.0) 714 : audit [INF] from='client.? 172.21.15.80:0/2727616130' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.509 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.609788+0000 mon.a (mon.0) 715 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi080-54215-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.509 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.610508+0000 mon.a (mon.0) 716 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi080-54199-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.509 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.611333+0000 mon.a (mon.0) 717 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54533-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.509 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.619723+0000 mon.a (mon.0) 718 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:40.509 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[18459]: audit 2024-02-13T00:37:39.736807+0000 mon.a (mon.0) 719 : audit [DBG] from='client.? 172.21.15.80:0/1401614552' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T00:37:40.509 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:37:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:37:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:37:40.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:35.631309+0000 mon.c (mon.2) 79 : audit [INF] from='client.? 172.21.15.80:0/1686834050' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi080-54231-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:35.631763+0000 mon.c (mon.2) 80 : audit [INF] from='client.? 172.21.15.80:0/3266209987' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi080-54255-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:35.632153+0000 mon.c (mon.2) 81 : audit [INF] from='client.? 172.21.15.80:0/2081649122' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi080-54191-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:35.632790+0000 mon.c (mon.2) 82 : audit [INF] from='client.? 172.21.15.80:0/1566198701' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi080-54483-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:35.633075+0000 mon.c (mon.2) 83 : audit [INF] from='client.? 172.21.15.80:0/1995436239' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:35.636093+0000 mon.b (mon.1) 35 : audit [INF] from='client.? 172.21.15.80:0/1284809844' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi080-54474-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:35.636544+0000 mon.b (mon.1) 36 : audit [INF] from='client.? 172.21.15.80:0/4072998863' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi080-54454-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:35.637291+0000 mon.c (mon.2) 84 : audit [INF] from='client.? 172.21.15.80:0/640662995' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi080-54665-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:35.637744+0000 mon.c (mon.2) 85 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:35.644951+0000 mon.c (mon.2) 86 : audit [INF] from='client.? 172.21.15.80:0/2239853122' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi080-54478-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:35.681211+0000 mon.c (mon.2) 87 : audit [DBG] from='client.? 172.21.15.80:0/2401248328' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T00:37:40.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: cluster 2024-02-13T00:37:36.852196+0000 mgr.y (mgr.24461) 293 : cluster [DBG] pgmap v225: 612 pgs: 65 creating+peering, 132 active+clean, 415 unknown; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:37:40.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:37.709320+0000 mon.c (mon.2) 88 : audit [DBG] from='client.? 172.21.15.80:0/3835791519' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T00:37:40.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:38.075284+0000 mgr.y (mgr.24461) 294 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:37:40.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:38.682125+0000 mon.c (mon.2) 89 : audit [INF] from='client.? 172.21.15.80:0/1117570004' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:40.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:38.682602+0000 mon.c (mon.2) 90 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-13T00:37:40.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: cluster 2024-02-13T00:37:38.855907+0000 mgr.y (mgr.24461) 295 : cluster [DBG] pgmap v226: 612 pgs: 343 creating+peering, 132 active+clean, 137 unknown; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:40.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: cluster 2024-02-13T00:37:39.110175+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-13T00:37:40.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.122992+0000 mon.a (mon.0) 696 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi080-54474-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.123451+0000 mon.a (mon.0) 697 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi080-54231-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.123702+0000 mon.a (mon.0) 698 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi080-54454-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.123956+0000 mon.a (mon.0) 699 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi080-54255-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.124247+0000 mon.a (mon.0) 700 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi080-54191-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.124545+0000 mon.a (mon.0) 701 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi080-54483-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.136468+0000 mon.a (mon.0) 702 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.136878+0000 mon.a (mon.0) 703 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi080-54665-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.137219+0000 mon.a (mon.0) 704 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.137505+0000 mon.a (mon.0) 705 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi080-54478-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:35.631309+0000 mon.c (mon.2) 79 : audit [INF] from='client.? 172.21.15.80:0/1686834050' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi080-54231-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:35.631763+0000 mon.c (mon.2) 80 : audit [INF] from='client.? 172.21.15.80:0/3266209987' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi080-54255-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:35.632153+0000 mon.c (mon.2) 81 : audit [INF] from='client.? 172.21.15.80:0/2081649122' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi080-54191-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:35.632790+0000 mon.c (mon.2) 82 : audit [INF] from='client.? 172.21.15.80:0/1566198701' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi080-54483-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:35.633075+0000 mon.c (mon.2) 83 : audit [INF] from='client.? 172.21.15.80:0/1995436239' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:35.636093+0000 mon.b (mon.1) 35 : audit [INF] from='client.? 172.21.15.80:0/1284809844' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi080-54474-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:35.636544+0000 mon.b (mon.1) 36 : audit [INF] from='client.? 172.21.15.80:0/4072998863' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi080-54454-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.513 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:35.637291+0000 mon.c (mon.2) 84 : audit [INF] from='client.? 172.21.15.80:0/640662995' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi080-54665-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.513 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:35.637744+0000 mon.c (mon.2) 85 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.513 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:35.644951+0000 mon.c (mon.2) 86 : audit [INF] from='client.? 172.21.15.80:0/2239853122' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi080-54478-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.513 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:35.681211+0000 mon.c (mon.2) 87 : audit [DBG] from='client.? 172.21.15.80:0/2401248328' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T00:37:40.513 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: cluster 2024-02-13T00:37:36.852196+0000 mgr.y (mgr.24461) 293 : cluster [DBG] pgmap v225: 612 pgs: 65 creating+peering, 132 active+clean, 415 unknown; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:37:40.513 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:37.709320+0000 mon.c (mon.2) 88 : audit [DBG] from='client.? 172.21.15.80:0/3835791519' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T00:37:40.513 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:38.075284+0000 mgr.y (mgr.24461) 294 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:37:40.513 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.141229+0000 mon.a (mon.0) 706 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:40.513 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.141511+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-13T00:37:40.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.154208+0000 mon.a (mon.0) 708 : audit [INF] from='client.? 172.21.15.80:0/1728366775' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi080-54183-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:40.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.154586+0000 mon.a (mon.0) 709 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi080-54175-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:40.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.154749+0000 mon.a (mon.0) 710 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi080-54223-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:40.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.175185+0000 mon.c (mon.2) 91 : audit [INF] from='client.? 172.21.15.80:0/221656257' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54516-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.175658+0000 mon.c (mon.2) 92 : audit [INF] from='client.? 172.21.15.80:0/3693664894' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi080-54199-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.176082+0000 mon.c (mon.2) 93 : audit [INF] from='client.? 172.21.15.80:0/891818214' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54533-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: cluster 2024-02-13T00:37:39.599160+0000 mon.a (mon.0) 711 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-13T00:37:40.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.600188+0000 mon.c (mon.2) 94 : audit [INF] from='client.? 172.21.15.80:0/1117570004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:40.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.605068+0000 mon.a (mon.0) 712 : audit [INF] from='client.? 172.21.15.80:0/1901790603' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi080-54340-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.606631+0000 mon.a (mon.0) 713 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54516-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.609305+0000 mon.a (mon.0) 714 : audit [INF] from='client.? 172.21.15.80:0/2727616130' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.609788+0000 mon.a (mon.0) 715 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi080-54215-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.610508+0000 mon.a (mon.0) 716 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi080-54199-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.514 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.611333+0000 mon.a (mon.0) 717 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54533-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.515 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.619723+0000 mon.a (mon.0) 718 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:40.515 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[17386]: audit 2024-02-13T00:37:39.736807+0000 mon.a (mon.0) 719 : audit [DBG] from='client.? 172.21.15.80:0/1401614552' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T00:37:40.515 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:38.682125+0000 mon.c (mon.2) 89 : audit [INF] from='client.? 172.21.15.80:0/1117570004' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:40.515 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:38.682602+0000 mon.c (mon.2) 90 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-13T00:37:40.515 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: cluster 2024-02-13T00:37:38.855907+0000 mgr.y (mgr.24461) 295 : cluster [DBG] pgmap v226: 612 pgs: 343 creating+peering, 132 active+clean, 137 unknown; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:37:40.515 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: cluster 2024-02-13T00:37:39.110175+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-13T00:37:40.515 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.122992+0000 mon.a (mon.0) 696 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi080-54474-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.515 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.123451+0000 mon.a (mon.0) 697 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi080-54231-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.516 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.123702+0000 mon.a (mon.0) 698 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi080-54454-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.516 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.123956+0000 mon.a (mon.0) 699 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi080-54255-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.516 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.124247+0000 mon.a (mon.0) 700 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi080-54191-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.516 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.124545+0000 mon.a (mon.0) 701 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi080-54483-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.516 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.136468+0000 mon.a (mon.0) 702 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.516 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.136878+0000 mon.a (mon.0) 703 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi080-54665-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.516 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.137219+0000 mon.a (mon.0) 704 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.516 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.137505+0000 mon.a (mon.0) 705 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi080-54478-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.516 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.141229+0000 mon.a (mon.0) 706 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:40.516 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.141511+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-13T00:37:40.516 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.154208+0000 mon.a (mon.0) 708 : audit [INF] from='client.? 172.21.15.80:0/1728366775' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi080-54183-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:40.516 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.154586+0000 mon.a (mon.0) 709 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi080-54175-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:40.516 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.154749+0000 mon.a (mon.0) 710 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi080-54223-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:40.516 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.175185+0000 mon.c (mon.2) 91 : audit [INF] from='client.? 172.21.15.80:0/221656257' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54516-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.517 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.175658+0000 mon.c (mon.2) 92 : audit [INF] from='client.? 172.21.15.80:0/3693664894' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi080-54199-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.517 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.176082+0000 mon.c (mon.2) 93 : audit [INF] from='client.? 172.21.15.80:0/891818214' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54533-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.517 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: cluster 2024-02-13T00:37:39.599160+0000 mon.a (mon.0) 711 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-13T00:37:40.517 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.600188+0000 mon.c (mon.2) 94 : audit [INF] from='client.? 172.21.15.80:0/1117570004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:40.517 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.605068+0000 mon.a (mon.0) 712 : audit [INF] from='client.? 172.21.15.80:0/1901790603' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi080-54340-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.517 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.606631+0000 mon.a (mon.0) 713 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54516-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.517 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.609305+0000 mon.a (mon.0) 714 : audit [INF] from='client.? 172.21.15.80:0/2727616130' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.517 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.609788+0000 mon.a (mon.0) 715 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi080-54215-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.517 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.610508+0000 mon.a (mon.0) 716 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi080-54199-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.517 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.611333+0000 mon.a (mon.0) 717 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54533-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:40.517 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.619723+0000 mon.a (mon.0) 718 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:40.517 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:40 smithi080 bash[24237]: audit 2024-02-13T00:37:39.736807+0000 mon.a (mon.0) 719 : audit [DBG] from='client.? 172.21.15.80:0/1401614552' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T00:37:40.518 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2024-02-13T00:37:40.518 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [----------] Global test environment set-up. 2024-02-13T00:37:40.518 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [----------] 12 tests from AsioRados 2024-02-13T00:37:40.519 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2024-02-13T00:37:40.519 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (1 ms) 2024-02-13T00:37:40.519 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2024-02-13T00:37:40.519 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (5 ms) 2024-02-13T00:37:40.519 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2024-02-13T00:37:40.519 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (3 ms) 2024-02-13T00:37:40.519 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2024-02-13T00:37:40.519 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (9 ms) 2024-02-13T00:37:40.519 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2024-02-13T00:37:40.519 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (5 ms) 2024-02-13T00:37:40.519 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2024-02-13T00:37:40.519 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (4 ms) 2024-02-13T00:37:40.519 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2024-02-13T00:37:40.520 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (1 ms) 2024-02-13T00:37:40.520 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2024-02-13T00:37:40.520 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (2 ms) 2024-02-13T00:37:40.520 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2024-02-13T00:37:40.520 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (0 ms) 2024-02-13T00:37:40.520 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2024-02-13T00:37:40.520 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (3 ms) 2024-02-13T00:37:40.520 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2024-02-13T00:37:40.520 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (4 ms) 2024-02-13T00:37:40.520 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2024-02-13T00:37:40.520 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (4 ms) 2024-02-13T00:37:40.520 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [----------] 12 tests from AsioRados (43 ms total) 2024-02-13T00:37:40.520 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: 2024-02-13T00:37:40.520 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [----------] Global test environment tear-down 2024-02-13T00:37:40.520 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (11528 ms total) 2024-02-13T00:37:40.521 INFO:tasks.workunit.client.0.smithi080.stdout: api_asio: [ PASSED ] 12 tests. 2024-02-13T00:37:41.161 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2024-02-13T00:37:41.161 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [----------] Global test environment set-up. 2024-02-13T00:37:41.161 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [----------] 7 tests from LibRadosList 2024-02-13T00:37:41.161 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2024-02-13T00:37:41.161 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ OK ] LibRadosList.ListObjects (49 ms) 2024-02-13T00:37:41.161 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2024-02-13T00:37:41.161 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (38 ms) 2024-02-13T00:37:41.162 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2024-02-13T00:37:41.162 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: myset foo1,foo2,foo3 2024-02-13T00:37:41.162 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: foo1 2024-02-13T00:37:41.162 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: foo2 2024-02-13T00:37:41.162 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: foo3 2024-02-13T00:37:41.162 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: myset foo1,foo4,foo5 2024-02-13T00:37:41.162 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: foo4 2024-02-13T00:37:41.162 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: foo5 2024-02-13T00:37:41.162 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: foo1 2024-02-13T00:37:41.162 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: myset foo6,foo7 2024-02-13T00:37:41.162 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: foo7 2024-02-13T00:37:41.162 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: foo6 2024-02-13T00:37:41.162 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-02-13T00:37:41.162 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: ns1:foo4 2024-02-13T00:37:41.163 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: ns1:foo5 2024-02-13T00:37:41.163 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: ns2:foo7 2024-02-13T00:37:41.163 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: ns2:foo6 2024-02-13T00:37:41.163 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: ns1:foo1 2024-02-13T00:37:41.163 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: :foo1 2024-02-13T00:37:41.163 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: :foo2 2024-02-13T00:37:41.163 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: :foo3 2024-02-13T00:37:41.163 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (103 ms) 2024-02-13T00:37:41.163 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2024-02-13T00:37:41.163 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 1 0 2024-02-13T00:37:41.163 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 10 0 2024-02-13T00:37:41.163 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 13 0 2024-02-13T00:37:41.163 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 7 0 2024-02-13T00:37:41.163 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 14 0 2024-02-13T00:37:41.163 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 0 0 2024-02-13T00:37:41.163 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 15 0 2024-02-13T00:37:41.164 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 11 0 2024-02-13T00:37:41.164 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 5 0 2024-02-13T00:37:41.164 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 8 0 2024-02-13T00:37:41.164 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 6 0 2024-02-13T00:37:41.164 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 3 0 2024-02-13T00:37:41.164 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 4 0 2024-02-13T00:37:41.164 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 12 0 2024-02-13T00:37:41.164 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 9 0 2024-02-13T00:37:41.164 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 2 0 2024-02-13T00:37:41.165 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-02-13T00:37:41.165 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (92 ms) 2024-02-13T00:37:41.165 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2024-02-13T00:37:41.165 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: x cursor=MIN 2024-02-13T00:37:41.165 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > oid=1 cursor=27:02547ec2:::1:head 2024-02-13T00:37:41.165 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > oid=10 cursor=27:52ea6a34:::10:head 2024-02-13T00:37:41.165 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > oid=13 cursor=27:566253c9:::13:head 2024-02-13T00:37:41.165 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > oid=7 cursor=27:5c6b0b28:::7:head 2024-02-13T00:37:41.165 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > oid=14 cursor=27:62a1935d:::14:head 2024-02-13T00:37:41.165 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > oid=0 cursor=27:6cac518f:::0:head 2024-02-13T00:37:41.165 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > oid=15 cursor=27:863748b0:::15:head 2024-02-13T00:37:41.165 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > oid=11 cursor=27:89d3ae78:::11:head 2024-02-13T00:37:41.165 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > oid=5 cursor=27:b29083e3:::5:head 2024-02-13T00:37:41.165 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > oid=8 cursor=27:bd63b0f1:::8:head 2024-02-13T00:37:41.165 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > oid=6 cursor=27:c4fdafeb:::6:head 2024-02-13T00:37:41.166 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > oid=3 cursor=27:cfc208b3:::3:head 2024-02-13T00:37:41.166 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > oid=4 cursor=27:d83876eb:::4:head 2024-02-13T00:37:41.166 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > oid=12 cursor=27:de5d7c5f:::12:head 2024-02-13T00:37:41.166 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > oid=9 cursor=27:e960b815:::9:head 2024-02-13T00:37:41.166 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > oid=2 cursor=27:f905c69b:::2:head 2024-02-13T00:37:41.166 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: FIRST> seek to MIN oid=1 2024-02-13T00:37:41.166 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : oid=1 cursor=27:02547ec2:::1:head 2024-02-13T00:37:41.166 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:02547ec2:::1:head 2024-02-13T00:37:41.166 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:02547ec2:::1:head -> 1 2024-02-13T00:37:41.166 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : oid=10 cursor=27:52ea6a34:::10:head 2024-02-13T00:37:41.166 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:52ea6a34:::10:head 2024-02-13T00:37:41.166 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:52ea6a34:::10:head -> 10 2024-02-13T00:37:41.166 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : oid=13 cursor=27:566253c9:::13:head 2024-02-13T00:37:41.166 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:566253c9:::13:head 2024-02-13T00:37:41.167 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:566253c9:::13:head -> 13 2024-02-13T00:37:41.167 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : oid=7 cursor=27:5c6b0b28:::7:head 2024-02-13T00:37:41.167 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:5c6b0b28:::7:head 2024-02-13T00:37:41.167 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:5c6b0b28:::7:head -> 7 2024-02-13T00:37:41.267 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : oid=14 cursor=27:62a1935d:::14:head 2024-02-13T00:37:41.267 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:62a1935d:::14:head 2024-02-13T00:37:41.267 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:62a1935d:::14:head -> 14 2024-02-13T00:37:41.267 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : oid=0 cursor=27:6cac518f:::0:head 2024-02-13T00:37:41.267 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:6cac518f:::0:head 2024-02-13T00:37:41.267 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:6cac518f:::0:head -> 0 2024-02-13T00:37:41.267 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : oid=15 cursor=27:863748b0:::15:head 2024-02-13T00:37:41.267 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:863748b0:::15:head 2024-02-13T00:37:41.267 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:863748b0:::15:head -> 15 2024-02-13T00:37:41.267 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : oid=11 cursor=27:89d3ae78:::11:head 2024-02-13T00:37:41.268 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:89d3ae78:::11:head 2024-02-13T00:37:41.268 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:89d3ae78:::11:head -> 11 2024-02-13T00:37:41.268 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : oid=5 cursor=27:b29083e3:::5:head 2024-02-13T00:37:41.268 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:b29083e3:::5:head 2024-02-13T00:37:41.268 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:b29083e3:::5:head -> 5 2024-02-13T00:37:41.268 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : oid=8 cursor=27:bd63b0f1:::8:head 2024-02-13T00:37:41.268 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:bd63b0f1:::8:head 2024-02-13T00:37:41.268 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:bd63b0f1:::8:head -> 8 2024-02-13T00:37:41.268 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : oid=6 cursor=27:c4fdafeb:::6:head 2024-02-13T00:37:41.268 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:c4fdafeb:::6:head 2024-02-13T00:37:41.268 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:c4fdafeb:::6:head -> 6 2024-02-13T00:37:41.268 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : oid=3 cursor=27:cfc208b3:::3:head 2024-02-13T00:37:41.268 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:cfc208b3:::3:head 2024-02-13T00:37:41.268 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:cfc208b3:::3:head -> 3 2024-02-13T00:37:41.269 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : oid=4 cursor=27:d83876eb:::4:head 2024-02-13T00:37:41.269 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:d83876eb:::4:head 2024-02-13T00:37:41.269 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:d83876eb:::4:head -> 4 2024-02-13T00:37:41.269 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : oid=12 cursor=27:de5d7c5f:::12:head 2024-02-13T00:37:41.269 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:de5d7c5f:::12:head 2024-02-13T00:37:41.269 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:de5d7c5f:::12:head -> 12 2024-02-13T00:37:41.269 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : oid=9 cursor=27:e960b815:::9:head 2024-02-13T00:37:41.269 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:e960b815:::9:head 2024-02-13T00:37:41.269 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:e960b815:::9:head -> 9 2024-02-13T00:37:41.269 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : oid=2 cursor=27:f905c69b:::2:head 2024-02-13T00:37:41.269 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:f905c69b:::2:head 2024-02-13T00:37:41.269 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:f905c69b:::2:head -> 2 2024-02-13T00:37:41.269 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:5c6b0b28:::7:head 2024-02-13T00:37:41.269 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : cursor()=27:5c6b0b28:::7:head expected=27:5c6b0b28:::7:head 2024-02-13T00:37:41.270 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:5c6b0b28:::7:head -> 7 2024-02-13T00:37:41.270 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : entry=7 expected=7 2024-02-13T00:37:41.270 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:c4fdafeb:::6:head 2024-02-13T00:37:41.270 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : cursor()=27:c4fdafeb:::6:head expected=27:c4fdafeb:::6:head 2024-02-13T00:37:41.270 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:c4fdafeb:::6:head -> 6 2024-02-13T00:37:41.270 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : entry=6 expected=6 2024-02-13T00:37:41.270 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:52ea6a34:::10:head 2024-02-13T00:37:41.270 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : cursor()=27:52ea6a34:::10:head expected=27:52ea6a34:::10:head 2024-02-13T00:37:41.270 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:52ea6a34:::10:head -> 10 2024-02-13T00:37:41.270 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : entry=10 expected=10 2024-02-13T00:37:41.270 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:62a1935d:::14:head 2024-02-13T00:37:41.270 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : cursor()=27:62a1935d:::14:head expected=27:62a1935d:::14:head 2024-02-13T00:37:41.270 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:62a1935d:::14:head -> 14 2024-02-13T00:37:41.270 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : entry=14 expected=14 2024-02-13T00:37:41.270 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:02547ec2:::1:head 2024-02-13T00:37:41.270 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : cursor()=27:02547ec2:::1:head expected=27:02547ec2:::1:head 2024-02-13T00:37:41.271 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:02547ec2:::1:head -> 1 2024-02-13T00:37:41.271 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : entry=1 expected=1 2024-02-13T00:37:41.271 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:f905c69b:::2:head 2024-02-13T00:37:41.271 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : cursor()=27:f905c69b:::2:head expected=27:f905c69b:::2:head 2024-02-13T00:37:41.271 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:f905c69b:::2:head -> 2 2024-02-13T00:37:41.271 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : entry=2 expected=2 2024-02-13T00:37:41.271 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:e960b815:::9:head 2024-02-13T00:37:41.271 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : cursor()=27:e960b815:::9:head expected=27:e960b815:::9:head 2024-02-13T00:37:41.271 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:e960b815:::9:head -> 9 2024-02-13T00:37:41.271 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : entry=9 expected=9 2024-02-13T00:37:41.271 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:de5d7c5f:::12:head 2024-02-13T00:37:41.271 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : cursor()=27:de5d7c5f:::12:head expected=27:de5d7c5f:::12:head 2024-02-13T00:37:41.271 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:de5d7c5f:::12:head -> 12 2024-02-13T00:37:41.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:41 smithi106 bash[18459]: audit 2024-02-13T00:37:40.169509+0000 mon.a (mon.0) 720 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi080-54474-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:41 smithi106 bash[18459]: audit 2024-02-13T00:37:40.169619+0000 mon.a (mon.0) 721 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi080-54231-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:41 smithi106 bash[18459]: audit 2024-02-13T00:37:40.169707+0000 mon.a (mon.0) 722 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi080-54454-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:41 smithi106 bash[18459]: audit 2024-02-13T00:37:40.169796+0000 mon.a (mon.0) 723 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi080-54255-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:41 smithi106 bash[18459]: audit 2024-02-13T00:37:40.169896+0000 mon.a (mon.0) 724 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi080-54191-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:41 smithi106 bash[18459]: audit 2024-02-13T00:37:40.170000+0000 mon.a (mon.0) 725 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi080-54483-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:41 smithi106 bash[18459]: audit 2024-02-13T00:37:40.170108+0000 mon.a (mon.0) 726 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:41 smithi106 bash[18459]: audit 2024-02-13T00:37:40.170279+0000 mon.a (mon.0) 727 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi080-54665-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:41 smithi106 bash[18459]: audit 2024-02-13T00:37:40.170349+0000 mon.a (mon.0) 728 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:41 smithi106 bash[18459]: audit 2024-02-13T00:37:40.170417+0000 mon.a (mon.0) 729 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi080-54478-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:41 smithi106 bash[18459]: audit 2024-02-13T00:37:40.170497+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-13T00:37:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:41 smithi106 bash[18459]: audit 2024-02-13T00:37:40.170613+0000 mon.a (mon.0) 731 : audit [INF] from='client.? 172.21.15.80:0/1901790603' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi080-54340-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:41 smithi106 bash[18459]: audit 2024-02-13T00:37:40.170696+0000 mon.a (mon.0) 732 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54516-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:41 smithi106 bash[18459]: audit 2024-02-13T00:37:40.170762+0000 mon.a (mon.0) 733 : audit [INF] from='client.? 172.21.15.80:0/2727616130' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:41 smithi106 bash[18459]: audit 2024-02-13T00:37:40.170814+0000 mon.a (mon.0) 734 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi080-54215-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:41 smithi106 bash[18459]: audit 2024-02-13T00:37:40.170882+0000 mon.a (mon.0) 735 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi080-54199-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:41 smithi106 bash[18459]: audit 2024-02-13T00:37:40.170966+0000 mon.a (mon.0) 736 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54533-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:41 smithi106 bash[18459]: audit 2024-02-13T00:37:40.171130+0000 mon.a (mon.0) 737 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:41.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:41 smithi106 bash[18459]: cluster 2024-02-13T00:37:40.171212+0000 mon.a (mon.0) 738 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-02-13T00:37:41.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:41 smithi106 bash[18459]: audit 2024-02-13T00:37:40.181591+0000 mon.c (mon.2) 95 : audit [INF] from='client.? 172.21.15.80:0/1117570004' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi080-54497-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:41.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:41 smithi106 bash[18459]: audit 2024-02-13T00:37:40.762676+0000 mon.a (mon.0) 739 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi080-54497-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:41.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[17386]: audit 2024-02-13T00:37:40.169509+0000 mon.a (mon.0) 720 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi080-54474-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[17386]: audit 2024-02-13T00:37:40.169619+0000 mon.a (mon.0) 721 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi080-54231-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[17386]: audit 2024-02-13T00:37:40.169707+0000 mon.a (mon.0) 722 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi080-54454-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[17386]: audit 2024-02-13T00:37:40.169796+0000 mon.a (mon.0) 723 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi080-54255-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[17386]: audit 2024-02-13T00:37:40.169896+0000 mon.a (mon.0) 724 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi080-54191-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[17386]: audit 2024-02-13T00:37:40.170000+0000 mon.a (mon.0) 725 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi080-54483-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[17386]: audit 2024-02-13T00:37:40.170108+0000 mon.a (mon.0) 726 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[17386]: audit 2024-02-13T00:37:40.170279+0000 mon.a (mon.0) 727 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi080-54665-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[17386]: audit 2024-02-13T00:37:40.170349+0000 mon.a (mon.0) 728 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[17386]: audit 2024-02-13T00:37:40.170417+0000 mon.a (mon.0) 729 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi080-54478-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[17386]: audit 2024-02-13T00:37:40.170497+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-13T00:37:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[17386]: audit 2024-02-13T00:37:40.170613+0000 mon.a (mon.0) 731 : audit [INF] from='client.? 172.21.15.80:0/1901790603' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi080-54340-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[17386]: audit 2024-02-13T00:37:40.170696+0000 mon.a (mon.0) 732 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54516-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[24237]: audit 2024-02-13T00:37:40.169509+0000 mon.a (mon.0) 720 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi080-54474-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[24237]: audit 2024-02-13T00:37:40.169619+0000 mon.a (mon.0) 721 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi080-54231-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[24237]: audit 2024-02-13T00:37:40.169707+0000 mon.a (mon.0) 722 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi080-54454-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[24237]: audit 2024-02-13T00:37:40.169796+0000 mon.a (mon.0) 723 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi080-54255-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[24237]: audit 2024-02-13T00:37:40.169896+0000 mon.a (mon.0) 724 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi080-54191-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[24237]: audit 2024-02-13T00:37:40.170000+0000 mon.a (mon.0) 725 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi080-54483-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[24237]: audit 2024-02-13T00:37:40.170108+0000 mon.a (mon.0) 726 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[24237]: audit 2024-02-13T00:37:40.170279+0000 mon.a (mon.0) 727 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi080-54665-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[24237]: audit 2024-02-13T00:37:40.170349+0000 mon.a (mon.0) 728 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[24237]: audit 2024-02-13T00:37:40.170417+0000 mon.a (mon.0) 729 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi080-54478-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[24237]: audit 2024-02-13T00:37:40.170497+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-13T00:37:41.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[24237]: audit 2024-02-13T00:37:40.170613+0000 mon.a (mon.0) 731 : audit [INF] from='client.? 172.21.15.80:0/1901790603' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi080-54340-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[24237]: audit 2024-02-13T00:37:40.170696+0000 mon.a (mon.0) 732 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54516-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[17386]: audit 2024-02-13T00:37:40.170762+0000 mon.a (mon.0) 733 : audit [INF] from='client.? 172.21.15.80:0/2727616130' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[17386]: audit 2024-02-13T00:37:40.170814+0000 mon.a (mon.0) 734 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi080-54215-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[17386]: audit 2024-02-13T00:37:40.170882+0000 mon.a (mon.0) 735 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi080-54199-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[17386]: audit 2024-02-13T00:37:40.170966+0000 mon.a (mon.0) 736 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54533-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[17386]: audit 2024-02-13T00:37:40.171130+0000 mon.a (mon.0) 737 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:41.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[17386]: cluster 2024-02-13T00:37:40.171212+0000 mon.a (mon.0) 738 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-02-13T00:37:41.762 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[17386]: audit 2024-02-13T00:37:40.181591+0000 mon.c (mon.2) 95 : audit [INF] from='client.? 172.21.15.80:0/1117570004' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi080-54497-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:41.762 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[17386]: audit 2024-02-13T00:37:40.762676+0000 mon.a (mon.0) 739 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi080-54497-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:41.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[24237]: audit 2024-02-13T00:37:40.170762+0000 mon.a (mon.0) 733 : audit [INF] from='client.? 172.21.15.80:0/2727616130' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[24237]: audit 2024-02-13T00:37:40.170814+0000 mon.a (mon.0) 734 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi080-54215-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[24237]: audit 2024-02-13T00:37:40.170882+0000 mon.a (mon.0) 735 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi080-54199-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[24237]: audit 2024-02-13T00:37:40.170966+0000 mon.a (mon.0) 736 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54533-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:41.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[24237]: audit 2024-02-13T00:37:40.171130+0000 mon.a (mon.0) 737 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:41.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[24237]: cluster 2024-02-13T00:37:40.171212+0000 mon.a (mon.0) 738 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-02-13T00:37:41.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[24237]: audit 2024-02-13T00:37:40.181591+0000 mon.c (mon.2) 95 : audit [INF] from='client.? 172.21.15.80:0/1117570004' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi080-54497-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:41.763 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:41 smithi080 bash[24237]: audit 2024-02-13T00:37:40.762676+0000 mon.a (mon.0) 739 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi080-54497-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:41.767 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : ent api_service: [==========] Running 4 tests from 1 test suite. 2024-02-13T00:37:41.767 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: [----------] Global test environment set-up. 2024-02-13T00:37:41.767 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: [----------] 4 tests from LibRadosService 2024-02-13T00:37:41.767 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2024-02-13T00:37:41.767 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5055 ms) 2024-02-13T00:37:41.767 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2024-02-13T00:37:41.767 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: [ OK ] LibRadosService.RegisterLate (43 ms) 2024-02-13T00:37:41.767 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2024-02-13T00:37:41.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: cluster: 2024-02-13T00:37:41.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: id: a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:37:41.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: health: HEALTH_OK 2024-02-13T00:37:41.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 2024-02-13T00:37:41.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: services: 2024-02-13T00:37:41.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 13m) 2024-02-13T00:37:41.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: mgr: y(active, since 7m), standbys: x 2024-02-13T00:37:41.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: osd: 8 osds: 8 up (since 7m), 8 in (since 8m) 2024-02-13T00:37:41.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-02-13T00:37:41.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 2024-02-13T00:37:41.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: data: 2024-02-13T00:37:41.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: pools: 6 pools, 132 pgs 2024-02-13T00:37:41.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: objects: 224 objects, 5.7 KiB 2024-02-13T00:37:41.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: usage: 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:37:41.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: pgs: 132 active+clean 2024-02-13T00:37:41.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 2024-02-13T00:37:41.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: io: 2024-02-13T00:37:41.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: client: 1.2 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-02-13T00:37:41.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 2024-02-13T00:37:41.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 2024-02-13T00:37:41.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: cluster: 2024-02-13T00:37:41.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: id: a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:37:41.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: health: HEALTH_OK 2024-02-13T00:37:41.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 2024-02-13T00:37:41.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: services: 2024-02-13T00:37:41.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 13m) 2024-02-13T00:37:41.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: mgr: y(active, since 7m), standbys: x 2024-02-13T00:37:41.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: osd: 8 osds: 8 up (since 8m), 8 in (since 8m) 2024-02-13T00:37:41.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-02-13T00:37:41.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 2024-02-13T00:37:41.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: data: 2024-02-13T00:37:41.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: pools: 6 pools, 132 pgs 2024-02-13T00:37:41.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: objects: 224 objects, 5.7 KiB 2024-02-13T00:37:41.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: usage: 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:37:41.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: pgs: 132 active+clean 2024-02-13T00:37:41.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 2024-02-13T00:37:41.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: io: 2024-02-13T00:37:41.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: client: 1.2 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-02-13T00:37:41.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 2024-02-13T00:37:41.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 2024-02-13T00:37:41.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: cluster: 2024-02-13T00:37:41.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: id: a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:37:41.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: health: HEALTH_OK 2024-02-13T00:37:41.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 2024-02-13T00:37:41.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: services: 2024-02-13T00:37:41.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 13m) 2024-02-13T00:37:41.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: mgr: y(active, since 7m), standbys: x 2024-02-13T00:37:41.772 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: osd: 8 osds: 8 up (since 8m), 8 in (since 8m) 2024-02-13T00:37:41.772 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: foo: 5 portals active (1 hosts, 3 zones) 2024-02-13T00:37:41.772 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-02-13T00:37:41.772 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 2024-02-13T00:37:41.772 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: data: 2024-02-13T00:37:41.772 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: pools: 9 pools, 228 pgs 2024-02-13T00:37:41.772 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: objects: 224 objects, 5.7 KiB 2024-02-13T00:37:41.772 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: usage: 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:37:41.772 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: pgs: 13.596% pgs unknown 2024-02-13T00:37:41.772 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 28.509% pgs not active 2024-02-13T00:37:41.772 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 132 active+clean 2024-02-13T00:37:41.772 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 65 creating+peering 2024-02-13T00:37:41.772 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 31 unknown 2024-02-13T00:37:41.772 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 2024-02-13T00:37:41.772 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: io: 2024-02-13T00:37:41.773 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: client: 1023 B/s rd, 0 op/s rd, 0 op/s wr 2024-02-13T00:37:41.773 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 2024-02-13T00:37:41.773 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 2024-02-13T00:37:41.773 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: cluster: 2024-02-13T00:37:41.773 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: id: a5ae7724-ca05-11ee-95b9-87774f69a715 2024-02-13T00:37:42.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:42 smithi106 bash[18459]: audit 2024-02-13T00:37:41.764616+0000 mon.c (mon.2) 96 : audit [DBG] from='client.? 172.21.15.80:0/684653387' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T00:37:42.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:42 smithi106 bash[18459]: audit 2024-02-13T00:37:41.796526+0000 mon.b (mon.1) 37 : audit [INF] from='client.? 172.21.15.80:0/4156749885' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi080-54175-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:42.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:42 smithi106 bash[18459]: cluster 2024-02-13T00:37:42.276174+0000 mon.a (mon.0) 740 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-02-13T00:37:42.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:42 smithi106 bash[18459]: audit 2024-02-13T00:37:42.278690+0000 mon.a (mon.0) 741 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:42.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:42 smithi080 bash[17386]: audit 2024-02-13T00:37:41.764616+0000 mon.c (mon.2) 96 : audit [DBG] from='client.? 172.21.15.80:0/684653387' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T00:37:42.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:42 smithi080 bash[17386]: audit 2024-02-13T00:37:41.796526+0000 mon.b (mon.1) 37 : audit [INF] from='client.? 172.21.15.80:0/4156749885' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi080-54175-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:42.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:42 smithi080 bash[17386]: cluster 2024-02-13T00:37:42.276174+0000 mon.a (mon.0) 740 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-02-13T00:37:42.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:42 smithi080 bash[17386]: audit 2024-02-13T00:37:42.278690+0000 mon.a (mon.0) 741 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:42.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:42 smithi080 bash[24237]: audit 2024-02-13T00:37:41.764616+0000 mon.c (mon.2) 96 : audit [DBG] from='client.? 172.21.15.80:0/684653387' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T00:37:42.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:42 smithi080 bash[24237]: audit 2024-02-13T00:37:41.796526+0000 mon.b (mon.1) 37 : audit [INF] from='client.? 172.21.15.80:0/4156749885' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi080-54175-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:42.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:42 smithi080 bash[24237]: cluster 2024-02-13T00:37:42.276174+0000 mon.a (mon.0) 740 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-02-13T00:37:42.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:42 smithi080 bash[24237]: audit 2024-02-13T00:37:42.278690+0000 mon.a (mon.0) 741 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:42.958 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_1_[54683]: starting. 2024-02-13T00:37:42.958 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_1_[54683]: creating pool ceph_test_rados_list_parallel.smithi080-54670 2024-02-13T00:37:42.958 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_1_[54683]: created object 0... 2024-02-13T00:37:42.958 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_1_[54683]: created object 25... 2024-02-13T00:37:42.958 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_1_[54683]: created object 49... 2024-02-13T00:37:42.959 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_1_[54683]: finishing. 2024-02-13T00:37:42.959 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_1_[54683]: shutting down. 2024-02-13T00:37:42.959 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_2_[54684]: starting. 2024-02-13T00:37:42.959 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_2_[54684]: listing objects. 2024-02-13T00:37:42.959 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_2_[54684]: listed object 0... 2024-02-13T00:37:42.959 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_2_[54684]: listed object 25... 2024-02-13T00:37:42.959 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_2_[54684]: saw 50 objects 2024-02-13T00:37:42.959 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_2_[54684]: shutting down. 2024-02-13T00:37:42.959 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:42.959 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_3_[55408]: starting. 2024-02-13T00:37:42.960 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_3_[55408]: creating pool ceph_test_rados_list_parallel.smithi080-54670 2024-02-13T00:37:42.960 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_3_[55408]: created object 0... 2024-02-13T00:37:42.960 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_3_[55408]: created object 25... 2024-02-13T00:37:42.960 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_3_[55408]: created object 49... 2024-02-13T00:37:42.960 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_3_[55408]: finishing. 2024-02-13T00:37:42.960 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_3_[55408]: shutting down. 2024-02-13T00:37:42.960 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:42.960 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_4_[55409]: starting. 2024-02-13T00:37:42.960 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_4_[55409]: listing objects. 2024-02-13T00:37:42.960 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_4_[55409]: listed object 0... 2024-02-13T00:37:42.960 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_4_[55409]: listed object 25... 2024-02-13T00:37:42.960 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_4_[55409]: saw 43 objects 2024-02-13T00:37:42.960 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_4_[55409]: shutting down. 2024-02-13T00:37:42.961 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:42.961 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_5_[55410]: starting. 2024-02-13T00:37:42.961 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_5_[55410]: removed 25 objects... 2024-02-13T00:37:42.961 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_5_[55410]: removed half of the objects 2024-02-13T00:37:42.961 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_5_[55410]: removed 50 objects... 2024-02-13T00:37:42.961 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_5_[55410]: removed 50 objects 2024-02-13T00:37:42.961 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_5_[55410]: shutting down. 2024-02-13T00:37:42.961 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:42.961 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:42.961 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_6_[55472]: starting. 2024-02-13T00:37:42.961 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_6_[55472]: creating pool ceph_test_rados_list_parallel.smithi080-54670 2024-02-13T00:37:42.961 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_6_[55472]: created object 0... 2024-02-13T00:37:42.962 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_6_[55472]: created object 25... 2024-02-13T00:37:42.962 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_6_[55472]: created object 49... 2024-02-13T00:37:42.962 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_6_[55472]: finishing. 2024-02-13T00:37:42.962 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_6_[55472]: shutting down. 2024-02-13T00:37:42.962 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:42.962 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:42.962 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_7_[55473]: starting. 2024-02-13T00:37:42.962 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_7_[55473]: listing objects. 2024-02-13T00:37:42.962 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_7_[55473]: listed object 0... 2024-02-13T00:37:42.962 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_7_[55473]: listed object 25... 2024-02-13T00:37:42.962 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_7_[55473]: listed object 50... 2024-02-13T00:37:42.962 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_7_[55473]: saw 56 objects 2024-02-13T00:37:42.962 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_7_[55473]: shutting down. 2024-02-13T00:37:42.962 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:42.962 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:42.963 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_8_[55474]: starting. 2024-02-13T00:37:42.963 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_8_[55474]: added 25 objects... 2024-02-13T00:37:42.963 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_8_[55474]: added half of the objects 2024-02-13T00:37:42.963 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_8_[55474]: added 50 objects... 2024-02-13T00:37:42.963 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_8_[55474]: added 50 objects 2024-02-13T00:37:42.963 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_8_[55474]: shutting down. 2024-02-13T00:37:42.963 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:42.963 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:43.412 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ********************** api_cmd_pp: Running main() from gmock_main.cc 2024-02-13T00:37:43.412 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2024-02-13T00:37:43.412 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd_pp: [----------] Global test environment set-up. 2024-02-13T00:37:43.412 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2024-02-13T00:37:43.413 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2024-02-13T00:37:43.413 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (51 ms) 2024-02-13T00:37:43.413 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2024-02-13T00:37:43.413 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (40 ms) 2024-02-13T00:37:43.413 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2024-02-13T00:37:43.416 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (14253 ms) 2024-02-13T00:37:43.416 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (14345 ms total) 2024-02-13T00:37:43.416 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd_pp: 2024-02-13T00:37:43.416 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd_pp: [----------] Global test environment tear-down 2024-02-13T00:37:43.416 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (14345 ms total) 2024-02-13T00:37:43.416 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2024-02-13T00:37:43.438 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:37:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:37:43] "GET /metrics HTTP/1.1" 200 179507 "" "Prometheus/2.33.4" 2024-02-13T00:37:43.438 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:43 smithi080 bash[17386]: cluster 2024-02-13T00:37:40.856897+0000 mgr.y (mgr.24461) 296 : cluster [DBG] pgmap v229: 836 pgs: 279 creating+peering, 132 active+clean, 425 unknown; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:37:43.438 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:43 smithi080 bash[17386]: audit 2024-02-13T00:37:42.314762+0000 mon.a (mon.0) 742 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi080-54497-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]': finished 2024-02-13T00:37:43.438 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:43 smithi080 bash[17386]: cluster 2024-02-13T00:37:42.319213+0000 mon.a (mon.0) 743 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-02-13T00:37:43.438 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:43 smithi080 bash[17386]: audit 2024-02-13T00:37:42.327384+0000 mon.a (mon.0) 744 : audit [INF] from='client.? 172.21.15.80:0/2775809953' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi080-54183-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:43.438 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:43 smithi080 bash[17386]: audit 2024-02-13T00:37:42.876332+0000 mon.a (mon.0) 745 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi080-54175-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:43.470 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: Running main() from gmock_main.cc 2024-02-13T00:37:43.471 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [==========] Running 16 tests from 1 test suite. 2024-02-13T00:37:43.471 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [----------] Global test environment set-up. 2024-02-13T00:37:43.471 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [----------] 16 tests from CReadOpsTest 2024-02-13T00:37:43.471 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2024-02-13T00:37:43.471 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2024-02-13T00:37:43.471 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2024-02-13T00:37:43.471 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (301 ms) 2024-02-13T00:37:43.471 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2024-02-13T00:37:43.471 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (13 ms) 2024-02-13T00:37:43.471 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2024-02-13T00:37:43.471 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (13 ms) 2024-02-13T00:37:43.471 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2024-02-13T00:37:43.471 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (34 ms) 2024-02-13T00:37:43.471 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2024-02-13T00:37:43.472 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (7 ms) 2024-02-13T00:37:43.472 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2024-02-13T00:37:43.472 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (11 ms) 2024-02-13T00:37:43.472 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2024-02-13T00:37:43.472 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (5 ms) 2024-02-13T00:37:43.472 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2024-02-13T00:37:43.472 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (9 ms) 2024-02-13T00:37:43.472 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2024-02-13T00:37:43.472 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (5 ms) 2024-02-13T00:37:43.472 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2024-02-13T00:37:43.472 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (11 ms) 2024-02-13T00:37:43.472 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2024-02-13T00:37:43.472 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (7 ms) 2024-02-13T00:37:43.472 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2024-02-13T00:37:43.473 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (17 ms) 2024-02-13T00:37:43.473 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2024-02-13T00:37:43.473 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (15 ms) 2024-02-13T00:37:43.473 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2024-02-13T00:37:43.473 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (11 ms) 2024-02-13T00:37:43.473 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2024-02-13T00:37:43.473 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (5 ms) 2024-02-13T00:37:43.473 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [----------] 16 tests from CReadOpsTest (464 ms total) 2024-02-13T00:37:43.473 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: 2024-02-13T00:37:43.473 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [----------] Global test environment tear-down 2024-02-13T00:37:43.473 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [==========] 16 tests from 1 test suite ran. (14353 ms total) 2024-02-13T00:37:43.473 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_read_operations: [ PASSED ] 16 tests. 2024-02-13T00:37:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:43 smithi106 bash[18459]: cluster 2024-02-13T00:37:40.856897+0000 mgr.y (mgr.24461) 296 : cluster [DBG] pgmap v229: 836 pgs: 279 creating+peering, 132 active+clean, 425 unknown; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:37:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:43 smithi106 bash[18459]: audit 2024-02-13T00:37:42.314762+0000 mon.a (mon.0) 742 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi080-54497-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]': finished 2024-02-13T00:37:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:43 smithi106 bash[18459]: cluster 2024-02-13T00:37:42.319213+0000 mon.a (mon.0) 743 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-02-13T00:37:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:43 smithi106 bash[18459]: audit 2024-02-13T00:37:42.327384+0000 mon.a (mon.0) 744 : audit [INF] from='client.? 172.21.15.80:0/2775809953' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi080-54183-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:43 smithi106 bash[18459]: audit 2024-02-13T00:37:42.876332+0000 mon.a (mon.0) 745 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi080-54175-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:43.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:43 smithi080 bash[24237]: cluster 2024-02-13T00:37:40.856897+0000 mgr.y (mgr.24461) 296 : cluster [DBG] pgmap v229: 836 pgs: 279 creating+peering, 132 active+clean, 425 unknown; 5.7 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:37:43.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:43 smithi080 bash[24237]: audit 2024-02-13T00:37:42.314762+0000 mon.a (mon.0) 742 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi080-54497-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]': finished 2024-02-13T00:37:43.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:43 smithi080 bash[24237]: cluster 2024-02-13T00:37:42.319213+0000 mon.a (mon.0) 743 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-02-13T00:37:43.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:43 smithi080 bash[24237]: audit 2024-02-13T00:37:42.327384+0000 mon.a (mon.0) 744 : audit [INF] from='client.? 172.21.15.80:0/2775809953' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi080-54183-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:43.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:43 smithi080 bash[24237]: audit 2024-02-13T00:37:42.876332+0000 mon.a (mon.0) 745 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi080-54175-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:44.005 INFO:tasks.workunit.client.0.smithi080.stdout:********* 2024-02-13T00:37:44.006 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_9_[55572]: starting. 2024-02-13T00:37:44.006 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_9_[55572]: creating pool ceph_test_rados_list_parallel.smithi080-54670 2024-02-13T00:37:44.006 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_9_[55572]: created object 0... 2024-02-13T00:37:44.006 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_9_[55572]: created object 25... 2024-02-13T00:37:44.006 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_9_[55572]: created object 49... 2024-02-13T00:37:44.006 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_9_[55572]: finishing. 2024-02-13T00:37:44.006 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_9_[55572]: shutting down. 2024-02-13T00:37:44.006 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:44.007 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:44.007 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:44.007 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_10_[55573]: starting. 2024-02-13T00:37:44.007 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_10_[55573]: listing objects. 2024-02-13T00:37:44.007 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_10_[55573]: listed object 0... 2024-02-13T00:37:44.007 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_10_[55573]: listed object 25... 2024-02-13T00:37:44.007 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_10_[55573]: listed object 50... 2024-02-13T00:37:44.007 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_10_[55573]: listed object 75... 2024-02-13T00:37:44.007 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_10_[55573]: saw 98 objects 2024-02-13T00:37:44.007 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_10_[55573]: shutting down. 2024-02-13T00:37:44.007 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:44.008 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:44.008 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:44.008 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_11_[55574]: starting. 2024-02-13T00:37:44.008 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_11_[55574]: added 25 objects... 2024-02-13T00:37:44.008 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_11_[55574]: added half of the objects 2024-02-13T00:37:44.008 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_11_[55574]: added 50 objects... 2024-02-13T00:37:44.008 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_11_[55574]: added 50 objects 2024-02-13T00:37:44.008 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_11_[55574]: shutting down. 2024-02-13T00:37:44.008 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:44.008 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:44.008 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:44.009 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_13_[55576]: starting. 2024-02-13T00:37:44.009 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_13_[55576]: removed 25 objects... 2024-02-13T00:37:44.009 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_13_[55576]: removed half of the objects 2024-02-13T00:37:44.009 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_13_[55576]: removed 50 objects... 2024-02-13T00:37:44.009 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_13_[55576]: removed 50 objects 2024-02-13T00:37:44.009 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_13_[55576]: shutting down. 2024-02-13T00:37:44.009 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:44.009 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:44.009 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:44.009 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_12_[55575]: starting. 2024-02-13T00:37:44.009 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_12_[55575]: added 25 objects... 2024-02-13T00:37:44.009 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_12_[55575]: added half of the objects 2024-02-13T00:37:44.009 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_12_[55575]: added 50 objects... 2024-02-13T00:37:44.010 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_12_[55575]: added 50 objects 2024-02-13T00:37:44.010 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_12_[55575]: shutting down. 2024-02-13T00:37:44.010 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:44.010 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:44.010 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:44.010 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:44.010 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_14_[55654]: starting. 2024-02-13T00:37:44.010 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_14_[55654]: creating pool ceph_test_rados_list_parallel.smithi080-54670 2024-02-13T00:37:44.010 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_14_[55654]: created object 0... 2024-02-13T00:37:44.010 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_14_[55654]: created object 25... 2024-02-13T00:37:44.010 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_14_[55654]: created object 49... 2024-02-13T00:37:44.010 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_14_[55654]: finishing. 2024-02-13T00:37:44.010 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_14_[55654]: shutting down. 2024-02-13T00:37:44.011 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:44.011 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:44.011 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:44.011 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:44.011 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_15_[55655]: starting. 2024-02-13T00:37:44.011 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_15_[55655]: listing objects. 2024-02-13T00:37:44.011 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_15_[55655]: listed object 0... 2024-02-13T00:37:44.967 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_15_[55655]: listed object 2 api_cmd: Running main() from gmock_main.cc 2024-02-13T00:37:44.968 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2024-02-13T00:37:44.968 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: [----------] Global test environment set-up. 2024-02-13T00:37:44.968 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2024-02-13T00:37:44.968 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2024-02-13T00:37:44.968 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (65 ms) 2024-02-13T00:37:44.968 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2024-02-13T00:37:44.968 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (47 ms) 2024-02-13T00:37:44.968 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2024-02-13T00:37:44.968 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (14249 ms) 2024-02-13T00:37:44.968 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2024-02-13T00:37:44.968 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:42.314762+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi080-54497-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]': finished 2024-02-13T00:37:44.969 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:42.327384+0000 mon.a [INF] from='client.? 172.21.15.80:0/2775809953' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi080-54183-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:44.969 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:42.876332+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi080-54175-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:44.969 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:43.372046+0000 mon.a [WRN] Health check failed: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:37:44.969 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:43.389398+0000 mon.a [INF] from='client.? 172.21.15.80:0/2775809953' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi080-54183-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:44.969 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:43.389960+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi080-54175-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:44.969 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:43.396873+0000 mon.c [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:44.969 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:43.402124+0000 mon.b [INF] from='client.? 172.21.15.80:0/2418967653' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:44.969 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:43.432683+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:44.969 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:43.472525+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:44.969 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:43.492440+0000 mon.b [INF] from='client.? 172.21.15.80:0/1268394734' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:44.969 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:43.494011+0000 mon.b [INF] from='client.? 172.21.15.80:0/2427324406' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:45.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: cluster 2024-02-13T00:37:42.860924+0000 mgr.y (mgr.24461) 297 : cluster [DBG] pgmap v232: 908 pgs: 104 creating+peering, 804 active+clean; 40 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 34 KiB/s rd, 115 KiB/s wr, 647 op/s 2024-02-13T00:37:45.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: cluster 2024-02-13T00:37:43.372046+0000 mon.a (mon.0) 746 : cluster [WRN] Health check failed: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:37:45.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: audit 2024-02-13T00:37:43.373311+0000 mon.a (mon.0) 747 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:45.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: audit 2024-02-13T00:37:43.389398+0000 mon.a (mon.0) 748 : audit [INF] from='client.? 172.21.15.80:0/2775809953' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi080-54183-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:45.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: audit 2024-02-13T00:37:43.389960+0000 mon.a (mon.0) 749 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi080-54175-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:45.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: cluster 2024-02-13T00:37:43.390223+0000 mon.a (mon.0) 750 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-02-13T00:37:45.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: audit 2024-02-13T00:37:43.396873+0000 mon.c (mon.2) 97 : audit [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:45.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: audit 2024-02-13T00:37:43.402124+0000 mon.b (mon.1) 38 : audit [INF] from='client.? 172.21.15.80:0/2418967653' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:45.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: audit 2024-02-13T00:37:43.432683+0000 mon.a (mon.0) 751 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:45.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: audit 2024-02-13T00:37:43.472525+0000 mon.a (mon.0) 752 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:45.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: audit 2024-02-13T00:37:43.492440+0000 mon.b (mon.1) 39 : audit [INF] from='client.? 172.21.15.80:0/1268394734' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:45.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: audit 2024-02-13T00:37:43.494011+0000 mon.b (mon.1) 40 : audit [INF] from='client.? 172.21.15.80:0/2427324406' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:45.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: audit 2024-02-13T00:37:43.536257+0000 mon.c (mon.2) 98 : audit [INF] from='client.? 172.21.15.80:0/2470845228' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-13T00:37:45.259 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: cluster 2024-02-13T00:37:43.538628+0000 client.admin (client.?) 0 : cluster [INF] onexx 2024-02-13T00:37:45.260 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: audit 2024-02-13T00:37:43.558757+0000 mon.b (mon.1) 41 : audit [INF] from='client.? 172.21.15.80:0/3543275486' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:45.260 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: audit 2024-02-13T00:37:43.974978+0000 mon.c (mon.2) 99 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.0"}]: dispatch 2024-02-13T00:37:45.260 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: audit 2024-02-13T00:37:43.976370+0000 mon.c (mon.2) 100 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.1"}]: dispatch 2024-02-13T00:37:45.260 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: audit 2024-02-13T00:37:43.977276+0000 mon.c (mon.2) 101 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.2"}]: dispatch 2024-02-13T00:37:45.260 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: audit 2024-02-13T00:37:43.978133+0000 mon.c (mon.2) 102 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.3"}]: dispatch 2024-02-13T00:37:45.260 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: audit 2024-02-13T00:37:43.978861+0000 mon.c (mon.2) 103 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.4"}]: dispatch 2024-02-13T00:37:45.260 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: audit 2024-02-13T00:37:43.979610+0000 mon.c (mon.2) 104 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.5"}]: dispatch 2024-02-13T00:37:45.260 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: audit 2024-02-13T00:37:43.980253+0000 mon.c (mon.2) 105 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.6"}]: dispatch 2024-02-13T00:37:45.260 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: audit 2024-02-13T00:37:43.980960+0000 mon.c (mon.2) 106 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.7"}]: dispatch 2024-02-13T00:37:45.260 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: audit 2024-02-13T00:37:43.981596+0000 mon.c (mon.2) 107 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.8"}]: dispatch 2024-02-13T00:37:45.260 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: audit 2024-02-13T00:37:43.982165+0000 mon.c (mon.2) 108 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.9"}]: dispatch 2024-02-13T00:37:45.260 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:44 smithi106 bash[18459]: audit 2024-02-13T00:37:44.026932+0000 mon.a (mon.0) 753 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-13T00:37:45.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: cluster 2024-02-13T00:37:42.860924+0000 mgr.y (mgr.24461) 297 : cluster [DBG] pgmap v232: 908 pgs: 104 creating+peering, 804 active+clean; 40 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 34 KiB/s rd, 115 KiB/s wr, 647 op/s 2024-02-13T00:37:45.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: cluster 2024-02-13T00:37:43.372046+0000 mon.a (mon.0) 746 : cluster [WRN] Health check failed: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:37:45.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: audit 2024-02-13T00:37:43.373311+0000 mon.a (mon.0) 747 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:45.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: audit 2024-02-13T00:37:43.389398+0000 mon.a (mon.0) 748 : audit [INF] from='client.? 172.21.15.80:0/2775809953' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi080-54183-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:45.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: audit 2024-02-13T00:37:43.389960+0000 mon.a (mon.0) 749 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi080-54175-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:45.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: cluster 2024-02-13T00:37:43.390223+0000 mon.a (mon.0) 750 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-02-13T00:37:45.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: audit 2024-02-13T00:37:43.396873+0000 mon.c (mon.2) 97 : audit [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:45.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: audit 2024-02-13T00:37:43.402124+0000 mon.b (mon.1) 38 : audit [INF] from='client.? 172.21.15.80:0/2418967653' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:45.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: audit 2024-02-13T00:37:43.432683+0000 mon.a (mon.0) 751 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:45.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: audit 2024-02-13T00:37:43.472525+0000 mon.a (mon.0) 752 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:45.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: audit 2024-02-13T00:37:43.492440+0000 mon.b (mon.1) 39 : audit [INF] from='client.? 172.21.15.80:0/1268394734' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:45.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: audit 2024-02-13T00:37:43.494011+0000 mon.b (mon.1) 40 : audit [INF] from='client.? 172.21.15.80:0/2427324406' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:45.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: audit 2024-02-13T00:37:43.536257+0000 mon.c (mon.2) 98 : audit [INF] from='client.? 172.21.15.80:0/2470845228' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-13T00:37:45.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: cluster 2024-02-13T00:37:43.538628+0000 client.admin (client.?) 0 : cluster [INF] onexx 2024-02-13T00:37:45.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: audit 2024-02-13T00:37:43.558757+0000 mon.b (mon.1) 41 : audit [INF] from='client.? 172.21.15.80:0/3543275486' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:45.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: cluster 2024-02-13T00:37:42.860924+0000 mgr.y (mgr.24461) 297 : cluster [DBG] pgmap v232: 908 pgs: 104 creating+peering, 804 active+clean; 40 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 34 KiB/s rd, 115 KiB/s wr, 647 op/s 2024-02-13T00:37:45.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: cluster 2024-02-13T00:37:43.372046+0000 mon.a (mon.0) 746 : cluster [WRN] Health check failed: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:37:45.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: audit 2024-02-13T00:37:43.373311+0000 mon.a (mon.0) 747 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:45.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: audit 2024-02-13T00:37:43.389398+0000 mon.a (mon.0) 748 : audit [INF] from='client.? 172.21.15.80:0/2775809953' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi080-54183-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:45.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: audit 2024-02-13T00:37:43.389960+0000 mon.a (mon.0) 749 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi080-54175-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:45.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: cluster 2024-02-13T00:37:43.390223+0000 mon.a (mon.0) 750 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-02-13T00:37:45.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: audit 2024-02-13T00:37:43.396873+0000 mon.c (mon.2) 97 : audit [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:45.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: audit 2024-02-13T00:37:43.402124+0000 mon.b (mon.1) 38 : audit [INF] from='client.? 172.21.15.80:0/2418967653' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:45.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: audit 2024-02-13T00:37:43.432683+0000 mon.a (mon.0) 751 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:45.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: audit 2024-02-13T00:37:43.472525+0000 mon.a (mon.0) 752 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:45.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: audit 2024-02-13T00:37:43.492440+0000 mon.b (mon.1) 39 : audit [INF] from='client.? 172.21.15.80:0/1268394734' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:45.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: audit 2024-02-13T00:37:43.494011+0000 mon.b (mon.1) 40 : audit [INF] from='client.? 172.21.15.80:0/2427324406' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:45.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: audit 2024-02-13T00:37:43.536257+0000 mon.c (mon.2) 98 : audit [INF] from='client.? 172.21.15.80:0/2470845228' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-13T00:37:45.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: cluster 2024-02-13T00:37:43.538628+0000 client.admin (client.?) 0 : cluster [INF] onexx 2024-02-13T00:37:45.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: audit 2024-02-13T00:37:43.558757+0000 mon.b (mon.1) 41 : audit [INF] from='client.? 172.21.15.80:0/3543275486' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:45.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: audit 2024-02-13T00:37:43.974978+0000 mon.c (mon.2) 99 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.0"}]: dispatch 2024-02-13T00:37:45.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: audit 2024-02-13T00:37:43.976370+0000 mon.c (mon.2) 100 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.1"}]: dispatch 2024-02-13T00:37:45.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: audit 2024-02-13T00:37:43.977276+0000 mon.c (mon.2) 101 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.2"}]: dispatch 2024-02-13T00:37:45.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: audit 2024-02-13T00:37:43.978133+0000 mon.c (mon.2) 102 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.3"}]: dispatch 2024-02-13T00:37:45.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: audit 2024-02-13T00:37:43.978861+0000 mon.c (mon.2) 103 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.4"}]: dispatch 2024-02-13T00:37:45.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: audit 2024-02-13T00:37:43.979610+0000 mon.c (mon.2) 104 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.5"}]: dispatch 2024-02-13T00:37:45.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: audit 2024-02-13T00:37:43.980253+0000 mon.c (mon.2) 105 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.6"}]: dispatch 2024-02-13T00:37:45.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: audit 2024-02-13T00:37:43.980960+0000 mon.c (mon.2) 106 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.7"}]: dispatch 2024-02-13T00:37:45.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: audit 2024-02-13T00:37:43.981596+0000 mon.c (mon.2) 107 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.8"}]: dispatch 2024-02-13T00:37:45.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: audit 2024-02-13T00:37:43.982165+0000 mon.c (mon.2) 108 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.9"}]: dispatch 2024-02-13T00:37:45.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[24237]: audit 2024-02-13T00:37:44.026932+0000 mon.a (mon.0) 753 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-13T00:37:45.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: audit 2024-02-13T00:37:43.974978+0000 mon.c (mon.2) 99 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.0"}]: dispatch 2024-02-13T00:37:45.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: audit 2024-02-13T00:37:43.976370+0000 mon.c (mon.2) 100 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.1"}]: dispatch 2024-02-13T00:37:45.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: audit 2024-02-13T00:37:43.977276+0000 mon.c (mon.2) 101 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.2"}]: dispatch 2024-02-13T00:37:45.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: audit 2024-02-13T00:37:43.978133+0000 mon.c (mon.2) 102 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.3"}]: dispatch 2024-02-13T00:37:45.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: audit 2024-02-13T00:37:43.978861+0000 mon.c (mon.2) 103 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.4"}]: dispatch 2024-02-13T00:37:45.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: audit 2024-02-13T00:37:43.979610+0000 mon.c (mon.2) 104 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.5"}]: dispatch 2024-02-13T00:37:45.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: audit 2024-02-13T00:37:43.980253+0000 mon.c (mon.2) 105 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.6"}]: dispatch 2024-02-13T00:37:45.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: audit 2024-02-13T00:37:43.980960+0000 mon.c (mon.2) 106 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.7"}]: dispatch 2024-02-13T00:37:45.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: audit 2024-02-13T00:37:43.981596+0000 mon.c (mon.2) 107 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.8"}]: dispatch 2024-02-13T00:37:45.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: audit 2024-02-13T00:37:43.982165+0000 mon.c (mon.2) 108 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.9"}]: dispatch 2024-02-13T00:37:45.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:44 smithi080 bash[17386]: audit 2024-02-13T00:37:44.026932+0000 mon.a (mon.0) 753 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-13T00:37:45.892 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:43.536257+0000 mon.c [INF] from='client.? 172.21.15.80:0/2470845228' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]5... 2024-02-13T00:37:45.893 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_15_[55655]: listed object 50... 2024-02-13T00:37:45.893 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_15_[55655]: listed object 75... 2024-02-13T00:37:45.893 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_15_[55655]: listed object 100... 2024-02-13T00:37:45.893 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_15_[55655]: listed object 125... 2024-02-13T00:37:45.893 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_15_[55655]: saw 150 objects 2024-02-13T00:37:45.893 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_15_[55655]: shutting down. 2024-02-13T00:37:45.893 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:45.894 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:45.894 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:45.894 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:45.894 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_16_[55656]: starting. 2024-02-13T00:37:45.894 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_16_[55656]: added 25 objects... 2024-02-13T00:37:45.894 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_16_[55656]: added half of the objects 2024-02-13T00:37:45.894 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_16_[55656]: added 50 objects... 2024-02-13T00:37:45.894 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_16_[55656]: added 50 objects 2024-02-13T00:37:45.894 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: process_16_[55656]: shutting down. 2024-02-13T00:37:45.894 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:45.894 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:45.894 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:45.894 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:45.894 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******************************* 2024-02-13T00:37:45.894 INFO:tasks.workunit.client.0.smithi080.stdout: list_parallel: ******* SUCCESS ********** 2024-02-13T00:37:46.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:43.975294+0000 mgr.y (mgr.24461) 298 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.0"}]: dispatch 2024-02-13T00:37:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:43.976650+0000 mgr.y (mgr.24461) 299 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.1"}]: dispatch 2024-02-13T00:37:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:43.977509+0000 mgr.y (mgr.24461) 300 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.2"}]: dispatch 2024-02-13T00:37:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:43.978302+0000 mgr.y (mgr.24461) 301 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.3"}]: dispatch 2024-02-13T00:37:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:43.979015+0000 mgr.y (mgr.24461) 302 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.4"}]: dispatch 2024-02-13T00:37:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:43.979765+0000 mgr.y (mgr.24461) 303 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.5"}]: dispatch 2024-02-13T00:37:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:43.980455+0000 mgr.y (mgr.24461) 304 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.6"}]: dispatch 2024-02-13T00:37:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:43.981102+0000 mgr.y (mgr.24461) 305 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.7"}]: dispatch 2024-02-13T00:37:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:43.981728+0000 mgr.y (mgr.24461) 306 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.8"}]: dispatch 2024-02-13T00:37:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:43.982287+0000 mgr.y (mgr.24461) 307 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.9"}]: dispatch 2024-02-13T00:37:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: cluster 2024-02-13T00:37:44.430027+0000 osd.4 (osd.4) 3 : cluster [DBG] 17.2 deep-scrub starts 2024-02-13T00:37:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: cluster 2024-02-13T00:37:44.477056+0000 osd.4 (osd.4) 4 : cluster [DBG] 17.2 deep-scrub ok 2024-02-13T00:37:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:44.483428+0000 mon.a (mon.0) 754 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:46.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:44.484429+0000 mon.a (mon.0) 755 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:46.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:44.490768+0000 mon.a (mon.0) 756 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:46.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:44.490921+0000 mon.a (mon.0) 757 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:46.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: cluster 2024-02-13T00:37:44.491322+0000 mon.a (mon.0) 758 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-02-13T00:37:46.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:44.495634+0000 mon.c (mon.2) 109 : audit [INF] from='client.? 172.21.15.80:0/4291925045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:46.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:44.497728+0000 mon.a (mon.0) 759 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:46.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:44.498800+0000 mon.a (mon.0) 760 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi080-54191-15"}]: dispatch 2024-02-13T00:37:46.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:44.499375+0000 mon.b (mon.1) 42 : audit [INF] from='client.? 172.21.15.80:0/1268394734' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:46.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:44.511089+0000 mon.b (mon.1) 43 : audit [INF] from='client.? 172.21.15.80:0/2427324406' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:46.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: cluster 2024-02-13T00:37:44.862010+0000 mgr.y (mgr.24461) 308 : cluster [DBG] pgmap v235: 652 pgs: 128 unknown, 104 creating+peering, 420 active+clean; 23 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 72 KiB/s wr, 545 op/s 2024-02-13T00:37:46.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:44.971784+0000 mon.a (mon.0) 761 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-02-13T00:37:46.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:44.972728+0000 mon.c (mon.2) 110 : audit [INF] from='client.? 172.21.15.80:0/2470845228' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-02-13T00:37:46.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: cluster 2024-02-13T00:37:44.972894+0000 client.admin (client.?) 0 : cluster [INF] twoxx 2024-02-13T00:37:46.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:44.972931+0000 mon.a (mon.0) 762 : audit [INF] from='client.? 172.21.15.80:0/2775809953' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi080-54183-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:46.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:44.973414+0000 mon.a (mon.0) 763 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi080-54191-15"}]: dispatch 2024-02-13T00:37:46.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.418895+0000 mon.a (mon.0) 764 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi080-54191-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.419611+0000 mon.a (mon.0) 765 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi080-54199-22"}]: dispatch 2024-02-13T00:37:46.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.422260+0000 mon.a (mon.0) 766 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:46.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.422691+0000 mon.a (mon.0) 767 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi080-54199-22"}]: dispatch 2024-02-13T00:37:46.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.423485+0000 mon.a (mon.0) 768 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi080-54199-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.423935+0000 mon.b (mon.1) 44 : audit [INF] from='client.? 172.21.15.80:0/3543275486' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:46.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:43.975294+0000 mgr.y (mgr.24461) 298 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.0"}]: dispatch 2024-02-13T00:37:46.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:43.976650+0000 mgr.y (mgr.24461) 299 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.1"}]: dispatch 2024-02-13T00:37:46.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:43.977509+0000 mgr.y (mgr.24461) 300 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.2"}]: dispatch 2024-02-13T00:37:46.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:43.978302+0000 mgr.y (mgr.24461) 301 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.3"}]: dispatch 2024-02-13T00:37:46.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:43.979015+0000 mgr.y (mgr.24461) 302 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.4"}]: dispatch 2024-02-13T00:37:46.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:43.979765+0000 mgr.y (mgr.24461) 303 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.5"}]: dispatch 2024-02-13T00:37:46.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:43.980455+0000 mgr.y (mgr.24461) 304 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.6"}]: dispatch 2024-02-13T00:37:46.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:43.981102+0000 mgr.y (mgr.24461) 305 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.7"}]: dispatch 2024-02-13T00:37:46.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:43.981728+0000 mgr.y (mgr.24461) 306 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.8"}]: dispatch 2024-02-13T00:37:46.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:43.982287+0000 mgr.y (mgr.24461) 307 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.9"}]: dispatch 2024-02-13T00:37:46.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: cluster 2024-02-13T00:37:44.430027+0000 osd.4 (osd.4) 3 : cluster [DBG] 17.2 deep-scrub starts 2024-02-13T00:37:46.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: cluster 2024-02-13T00:37:44.477056+0000 osd.4 (osd.4) 4 : cluster [DBG] 17.2 deep-scrub ok 2024-02-13T00:37:46.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:44.483428+0000 mon.a (mon.0) 754 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:46.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:44.484429+0000 mon.a (mon.0) 755 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:46.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:44.490768+0000 mon.a (mon.0) 756 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:46.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:44.490921+0000 mon.a (mon.0) 757 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:46.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: cluster 2024-02-13T00:37:44.491322+0000 mon.a (mon.0) 758 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-02-13T00:37:46.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:44.495634+0000 mon.c (mon.2) 109 : audit [INF] from='client.? 172.21.15.80:0/4291925045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:46.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:44.497728+0000 mon.a (mon.0) 759 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:46.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:43.975294+0000 mgr.y (mgr.24461) 298 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.0"}]: dispatch 2024-02-13T00:37:46.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:43.976650+0000 mgr.y (mgr.24461) 299 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.1"}]: dispatch 2024-02-13T00:37:46.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:43.977509+0000 mgr.y (mgr.24461) 300 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.2"}]: dispatch 2024-02-13T00:37:46.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:43.978302+0000 mgr.y (mgr.24461) 301 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.3"}]: dispatch 2024-02-13T00:37:46.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:43.979015+0000 mgr.y (mgr.24461) 302 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.4"}]: dispatch 2024-02-13T00:37:46.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:43.979765+0000 mgr.y (mgr.24461) 303 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.5"}]: dispatch 2024-02-13T00:37:46.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:43.980455+0000 mgr.y (mgr.24461) 304 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.6"}]: dispatch 2024-02-13T00:37:46.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:43.981102+0000 mgr.y (mgr.24461) 305 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.7"}]: dispatch 2024-02-13T00:37:46.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:43.981728+0000 mgr.y (mgr.24461) 306 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.8"}]: dispatch 2024-02-13T00:37:46.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:43.982287+0000 mgr.y (mgr.24461) 307 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.9"}]: dispatch 2024-02-13T00:37:46.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: cluster 2024-02-13T00:37:44.430027+0000 osd.4 (osd.4) 3 : cluster [DBG] 17.2 deep-scrub starts 2024-02-13T00:37:46.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: cluster 2024-02-13T00:37:44.477056+0000 osd.4 (osd.4) 4 : cluster [DBG] 17.2 deep-scrub ok 2024-02-13T00:37:46.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:44.483428+0000 mon.a (mon.0) 754 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:46.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:44.484429+0000 mon.a (mon.0) 755 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:46.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:44.490768+0000 mon.a (mon.0) 756 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:46.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:44.490921+0000 mon.a (mon.0) 757 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:46.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: cluster 2024-02-13T00:37:44.491322+0000 mon.a (mon.0) 758 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-02-13T00:37:46.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:44.495634+0000 mon.c (mon.2) 109 : audit [INF] from='client.? 172.21.15.80:0/4291925045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:46.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:44.497728+0000 mon.a (mon.0) 759 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:46.262 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.424469+0000 mon.a (mon.0) 769 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:46.262 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.425339+0000 mon.c (mon.2) 111 : audit [INF] from='client.? 172.21.15.80:0/4291925045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:46.262 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: cluster 2024-02-13T00:37:45.500936+0000 osd.6 (osd.6) 3 : cluster [DBG] 17.5 deep-scrub starts 2024-02-13T00:37:46.262 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: cluster 2024-02-13T00:37:45.504580+0000 osd.6 (osd.6) 4 : cluster [DBG] 17.5 deep-scrub ok 2024-02-13T00:37:46.262 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.873726+0000 mon.a (mon.0) 770 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-02-13T00:37:46.262 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.874487+0000 mon.a (mon.0) 771 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:46.262 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.882781+0000 mon.a (mon.0) 772 : audit [INF] from='client.? 172.21.15.80:0/2775809953' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi080-54183-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:46.263 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.882901+0000 mon.a (mon.0) 773 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi080-54191-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:46.263 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.883075+0000 mon.a (mon.0) 774 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi080-54199-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:46.263 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: cluster 2024-02-13T00:37:45.883261+0000 mon.a (mon.0) 775 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2024-02-13T00:37:46.263 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.884608+0000 mon.a (mon.0) 776 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:46.263 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.886904+0000 mon.b (mon.1) 45 : audit [INF] from='client.? 172.21.15.80:0/2300884774' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:46.263 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.890023+0000 mon.c (mon.2) 112 : audit [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:46.263 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.890222+0000 mon.c (mon.2) 113 : audit [INF] from='client.? 172.21.15.80:0/1117570004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:46.263 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.892772+0000 mon.c (mon.2) 114 : audit [INF] from='client.? 172.21.15.80:0/4291925045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi080-54478-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.263 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.892821+0000 mon.a (mon.0) 777 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi080-54191-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi080-54191-15"}]: dispatch 2024-02-13T00:37:46.263 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.895355+0000 mon.a (mon.0) 778 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi080-54199-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi080-54199-22"}]: dispatch 2024-02-13T00:37:46.263 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.896801+0000 mon.a (mon.0) 779 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:46.263 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.897321+0000 mon.a (mon.0) 780 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:46.263 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.897922+0000 mon.a (mon.0) 781 : audit [INF] from='client.? 172.21.15.80:0/2775809953' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi080-54183-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-02-13T00:37:46.263 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.898332+0000 mon.b (mon.1) 46 : audit [INF] from='client.? 172.21.15.80:0/1268394734' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.264 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.898973+0000 mon.b (mon.1) 47 : audit [INF] from='client.? 172.21.15.80:0/2427324406' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi080-54223-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.264 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.907817+0000 mon.a (mon.0) 782 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:46.264 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.908195+0000 mon.a (mon.0) 783 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:46.264 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.908562+0000 mon.a (mon.0) 784 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi080-54478-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.264 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.912472+0000 mon.a (mon.0) 785 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:46.264 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.912861+0000 mon.a (mon.0) 786 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:46.264 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.913413+0000 mon.a (mon.0) 787 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.264 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.913826+0000 mon.a (mon.0) 788 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi080-54223-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.264 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.915307+0000 mon.b (mon.1) 48 : audit [INF] from='client.? 172.21.15.80:0/3543275486' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.264 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:45 smithi106 bash[18459]: audit 2024-02-13T00:37:45.917729+0000 mon.a (mon.0) 789 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:44.498800+0000 mon.a (mon.0) 760 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi080-54191-15"}]: dispatch 2024-02-13T00:37:46.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:44.499375+0000 mon.b (mon.1) 42 : audit [INF] from='client.? 172.21.15.80:0/1268394734' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:46.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:44.511089+0000 mon.b (mon.1) 43 : audit [INF] from='client.? 172.21.15.80:0/2427324406' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:46.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: cluster 2024-02-13T00:37:44.862010+0000 mgr.y (mgr.24461) 308 : cluster [DBG] pgmap v235: 652 pgs: 128 unknown, 104 creating+peering, 420 active+clean; 23 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 72 KiB/s wr, 545 op/s 2024-02-13T00:37:46.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:44.971784+0000 mon.a (mon.0) 761 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-02-13T00:37:46.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:44.972728+0000 mon.c (mon.2) 110 : audit [INF] from='client.? 172.21.15.80:0/2470845228' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-02-13T00:37:46.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: cluster 2024-02-13T00:37:44.972894+0000 client.admin (client.?) 0 : cluster [INF] twoxx 2024-02-13T00:37:46.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:44.972931+0000 mon.a (mon.0) 762 : audit [INF] from='client.? 172.21.15.80:0/2775809953' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi080-54183-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:46.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:44.973414+0000 mon.a (mon.0) 763 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi080-54191-15"}]: dispatch 2024-02-13T00:37:46.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.418895+0000 mon.a (mon.0) 764 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi080-54191-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.419611+0000 mon.a (mon.0) 765 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi080-54199-22"}]: dispatch 2024-02-13T00:37:46.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.422260+0000 mon.a (mon.0) 766 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:46.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.422691+0000 mon.a (mon.0) 767 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi080-54199-22"}]: dispatch 2024-02-13T00:37:46.265 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.423485+0000 mon.a (mon.0) 768 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi080-54199-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.266 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.423935+0000 mon.b (mon.1) 44 : audit [INF] from='client.? 172.21.15.80:0/3543275486' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:46.266 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:44.498800+0000 mon.a (mon.0) 760 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi080-54191-15"}]: dispatch 2024-02-13T00:37:46.266 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:44.499375+0000 mon.b (mon.1) 42 : audit [INF] from='client.? 172.21.15.80:0/1268394734' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:46.266 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:44.511089+0000 mon.b (mon.1) 43 : audit [INF] from='client.? 172.21.15.80:0/2427324406' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:46.266 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: cluster 2024-02-13T00:37:44.862010+0000 mgr.y (mgr.24461) 308 : cluster [DBG] pgmap v235: 652 pgs: 128 unknown, 104 creating+peering, 420 active+clean; 23 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 72 KiB/s wr, 545 op/s 2024-02-13T00:37:46.266 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:44.971784+0000 mon.a (mon.0) 761 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-02-13T00:37:46.266 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:44.972728+0000 mon.c (mon.2) 110 : audit [INF] from='client.? 172.21.15.80:0/2470845228' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-02-13T00:37:46.266 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: cluster 2024-02-13T00:37:44.972894+0000 client.admin (client.?) 0 : cluster [INF] twoxx 2024-02-13T00:37:46.266 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:44.972931+0000 mon.a (mon.0) 762 : audit [INF] from='client.? 172.21.15.80:0/2775809953' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi080-54183-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:46.266 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:44.973414+0000 mon.a (mon.0) 763 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi080-54191-15"}]: dispatch 2024-02-13T00:37:46.266 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.418895+0000 mon.a (mon.0) 764 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi080-54191-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.267 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.419611+0000 mon.a (mon.0) 765 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi080-54199-22"}]: dispatch 2024-02-13T00:37:46.267 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.422260+0000 mon.a (mon.0) 766 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:46.267 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.422691+0000 mon.a (mon.0) 767 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi080-54199-22"}]: dispatch 2024-02-13T00:37:46.267 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.423485+0000 mon.a (mon.0) 768 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi080-54199-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.267 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.423935+0000 mon.b (mon.1) 44 : audit [INF] from='client.? 172.21.15.80:0/3543275486' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:46.267 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.424469+0000 mon.a (mon.0) 769 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:46.267 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.425339+0000 mon.c (mon.2) 111 : audit [INF] from='client.? 172.21.15.80:0/4291925045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:46.267 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: cluster 2024-02-13T00:37:45.500936+0000 osd.6 (osd.6) 3 : cluster [DBG] 17.5 deep-scrub starts 2024-02-13T00:37:46.267 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: cluster 2024-02-13T00:37:45.504580+0000 osd.6 (osd.6) 4 : cluster [DBG] 17.5 deep-scrub ok 2024-02-13T00:37:46.267 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.873726+0000 mon.a (mon.0) 770 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-02-13T00:37:46.267 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.874487+0000 mon.a (mon.0) 771 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:46.267 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.882781+0000 mon.a (mon.0) 772 : audit [INF] from='client.? 172.21.15.80:0/2775809953' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi080-54183-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:46.268 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.882901+0000 mon.a (mon.0) 773 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi080-54191-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:46.268 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.883075+0000 mon.a (mon.0) 774 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi080-54199-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:46.268 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: cluster 2024-02-13T00:37:45.883261+0000 mon.a (mon.0) 775 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2024-02-13T00:37:46.268 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.884608+0000 mon.a (mon.0) 776 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:46.268 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.886904+0000 mon.b (mon.1) 45 : audit [INF] from='client.? 172.21.15.80:0/2300884774' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:46.268 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.890023+0000 mon.c (mon.2) 112 : audit [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:46.268 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.890222+0000 mon.c (mon.2) 113 : audit [INF] from='client.? 172.21.15.80:0/1117570004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:46.268 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.892772+0000 mon.c (mon.2) 114 : audit [INF] from='client.? 172.21.15.80:0/4291925045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi080-54478-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.268 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.424469+0000 mon.a (mon.0) 769 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:46.269 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.425339+0000 mon.c (mon.2) 111 : audit [INF] from='client.? 172.21.15.80:0/4291925045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:46.269 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: cluster 2024-02-13T00:37:45.500936+0000 osd.6 (osd.6) 3 : cluster [DBG] 17.5 deep-scrub starts 2024-02-13T00:37:46.269 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: cluster 2024-02-13T00:37:45.504580+0000 osd.6 (osd.6) 4 : cluster [DBG] 17.5 deep-scrub ok 2024-02-13T00:37:46.269 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.873726+0000 mon.a (mon.0) 770 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-02-13T00:37:46.269 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.874487+0000 mon.a (mon.0) 771 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:46.269 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.882781+0000 mon.a (mon.0) 772 : audit [INF] from='client.? 172.21.15.80:0/2775809953' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi080-54183-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:46.269 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.882901+0000 mon.a (mon.0) 773 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi080-54191-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:46.269 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.883075+0000 mon.a (mon.0) 774 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi080-54199-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:46.269 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: cluster 2024-02-13T00:37:45.883261+0000 mon.a (mon.0) 775 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2024-02-13T00:37:46.269 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.884608+0000 mon.a (mon.0) 776 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:46.269 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.886904+0000 mon.b (mon.1) 45 : audit [INF] from='client.? 172.21.15.80:0/2300884774' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:46.269 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.890023+0000 mon.c (mon.2) 112 : audit [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:46.269 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.890222+0000 mon.c (mon.2) 113 : audit [INF] from='client.? 172.21.15.80:0/1117570004' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:46.269 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.892772+0000 mon.c (mon.2) 114 : audit [INF] from='client.? 172.21.15.80:0/4291925045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi080-54478-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.270 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.892821+0000 mon.a (mon.0) 777 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi080-54191-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi080-54191-15"}]: dispatch 2024-02-13T00:37:46.270 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.895355+0000 mon.a (mon.0) 778 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi080-54199-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi080-54199-22"}]: dispatch 2024-02-13T00:37:46.270 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.896801+0000 mon.a (mon.0) 779 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:46.270 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.897321+0000 mon.a (mon.0) 780 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:46.270 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.897922+0000 mon.a (mon.0) 781 : audit [INF] from='client.? 172.21.15.80:0/2775809953' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi080-54183-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-02-13T00:37:46.270 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.898332+0000 mon.b (mon.1) 46 : audit [INF] from='client.? 172.21.15.80:0/1268394734' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.270 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.898973+0000 mon.b (mon.1) 47 : audit [INF] from='client.? 172.21.15.80:0/2427324406' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi080-54223-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.270 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.907817+0000 mon.a (mon.0) 782 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:46.270 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.908195+0000 mon.a (mon.0) 783 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:46.270 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.908562+0000 mon.a (mon.0) 784 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi080-54478-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.270 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.912472+0000 mon.a (mon.0) 785 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:46.270 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.912861+0000 mon.a (mon.0) 786 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:46.270 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.913413+0000 mon.a (mon.0) 787 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.270 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.913826+0000 mon.a (mon.0) 788 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi080-54223-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.271 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.892821+0000 mon.a (mon.0) 777 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi080-54191-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi080-54191-15"}]: dispatch 2024-02-13T00:37:46.271 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.895355+0000 mon.a (mon.0) 778 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi080-54199-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi080-54199-22"}]: dispatch 2024-02-13T00:37:46.271 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.896801+0000 mon.a (mon.0) 779 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:46.271 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.897321+0000 mon.a (mon.0) 780 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:46.271 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.897922+0000 mon.a (mon.0) 781 : audit [INF] from='client.? 172.21.15.80:0/2775809953' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi080-54183-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-02-13T00:37:46.271 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.898332+0000 mon.b (mon.1) 46 : audit [INF] from='client.? 172.21.15.80:0/1268394734' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.271 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.898973+0000 mon.b (mon.1) 47 : audit [INF] from='client.? 172.21.15.80:0/2427324406' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi080-54223-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.271 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.907817+0000 mon.a (mon.0) 782 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:46.271 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.908195+0000 mon.a (mon.0) 783 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:46.271 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.908562+0000 mon.a (mon.0) 784 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi080-54478-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.271 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.912472+0000 mon.a (mon.0) 785 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:46.271 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.912861+0000 mon.a (mon.0) 786 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:46.272 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.913413+0000 mon.a (mon.0) 787 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.272 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.913826+0000 mon.a (mon.0) 788 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi080-54223-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.272 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.915307+0000 mon.b (mon.1) 48 : audit [INF] from='client.? 172.21.15.80:0/3543275486' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.272 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[17386]: audit 2024-02-13T00:37:45.917729+0000 mon.a (mon.0) 789 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.272 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.915307+0000 mon.b (mon.1) 48 : audit [INF] from='client.? 172.21.15.80:0/3543275486' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:46.272 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:45 smithi080 bash[24237]: audit 2024-02-13T00:37:45.917729+0000 mon.a (mon.0) 789 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:48.085 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:47 smithi106 bash[18459]: audit 2024-02-13T00:37:45.981688+0000 mon.a (mon.0) 790 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-02-13T00:37:48.085 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:47 smithi106 bash[18459]: cluster 2024-02-13T00:37:46.524375+0000 osd.3 (osd.3) 3 : cluster [DBG] 17.9 deep-scrub starts 2024-02-13T00:37:48.085 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:47 smithi106 bash[18459]: cluster 2024-02-13T00:37:46.529212+0000 osd.3 (osd.3) 4 : cluster [DBG] 17.9 deep-scrub ok 2024-02-13T00:37:48.085 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:47 smithi106 bash[18459]: audit 2024-02-13T00:37:46.878949+0000 mon.a (mon.0) 791 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:48.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:47 smithi080 bash[17386]: audit 2024-02-13T00:37:45.981688+0000 mon.a (mon.0) 790 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-02-13T00:37:48.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:47 smithi080 bash[17386]: cluster 2024-02-13T00:37:46.524375+0000 osd.3 (osd.3) 3 : cluster [DBG] 17.9 deep-scrub starts 2024-02-13T00:37:48.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:47 smithi080 bash[17386]: cluster 2024-02-13T00:37:46.529212+0000 osd.3 (osd.3) 4 : cluster [DBG] 17.9 deep-scrub ok 2024-02-13T00:37:48.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:47 smithi080 bash[17386]: audit 2024-02-13T00:37:46.878949+0000 mon.a (mon.0) 791 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:48.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:47 smithi080 bash[24237]: audit 2024-02-13T00:37:45.981688+0000 mon.a (mon.0) 790 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-02-13T00:37:48.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:47 smithi080 bash[24237]: cluster 2024-02-13T00:37:46.524375+0000 osd.3 (osd.3) 3 : cluster [DBG] 17.9 deep-scrub starts 2024-02-13T00:37:48.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:47 smithi080 bash[24237]: cluster 2024-02-13T00:37:46.529212+0000 osd.3 (osd.3) 4 : cluster [DBG] 17.9 deep-scrub ok 2024-02-13T00:37:48.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:47 smithi080 bash[24237]: audit 2024-02-13T00:37:46.878949+0000 mon.a (mon.0) 791 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:48.505 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:37:48 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:37:48.689 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_1_[54805]: starting. 2024-02-13T00:37:48.689 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_1_[54805]: creating pool ceph_test_rados_delete_pools_parallel.smithi080-54759 2024-02-13T00:37:48.689 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_1_[54805]: created object 0... 2024-02-13T00:37:48.689 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_1_[54805]: created object 25... 2024-02-13T00:37:48.689 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_1_[54805]: created object 49... 2024-02-13T00:37:48.689 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_1_[54805]: finishing. 2024-02-13T00:37:48.689 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_1_[54805]: shutting down. 2024-02-13T00:37:48.690 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_2_[54809]: starting. 2024-02-13T00:37:48.690 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_2_[54809]: deleting pool ceph_test_rados_delete_pools_parallel.smithi080-54759 2024-02-13T00:37:48.690 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_2_[54809]: shutting down. 2024-02-13T00:37:48.690 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: ******************************* 2024-02-13T00:37:48.690 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_3_[55709]: starting. 2024-02-13T00:37:48.690 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_3_[55709]: creating pool ceph_test_rados_delete_pools_parallel.smithi080-54759 2024-02-13T00:37:48.690 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_3_[55709]: created object 0... 2024-02-13T00:37:48.690 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_3_[55709]: created object 25... 2024-02-13T00:37:48.690 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_3_[55709]: created object 49... 2024-02-13T00:37:48.690 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_3_[55709]: finishing. 2024-02-13T00:37:48.690 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_3_[55709]: shutting down. 2024-02-13T00:37:48.690 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: ******************************* 2024-02-13T00:37:48.690 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_5_[55711]: starting. 2024-02-13T00:37:48.690 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_5_[55711]: listing objects. 2024-02-13T00:37:48.690 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_5_[55711]: listed object 0... 2024-02-13T00:37:48.691 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_5_[55711]: listed object 25... 2024-02-13T00:37:48.691 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_5_[55711]: saw 50 objects 2024-02-13T00:37:48.691 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_5_[55711]: shutting down. 2024-02-13T00:37:48.691 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: ******************************* 2024-02-13T00:37:48.691 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_4_[55710]: starting. 2024-02-13T00:37:48.691 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_4_[55710]: deleting pool ceph_test_rados_delete_pools_parallel.smithi080-54759 2024-02-13T00:37:48.691 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: process_4_[55710]: shutting down. 2024-02-13T00:37:48.691 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: ******************************* 2024-02-13T00:37:48.691 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: ******************************* 2024-02-13T00:37:48.691 INFO:tasks.workunit.client.0.smithi080.stdout: delete_pools_parallel: ******* SUCCESS ********** 2024-02-13T00:37:48.691 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: process_1_[54727]: starting. 2024-02-13T00:37:48.692 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: process_1_[54727]: creating pool ceph_test_rados_open_pools_parallel.smithi080-54687 2024-02-13T00:37:48.692 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: process_1_[54727]: created object 0... 2024-02-13T00:37:48.692 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: process_1_[54727]: created object 25... 2024-02-13T00:37:48.692 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: process_1_[54727]: created object 49... 2024-02-13T00:37:48.692 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: process_1_[54727]: finishing. 2024-02-13T00:37:48.692 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: process_1_[54727]: shutting down. 2024-02-13T00:37:48.692 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: process_2_[54730]: starting. 2024-02-13T00:37:48.692 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: process_2_[54730]: rados_pool_create. 2024-02-13T00:37:48.692 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: process_2_[54730]: rados_ioctx_create. 2024-02-13T00:37:48.692 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: process_2_[54730]: shutting down. 2024-02-13T00:37:48.692 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: ******************************* 2024-02-13T00:37:48.692 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: process_3_[55702]: starting. 2024-02-13T00:37:48.692 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: process_3_[55702]: creating pool ceph_test_rados_open_pools_parallel.smithi080-54687 2024-02-13T00:37:48.692 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: process_3_[55702]: created object 0... 2024-02-13T00:37:48.693 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: process_3_[55702]: created object 25... 2024-02-13T00:37:48.693 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: process_3_[55702]: created object 49... 2024-02-13T00:37:48.693 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: process_3_[55702]: finishing. 2024-02-13T00:37:48.693 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: process_3_[55702]: shutting down. 2024-02-13T00:37:48.693 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: ******************************* 2024-02-13T00:37:48.693 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: process_4_[55703]: starting. 2024-02-13T00:37:48.693 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: process_4_[55703]: rados_pool_create. 2024-02-13T00:37:48.693 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: process_4_[55703]: rados_ioctx_create. 2024-02-13T00:37:48.693 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: process_4_[55703]: shutting down. 2024-02-13T00:37:48.693 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: ******************************* 2024-02-13T00:37:48.693 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: ******************************* 2024-02-13T00:37:48.693 INFO:tasks.workunit.client.0.smithi080.stdout: open_pools_parallel: ******* SUCCESS ********** 2024-02-13T00:37:50.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:37:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:37:50.817 INFO:tasks.workunit.client.0.smithi080.stdout:}]: dispatch 2024-02-13T00:37:50.818 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:43.538628+0000 client.admin [INF] onexx 2024-02-13T00:37:50.818 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:43.558757+0000 mon.b [INF] from='client.? 172.21.15.80:0/3543275486' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:50.818 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:43.974978+0000 mon.c [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.0"}]: dispatch 2024-02-13T00:37:50.818 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:43.976370+0000 mon.c [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.1"}]: dispatch 2024-02-13T00:37:50.818 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:43.977276+0000 mon.c [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.2"}]: dispatch 2024-02-13T00:37:50.818 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:43.978133+0000 mon.c [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.3"}]: dispatch 2024-02-13T00:37:50.818 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:43.978861+0000 mon.c [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.4"}]: dispatch 2024-02-13T00:37:50.818 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:43.979610+0000 mon.c [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.5"}]: dispatch 2024-02-13T00:37:50.818 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:43.980253+0000 mon.c [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.6"}]: dispatch 2024-02-13T00:37:50.818 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:43.980960+0000 mon.c [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.7"}]: dispatch 2024-02-13T00:37:50.818 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:43.981596+0000 mon.c [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.8"}]: dispatch 2024-02-13T00:37:50.818 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:43.982165+0000 mon.c [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.9"}]: dispatch 2024-02-13T00:37:50.818 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:44.026932+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-13T00:37:50.819 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:45.981688+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-02-13T00:37:50.819 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.787684+0000 mon.a [INF] from='client.? 172.21.15.80:0/2775809953' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi080-54183-3", "field": "max_bytes", "val": "4096"}]': finished 2024-02-13T00:37:50.819 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.788475+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:50.819 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.788677+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]': finished 2024-02-13T00:37:50.819 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.788945+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi080-54478-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:50.819 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.789204+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:50.819 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.789548+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:50.819 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.789816+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi080-54223-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:50.819 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.789913+0000 mon.c [INF] from='client.? 172.21.15.80:0/1117570004' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:50.819 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.790204+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:50.819 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.790255+0000 mon.c [INF] from='client.? 172.21.15.80:0/4291925045' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi080-54478-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:50.819 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.791367+0000 mon.b [INF] from='client.? 172.21.15.80:0/1268394734' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi080-54474-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:50.819 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.791846+0000 mon.b [INF] from='client.? 172.21.15.80:0/2427324406' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi080-54223-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:50.819 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.792015+0000 mon.c [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-4", "tierpool": "test-rados-api-smithi080-54255-4-cache"}]: dispatch 2024-02-13T00:37:50.820 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.792651+0000 mon.b [INF] from='client.? 172.21.15.80:0/3543275486' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi080-54231-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:50.820 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.806073+0000 mon.a [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:37:50.820 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.809244+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:50.820 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.809640+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi080-54478-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:50.820 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.810066+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-4", "tierpool": "test-rados-api-smithi080-54255-4-cache"}]: dispatch 2024-02-13T00:37:50.820 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.815583+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi080-54474-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:51.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: cluster 2024-02-13T00:37:46.863178+0000 mgr.y (mgr.24461) 309 : cluster [DBG] pgmap v237: 676 pgs: 224 unknown, 96 creating+peering, 356 active+clean; 9.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.6 KiB/s rd, 20 KiB/s wr, 424 op/s 2024-02-13T00:37:51.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:47.787684+0000 mon.a (mon.0) 792 : audit [INF] from='client.? 172.21.15.80:0/2775809953' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi080-54183-3", "field": "max_bytes", "val": "4096"}]': finished 2024-02-13T00:37:51.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:47.788475+0000 mon.a (mon.0) 793 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:51.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:47.788677+0000 mon.a (mon.0) 794 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]': finished 2024-02-13T00:37:51.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:47.788945+0000 mon.a (mon.0) 795 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi080-54478-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:51.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:47.789204+0000 mon.a (mon.0) 796 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:51.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:47.789548+0000 mon.a (mon.0) 797 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:51.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:47.789816+0000 mon.a (mon.0) 798 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi080-54223-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:51.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:47.789913+0000 mon.c (mon.2) 115 : audit [INF] from='client.? 172.21.15.80:0/1117570004' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:51.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:47.790204+0000 mon.a (mon.0) 799 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:51.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:47.790255+0000 mon.c (mon.2) 116 : audit [INF] from='client.? 172.21.15.80:0/4291925045' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi080-54478-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:51.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: cluster 2024-02-13T00:37:47.790631+0000 mon.a (mon.0) 800 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2024-02-13T00:37:51.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:47.791367+0000 mon.b (mon.1) 49 : audit [INF] from='client.? 172.21.15.80:0/1268394734' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi080-54474-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:51.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:47.791846+0000 mon.b (mon.1) 50 : audit [INF] from='client.? 172.21.15.80:0/2427324406' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi080-54223-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:51.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:47.792015+0000 mon.c (mon.2) 117 : audit [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-4", "tierpool": "test-rados-api-smithi080-54255-4-cache"}]: dispatch 2024-02-13T00:37:51.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:47.792651+0000 mon.b (mon.1) 51 : audit [INF] from='client.? 172.21.15.80:0/3543275486' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi080-54231-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:51.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:47.806073+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:37:51.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:47.809244+0000 mon.a (mon.0) 802 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:51.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:47.809640+0000 mon.a (mon.0) 803 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi080-54478-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:51.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:47.810066+0000 mon.a (mon.0) 804 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-4", "tierpool": "test-rados-api-smithi080-54255-4-cache"}]: dispatch 2024-02-13T00:37:51.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:47.815583+0000 mon.a (mon.0) 805 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi080-54474-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:51.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:47.816138+0000 mon.a (mon.0) 806 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi080-54223-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:51.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:47.816714+0000 mon.a (mon.0) 807 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi080-54231-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:51.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:47.984375+0000 mon.c (mon.2) 118 : audit [INF] from='client.? 172.21.15.80:0/2470845228' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-13T00:37:51.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: cluster 2024-02-13T00:37:47.984715+0000 client.admin (client.?) 0 : cluster [INF] threexx 2024-02-13T00:37:51.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:48.241669+0000 mon.a (mon.0) 808 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-13T00:37:51.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:50 smithi106 bash[18459]: audit 2024-02-13T00:37:48.242250+0000 mon.a (mon.0) 809 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:51.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: cluster 2024-02-13T00:37:46.863178+0000 mgr.y (mgr.24461) 309 : cluster [DBG] pgmap v237: 676 pgs: 224 unknown, 96 creating+peering, 356 active+clean; 9.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.6 KiB/s rd, 20 KiB/s wr, 424 op/s 2024-02-13T00:37:51.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:47.787684+0000 mon.a (mon.0) 792 : audit [INF] from='client.? 172.21.15.80:0/2775809953' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi080-54183-3", "field": "max_bytes", "val": "4096"}]': finished 2024-02-13T00:37:51.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:47.788475+0000 mon.a (mon.0) 793 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:51.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:47.788677+0000 mon.a (mon.0) 794 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]': finished 2024-02-13T00:37:51.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:47.788945+0000 mon.a (mon.0) 795 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi080-54478-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:51.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:47.789204+0000 mon.a (mon.0) 796 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:51.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:47.789548+0000 mon.a (mon.0) 797 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:51.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:47.789816+0000 mon.a (mon.0) 798 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi080-54223-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:51.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:47.789913+0000 mon.c (mon.2) 115 : audit [INF] from='client.? 172.21.15.80:0/1117570004' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:51.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:47.790204+0000 mon.a (mon.0) 799 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:51.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:47.790255+0000 mon.c (mon.2) 116 : audit [INF] from='client.? 172.21.15.80:0/4291925045' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi080-54478-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:51.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: cluster 2024-02-13T00:37:47.790631+0000 mon.a (mon.0) 800 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2024-02-13T00:37:51.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:47.791367+0000 mon.b (mon.1) 49 : audit [INF] from='client.? 172.21.15.80:0/1268394734' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi080-54474-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:51.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: cluster 2024-02-13T00:37:46.863178+0000 mgr.y (mgr.24461) 309 : cluster [DBG] pgmap v237: 676 pgs: 224 unknown, 96 creating+peering, 356 active+clean; 9.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.6 KiB/s rd, 20 KiB/s wr, 424 op/s 2024-02-13T00:37:51.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:47.787684+0000 mon.a (mon.0) 792 : audit [INF] from='client.? 172.21.15.80:0/2775809953' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi080-54183-3", "field": "max_bytes", "val": "4096"}]': finished 2024-02-13T00:37:51.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:47.788475+0000 mon.a (mon.0) 793 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:51.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:47.788677+0000 mon.a (mon.0) 794 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi080-54497-1"}]': finished 2024-02-13T00:37:51.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:47.788945+0000 mon.a (mon.0) 795 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi080-54478-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:51.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:47.789204+0000 mon.a (mon.0) 796 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:51.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:47.789548+0000 mon.a (mon.0) 797 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:51.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:47.789816+0000 mon.a (mon.0) 798 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi080-54223-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:51.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:47.789913+0000 mon.c (mon.2) 115 : audit [INF] from='client.? 172.21.15.80:0/1117570004' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:51.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:47.790204+0000 mon.a (mon.0) 799 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:51.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:47.790255+0000 mon.c (mon.2) 116 : audit [INF] from='client.? 172.21.15.80:0/4291925045' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi080-54478-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:51.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: cluster 2024-02-13T00:37:47.790631+0000 mon.a (mon.0) 800 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2024-02-13T00:37:51.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:47.791367+0000 mon.b (mon.1) 49 : audit [INF] from='client.? 172.21.15.80:0/1268394734' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi080-54474-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:51.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:47.791846+0000 mon.b (mon.1) 50 : audit [INF] from='client.? 172.21.15.80:0/2427324406' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi080-54223-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:51.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:47.792015+0000 mon.c (mon.2) 117 : audit [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-4", "tierpool": "test-rados-api-smithi080-54255-4-cache"}]: dispatch 2024-02-13T00:37:51.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:47.792651+0000 mon.b (mon.1) 51 : audit [INF] from='client.? 172.21.15.80:0/3543275486' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi080-54231-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:51.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:47.806073+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:37:51.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:47.809244+0000 mon.a (mon.0) 802 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:51.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:47.809640+0000 mon.a (mon.0) 803 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi080-54478-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:51.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:47.810066+0000 mon.a (mon.0) 804 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-4", "tierpool": "test-rados-api-smithi080-54255-4-cache"}]: dispatch 2024-02-13T00:37:51.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:47.815583+0000 mon.a (mon.0) 805 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi080-54474-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:51.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:47.816138+0000 mon.a (mon.0) 806 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi080-54223-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:51.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:47.816714+0000 mon.a (mon.0) 807 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi080-54231-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:51.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:47.984375+0000 mon.c (mon.2) 118 : audit [INF] from='client.? 172.21.15.80:0/2470845228' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-13T00:37:51.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: cluster 2024-02-13T00:37:47.984715+0000 client.admin (client.?) 0 : cluster [INF] threexx 2024-02-13T00:37:51.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:48.241669+0000 mon.a (mon.0) 808 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-13T00:37:51.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[17386]: audit 2024-02-13T00:37:48.242250+0000 mon.a (mon.0) 809 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:51.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:47.791846+0000 mon.b (mon.1) 50 : audit [INF] from='client.? 172.21.15.80:0/2427324406' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi080-54223-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:51.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:47.792015+0000 mon.c (mon.2) 117 : audit [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-4", "tierpool": "test-rados-api-smithi080-54255-4-cache"}]: dispatch 2024-02-13T00:37:51.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:47.792651+0000 mon.b (mon.1) 51 : audit [INF] from='client.? 172.21.15.80:0/3543275486' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi080-54231-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:51.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:47.806073+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:37:51.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:47.809244+0000 mon.a (mon.0) 802 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi080-54497-1"}]: dispatch 2024-02-13T00:37:51.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:47.809640+0000 mon.a (mon.0) 803 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi080-54478-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:51.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:47.810066+0000 mon.a (mon.0) 804 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-4", "tierpool": "test-rados-api-smithi080-54255-4-cache"}]: dispatch 2024-02-13T00:37:51.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:47.815583+0000 mon.a (mon.0) 805 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi080-54474-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:51.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:47.816138+0000 mon.a (mon.0) 806 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi080-54223-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:51.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:47.816714+0000 mon.a (mon.0) 807 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi080-54231-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:51.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:47.984375+0000 mon.c (mon.2) 118 : audit [INF] from='client.? 172.21.15.80:0/2470845228' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-13T00:37:51.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: cluster 2024-02-13T00:37:47.984715+0000 client.admin (client.?) 0 : cluster [INF] threexx 2024-02-13T00:37:51.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:48.241669+0000 mon.a (mon.0) 808 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-13T00:37:51.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:50 smithi080 bash[24237]: audit 2024-02-13T00:37:48.242250+0000 mon.a (mon.0) 809 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:51.979 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.816138+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "os api_io_pp: Running main() from gmock_main.cc 2024-02-13T00:37:51.979 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2024-02-13T00:37:51.979 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [----------] Global test environment set-up. 2024-02-13T00:37:51.979 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2024-02-13T00:37:51.979 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: seed 54199 2024-02-13T00:37:51.979 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2024-02-13T00:37:51.979 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-02-13T00:37:51.979 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2024-02-13T00:37:51.979 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (266 ms) 2024-02-13T00:37:51.979 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2024-02-13T00:37:51.979 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (29 ms) 2024-02-13T00:37:51.980 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2024-02-13T00:37:51.980 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (4 ms) 2024-02-13T00:37:51.980 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2024-02-13T00:37:51.980 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (13 ms) 2024-02-13T00:37:51.980 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2024-02-13T00:37:51.980 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (8 ms) 2024-02-13T00:37:51.980 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2024-02-13T00:37:51.980 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (11 ms) 2024-02-13T00:37:51.980 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-02-13T00:37:51.980 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (10 ms) 2024-02-13T00:37:51.980 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-02-13T00:37:51.980 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (12 ms) 2024-02-13T00:37:51.980 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-02-13T00:37:51.980 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (5 ms) 2024-02-13T00:37:51.981 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-02-13T00:37:51.981 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (5 ms) 2024-02-13T00:37:51.981 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-02-13T00:37:51.981 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (4 ms) 2024-02-13T00:37:51.981 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2024-02-13T00:37:51.981 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (7 ms) 2024-02-13T00:37:51.981 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2024-02-13T00:37:51.981 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (7 ms) 2024-02-13T00:37:51.981 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-02-13T00:37:51.981 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (7 ms) 2024-02-13T00:37:51.981 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2024-02-13T00:37:51.981 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (20 ms) 2024-02-13T00:37:51.981 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-02-13T00:37:51.981 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (8 ms) 2024-02-13T00:37:51.981 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2024-02-13T00:37:51.982 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (5 ms) 2024-02-13T00:37:51.982 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-02-13T00:37:51.982 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (8 ms) 2024-02-13T00:37:51.982 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-02-13T00:37:51.982 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (8 ms) 2024-02-13T00:37:51.982 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (437 ms total) 2024-02-13T00:37:51.982 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: 2024-02-13T00:37:51.982 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2024-02-13T00:37:51.982 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2024-02-13T00:37:51.982 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (657 ms) 2024-02-13T00:37:51.982 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2024-02-13T00:37:51.982 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (20 ms) 2024-02-13T00:37:51.982 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-02-13T00:37:51.982 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (4 ms) 2024-02-13T00:37:51.982 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2024-02-13T00:37:51.982 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (6 ms) 2024-02-13T00:37:51.983 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2024-02-13T00:37:51.983 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (4 ms) 2024-02-13T00:37:52.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: cluster 2024-02-13T00:37:47.319935+0000 osd.7 (osd.7) 3 : cluster [DBG] 17.0 deep-scrub starts 2024-02-13T00:37:52.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: cluster 2024-02-13T00:37:47.321339+0000 osd.7 (osd.7) 4 : cluster [DBG] 17.0 deep-scrub ok 2024-02-13T00:37:52.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: audit 2024-02-13T00:37:48.082046+0000 mgr.y (mgr.24461) 310 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:37:52.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: audit 2024-02-13T00:37:48.248502+0000 mon.a (mon.0) 810 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi080-54191-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi080-54191-15"}]': finished 2024-02-13T00:37:52.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: audit 2024-02-13T00:37:48.248609+0000 mon.a (mon.0) 811 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi080-54199-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi080-54199-22"}]': finished 2024-02-13T00:37:52.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: audit 2024-02-13T00:37:48.248736+0000 mon.a (mon.0) 812 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi080-54497-1"}]': finished 2024-02-13T00:37:52.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: cluster 2024-02-13T00:37:48.314540+0000 osd.7 (osd.7) 5 : cluster [DBG] 17.8 deep-scrub starts 2024-02-13T00:37:52.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: cluster 2024-02-13T00:37:48.315604+0000 osd.7 (osd.7) 6 : cluster [DBG] 17.8 deep-scrub ok 2024-02-13T00:37:52.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: cluster 2024-02-13T00:37:48.432820+0000 osd.4 (osd.4) 5 : cluster [DBG] 17.3 deep-scrub starts 2024-02-13T00:37:52.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: cluster 2024-02-13T00:37:48.478320+0000 osd.4 (osd.4) 6 : cluster [DBG] 17.3 deep-scrub ok 2024-02-13T00:37:52.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: cluster 2024-02-13T00:37:48.542990+0000 osd.6 (osd.6) 5 : cluster [DBG] 17.6 deep-scrub starts 2024-02-13T00:37:52.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: cluster 2024-02-13T00:37:48.547490+0000 osd.6 (osd.6) 6 : cluster [DBG] 17.6 deep-scrub ok 2024-02-13T00:37:52.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: audit 2024-02-13T00:37:48.682206+0000 mon.a (mon.0) 813 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-4", "tierpool": "test-rados-api-smithi080-54255-4-cache"}]': finished 2024-02-13T00:37:52.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: audit 2024-02-13T00:37:48.683423+0000 mon.c (mon.2) 119 : audit [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-4", "overlaypool": "test-rados-api-smithi080-54255-4-cache"}]: dispatch 2024-02-13T00:37:52.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: cluster 2024-02-13T00:37:48.864249+0000 mgr.y (mgr.24461) 311 : cluster [DBG] pgmap v240: 532 pgs: 48 unknown, 484 active+clean; 144 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 29 op/s 2024-02-13T00:37:52.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: audit 2024-02-13T00:37:49.939114+0000 mon.c (mon.2) 120 : audit [INF] from='client.? 172.21.15.80:0/2331385887' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi080-54175-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:52.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: cluster 2024-02-13T00:37:50.805826+0000 mon.a (mon.0) 814 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2024-02-13T00:37:52.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: audit 2024-02-13T00:37:50.818609+0000 mon.a (mon.0) 815 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-02-13T00:37:52.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: audit 2024-02-13T00:37:50.819158+0000 mon.c (mon.2) 121 : audit [INF] from='client.? 172.21.15.80:0/2470845228' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-02-13T00:37:52.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: cluster 2024-02-13T00:37:50.819288+0000 client.admin (client.?) 0 : cluster [INF] fourxx 2024-02-13T00:37:52.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: audit 2024-02-13T00:37:50.819809+0000 mon.a (mon.0) 816 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:52.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: audit 2024-02-13T00:37:50.826627+0000 mon.a (mon.0) 817 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi080-54478-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi080-54478-6"}]': finished 2024-02-13T00:37:52.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: audit 2024-02-13T00:37:50.826743+0000 mon.a (mon.0) 818 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi080-54474-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi080-54474-7"}]': finished 2024-02-13T00:37:52.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: audit 2024-02-13T00:37:50.826846+0000 mon.a (mon.0) 819 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi080-54223-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi080-54223-10"}]': finished 2024-02-13T00:37:52.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: audit 2024-02-13T00:37:50.826931+0000 mon.a (mon.0) 820 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi080-54231-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi080-54231-10"}]': finished 2024-02-13T00:37:52.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: cluster 2024-02-13T00:37:50.865265+0000 mgr.y (mgr.24461) 312 : cluster [DBG] pgmap v242: 628 pgs: 144 unknown, 484 active+clean; 144 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 9.6 MiB/s rd, 30 MiB/s wr, 53 op/s 2024-02-13T00:37:52.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: cluster 2024-02-13T00:37:51.277624+0000 mon.a (mon.0) 821 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2024-02-13T00:37:52.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: cluster 2024-02-13T00:37:51.277943+0000 mon.a (mon.0) 822 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:37:52.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: audit 2024-02-13T00:37:51.281352+0000 mon.a (mon.0) 823 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-4", "overlaypool": "test-rados-api-smithi080-54255-4-cache"}]: dispatch 2024-02-13T00:37:52.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: audit 2024-02-13T00:37:51.285190+0000 mon.a (mon.0) 824 : audit [INF] from='client.? 172.21.15.80:0/3268762372' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:52.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: audit 2024-02-13T00:37:51.285829+0000 mon.a (mon.0) 825 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi080-54239-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:52.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: audit 2024-02-13T00:37:51.286281+0000 mon.a (mon.0) 826 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi080-54175-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:52.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:51 smithi106 bash[18459]: audit 2024-02-13T00:37:51.719782+0000 mon.a (mon.0) 827 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-02-13T00:37:52.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: cluster 2024-02-13T00:37:47.319935+0000 osd.7 (osd.7) 3 : cluster [DBG] 17.0 deep-scrub starts 2024-02-13T00:37:52.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: cluster 2024-02-13T00:37:47.321339+0000 osd.7 (osd.7) 4 : cluster [DBG] 17.0 deep-scrub ok 2024-02-13T00:37:52.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: audit 2024-02-13T00:37:48.082046+0000 mgr.y (mgr.24461) 310 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:37:52.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: audit 2024-02-13T00:37:48.248502+0000 mon.a (mon.0) 810 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi080-54191-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi080-54191-15"}]': finished 2024-02-13T00:37:52.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: audit 2024-02-13T00:37:48.248609+0000 mon.a (mon.0) 811 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi080-54199-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi080-54199-22"}]': finished 2024-02-13T00:37:52.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: audit 2024-02-13T00:37:48.248736+0000 mon.a (mon.0) 812 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi080-54497-1"}]': finished 2024-02-13T00:37:52.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: cluster 2024-02-13T00:37:48.314540+0000 osd.7 (osd.7) 5 : cluster [DBG] 17.8 deep-scrub starts 2024-02-13T00:37:52.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: cluster 2024-02-13T00:37:48.315604+0000 osd.7 (osd.7) 6 : cluster [DBG] 17.8 deep-scrub ok 2024-02-13T00:37:52.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: cluster 2024-02-13T00:37:48.432820+0000 osd.4 (osd.4) 5 : cluster [DBG] 17.3 deep-scrub starts 2024-02-13T00:37:52.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: cluster 2024-02-13T00:37:48.478320+0000 osd.4 (osd.4) 6 : cluster [DBG] 17.3 deep-scrub ok 2024-02-13T00:37:52.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: cluster 2024-02-13T00:37:48.542990+0000 osd.6 (osd.6) 5 : cluster [DBG] 17.6 deep-scrub starts 2024-02-13T00:37:52.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: cluster 2024-02-13T00:37:48.547490+0000 osd.6 (osd.6) 6 : cluster [DBG] 17.6 deep-scrub ok 2024-02-13T00:37:52.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: audit 2024-02-13T00:37:48.682206+0000 mon.a (mon.0) 813 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-4", "tierpool": "test-rados-api-smithi080-54255-4-cache"}]': finished 2024-02-13T00:37:52.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: audit 2024-02-13T00:37:48.683423+0000 mon.c (mon.2) 119 : audit [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-4", "overlaypool": "test-rados-api-smithi080-54255-4-cache"}]: dispatch 2024-02-13T00:37:52.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: cluster 2024-02-13T00:37:48.864249+0000 mgr.y (mgr.24461) 311 : cluster [DBG] pgmap v240: 532 pgs: 48 unknown, 484 active+clean; 144 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 29 op/s 2024-02-13T00:37:52.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: audit 2024-02-13T00:37:49.939114+0000 mon.c (mon.2) 120 : audit [INF] from='client.? 172.21.15.80:0/2331385887' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi080-54175-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:52.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: cluster 2024-02-13T00:37:50.805826+0000 mon.a (mon.0) 814 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2024-02-13T00:37:52.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: audit 2024-02-13T00:37:50.818609+0000 mon.a (mon.0) 815 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-02-13T00:37:52.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: audit 2024-02-13T00:37:50.819158+0000 mon.c (mon.2) 121 : audit [INF] from='client.? 172.21.15.80:0/2470845228' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-02-13T00:37:52.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: cluster 2024-02-13T00:37:47.319935+0000 osd.7 (osd.7) 3 : cluster [DBG] 17.0 deep-scrub starts 2024-02-13T00:37:52.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: cluster 2024-02-13T00:37:47.321339+0000 osd.7 (osd.7) 4 : cluster [DBG] 17.0 deep-scrub ok 2024-02-13T00:37:52.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: audit 2024-02-13T00:37:48.082046+0000 mgr.y (mgr.24461) 310 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:37:52.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: audit 2024-02-13T00:37:48.248502+0000 mon.a (mon.0) 810 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi080-54191-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi080-54191-15"}]': finished 2024-02-13T00:37:52.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: audit 2024-02-13T00:37:48.248609+0000 mon.a (mon.0) 811 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi080-54199-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi080-54199-22"}]': finished 2024-02-13T00:37:52.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: audit 2024-02-13T00:37:48.248736+0000 mon.a (mon.0) 812 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi080-54497-1"}]': finished 2024-02-13T00:37:52.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: cluster 2024-02-13T00:37:48.314540+0000 osd.7 (osd.7) 5 : cluster [DBG] 17.8 deep-scrub starts 2024-02-13T00:37:52.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: cluster 2024-02-13T00:37:48.315604+0000 osd.7 (osd.7) 6 : cluster [DBG] 17.8 deep-scrub ok 2024-02-13T00:37:52.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: cluster 2024-02-13T00:37:48.432820+0000 osd.4 (osd.4) 5 : cluster [DBG] 17.3 deep-scrub starts 2024-02-13T00:37:52.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: cluster 2024-02-13T00:37:48.478320+0000 osd.4 (osd.4) 6 : cluster [DBG] 17.3 deep-scrub ok 2024-02-13T00:37:52.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: cluster 2024-02-13T00:37:48.542990+0000 osd.6 (osd.6) 5 : cluster [DBG] 17.6 deep-scrub starts 2024-02-13T00:37:52.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: cluster 2024-02-13T00:37:48.547490+0000 osd.6 (osd.6) 6 : cluster [DBG] 17.6 deep-scrub ok 2024-02-13T00:37:52.262 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: audit 2024-02-13T00:37:48.682206+0000 mon.a (mon.0) 813 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-4", "tierpool": "test-rados-api-smithi080-54255-4-cache"}]': finished 2024-02-13T00:37:52.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: audit 2024-02-13T00:37:48.683423+0000 mon.c (mon.2) 119 : audit [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-4", "overlaypool": "test-rados-api-smithi080-54255-4-cache"}]: dispatch 2024-02-13T00:37:52.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: cluster 2024-02-13T00:37:48.864249+0000 mgr.y (mgr.24461) 311 : cluster [DBG] pgmap v240: 532 pgs: 48 unknown, 484 active+clean; 144 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 29 op/s 2024-02-13T00:37:52.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: audit 2024-02-13T00:37:49.939114+0000 mon.c (mon.2) 120 : audit [INF] from='client.? 172.21.15.80:0/2331385887' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi080-54175-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:52.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: cluster 2024-02-13T00:37:50.805826+0000 mon.a (mon.0) 814 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2024-02-13T00:37:52.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: audit 2024-02-13T00:37:50.818609+0000 mon.a (mon.0) 815 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-02-13T00:37:52.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: audit 2024-02-13T00:37:50.819158+0000 mon.c (mon.2) 121 : audit [INF] from='client.? 172.21.15.80:0/2470845228' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-02-13T00:37:52.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: cluster 2024-02-13T00:37:50.819288+0000 client.admin (client.?) 0 : cluster [INF] fourxx 2024-02-13T00:37:52.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: audit 2024-02-13T00:37:50.819809+0000 mon.a (mon.0) 816 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:52.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: audit 2024-02-13T00:37:50.826627+0000 mon.a (mon.0) 817 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi080-54478-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi080-54478-6"}]': finished 2024-02-13T00:37:52.263 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: audit 2024-02-13T00:37:50.826743+0000 mon.a (mon.0) 818 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi080-54474-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi080-54474-7"}]': finished 2024-02-13T00:37:52.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: audit 2024-02-13T00:37:50.826846+0000 mon.a (mon.0) 819 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi080-54223-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi080-54223-10"}]': finished 2024-02-13T00:37:52.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: audit 2024-02-13T00:37:50.826931+0000 mon.a (mon.0) 820 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi080-54231-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi080-54231-10"}]': finished 2024-02-13T00:37:52.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: cluster 2024-02-13T00:37:50.865265+0000 mgr.y (mgr.24461) 312 : cluster [DBG] pgmap v242: 628 pgs: 144 unknown, 484 active+clean; 144 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 9.6 MiB/s rd, 30 MiB/s wr, 53 op/s 2024-02-13T00:37:52.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: cluster 2024-02-13T00:37:51.277624+0000 mon.a (mon.0) 821 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2024-02-13T00:37:52.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: cluster 2024-02-13T00:37:51.277943+0000 mon.a (mon.0) 822 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:37:52.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: audit 2024-02-13T00:37:51.281352+0000 mon.a (mon.0) 823 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-4", "overlaypool": "test-rados-api-smithi080-54255-4-cache"}]: dispatch 2024-02-13T00:37:52.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: audit 2024-02-13T00:37:51.285190+0000 mon.a (mon.0) 824 : audit [INF] from='client.? 172.21.15.80:0/3268762372' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:52.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: audit 2024-02-13T00:37:51.285829+0000 mon.a (mon.0) 825 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi080-54239-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:52.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: audit 2024-02-13T00:37:51.286281+0000 mon.a (mon.0) 826 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi080-54175-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:52.264 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[17386]: audit 2024-02-13T00:37:51.719782+0000 mon.a (mon.0) 827 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-02-13T00:37:52.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: cluster 2024-02-13T00:37:50.819288+0000 client.admin (client.?) 0 : cluster [INF] fourxx 2024-02-13T00:37:52.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: audit 2024-02-13T00:37:50.819809+0000 mon.a (mon.0) 816 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:52.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: audit 2024-02-13T00:37:50.826627+0000 mon.a (mon.0) 817 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi080-54478-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi080-54478-6"}]': finished 2024-02-13T00:37:52.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: audit 2024-02-13T00:37:50.826743+0000 mon.a (mon.0) 818 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi080-54474-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi080-54474-7"}]': finished 2024-02-13T00:37:52.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: audit 2024-02-13T00:37:50.826846+0000 mon.a (mon.0) 819 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi080-54223-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi080-54223-10"}]': finished 2024-02-13T00:37:52.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: audit 2024-02-13T00:37:50.826931+0000 mon.a (mon.0) 820 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi080-54231-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi080-54231-10"}]': finished 2024-02-13T00:37:52.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: cluster 2024-02-13T00:37:50.865265+0000 mgr.y (mgr.24461) 312 : cluster [DBG] pgmap v242: 628 pgs: 144 unknown, 484 active+clean; 144 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 9.6 MiB/s rd, 30 MiB/s wr, 53 op/s 2024-02-13T00:37:52.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: cluster 2024-02-13T00:37:51.277624+0000 mon.a (mon.0) 821 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2024-02-13T00:37:52.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: cluster 2024-02-13T00:37:51.277943+0000 mon.a (mon.0) 822 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:37:52.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: audit 2024-02-13T00:37:51.281352+0000 mon.a (mon.0) 823 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-4", "overlaypool": "test-rados-api-smithi080-54255-4-cache"}]: dispatch 2024-02-13T00:37:52.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: audit 2024-02-13T00:37:51.285190+0000 mon.a (mon.0) 824 : audit [INF] from='client.? 172.21.15.80:0/3268762372' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:52.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: audit 2024-02-13T00:37:51.285829+0000 mon.a (mon.0) 825 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi080-54239-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:52.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: audit 2024-02-13T00:37:51.286281+0000 mon.a (mon.0) 826 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi080-54175-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:52.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:51 smithi080 bash[24237]: audit 2024-02-13T00:37:51.719782+0000 mon.a (mon.0) 827 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-02-13T00:37:53.115 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[24237]: audit 2024-02-13T00:37:51.823518+0000 mon.a (mon.0) 828 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-02-13T00:37:53.116 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[24237]: audit 2024-02-13T00:37:51.825759+0000 mon.a (mon.0) 829 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:53.116 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[24237]: audit 2024-02-13T00:37:51.830882+0000 mon.a (mon.0) 830 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-4", "overlaypool": "test-rados-api-smithi080-54255-4-cache"}]': finished 2024-02-13T00:37:53.116 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[24237]: audit 2024-02-13T00:37:51.831066+0000 mon.a (mon.0) 831 : audit [INF] from='client.? 172.21.15.80:0/3268762372' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:53.116 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[24237]: audit 2024-02-13T00:37:51.831165+0000 mon.a (mon.0) 832 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi080-54239-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:53.116 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[24237]: audit 2024-02-13T00:37:51.831268+0000 mon.a (mon.0) 833 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi080-54175-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:53.116 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[24237]: cluster 2024-02-13T00:37:51.831486+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2024-02-13T00:37:53.116 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[24237]: audit 2024-02-13T00:37:51.833401+0000 mon.c (mon.2) 122 : audit [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-4-cache", "mode": "writeback"}]: dispatch 2024-02-13T00:37:53.116 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[24237]: audit 2024-02-13T00:37:51.834413+0000 mon.c (mon.2) 123 : audit [INF] from='client.? 172.21.15.80:0/3779872273' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:53.116 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[24237]: audit 2024-02-13T00:37:51.835796+0000 mon.a (mon.0) 835 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-4-cache", "mode": "writeback"}]: dispatch 2024-02-13T00:37:53.116 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[24237]: audit 2024-02-13T00:37:51.836350+0000 mon.a (mon.0) 836 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:53.116 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[24237]: audit 2024-02-13T00:37:51.836791+0000 mon.c (mon.2) 124 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:53.116 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[24237]: audit 2024-02-13T00:37:51.845760+0000 mon.a (mon.0) 837 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:53.116 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[24237]: audit 2024-02-13T00:37:51.889481+0000 mon.c (mon.2) 125 : audit [INF] from='client.? 172.21.15.80:0/286997137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:53.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[17386]: audit 2024-02-13T00:37:51.823518+0000 mon.a (mon.0) 828 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-02-13T00:37:53.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[17386]: audit 2024-02-13T00:37:51.825759+0000 mon.a (mon.0) 829 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:53.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[17386]: audit 2024-02-13T00:37:51.830882+0000 mon.a (mon.0) 830 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-4", "overlaypool": "test-rados-api-smithi080-54255-4-cache"}]': finished 2024-02-13T00:37:53.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[17386]: audit 2024-02-13T00:37:51.831066+0000 mon.a (mon.0) 831 : audit [INF] from='client.? 172.21.15.80:0/3268762372' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:53.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[17386]: audit 2024-02-13T00:37:51.831165+0000 mon.a (mon.0) 832 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi080-54239-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:53.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[17386]: audit 2024-02-13T00:37:51.831268+0000 mon.a (mon.0) 833 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi080-54175-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:53.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[17386]: cluster 2024-02-13T00:37:51.831486+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2024-02-13T00:37:53.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[17386]: audit 2024-02-13T00:37:51.833401+0000 mon.c (mon.2) 122 : audit [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-4-cache", "mode": "writeback"}]: dispatch 2024-02-13T00:37:53.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[17386]: audit 2024-02-13T00:37:51.834413+0000 mon.c (mon.2) 123 : audit [INF] from='client.? 172.21.15.80:0/3779872273' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:53.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[17386]: audit 2024-02-13T00:37:51.835796+0000 mon.a (mon.0) 835 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-4-cache", "mode": "writeback"}]: dispatch 2024-02-13T00:37:53.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[17386]: audit 2024-02-13T00:37:51.836350+0000 mon.a (mon.0) 836 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:53.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[17386]: audit 2024-02-13T00:37:51.836791+0000 mon.c (mon.2) 124 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:53.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[17386]: audit 2024-02-13T00:37:51.845760+0000 mon.a (mon.0) 837 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:53.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[17386]: audit 2024-02-13T00:37:51.889481+0000 mon.c (mon.2) 125 : audit [INF] from='client.? 172.21.15.80:0/286997137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:53.118 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[24237]: audit 2024-02-13T00:37:51.889903+0000 mon.a (mon.0) 838 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:53.118 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[24237]: audit 2024-02-13T00:37:51.893941+0000 mon.c (mon.2) 126 : audit [INF] from='client.? 172.21.15.80:0/286997137' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:53.118 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[24237]: audit 2024-02-13T00:37:51.894628+0000 mon.a (mon.0) 839 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:53.118 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[24237]: audit 2024-02-13T00:37:51.897598+0000 mon.c (mon.2) 127 : audit [INF] from='client.? 172.21.15.80:0/286997137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:53.118 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[24237]: audit 2024-02-13T00:37:51.898514+0000 mon.a (mon.0) 840 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:53.118 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[24237]: audit 2024-02-13T00:37:51.946371+0000 mon.a (mon.0) 841 : audit [DBG] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-02-13T00:37:53.118 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[24237]: audit 2024-02-13T00:37:51.947382+0000 mon.a (mon.0) 842 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi080-54239-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:53.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[17386]: audit 2024-02-13T00:37:51.889903+0000 mon.a (mon.0) 838 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:53.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[17386]: audit 2024-02-13T00:37:51.893941+0000 mon.c (mon.2) 126 : audit [INF] from='client.? 172.21.15.80:0/286997137' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:53.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[17386]: audit 2024-02-13T00:37:51.894628+0000 mon.a (mon.0) 839 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:53.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[17386]: audit 2024-02-13T00:37:51.897598+0000 mon.c (mon.2) 127 : audit [INF] from='client.? 172.21.15.80:0/286997137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:53.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[17386]: audit 2024-02-13T00:37:51.898514+0000 mon.a (mon.0) 840 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:53.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[17386]: audit 2024-02-13T00:37:51.946371+0000 mon.a (mon.0) 841 : audit [DBG] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-02-13T00:37:53.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:52 smithi080 bash[17386]: audit 2024-02-13T00:37:51.947382+0000 mon.a (mon.0) 842 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi080-54239-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:53.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:52 smithi106 bash[18459]: audit 2024-02-13T00:37:51.823518+0000 mon.a (mon.0) 828 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-02-13T00:37:53.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:52 smithi106 bash[18459]: audit 2024-02-13T00:37:51.825759+0000 mon.a (mon.0) 829 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:53.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:52 smithi106 bash[18459]: audit 2024-02-13T00:37:51.830882+0000 mon.a (mon.0) 830 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-4", "overlaypool": "test-rados-api-smithi080-54255-4-cache"}]': finished 2024-02-13T00:37:53.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:52 smithi106 bash[18459]: audit 2024-02-13T00:37:51.831066+0000 mon.a (mon.0) 831 : audit [INF] from='client.? 172.21.15.80:0/3268762372' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:53.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:52 smithi106 bash[18459]: audit 2024-02-13T00:37:51.831165+0000 mon.a (mon.0) 832 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi080-54239-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:53.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:52 smithi106 bash[18459]: audit 2024-02-13T00:37:51.831268+0000 mon.a (mon.0) 833 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi080-54175-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:53.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:52 smithi106 bash[18459]: cluster 2024-02-13T00:37:51.831486+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2024-02-13T00:37:53.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:52 smithi106 bash[18459]: audit 2024-02-13T00:37:51.833401+0000 mon.c (mon.2) 122 : audit [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-4-cache", "mode": "writeback"}]: dispatch 2024-02-13T00:37:53.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:52 smithi106 bash[18459]: audit 2024-02-13T00:37:51.834413+0000 mon.c (mon.2) 123 : audit [INF] from='client.? 172.21.15.80:0/3779872273' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:53.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:52 smithi106 bash[18459]: audit 2024-02-13T00:37:51.835796+0000 mon.a (mon.0) 835 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-4-cache", "mode": "writeback"}]: dispatch 2024-02-13T00:37:53.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:52 smithi106 bash[18459]: audit 2024-02-13T00:37:51.836350+0000 mon.a (mon.0) 836 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:53.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:52 smithi106 bash[18459]: audit 2024-02-13T00:37:51.836791+0000 mon.c (mon.2) 124 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:53.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:52 smithi106 bash[18459]: audit 2024-02-13T00:37:51.845760+0000 mon.a (mon.0) 837 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:53.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:52 smithi106 bash[18459]: audit 2024-02-13T00:37:51.889481+0000 mon.c (mon.2) 125 : audit [INF] from='client.? 172.21.15.80:0/286997137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:53.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:52 smithi106 bash[18459]: audit 2024-02-13T00:37:51.889903+0000 mon.a (mon.0) 838 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:53.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:52 smithi106 bash[18459]: audit 2024-02-13T00:37:51.893941+0000 mon.c (mon.2) 126 : audit [INF] from='client.? 172.21.15.80:0/286997137' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:53.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:52 smithi106 bash[18459]: audit 2024-02-13T00:37:51.894628+0000 mon.a (mon.0) 839 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:53.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:52 smithi106 bash[18459]: audit 2024-02-13T00:37:51.897598+0000 mon.c (mon.2) 127 : audit [INF] from='client.? 172.21.15.80:0/286997137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:53.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:52 smithi106 bash[18459]: audit 2024-02-13T00:37:51.898514+0000 mon.a (mon.0) 840 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:37:53.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:52 smithi106 bash[18459]: audit 2024-02-13T00:37:51.946371+0000 mon.a (mon.0) 841 : audit [DBG] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-02-13T00:37:53.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:52 smithi106 bash[18459]: audit 2024-02-13T00:37:51.947382+0000 mon.a (mon.0) 842 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi080-54239-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:53.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:37:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:37:53] "GET /metrics HTTP/1.1" 200 208020 "" "Prometheus/2.33.4" 2024-02-13T00:37:53.829 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN d pool create", "pool": "LibRadosLockEC_smithi080-54223-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:53.830 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.816714+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi080-54231-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:53.830 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.984375+0000 mon.c [INF] from='client.? 172.21.15.80:0/2470845228' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-13T00:37:53.830 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:47.984715+0000 client.admin [INF] threexx 2024-02-13T00:37:53.830 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: got: 2024-02-13T00:37:48.241669+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-13T00:37:53.830 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (10409 ms) 2024-02-13T00:37:53.830 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (24770 ms total) 2024-02-13T00:37:53.830 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: 2024-02-13T00:37:53.830 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: [----------] Global test environment tear-down 2024-02-13T00:37:53.830 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (24770 ms total) 2024-02-13T00:37:53.830 INFO:tasks.workunit.client.0.smithi080.stdout: api_cmd: [ PASSED ] 4 tests. 2024-02-13T00:37:54.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: cluster 2024-02-13T00:37:52.429212+0000 osd.0 (osd.0) 3 : cluster [DBG] 17.1 deep-scrub starts 2024-02-13T00:37:54.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: cluster 2024-02-13T00:37:52.432393+0000 osd.0 (osd.0) 4 : cluster [DBG] 17.1 deep-scrub ok 2024-02-13T00:37:54.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: cluster 2024-02-13T00:37:52.827502+0000 mon.a (mon.0) 843 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:37:54.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:52.827949+0000 mon.a (mon.0) 844 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:52.833171+0000 mon.a (mon.0) 845 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-4-cache", "mode": "writeback"}]': finished 2024-02-13T00:37:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:52.833300+0000 mon.a (mon.0) 846 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:52.833439+0000 mon.a (mon.0) 847 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:52.833696+0000 mon.a (mon.0) 848 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:52.833904+0000 mon.a (mon.0) 849 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi080-54239-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: cluster 2024-02-13T00:37:52.834082+0000 mon.a (mon.0) 850 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2024-02-13T00:37:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:52.835838+0000 mon.b (mon.1) 52 : audit [INF] from='client.? 172.21.15.80:0/1268394734' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:52.837493+0000 mon.c (mon.2) 128 : audit [INF] from='client.? 172.21.15.80:0/4291925045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:52.837748+0000 mon.c (mon.2) 129 : audit [INF] from='client.? 172.21.15.80:0/286997137' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi080-54483-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:52.845663+0000 mon.a (mon.0) 851 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:52.845958+0000 mon.a (mon.0) 852 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:52.846599+0000 mon.a (mon.0) 853 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi080-54199-22"}]: dispatch 2024-02-13T00:37:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:52.846886+0000 mon.a (mon.0) 854 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi080-54483-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:54.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:52.847827+0000 mon.a (mon.0) 855 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi080-54239-1","app": "app2"}]: dispatch 2024-02-13T00:37:54.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:52.849957+0000 mon.a (mon.0) 856 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi080-54239-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:54.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:52.868966+0000 mon.a (mon.0) 857 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi080-54191-15"}]: dispatch 2024-02-13T00:37:54.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: cluster 2024-02-13T00:37:52.869562+0000 mgr.y (mgr.24461) 313 : cluster [DBG] pgmap v245: 564 pgs: 64 creating+peering, 500 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.9 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-02-13T00:37:54.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:52.934051+0000 mon.c (mon.2) 130 : audit [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-4"}]: dispatch 2024-02-13T00:37:54.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:52.936989+0000 mon.c (mon.2) 131 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "pg_num": 4}]: dispatch 2024-02-13T00:37:54.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:53.325799+0000 mon.a (mon.0) 858 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-4"}]: dispatch 2024-02-13T00:37:54.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:53.326153+0000 mon.a (mon.0) 859 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "pg_num": 4}]: dispatch 2024-02-13T00:37:54.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:53.377112+0000 mon.c (mon.2) 132 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:37:54.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:53.677493+0000 mon.c (mon.2) 133 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:37:54.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:53.678743+0000 mon.c (mon.2) 134 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:37:54.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:54 smithi106 bash[18459]: audit 2024-02-13T00:37:53.788524+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:37:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: cluster 2024-02-13T00:37:52.429212+0000 osd.0 (osd.0) 3 : cluster [DBG] 17.1 deep-scrub starts 2024-02-13T00:37:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: cluster 2024-02-13T00:37:52.432393+0000 osd.0 (osd.0) 4 : cluster [DBG] 17.1 deep-scrub ok 2024-02-13T00:37:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: cluster 2024-02-13T00:37:52.827502+0000 mon.a (mon.0) 843 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:37:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:52.827949+0000 mon.a (mon.0) 844 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:52.833171+0000 mon.a (mon.0) 845 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-4-cache", "mode": "writeback"}]': finished 2024-02-13T00:37:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:52.833300+0000 mon.a (mon.0) 846 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:52.833439+0000 mon.a (mon.0) 847 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:52.833696+0000 mon.a (mon.0) 848 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:52.833904+0000 mon.a (mon.0) 849 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi080-54239-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: cluster 2024-02-13T00:37:52.834082+0000 mon.a (mon.0) 850 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2024-02-13T00:37:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:52.835838+0000 mon.b (mon.1) 52 : audit [INF] from='client.? 172.21.15.80:0/1268394734' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:52.837493+0000 mon.c (mon.2) 128 : audit [INF] from='client.? 172.21.15.80:0/4291925045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:54.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:52.837748+0000 mon.c (mon.2) 129 : audit [INF] from='client.? 172.21.15.80:0/286997137' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi080-54483-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:54.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:52.845663+0000 mon.a (mon.0) 851 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:54.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:52.845958+0000 mon.a (mon.0) 852 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: cluster 2024-02-13T00:37:52.429212+0000 osd.0 (osd.0) 3 : cluster [DBG] 17.1 deep-scrub starts 2024-02-13T00:37:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: cluster 2024-02-13T00:37:52.432393+0000 osd.0 (osd.0) 4 : cluster [DBG] 17.1 deep-scrub ok 2024-02-13T00:37:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: cluster 2024-02-13T00:37:52.827502+0000 mon.a (mon.0) 843 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:37:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:52.827949+0000 mon.a (mon.0) 844 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:52.833171+0000 mon.a (mon.0) 845 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-4-cache", "mode": "writeback"}]': finished 2024-02-13T00:37:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:52.833300+0000 mon.a (mon.0) 846 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:52.833439+0000 mon.a (mon.0) 847 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:52.833696+0000 mon.a (mon.0) 848 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:37:54.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:52.833904+0000 mon.a (mon.0) 849 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi080-54239-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:54.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: cluster 2024-02-13T00:37:52.834082+0000 mon.a (mon.0) 850 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2024-02-13T00:37:54.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:52.835838+0000 mon.b (mon.1) 52 : audit [INF] from='client.? 172.21.15.80:0/1268394734' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:54.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:52.837493+0000 mon.c (mon.2) 128 : audit [INF] from='client.? 172.21.15.80:0/4291925045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:54.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:52.837748+0000 mon.c (mon.2) 129 : audit [INF] from='client.? 172.21.15.80:0/286997137' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi080-54483-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:54.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:52.845663+0000 mon.a (mon.0) 851 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:54.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:52.845958+0000 mon.a (mon.0) 852 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:54.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:52.846599+0000 mon.a (mon.0) 853 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi080-54199-22"}]: dispatch 2024-02-13T00:37:54.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:52.846886+0000 mon.a (mon.0) 854 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi080-54483-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:54.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:52.847827+0000 mon.a (mon.0) 855 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi080-54239-1","app": "app2"}]: dispatch 2024-02-13T00:37:54.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:52.849957+0000 mon.a (mon.0) 856 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi080-54239-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:54.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:52.868966+0000 mon.a (mon.0) 857 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi080-54191-15"}]: dispatch 2024-02-13T00:37:54.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: cluster 2024-02-13T00:37:52.869562+0000 mgr.y (mgr.24461) 313 : cluster [DBG] pgmap v245: 564 pgs: 64 creating+peering, 500 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.9 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-02-13T00:37:54.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:52.934051+0000 mon.c (mon.2) 130 : audit [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-4"}]: dispatch 2024-02-13T00:37:54.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:52.936989+0000 mon.c (mon.2) 131 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "pg_num": 4}]: dispatch 2024-02-13T00:37:54.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:53.325799+0000 mon.a (mon.0) 858 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-4"}]: dispatch 2024-02-13T00:37:54.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:53.326153+0000 mon.a (mon.0) 859 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "pg_num": 4}]: dispatch 2024-02-13T00:37:54.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:53.377112+0000 mon.c (mon.2) 132 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:37:54.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:53.677493+0000 mon.c (mon.2) 133 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:37:54.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:53.678743+0000 mon.c (mon.2) 134 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:37:54.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[17386]: audit 2024-02-13T00:37:53.788524+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:37:54.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:52.846599+0000 mon.a (mon.0) 853 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi080-54199-22"}]: dispatch 2024-02-13T00:37:54.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:52.846886+0000 mon.a (mon.0) 854 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi080-54483-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:54.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:52.847827+0000 mon.a (mon.0) 855 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi080-54239-1","app": "app2"}]: dispatch 2024-02-13T00:37:54.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:52.849957+0000 mon.a (mon.0) 856 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi080-54239-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:54.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:52.868966+0000 mon.a (mon.0) 857 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi080-54191-15"}]: dispatch 2024-02-13T00:37:54.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: cluster 2024-02-13T00:37:52.869562+0000 mgr.y (mgr.24461) 313 : cluster [DBG] pgmap v245: 564 pgs: 64 creating+peering, 500 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.9 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-02-13T00:37:54.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:52.934051+0000 mon.c (mon.2) 130 : audit [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-4"}]: dispatch 2024-02-13T00:37:54.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:52.936989+0000 mon.c (mon.2) 131 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "pg_num": 4}]: dispatch 2024-02-13T00:37:54.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:53.325799+0000 mon.a (mon.0) 858 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-4"}]: dispatch 2024-02-13T00:37:54.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:53.326153+0000 mon.a (mon.0) 859 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "pg_num": 4}]: dispatch 2024-02-13T00:37:54.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:53.377112+0000 mon.c (mon.2) 132 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:37:54.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:53.677493+0000 mon.c (mon.2) 133 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:37:54.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:53.678743+0000 mon.c (mon.2) 134 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:37:54.763 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:54 smithi080 bash[24237]: audit 2024-02-13T00:37:53.788524+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:37:55.679 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: Running main() from gmock_main.cc 2024-02-13T00:37:55.679 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [==========] Running 8 tests from 2 test suites. 2024-02-13T00:37:55.679 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [----------] Global test environment set-up. 2024-02-13T00:37:55.680 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [----------] 4 tests from LibRadosStat 2024-02-13T00:37:55.680 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2024-02-13T00:37:55.680 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [ OK ] LibRadosStat.Stat (278 ms) 2024-02-13T00:37:55.680 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2024-02-13T00:37:55.680 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [ OK ] LibRadosStat.StatNS (30 ms) 2024-02-13T00:37:55.680 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2024-02-13T00:37:55.680 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (0 ms) 2024-02-13T00:37:55.680 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2024-02-13T00:37:55.680 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (3 ms) 2024-02-13T00:37:55.680 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [----------] 4 tests from LibRadosStat (311 ms total) 2024-02-13T00:37:55.680 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: 2024-02-13T00:37:55.680 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2024-02-13T00:37:55.680 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2024-02-13T00:37:55.680 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (1091 ms) 2024-02-13T00:37:55.680 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2024-02-13T00:37:55.681 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (19 ms) 2024-02-13T00:37:55.681 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2024-02-13T00:37:55.681 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (0 ms) 2024-02-13T00:37:55.681 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2024-02-13T00:37:55.681 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (4 ms) 2024-02-13T00:37:55.681 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (1114 ms total) 2024-02-13T00:37:55.681 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: 2024-02-13T00:37:55.681 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [----------] Global test environment tear-down 2024-02-13T00:37:55.681 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [==========] 8 tests from 2 test suites ran. (26640 ms total) 2024-02-13T00:37:55.681 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat: [ PASSED ] 8 tests. 2024-02-13T00:37:55.681 INFO:tasks.workunit.client.0.smithi080.stdout: ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-02-13T00:37:55.682 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (5 ms) 2024-02-13T00:37:55.682 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-02-13T00:37:55.682 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (9 ms) 2024-02-13T00:37:55.682 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-02-13T00:37:55.682 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (4 ms) 2024-02-13T00:37:55.682 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-02-13T00:37:55.682 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (8 ms) 2024-02-13T00:37:55.682 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2024-02-13T00:37:55.682 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (7 ms) 2024-02-13T00:37:55.682 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2024-02-13T00:37:55.682 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (4 ms) 2024-02-13T00:37:55.682 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-02-13T00:37:55.682 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (4 ms) 2024-02-13T00:37:55.682 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2024-02-13T00:37:55.682 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (12 ms) 2024-02-13T00:37:55.683 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2024-02-13T00:37:55.683 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (6 ms) 2024-02-13T00:37:55.683 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2024-02-13T00:37:55.683 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (9 ms) 2024-02-13T00:37:55.683 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-02-13T00:37:55.683 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (6 ms) 2024-02-13T00:37:55.683 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-02-13T00:37:55.683 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (8 ms) 2024-02-13T00:37:55.683 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (774 ms total) 2024-02-13T00:37:55.683 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: 2024-02-13T00:37:55.683 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [----------] Global test environment tear-down 2024-02-13T00:37:55.683 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (26742 ms total) 2024-02-13T00:37:55.683 INFO:tasks.workunit.client.0.smithi080.stdout: api_io_pp: [ PASSED ] 37 tests. 2024-02-13T00:37:55.684 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: Running main() from gmock_main.cc 2024-02-13T00:37:55.684 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [==========] Running 23 tests from 2 test suites. 2024-02-13T00:37:55.684 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [----------] Global test environment set-up. 2024-02-13T00:37:55.684 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [----------] 13 tests from LibRadosIo 2024-02-13T00:37:55.684 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2024-02-13T00:37:55.684 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (294 ms) 2024-02-13T00:37:55.685 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2024-02-13T00:37:55.685 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2024-02-13T00:37:55.685 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2024-02-13T00:37:55.685 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: no timeout :/ 2024-02-13T00:37:55.685 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: no timeout :/ 2024-02-13T00:37:55.685 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: no timeout :/ 2024-02-13T00:37:55.685 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: no timeout :/ 2024-02-13T00:37:55.685 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: no timeout :/ 2024-02-13T00:37:55.685 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (50 ms) 2024-02-13T00:37:55.685 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2024-02-13T00:37:55.685 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (11 ms) 2024-02-13T00:37:55.685 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2024-02-13T00:37:55.685 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIo.Checksum (4 ms) 2024-02-13T00:37:55.685 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-02-13T00:37:55.685 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (13 ms) 2024-02-13T00:37:55.685 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2024-02-13T00:37:55.686 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (4 ms) 2024-02-13T00:37:55.686 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2024-02-13T00:37:55.686 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (10 ms) 2024-02-13T00:37:55.686 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2024-02-13T00:37:55.686 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIo.TruncTest (5 ms) 2024-02-13T00:37:55.686 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2024-02-13T00:37:55.686 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (6 ms) 2024-02-13T00:37:55.686 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2024-02-13T00:37:55.686 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (5 ms) 2024-02-13T00:37:55.686 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2024-02-13T00:37:55.686 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIo.RmXattr (15 ms) 2024-02-13T00:37:55.686 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2024-02-13T00:37:55.686 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIo.XattrIter (8 ms) 2024-02-13T00:37:55.686 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [----------] 13 tests from LibRadosIo (425 ms total) 2024-02-13T00:37:55.686 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: 2024-02-13T00:37:55.686 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2024-02-13T00:37:55.687 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2024-02-13T00:37:55.687 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (668 ms) 2024-02-13T00:37:55.687 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2024-02-13T00:37:55.687 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (11 ms) 2024-02-13T00:37:55.687 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-02-13T00:37:55.687 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (9 ms) 2024-02-13T00:37:55.687 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-02-13T00:37:55.687 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (7 ms) 2024-02-13T00:37:55.687 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2024-02-13T00:37:55.687 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (10 ms) 2024-02-13T00:37:55.687 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2024-02-13T00:37:55.687 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (8 ms) 2024-02-13T00:37:55.687 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2024-02-13T00:37:55.687 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (5 ms) 2024-02-13T00:37:55.687 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-02-13T00:37:55.688 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (8 ms) 2024-02-13T00:37:55.688 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2024-02-13T00:37:55.688 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (14 ms) 2024-02-13T00:37:55.688 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2024-02-13T00:37:55.688 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (7 ms) 2024-02-13T00:37:55.688 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [----------] 10 tests from LibRadosIoEC (747 ms total) 2024-02-13T00:37:55.688 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: 2024-02-13T00:37:55.688 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [----------] Global test environment tear-down 2024-02-13T00:37:55.688 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [==========] 23 tests from 2 test suites ran. (26744 ms total) 2024-02-13T00:37:55.688 INFO:tasks.workunit.client.0.smithi080.stdout: api_io: [ PASSED ] 23 tests. 2024-02-13T00:37:55.703 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: Running main() from gmock_main.cc 2024-02-13T00:37:55.703 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2024-02-13T00:37:55.703 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [----------] Global test environment set-up. 2024-02-13T00:37:55.703 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2024-02-13T00:37:55.703 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: seed 54474 2024-02-13T00:37:55.703 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2024-02-13T00:37:55.703 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (209 ms) 2024-02-13T00:37:55.703 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-02-13T00:37:55.703 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (5 ms) 2024-02-13T00:37:55.703 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2024-02-13T00:37:55.703 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2024-02-13T00:37:55.704 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2024-02-13T00:37:55.704 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (4 ms) 2024-02-13T00:37:55.704 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2024-02-13T00:37:55.704 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (101 ms) 2024-02-13T00:37:55.704 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (319 ms total) 2024-02-13T00:37:55.704 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: 2024-02-13T00:37:55.704 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2024-02-13T00:37:55.704 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2024-02-13T00:37:55.704 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1114 ms) 2024-02-13T00:37:55.704 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2024-02-13T00:37:55.704 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (1 ms) 2024-02-13T00:37:55.704 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2024-02-13T00:37:55.704 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (4 ms) 2024-02-13T00:37:55.704 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2024-02-13T00:37:55.704 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (10 ms) 2024-02-13T00:37:55.705 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (1129 ms total) 2024-02-13T00:37:55.705 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: 2024-02-13T00:37:55.705 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [----------] Global test environment tear-down 2024-02-13T00:37:55.705 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (26664 ms total) 2024-02-13T00:37:55.705 INFO:tasks.workunit.client.0.smithi080.stdout: api_stat_pp: [ PASSED ] 9 tests. 2024-02-13T00:37:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: cluster 2024-02-13T00:37:53.400337+0000 osd.0 (osd.0) 5 : cluster [DBG] 17.4 deep-scrub starts 2024-02-13T00:37:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: cluster 2024-02-13T00:37:53.404425+0000 osd.0 (osd.0) 6 : cluster [DBG] 17.4 deep-scrub ok 2024-02-13T00:37:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: cluster 2024-02-13T00:37:53.681381+0000 mgr.y (mgr.24461) 314 : cluster [DBG] pgmap v246: 564 pgs: 64 creating+peering, 500 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.9 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-02-13T00:37:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: cluster 2024-02-13T00:37:54.257551+0000 mon.a (mon.0) 861 : cluster [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-02-13T00:37:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.260345+0000 mon.a (mon.0) 862 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.275869+0000 mon.a (mon.0) 863 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7"}]': finished 2024-02-13T00:37:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.275979+0000 mon.a (mon.0) 864 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi080-54478-6"}]': finished 2024-02-13T00:37:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.276080+0000 mon.a (mon.0) 865 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi080-54199-22"}]': finished 2024-02-13T00:37:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.276907+0000 mon.c (mon.2) 135 : audit [INF] from='client.? 172.21.15.80:0/4291925045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.278094+0000 mon.b (mon.1) 53 : audit [INF] from='client.? 172.21.15.80:0/1268394734' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.722497+0000 mon.a (mon.0) 866 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi080-54239-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.722581+0000 mon.a (mon.0) 867 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi080-54191-15"}]': finished 2024-02-13T00:37:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.722649+0000 mon.a (mon.0) 868 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-4"}]': finished 2024-02-13T00:37:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.722692+0000 mon.a (mon.0) 869 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "pg_num": 4}]': finished 2024-02-13T00:37:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: cluster 2024-02-13T00:37:54.723023+0000 mon.a (mon.0) 870 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2024-02-13T00:37:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.724135+0000 mon.c (mon.2) 136 : audit [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-4", "tierpool": "test-rados-api-smithi080-54255-4-cache"}]: dispatch 2024-02-13T00:37:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.724487+0000 mon.c (mon.2) 137 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:37:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.725142+0000 mon.b (mon.1) 54 : audit [INF] from='client.? 172.21.15.80:0/810994986' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.730111+0000 mon.a (mon.0) 871 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi080-54191-15"}]: dispatch 2024-02-13T00:37:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.731333+0000 mon.a (mon.0) 872 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi080-54199-22"}]: dispatch 2024-02-13T00:37:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.731708+0000 mon.a (mon.0) 873 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.731955+0000 mon.a (mon.0) 874 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.733036+0000 mon.a (mon.0) 875 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-4", "tierpool": "test-rados-api-smithi080-54255-4-cache"}]: dispatch 2024-02-13T00:37:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.733604+0000 mon.a (mon.0) 876 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:37:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.734619+0000 mon.a (mon.0) 877 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi080-54239-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-02-13T00:37:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.734929+0000 mon.a (mon.0) 878 : audit [INF] from='client.? 172.21.15.80:0/4093273256' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi080-54175-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.735224+0000 mon.a (mon.0) 879 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:55 smithi106 bash[18459]: audit 2024-02-13T00:37:54.735524+0000 mon.a (mon.0) 880 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi080-54239-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-13T00:37:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: cluster 2024-02-13T00:37:53.400337+0000 osd.0 (osd.0) 5 : cluster [DBG] 17.4 deep-scrub starts 2024-02-13T00:37:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: cluster 2024-02-13T00:37:53.404425+0000 osd.0 (osd.0) 6 : cluster [DBG] 17.4 deep-scrub ok 2024-02-13T00:37:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: cluster 2024-02-13T00:37:53.681381+0000 mgr.y (mgr.24461) 314 : cluster [DBG] pgmap v246: 564 pgs: 64 creating+peering, 500 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.9 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-02-13T00:37:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: cluster 2024-02-13T00:37:54.257551+0000 mon.a (mon.0) 861 : cluster [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-02-13T00:37:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.260345+0000 mon.a (mon.0) 862 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.275869+0000 mon.a (mon.0) 863 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7"}]': finished 2024-02-13T00:37:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.275979+0000 mon.a (mon.0) 864 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi080-54478-6"}]': finished 2024-02-13T00:37:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.276080+0000 mon.a (mon.0) 865 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi080-54199-22"}]': finished 2024-02-13T00:37:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.276907+0000 mon.c (mon.2) 135 : audit [INF] from='client.? 172.21.15.80:0/4291925045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.278094+0000 mon.b (mon.1) 53 : audit [INF] from='client.? 172.21.15.80:0/1268394734' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.722497+0000 mon.a (mon.0) 866 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi080-54239-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:56.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.722581+0000 mon.a (mon.0) 867 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi080-54191-15"}]': finished 2024-02-13T00:37:56.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.722649+0000 mon.a (mon.0) 868 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-4"}]': finished 2024-02-13T00:37:56.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.722692+0000 mon.a (mon.0) 869 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "pg_num": 4}]': finished 2024-02-13T00:37:56.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: cluster 2024-02-13T00:37:54.723023+0000 mon.a (mon.0) 870 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2024-02-13T00:37:56.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.724135+0000 mon.c (mon.2) 136 : audit [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-4", "tierpool": "test-rados-api-smithi080-54255-4-cache"}]: dispatch 2024-02-13T00:37:56.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: cluster 2024-02-13T00:37:53.400337+0000 osd.0 (osd.0) 5 : cluster [DBG] 17.4 deep-scrub starts 2024-02-13T00:37:56.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: cluster 2024-02-13T00:37:53.404425+0000 osd.0 (osd.0) 6 : cluster [DBG] 17.4 deep-scrub ok 2024-02-13T00:37:56.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: cluster 2024-02-13T00:37:53.681381+0000 mgr.y (mgr.24461) 314 : cluster [DBG] pgmap v246: 564 pgs: 64 creating+peering, 500 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.9 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-02-13T00:37:56.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: cluster 2024-02-13T00:37:54.257551+0000 mon.a (mon.0) 861 : cluster [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-02-13T00:37:56.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.260345+0000 mon.a (mon.0) 862 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:56.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.275869+0000 mon.a (mon.0) 863 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi080-54474-7"}]': finished 2024-02-13T00:37:56.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.275979+0000 mon.a (mon.0) 864 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi080-54478-6"}]': finished 2024-02-13T00:37:56.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.276080+0000 mon.a (mon.0) 865 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi080-54199-22"}]': finished 2024-02-13T00:37:56.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.276907+0000 mon.c (mon.2) 135 : audit [INF] from='client.? 172.21.15.80:0/4291925045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:56.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.278094+0000 mon.b (mon.1) 53 : audit [INF] from='client.? 172.21.15.80:0/1268394734' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:56.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.722497+0000 mon.a (mon.0) 866 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi080-54239-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:56.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.722581+0000 mon.a (mon.0) 867 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi080-54191-15"}]': finished 2024-02-13T00:37:56.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.722649+0000 mon.a (mon.0) 868 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-4"}]': finished 2024-02-13T00:37:56.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.722692+0000 mon.a (mon.0) 869 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "pg_num": 4}]': finished 2024-02-13T00:37:56.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: cluster 2024-02-13T00:37:54.723023+0000 mon.a (mon.0) 870 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2024-02-13T00:37:56.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.724135+0000 mon.c (mon.2) 136 : audit [INF] from='client.? 172.21.15.80:0/2960368632' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-4", "tierpool": "test-rados-api-smithi080-54255-4-cache"}]: dispatch 2024-02-13T00:37:56.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.724487+0000 mon.c (mon.2) 137 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:37:56.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.725142+0000 mon.b (mon.1) 54 : audit [INF] from='client.? 172.21.15.80:0/810994986' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:56.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.730111+0000 mon.a (mon.0) 871 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi080-54191-15"}]: dispatch 2024-02-13T00:37:56.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.731333+0000 mon.a (mon.0) 872 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi080-54199-22"}]: dispatch 2024-02-13T00:37:56.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.731708+0000 mon.a (mon.0) 873 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:56.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.731955+0000 mon.a (mon.0) 874 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:56.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.733036+0000 mon.a (mon.0) 875 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-4", "tierpool": "test-rados-api-smithi080-54255-4-cache"}]: dispatch 2024-02-13T00:37:56.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.733604+0000 mon.a (mon.0) 876 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:37:56.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.734619+0000 mon.a (mon.0) 877 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi080-54239-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-02-13T00:37:56.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.734929+0000 mon.a (mon.0) 878 : audit [INF] from='client.? 172.21.15.80:0/4093273256' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi080-54175-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:56.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.735224+0000 mon.a (mon.0) 879 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:56.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[17386]: audit 2024-02-13T00:37:54.735524+0000 mon.a (mon.0) 880 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi080-54239-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-13T00:37:56.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.724487+0000 mon.c (mon.2) 137 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:37:56.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.725142+0000 mon.b (mon.1) 54 : audit [INF] from='client.? 172.21.15.80:0/810994986' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:56.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.730111+0000 mon.a (mon.0) 871 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi080-54191-15"}]: dispatch 2024-02-13T00:37:56.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.731333+0000 mon.a (mon.0) 872 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi080-54199-22"}]: dispatch 2024-02-13T00:37:56.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.731708+0000 mon.a (mon.0) 873 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi080-54474-7"}]: dispatch 2024-02-13T00:37:56.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.731955+0000 mon.a (mon.0) 874 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi080-54478-6"}]: dispatch 2024-02-13T00:37:56.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.733036+0000 mon.a (mon.0) 875 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-4", "tierpool": "test-rados-api-smithi080-54255-4-cache"}]: dispatch 2024-02-13T00:37:56.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.733604+0000 mon.a (mon.0) 876 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:37:56.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.734619+0000 mon.a (mon.0) 877 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi080-54239-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-02-13T00:37:56.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.734929+0000 mon.a (mon.0) 878 : audit [INF] from='client.? 172.21.15.80:0/4093273256' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi080-54175-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:56.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.735224+0000 mon.a (mon.0) 879 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:56.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:55 smithi080 bash[24237]: audit 2024-02-13T00:37:54.735524+0000 mon.a (mon.0) 880 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi080-54239-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-13T00:37:57.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: cluster 2024-02-13T00:37:55.649858+0000 mon.a (mon.0) 881 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:37:57.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:55.650030+0000 mon.a (mon.0) 882 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:57.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:55.665344+0000 mon.a (mon.0) 883 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi080-54483-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]': finished 2024-02-13T00:37:57.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:55.666045+0000 mon.a (mon.0) 884 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi080-54191-15"}]': finished 2024-02-13T00:37:57.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:55.666208+0000 mon.a (mon.0) 885 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi080-54199-22"}]': finished 2024-02-13T00:37:57.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:55.666357+0000 mon.a (mon.0) 886 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi080-54474-7"}]': finished 2024-02-13T00:37:57.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:55.667090+0000 mon.a (mon.0) 887 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi080-54478-6"}]': finished 2024-02-13T00:37:57.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:55.667288+0000 mon.a (mon.0) 888 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-4", "tierpool": "test-rados-api-smithi080-54255-4-cache"}]': finished 2024-02-13T00:37:57.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:55.668106+0000 mon.a (mon.0) 889 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:37:57.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:55.668499+0000 mon.a (mon.0) 890 : audit [INF] from='client.? 172.21.15.80:0/4093273256' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi080-54175-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:57.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:55.668659+0000 mon.a (mon.0) 891 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:57.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:55.668768+0000 mon.a (mon.0) 892 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi080-54239-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-02-13T00:37:57.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: cluster 2024-02-13T00:37:55.669034+0000 mon.a (mon.0) 893 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2024-02-13T00:37:57.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:55.673475+0000 mon.c (mon.2) 138 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "overlaypool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6"}]: dispatch 2024-02-13T00:37:57.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:55.674969+0000 mon.a (mon.0) 894 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "overlaypool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6"}]: dispatch 2024-02-13T00:37:57.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:55.678230+0000 mon.a (mon.0) 895 : audit [INF] from='client.? 172.21.15.80:0/1424451315' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:57.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:55.678396+0000 mon.c (mon.2) 139 : audit [INF] from='client.? 172.21.15.80:0/1001960027' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi080-54340-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:57.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:55.679044+0000 mon.a (mon.0) 896 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi080-54340-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:57.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: cluster 2024-02-13T00:37:55.682023+0000 mgr.y (mgr.24461) 315 : cluster [DBG] pgmap v249: 624 pgs: 140 unknown, 32 creating+peering, 452 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.1 KiB/s rd, 6.2 KiB/s wr, 4 op/s 2024-02-13T00:37:57.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:55.694772+0000 mon.b (mon.1) 55 : audit [INF] from='client.? 172.21.15.80:0/2427324406' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:57.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:55.695941+0000 mon.a (mon.0) 897 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:57.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:55.697252+0000 mon.a (mon.0) 898 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi080-54239-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-13T00:37:57.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:55.698239+0000 mon.b (mon.1) 56 : audit [INF] from='client.? 172.21.15.80:0/3543275486' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:57.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:55.698933+0000 mon.a (mon.0) 899 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:57.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: cluster 2024-02-13T00:37:56.280228+0000 mon.a (mon.0) 900 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:37:57.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: cluster 2024-02-13T00:37:56.280766+0000 mon.a (mon.0) 901 : cluster [WRN] pool 'PoolQuotaPP_smithi080-54183-3' is full (reached quota's max_bytes: 4 KiB) 2024-02-13T00:37:57.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: cluster 2024-02-13T00:37:56.282234+0000 mon.a (mon.0) 902 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T00:37:57.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:56.288775+0000 mon.a (mon.0) 903 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "overlaypool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6"}]': finished 2024-02-13T00:37:57.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:56.288975+0000 mon.a (mon.0) 904 : audit [INF] from='client.? 172.21.15.80:0/1424451315' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:57.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:56.289099+0000 mon.a (mon.0) 905 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi080-54340-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:57.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:56.289372+0000 mon.a (mon.0) 906 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi080-54223-10"}]': finished 2024-02-13T00:37:57.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:56.289559+0000 mon.a (mon.0) 907 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi080-54239-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-02-13T00:37:57.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:56.289705+0000 mon.a (mon.0) 908 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10"}]': finished 2024-02-13T00:37:57.258 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: cluster 2024-02-13T00:37:56.289996+0000 mon.a (mon.0) 909 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2024-02-13T00:37:57.259 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:56.293671+0000 mon.b (mon.1) 57 : audit [INF] from='client.? 172.21.15.80:0/2427324406' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:57.259 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:56.294293+0000 mon.b (mon.1) 58 : audit [INF] from='client.? 172.21.15.80:0/3543275486' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:57.259 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:56.298433+0000 mon.a (mon.0) 910 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:57.259 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:56.303369+0000 mon.a (mon.0) 911 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:57.259 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:56.304630+0000 mon.a (mon.0) 912 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi080-54239-1","app":"app1","key":"key1"}]: dispatch 2024-02-13T00:37:57.259 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:56.308232+0000 mon.c (mon.2) 140 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "mode": "writeback"}]: dispatch 2024-02-13T00:37:57.259 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:56 smithi106 bash[18459]: audit 2024-02-13T00:37:56.316412+0000 mon.a (mon.0) 913 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "mode": "writeback"}]: dispatch 2024-02-13T00:37:57.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: cluster 2024-02-13T00:37:55.649858+0000 mon.a (mon.0) 881 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:37:57.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:55.650030+0000 mon.a (mon.0) 882 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:57.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:55.665344+0000 mon.a (mon.0) 883 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi080-54483-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]': finished 2024-02-13T00:37:57.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:55.666045+0000 mon.a (mon.0) 884 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi080-54191-15"}]': finished 2024-02-13T00:37:57.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:55.666208+0000 mon.a (mon.0) 885 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi080-54199-22"}]': finished 2024-02-13T00:37:57.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:55.666357+0000 mon.a (mon.0) 886 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi080-54474-7"}]': finished 2024-02-13T00:37:57.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:55.667090+0000 mon.a (mon.0) 887 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi080-54478-6"}]': finished 2024-02-13T00:37:57.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:55.667288+0000 mon.a (mon.0) 888 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-4", "tierpool": "test-rados-api-smithi080-54255-4-cache"}]': finished 2024-02-13T00:37:57.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:55.668106+0000 mon.a (mon.0) 889 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:37:57.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:55.668499+0000 mon.a (mon.0) 890 : audit [INF] from='client.? 172.21.15.80:0/4093273256' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi080-54175-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:57.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:55.668659+0000 mon.a (mon.0) 891 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:57.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:55.668768+0000 mon.a (mon.0) 892 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi080-54239-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-02-13T00:37:57.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: cluster 2024-02-13T00:37:55.669034+0000 mon.a (mon.0) 893 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2024-02-13T00:37:57.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:55.673475+0000 mon.c (mon.2) 138 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "overlaypool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6"}]: dispatch 2024-02-13T00:37:57.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:55.674969+0000 mon.a (mon.0) 894 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "overlaypool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6"}]: dispatch 2024-02-13T00:37:57.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:55.678230+0000 mon.a (mon.0) 895 : audit [INF] from='client.? 172.21.15.80:0/1424451315' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:57.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:55.678396+0000 mon.c (mon.2) 139 : audit [INF] from='client.? 172.21.15.80:0/1001960027' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi080-54340-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:57.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:55.679044+0000 mon.a (mon.0) 896 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi080-54340-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:57.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: cluster 2024-02-13T00:37:55.682023+0000 mgr.y (mgr.24461) 315 : cluster [DBG] pgmap v249: 624 pgs: 140 unknown, 32 creating+peering, 452 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.1 KiB/s rd, 6.2 KiB/s wr, 4 op/s 2024-02-13T00:37:57.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:55.694772+0000 mon.b (mon.1) 55 : audit [INF] from='client.? 172.21.15.80:0/2427324406' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:57.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:55.695941+0000 mon.a (mon.0) 897 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:57.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:55.697252+0000 mon.a (mon.0) 898 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi080-54239-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-13T00:37:57.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:55.698239+0000 mon.b (mon.1) 56 : audit [INF] from='client.? 172.21.15.80:0/3543275486' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:57.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:55.698933+0000 mon.a (mon.0) 899 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:57.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: cluster 2024-02-13T00:37:56.280228+0000 mon.a (mon.0) 900 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:37:57.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: cluster 2024-02-13T00:37:56.280766+0000 mon.a (mon.0) 901 : cluster [WRN] pool 'PoolQuotaPP_smithi080-54183-3' is full (reached quota's max_bytes: 4 KiB) 2024-02-13T00:37:57.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: cluster 2024-02-13T00:37:56.282234+0000 mon.a (mon.0) 902 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T00:37:57.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:56.288775+0000 mon.a (mon.0) 903 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "overlaypool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6"}]': finished 2024-02-13T00:37:57.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:56.288975+0000 mon.a (mon.0) 904 : audit [INF] from='client.? 172.21.15.80:0/1424451315' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:57.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:56.289099+0000 mon.a (mon.0) 905 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi080-54340-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:57.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:56.289372+0000 mon.a (mon.0) 906 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi080-54223-10"}]': finished 2024-02-13T00:37:57.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:56.289559+0000 mon.a (mon.0) 907 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi080-54239-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-02-13T00:37:57.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:56.289705+0000 mon.a (mon.0) 908 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10"}]': finished 2024-02-13T00:37:57.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: cluster 2024-02-13T00:37:56.289996+0000 mon.a (mon.0) 909 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2024-02-13T00:37:57.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:56.293671+0000 mon.b (mon.1) 57 : audit [INF] from='client.? 172.21.15.80:0/2427324406' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:57.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:56.294293+0000 mon.b (mon.1) 58 : audit [INF] from='client.? 172.21.15.80:0/3543275486' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:57.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:56.298433+0000 mon.a (mon.0) 910 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:57.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:56.303369+0000 mon.a (mon.0) 911 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:57.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:56.304630+0000 mon.a (mon.0) 912 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi080-54239-1","app":"app1","key":"key1"}]: dispatch 2024-02-13T00:37:57.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:56.308232+0000 mon.c (mon.2) 140 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "mode": "writeback"}]: dispatch 2024-02-13T00:37:57.262 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[17386]: audit 2024-02-13T00:37:56.316412+0000 mon.a (mon.0) 913 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "mode": "writeback"}]: dispatch 2024-02-13T00:37:57.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: cluster 2024-02-13T00:37:55.649858+0000 mon.a (mon.0) 881 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:37:57.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:55.650030+0000 mon.a (mon.0) 882 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:57.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:55.665344+0000 mon.a (mon.0) 883 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi080-54483-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]': finished 2024-02-13T00:37:57.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:55.666045+0000 mon.a (mon.0) 884 : audit [INF] from='client.? 172.21.15.80:0/2811987737' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi080-54191-15"}]': finished 2024-02-13T00:37:57.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:55.666208+0000 mon.a (mon.0) 885 : audit [INF] from='client.? 172.21.15.80:0/3584275864' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi080-54199-22"}]': finished 2024-02-13T00:37:57.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:55.666357+0000 mon.a (mon.0) 886 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi080-54474-7"}]': finished 2024-02-13T00:37:57.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:55.667090+0000 mon.a (mon.0) 887 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi080-54478-6"}]': finished 2024-02-13T00:37:57.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:55.667288+0000 mon.a (mon.0) 888 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-4", "tierpool": "test-rados-api-smithi080-54255-4-cache"}]': finished 2024-02-13T00:37:57.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:55.668106+0000 mon.a (mon.0) 889 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:37:57.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:55.668499+0000 mon.a (mon.0) 890 : audit [INF] from='client.? 172.21.15.80:0/4093273256' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi080-54175-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:57.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:55.668659+0000 mon.a (mon.0) 891 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:57.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:55.668768+0000 mon.a (mon.0) 892 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi080-54239-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-02-13T00:37:57.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: cluster 2024-02-13T00:37:55.669034+0000 mon.a (mon.0) 893 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2024-02-13T00:37:57.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:55.673475+0000 mon.c (mon.2) 138 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "overlaypool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6"}]: dispatch 2024-02-13T00:37:57.263 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:55.674969+0000 mon.a (mon.0) 894 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "overlaypool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6"}]: dispatch 2024-02-13T00:37:57.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:55.678230+0000 mon.a (mon.0) 895 : audit [INF] from='client.? 172.21.15.80:0/1424451315' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:57.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:55.678396+0000 mon.c (mon.2) 139 : audit [INF] from='client.? 172.21.15.80:0/1001960027' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi080-54340-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:57.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:55.679044+0000 mon.a (mon.0) 896 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi080-54340-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:57.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: cluster 2024-02-13T00:37:55.682023+0000 mgr.y (mgr.24461) 315 : cluster [DBG] pgmap v249: 624 pgs: 140 unknown, 32 creating+peering, 452 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 2.1 KiB/s rd, 6.2 KiB/s wr, 4 op/s 2024-02-13T00:37:57.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:55.694772+0000 mon.b (mon.1) 55 : audit [INF] from='client.? 172.21.15.80:0/2427324406' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:57.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:55.695941+0000 mon.a (mon.0) 897 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:57.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:55.697252+0000 mon.a (mon.0) 898 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi080-54239-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-13T00:37:57.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:55.698239+0000 mon.b (mon.1) 56 : audit [INF] from='client.? 172.21.15.80:0/3543275486' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:57.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:55.698933+0000 mon.a (mon.0) 899 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:57.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: cluster 2024-02-13T00:37:56.280228+0000 mon.a (mon.0) 900 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:37:57.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: cluster 2024-02-13T00:37:56.280766+0000 mon.a (mon.0) 901 : cluster [WRN] pool 'PoolQuotaPP_smithi080-54183-3' is full (reached quota's max_bytes: 4 KiB) 2024-02-13T00:37:57.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: cluster 2024-02-13T00:37:56.282234+0000 mon.a (mon.0) 902 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T00:37:57.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:56.288775+0000 mon.a (mon.0) 903 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "overlaypool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6"}]': finished 2024-02-13T00:37:57.264 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:56.288975+0000 mon.a (mon.0) 904 : audit [INF] from='client.? 172.21.15.80:0/1424451315' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:57.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:56.289099+0000 mon.a (mon.0) 905 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi080-54340-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:57.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:56.289372+0000 mon.a (mon.0) 906 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi080-54223-10"}]': finished 2024-02-13T00:37:57.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:56.289559+0000 mon.a (mon.0) 907 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi080-54239-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-02-13T00:37:57.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:56.289705+0000 mon.a (mon.0) 908 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi080-54231-10"}]': finished 2024-02-13T00:37:57.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: cluster 2024-02-13T00:37:56.289996+0000 mon.a (mon.0) 909 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2024-02-13T00:37:57.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:56.293671+0000 mon.b (mon.1) 57 : audit [INF] from='client.? 172.21.15.80:0/2427324406' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:57.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:56.294293+0000 mon.b (mon.1) 58 : audit [INF] from='client.? 172.21.15.80:0/3543275486' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:57.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:56.298433+0000 mon.a (mon.0) 910 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi080-54223-10"}]: dispatch 2024-02-13T00:37:57.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:56.303369+0000 mon.a (mon.0) 911 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi080-54231-10"}]: dispatch 2024-02-13T00:37:57.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:56.304630+0000 mon.a (mon.0) 912 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi080-54239-1","app":"app1","key":"key1"}]: dispatch 2024-02-13T00:37:57.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:56.308232+0000 mon.c (mon.2) 140 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "mode": "writeback"}]: dispatch 2024-02-13T00:37:57.265 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:56 smithi080 bash[24237]: audit 2024-02-13T00:37:56.316412+0000 mon.a (mon.0) 913 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "mode": "writeback"}]: dispatch 2024-02-13T00:37:57.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: Running main() from gmock_main.cc 2024-02-13T00:37:57.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2024-02-13T00:37:57.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [----------] Global test environment set-up. 2024-02-13T00:37:57.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2024-02-13T00:37:57.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: seed 54231 2024-02-13T00:37:57.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2024-02-13T00:37:57.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (280 ms) 2024-02-13T00:37:57.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2024-02-13T00:37:57.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (11 ms) 2024-02-13T00:37:57.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-02-13T00:37:57.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1007 ms) 2024-02-13T00:37:57.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2024-02-13T00:37:57.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1007 ms) 2024-02-13T00:37:57.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2024-02-13T00:37:57.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (6 ms) 2024-02-13T00:37:57.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2024-02-13T00:37:57.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (6 ms) 2024-02-13T00:37:57.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2024-02-13T00:37:57.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (6 ms) 2024-02-13T00:37:57.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2024-02-13T00:37:57.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (5 ms) 2024-02-13T00:37:57.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (2328 ms total) 2024-02-13T00:37:57.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: 2024-02-13T00:37:57.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2024-02-13T00:37:57.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2024-02-13T00:37:57.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (1112 ms) 2024-02-13T00:37:57.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2024-02-13T00:37:57.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (4 ms) 2024-02-13T00:37:57.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-02-13T00:37:57.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1086 ms) 2024-02-13T00:37:57.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-02-13T00:37:57.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1007 ms) 2024-02-13T00:37:57.320 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-02-13T00:37:57.320 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (6 ms) 2024-02-13T00:37:57.320 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2024-02-13T00:37:57.320 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (7 ms) 2024-02-13T00:37:57.320 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2024-02-13T00:37:57.320 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (8 ms) 2024-02-13T00:37:57.320 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2024-02-13T00:37:57.320 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (5 ms) 2024-02-13T00:37:57.320 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (3235 ms total) 2024-02-13T00:37:57.320 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: 2024-02-13T00:37:57.320 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [----------] Global test environment tear-down 2024-02-13T00:37:57.320 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (28369 ms total) 2024-02-13T00:37:57.321 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock_pp: [ PASSED ] 16 tests. 2024-02-13T00:37:57.321 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: Running main() from gmock_main.cc 2024-02-13T00:37:57.321 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2024-02-13T00:37:57.321 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [----------] Global test environment set-up. 2024-02-13T00:37:57.321 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [----------] 8 tests from LibRadosLock 2024-02-13T00:37:57.321 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2024-02-13T00:37:57.321 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (55 ms) 2024-02-13T00:37:57.321 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2024-02-13T00:37:57.321 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ OK ] LibRadosLock.LockShared (2 ms) 2024-02-13T00:37:57.321 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2024-02-13T00:37:57.321 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1140 ms) 2024-02-13T00:37:57.321 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2024-02-13T00:37:57.321 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1107 ms) 2024-02-13T00:37:57.321 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2024-02-13T00:37:57.321 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (7 ms) 2024-02-13T00:37:57.322 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2024-02-13T00:37:57.322 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ OK ] LibRadosLock.Unlock (6 ms) 2024-02-13T00:37:57.322 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2024-02-13T00:37:57.322 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (8 ms) 2024-02-13T00:37:57.322 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2024-02-13T00:37:57.322 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (4 ms) 2024-02-13T00:37:57.322 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [----------] 8 tests from LibRadosLock (2329 ms total) 2024-02-13T00:37:57.322 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: 2024-02-13T00:37:57.322 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2024-02-13T00:37:57.322 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2024-02-13T00:37:57.322 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (1099 ms) 2024-02-13T00:37:57.322 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2024-02-13T00:37:57.322 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (11 ms) 2024-02-13T00:37:57.322 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2024-02-13T00:37:57.322 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1079 ms) 2024-02-13T00:37:57.323 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2024-02-13T00:37:57.323 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1009 ms) 2024-02-13T00:37:57.323 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2024-02-13T00:37:57.323 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (6 ms) 2024-02-13T00:37:57.323 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2024-02-13T00:37:57.323 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (7 ms) 2024-02-13T00:37:57.323 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2024-02-13T00:37:57.323 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (8 ms) 2024-02-13T00:37:57.323 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2024-02-13T00:37:57.323 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (4 ms) 2024-02-13T00:37:57.323 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (3223 ms total) 2024-02-13T00:37:57.323 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: 2024-02-13T00:37:57.323 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [----------] Global test environment tear-down 2024-02-13T00:37:57.323 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (28376 ms total) 2024-02-13T00:37:57.323 INFO:tasks.workunit.client.0.smithi080.stdout: api_lock: [ PASSED ] 16 tests. 2024-02-13T00:37:57.858 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[17386]: audit 2024-02-13T00:37:56.808241+0000 mon.a (mon.0) 914 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:57.858 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[17386]: cluster 2024-02-13T00:37:57.287133+0000 mon.a (mon.0) 915 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:37:57.859 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[17386]: audit 2024-02-13T00:37:57.305251+0000 mon.a (mon.0) 916 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi080-54223-10"}]': finished 2024-02-13T00:37:57.859 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[17386]: audit 2024-02-13T00:37:57.305338+0000 mon.a (mon.0) 917 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi080-54231-10"}]': finished 2024-02-13T00:37:57.859 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[17386]: audit 2024-02-13T00:37:57.305408+0000 mon.a (mon.0) 918 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi080-54239-1","app":"app1","key":"key1"}]': finished 2024-02-13T00:37:57.859 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[17386]: audit 2024-02-13T00:37:57.305468+0000 mon.a (mon.0) 919 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "mode": "writeback"}]': finished 2024-02-13T00:37:57.859 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[17386]: cluster 2024-02-13T00:37:57.306323+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2024-02-13T00:37:57.859 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[17386]: audit 2024-02-13T00:37:57.308726+0000 mon.c (mon.2) 141 : audit [INF] from='client.? 172.21.15.80:0/286997137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:57.859 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[17386]: audit 2024-02-13T00:37:57.309848+0000 mon.c (mon.2) 142 : audit [INF] from='client.? 172.21.15.80:0/105110920' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi080-54175-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:57.859 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[17386]: audit 2024-02-13T00:37:57.318347+0000 mon.a (mon.0) 921 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:57.859 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[17386]: audit 2024-02-13T00:37:57.318727+0000 mon.a (mon.0) 922 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi080-54175-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:57.859 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[17386]: audit 2024-02-13T00:37:57.318941+0000 mon.a (mon.0) 923 : audit [INF] from='client.? 172.21.15.80:0/1376555857' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:58.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:37:58 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:37:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:57 smithi106 bash[18459]: audit 2024-02-13T00:37:56.808241+0000 mon.a (mon.0) 914 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:57 smithi106 bash[18459]: cluster 2024-02-13T00:37:57.287133+0000 mon.a (mon.0) 915 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:37:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:57 smithi106 bash[18459]: audit 2024-02-13T00:37:57.305251+0000 mon.a (mon.0) 916 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi080-54223-10"}]': finished 2024-02-13T00:37:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:57 smithi106 bash[18459]: audit 2024-02-13T00:37:57.305338+0000 mon.a (mon.0) 917 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi080-54231-10"}]': finished 2024-02-13T00:37:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:57 smithi106 bash[18459]: audit 2024-02-13T00:37:57.305408+0000 mon.a (mon.0) 918 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi080-54239-1","app":"app1","key":"key1"}]': finished 2024-02-13T00:37:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:57 smithi106 bash[18459]: audit 2024-02-13T00:37:57.305468+0000 mon.a (mon.0) 919 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "mode": "writeback"}]': finished 2024-02-13T00:37:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:57 smithi106 bash[18459]: cluster 2024-02-13T00:37:57.306323+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2024-02-13T00:37:58.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:57 smithi106 bash[18459]: audit 2024-02-13T00:37:57.308726+0000 mon.c (mon.2) 141 : audit [INF] from='client.? 172.21.15.80:0/286997137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:58.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:57 smithi106 bash[18459]: audit 2024-02-13T00:37:57.309848+0000 mon.c (mon.2) 142 : audit [INF] from='client.? 172.21.15.80:0/105110920' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi080-54175-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:58.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:57 smithi106 bash[18459]: audit 2024-02-13T00:37:57.318347+0000 mon.a (mon.0) 921 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:58.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:57 smithi106 bash[18459]: audit 2024-02-13T00:37:57.318727+0000 mon.a (mon.0) 922 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi080-54175-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:58.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:57 smithi106 bash[18459]: audit 2024-02-13T00:37:57.318941+0000 mon.a (mon.0) 923 : audit [INF] from='client.? 172.21.15.80:0/1376555857' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:58.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[24237]: audit 2024-02-13T00:37:56.808241+0000 mon.a (mon.0) 914 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:58.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[24237]: cluster 2024-02-13T00:37:57.287133+0000 mon.a (mon.0) 915 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:37:58.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[24237]: audit 2024-02-13T00:37:57.305251+0000 mon.a (mon.0) 916 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi080-54223-10"}]': finished 2024-02-13T00:37:58.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[24237]: audit 2024-02-13T00:37:57.305338+0000 mon.a (mon.0) 917 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi080-54231-10"}]': finished 2024-02-13T00:37:58.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[24237]: audit 2024-02-13T00:37:57.305408+0000 mon.a (mon.0) 918 : audit [INF] from='client.? 172.21.15.80:0/334779940' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi080-54239-1","app":"app1","key":"key1"}]': finished 2024-02-13T00:37:58.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[24237]: audit 2024-02-13T00:37:57.305468+0000 mon.a (mon.0) 919 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "mode": "writeback"}]': finished 2024-02-13T00:37:58.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[24237]: cluster 2024-02-13T00:37:57.306323+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2024-02-13T00:37:58.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[24237]: audit 2024-02-13T00:37:57.308726+0000 mon.c (mon.2) 141 : audit [INF] from='client.? 172.21.15.80:0/286997137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:58.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[24237]: audit 2024-02-13T00:37:57.309848+0000 mon.c (mon.2) 142 : audit [INF] from='client.? 172.21.15.80:0/105110920' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi080-54175-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:58.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[24237]: audit 2024-02-13T00:37:57.318347+0000 mon.a (mon.0) 921 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:58.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[24237]: audit 2024-02-13T00:37:57.318727+0000 mon.a (mon.0) 922 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi080-54175-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:58.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:57 smithi080 bash[24237]: audit 2024-02-13T00:37:57.318941+0000 mon.a (mon.0) 923 : audit [INF] from='client.? 172.21.15.80:0/1376555857' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:59.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:58 smithi106 bash[18459]: cluster 2024-02-13T00:37:57.682585+0000 mgr.y (mgr.24461) 316 : cluster [DBG] pgmap v252: 520 pgs: 100 unknown, 32 creating+peering, 388 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:37:59.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:58 smithi106 bash[18459]: audit 2024-02-13T00:37:57.851832+0000 mon.a (mon.0) 924 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:59.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:58 smithi106 bash[18459]: audit 2024-02-13T00:37:58.093386+0000 mgr.y (mgr.24461) 317 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:37:59.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:58 smithi106 bash[18459]: audit 2024-02-13T00:37:58.302692+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]': finished 2024-02-13T00:37:59.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:58 smithi106 bash[18459]: audit 2024-02-13T00:37:58.302809+0000 mon.a (mon.0) 926 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi080-54175-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:59.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:58 smithi106 bash[18459]: audit 2024-02-13T00:37:58.302909+0000 mon.a (mon.0) 927 : audit [INF] from='client.? 172.21.15.80:0/1376555857' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:59.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:58 smithi106 bash[18459]: cluster 2024-02-13T00:37:58.303111+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2024-02-13T00:37:59.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:58 smithi106 bash[18459]: audit 2024-02-13T00:37:58.313536+0000 mon.c (mon.2) 143 : audit [INF] from='client.? 172.21.15.80:0/4076195823' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:59.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:58 smithi106 bash[18459]: audit 2024-02-13T00:37:58.313804+0000 mon.c (mon.2) 144 : audit [INF] from='client.? 172.21.15.80:0/286997137' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:59.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:58 smithi106 bash[18459]: audit 2024-02-13T00:37:58.314132+0000 mon.a (mon.0) 929 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:59.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:37:58 smithi106 bash[18459]: audit 2024-02-13T00:37:58.315041+0000 mon.a (mon.0) 930 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:59.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:58 smithi080 bash[17386]: cluster 2024-02-13T00:37:57.682585+0000 mgr.y (mgr.24461) 316 : cluster [DBG] pgmap v252: 520 pgs: 100 unknown, 32 creating+peering, 388 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:37:59.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:58 smithi080 bash[17386]: audit 2024-02-13T00:37:57.851832+0000 mon.a (mon.0) 924 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:59.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:58 smithi080 bash[17386]: audit 2024-02-13T00:37:58.093386+0000 mgr.y (mgr.24461) 317 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:37:59.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:58 smithi080 bash[17386]: audit 2024-02-13T00:37:58.302692+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]': finished 2024-02-13T00:37:59.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:58 smithi080 bash[17386]: audit 2024-02-13T00:37:58.302809+0000 mon.a (mon.0) 926 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi080-54175-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:59.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:58 smithi080 bash[17386]: audit 2024-02-13T00:37:58.302909+0000 mon.a (mon.0) 927 : audit [INF] from='client.? 172.21.15.80:0/1376555857' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:59.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:58 smithi080 bash[17386]: cluster 2024-02-13T00:37:58.303111+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2024-02-13T00:37:59.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:58 smithi080 bash[17386]: audit 2024-02-13T00:37:58.313536+0000 mon.c (mon.2) 143 : audit [INF] from='client.? 172.21.15.80:0/4076195823' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:59.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:58 smithi080 bash[17386]: audit 2024-02-13T00:37:58.313804+0000 mon.c (mon.2) 144 : audit [INF] from='client.? 172.21.15.80:0/286997137' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:59.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:58 smithi080 bash[17386]: audit 2024-02-13T00:37:58.314132+0000 mon.a (mon.0) 929 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:59.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:37:58 smithi080 bash[17386]: audit 2024-02-13T00:37:58.315041+0000 mon.a (mon.0) 930 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:59.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:58 smithi080 bash[24237]: cluster 2024-02-13T00:37:57.682585+0000 mgr.y (mgr.24461) 316 : cluster [DBG] pgmap v252: 520 pgs: 100 unknown, 32 creating+peering, 388 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:37:59.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:58 smithi080 bash[24237]: audit 2024-02-13T00:37:57.851832+0000 mon.a (mon.0) 924 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:37:59.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:58 smithi080 bash[24237]: audit 2024-02-13T00:37:58.093386+0000 mgr.y (mgr.24461) 317 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:37:59.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:58 smithi080 bash[24237]: audit 2024-02-13T00:37:58.302692+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi080-54483-12"}]': finished 2024-02-13T00:37:59.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:58 smithi080 bash[24237]: audit 2024-02-13T00:37:58.302809+0000 mon.a (mon.0) 926 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi080-54175-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:59.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:58 smithi080 bash[24237]: audit 2024-02-13T00:37:58.302909+0000 mon.a (mon.0) 927 : audit [INF] from='client.? 172.21.15.80:0/1376555857' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:37:59.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:58 smithi080 bash[24237]: cluster 2024-02-13T00:37:58.303111+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2024-02-13T00:37:59.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:58 smithi080 bash[24237]: audit 2024-02-13T00:37:58.313536+0000 mon.c (mon.2) 143 : audit [INF] from='client.? 172.21.15.80:0/4076195823' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:59.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:58 smithi080 bash[24237]: audit 2024-02-13T00:37:58.313804+0000 mon.c (mon.2) 144 : audit [INF] from='client.? 172.21.15.80:0/286997137' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:59.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:58 smithi080 bash[24237]: audit 2024-02-13T00:37:58.314132+0000 mon.a (mon.0) 929 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:37:59.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:37:58 smithi080 bash[24237]: audit 2024-02-13T00:37:58.315041+0000 mon.a (mon.0) 930 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi080-54483-12"}]: dispatch 2024-02-13T00:37:59.346 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: Running main() from gmock_main.cc 2024-02-13T00:37:59.346 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2024-02-13T00:37:59.346 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [----------] Global test environment set-up. 2024-02-13T00:37:59.346 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2024-02-13T00:37:59.347 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2024-02-13T00:37:59.347 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: watch_notify_test_cb 2024-02-13T00:37:59.347 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (299 ms) 2024-02-13T00:37:59.347 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2024-02-13T00:37:59.347 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-02-13T00:37:59.347 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94862810943104 err -107 2024-02-13T00:37:59.347 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (1021 ms) 2024-02-13T00:37:59.347 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-02-13T00:37:59.347 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-02-13T00:37:59.347 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94862810943104 err -107 2024-02-13T00:37:59.347 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (1008 ms) 2024-02-13T00:37:59.347 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2024-02-13T00:37:59.347 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: watch_notify2_test_cb from 24740 notify_id 296352743425 cookie 94862810962480 2024-02-13T00:37:59.347 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (9 ms) 2024-02-13T00:37:59.347 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-02-13T00:37:59.348 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: watch_notify2_test_cb from 24740 notify_id 296352743424 cookie 94862811015968 2024-02-13T00:37:59.348 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (6 ms) 2024-02-13T00:37:59.348 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2024-02-13T00:37:59.348 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: watch_notify2_test_cb from 24740 notify_id 296352743424 cookie 94862811015968 2024-02-13T00:37:59.348 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (7 ms) 2024-02-13T00:37:59.348 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-02-13T00:37:59.348 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: watch_notify2_test_cb from 24740 notify_id 296352743425 cookie 94862810997056 2024-02-13T00:37:59.348 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: watch_notify2_test_cb from 24740 notify_id 296352743425 cookie 94862811015968 2024-02-13T00:37:59.348 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (10 ms) 2024-02-13T00:37:59.348 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-02-13T00:37:59.348 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: watch_notify2_test_cb from 24740 notify_id 296352743425 cookie 94862811015968 2024-02-13T00:37:59.348 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: watch_notify2_test_cb from 24740 notify_id 300647710722 cookie 94862811015968 2024-02-13T00:37:59.348 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3008 ms) 2024-02-13T00:37:59.348 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-02-13T00:37:59.349 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2024-02-13T00:37:59.349 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94862811015968 err -107 2024-02-13T00:37:59.349 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: watch_notify2_test_cb from 24740 notify_id 317827579906 cookie 94862811015968 2024-02-13T00:37:59.349 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5012 ms) 2024-02-13T00:37:59.349 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-02-13T00:37:59.349 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2024-02-13T00:37:59.349 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94862811015968 err -107 2024-02-13T00:37:59.349 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1008 ms) 2024-02-13T00:37:59.349 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (11388 ms total) 2024-02-13T00:37:59.349 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: 2024-02-13T00:37:59.349 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2024-02-13T00:37:59.349 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-02-13T00:37:59.349 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: watch_notify_test_cb 2024-02-13T00:37:59.349 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (723 ms) 2024-02-13T00:37:59.349 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (723 ms total) 2024-02-13T00:37:59.349 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: 2024-02-13T00:37:59.350 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [----------] Global test environment tear-down 2024-02-13T00:37:59.350 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (30305 ms total) 2024-02-13T00:37:59.374 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify: [ PASSED ] 11 tests. 2024-02-13T00:38:00.494 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2024-02-13T00:38:00.494 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2024-02-13T00:38:00.494 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2024-02-13T00:38:00.495 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2024-02-13T00:38:00.495 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-02-13T00:38:00.495 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: notify 2024-02-13T00:38:00.495 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (1326 ms) 2024-02-13T00:38:00.495 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-02-13T00:38:00.495 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (8 ms) 2024-02-13T00:38:00.495 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (1334 ms total) 2024-02-13T00:38:00.495 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: 2024-02-13T00:38:00.495 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-02-13T00:38:00.495 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-02-13T00:38:00.495 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: notify 2024-02-13T00:38:00.495 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (98 ms) 2024-02-13T00:38:00.495 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-02-13T00:38:00.495 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: notify 2024-02-13T00:38:00.495 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (4414 ms) 2024-02-13T00:38:00.495 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-02-13T00:38:00.496 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (8 ms) 2024-02-13T00:38:00.496 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-02-13T00:38:00.496 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (18 ms) 2024-02-13T00:38:00.496 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-02-13T00:38:00.496 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: handle_notify cookie 94870214327664 notify_id 347892350978 notifier_gid 25172 2024-02-13T00:38:00.496 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (20 ms) 2024-02-13T00:38:00.496 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-02-13T00:38:00.496 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: handle_notify cookie 94870214327664 notify_id 347892350980 notifier_gid 25172 2024-02-13T00:38:00.496 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (12 ms) 2024-02-13T00:38:00.496 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-02-13T00:38:00.496 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: handle_notify cookie 94870214330976 notify_id 347892350979 notifier_gid 25172 2024-02-13T00:38:00.496 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (8 ms) 2024-02-13T00:38:00.496 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-02-13T00:38:00.496 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: handle_notify cookie 94870214330976 notify_id 347892350980 notifier_gid 25172 2024-02-13T00:38:00.497 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (15 ms) 2024-02-13T00:38:00.497 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-02-13T00:38:00.497 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: handle_notify cookie 94870214330976 notify_id 347892350981 notifier_gid 25172 2024-02-13T00:38:00.497 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (26 ms) 2024-02-13T00:38:00.497 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-02-13T00:38:00.497 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: handle_notify cookie 94870214330976 notify_id 347892350978 notifier_gid 25172 2024-02-13T00:38:00.497 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (16 ms) 2024-02-13T00:38:00.497 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-02-13T00:38:00.497 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: trying... 2024-02-13T00:38:00.497 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: handle_notify cookie 94870214334208 notify_id 347892350977 notifier_gid 25172 2024-02-13T00:38:00.498 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: timed out 2024-02-13T00:38:00.498 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: flushing 2024-02-13T00:38:00.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:38:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:38:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:38:00.720 INFO:tasks.workunit.client.0.smithi080.stdout: api api_service_pp: [==========] Running 4 tests from 1 test suite. 2024-02-13T00:38:00.720 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: [----------] Global test environment set-up. 2024-02-13T00:38:00.720 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2024-02-13T00:38:00.720 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2024-02-13T00:38:00.721 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5067 ms) 2024-02-13T00:38:00.721 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2024-02-13T00:38:00.721 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (52 ms) 2024-02-13T00:38:00.721 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2024-02-13T00:38:00.721 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (21408 ms) 2024-02-13T00:38:00.721 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2024-02-13T00:38:00.721 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: attempt 0 of 20 2024-02-13T00:38:00.721 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: failed to deregister: 2024-02-13T00:38:00.721 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: { 2024-02-13T00:38:00.721 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "epoch": 19, 2024-02-13T00:38:00.721 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "modified": "2024-02-13T00:37:55.681614+0000", 2024-02-13T00:38:00.721 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "services": { 2024-02-13T00:38:00.721 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "laundry": { 2024-02-13T00:38:00.721 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "daemons": { 2024-02-13T00:38:00.721 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "summary": "", 2024-02-13T00:38:00.722 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "close-test-pid54604": { 2024-02-13T00:38:00.722 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "start_epoch": 19, 2024-02-13T00:38:00.722 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "start_stamp": "2024-02-13T00:37:55.657961+0000", 2024-02-13T00:38:00.722 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "gid": 25214, 2024-02-13T00:38:00.722 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "addr": "172.21.15.80:0/2434093188", 2024-02-13T00:38:00.722 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "metadata": { 2024-02-13T00:38:00.722 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "arch": "x86_64", 2024-02-13T00:38:00.722 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "ceph_release": "pacific", 2024-02-13T00:38:00.722 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "ceph_version": "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)", 2024-02-13T00:38:00.722 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "ceph_version_short": "16.2.14-521-g0e714d9a", 2024-02-13T00:38:00.722 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-02-13T00:38:00.722 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "distro": "ubuntu", 2024-02-13T00:38:00.722 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "distro_description": "Ubuntu 20.04.4 LTS", 2024-02-13T00:38:00.722 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "distro_version": "20.04", 2024-02-13T00:38:00.722 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "foo": "bar", 2024-02-13T00:38:00.722 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "hostname": "smithi080", 2024-02-13T00:38:00.723 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "kernel_description": "#104~20.04.1-Ubuntu SMP Tue Jan 16 13:34:09 UTC 2024", 2024-02-13T00:38:00.723 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "kernel_version": "5.15.0-94-generic", 2024-02-13T00:38:00.723 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "mem_swap_kb": "2097148", 2024-02-13T00:38:00.723 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "mem_total_kb": "32746876", 2024-02-13T00:38:00.723 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "os": "Linux", 2024-02-13T00:38:00.723 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "this": "that" 2024-02-13T00:38:00.723 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: }, 2024-02-13T00:38:00.723 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "task_status": {} 2024-02-13T00:38:00.723 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: }, 2024-02-13T00:38:00.723 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "pid54595": { 2024-02-13T00:38:00.723 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "start_epoch": 18, 2024-02-13T00:38:00.723 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "start_stamp": "2024-02-13T00:37:41.838285+0000", 2024-02-13T00:38:00.723 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "gid": 25031, 2024-02-13T00:38:00.723 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "addr": "172.21.15.80:0/3386261", 2024-02-13T00:38:00.723 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "metadata": { 2024-02-13T00:38:00.724 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "arch": "x86_64", 2024-02-13T00:38:00.724 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "ceph_release": "pacific", 2024-02-13T00:38:00.724 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "ceph_version": "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)", 2024-02-13T00:38:00.724 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "ceph_version_short": "16.2.14-521-g0e714d9a", 2024-02-13T00:38:00.725 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-02-13T00:38:00.726 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "distro": "ubuntu", 2024-02-13T00:38:00.726 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "distro_description": "Ubuntu 20.04.4 LTS", 2024-02-13T00:38:00.726 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "distro_version": "20.04", 2024-02-13T00:38:00.726 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "foo": "bar", 2024-02-13T00:38:00.726 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "hostname": "smithi080", 2024-02-13T00:38:00.726 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "kernel_description": "#104~20.04.1-Ubuntu SMP Tue Jan 16 13:34:09 UTC 2024", 2024-02-13T00:38:00.726 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "kernel_version": "5.15.0-94-generic", 2024-02-13T00:38:00.726 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "mem_swap_kb": "2097148", 2024-02-13T00:38:00.726 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "mem_total_kb": "32746876", 2024-02-13T00:38:00.726 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "os": "Linux", 2024-02-13T00:38:00.726 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "this": "that" 2024-02-13T00:38:00.726 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: }, 2024-02-13T00:38:00.726 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "task_status": {} 2024-02-13T00:38:00.726 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: } 2024-02-13T00:38:00.726 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: } 2024-02-13T00:38:00.727 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: }, 2024-02-13T00:38:00.727 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "rgw": { 2024-02-13T00:38:00.727 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "daemons": { 2024-02-13T00:38:00.727 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "summary": "", 2024-02-13T00:38:00.727 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "24382": { 2024-02-13T00:38:00.727 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "start_epoch": 13, 2024-02-13T00:38:00.727 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "start_stamp": "2024-02-13T00:29:59.074676+0000", 2024-02-13T00:38:00.727 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "gid": 24382, 2024-02-13T00:38:00.727 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "addr": "172.21.15.80:0/2057131335", 2024-02-13T00:38:00.727 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "metadata": { 2024-02-13T00:38:00.727 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "arch": "x86_64", 2024-02-13T00:38:00.727 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "ceph_release": "pacific", 2024-02-13T00:38:00.727 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "ceph_version": "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)", 2024-02-13T00:38:00.727 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "ceph_version_short": "16.2.14-521-g0e714d9a", 2024-02-13T00:38:00.727 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "container_hostname": "smithi080", 2024-02-13T00:38:00.727 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "container_image": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-13T00:38:00.728 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-02-13T00:38:00.728 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "distro": "centos", 2024-02-13T00:38:00.728 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "distro_description": "CentOS Stream 8", 2024-02-13T00:38:00.728 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "distro_version": "8", 2024-02-13T00:38:00.728 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "frontend_config#0": "beast port=80", 2024-02-13T00:38:00.728 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "frontend_type#0": "beast", 2024-02-13T00:38:00.728 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "hostname": "smithi080", 2024-02-13T00:38:00.728 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "id": "foo.a", 2024-02-13T00:38:00.728 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "kernel_description": "#104~20.04.1-Ubuntu SMP Tue Jan 16 13:34:09 UTC 2024", 2024-02-13T00:38:00.728 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "kernel_version": "5.15.0-94-generic", 2024-02-13T00:38:00.728 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "mem_swap_kb": "2097148", 2024-02-13T00:38:00.728 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "mem_total_kb": "32746876", 2024-02-13T00:38:00.728 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "num_handles": "1", 2024-02-13T00:38:00.728 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "os": "Linux", 2024-02-13T00:38:00.728 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "pid": "7", 2024-02-13T00:38:00.729 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "realm_id": "", 2024-02-13T00:38:00.729 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "realm_name": "", 2024-02-13T00:38:00.729 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "zone_id": "ec35f812-8a0f-49fd-be95-542ff2cd658b", 2024-02-13T00:38:00.729 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "zone_name": "default", 2024-02-13T00:38:00.729 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "zonegroup_id": "03efcb50-5ac8-4290-92a7-93bff9c5b4a5", 2024-02-13T00:38:01.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:00 smithi106 bash[18459]: audit 2024-02-13T00:37:58.877811+0000 mon.a (mon.0) 931 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:01.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:00 smithi106 bash[18459]: audit 2024-02-13T00:37:59.317152+0000 mon.a (mon.0) 932 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:01.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:00 smithi106 bash[18459]: audit 2024-02-13T00:37:59.317272+0000 mon.a (mon.0) 933 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi080-54483-12"}]': finished 2024-02-13T00:38:01.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:00 smithi106 bash[18459]: cluster 2024-02-13T00:37:59.317484+0000 mon.a (mon.0) 934 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2024-02-13T00:38:01.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:00 smithi106 bash[18459]: audit 2024-02-13T00:37:59.336866+0000 mon.a (mon.0) 935 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:01.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:00 smithi080 bash[17386]: audit 2024-02-13T00:37:58.877811+0000 mon.a (mon.0) 931 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:01.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:00 smithi080 bash[17386]: audit 2024-02-13T00:37:59.317152+0000 mon.a (mon.0) 932 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:01.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:00 smithi080 bash[17386]: audit 2024-02-13T00:37:59.317272+0000 mon.a (mon.0) 933 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi080-54483-12"}]': finished 2024-02-13T00:38:01.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:00 smithi080 bash[17386]: cluster 2024-02-13T00:37:59.317484+0000 mon.a (mon.0) 934 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2024-02-13T00:38:01.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:00 smithi080 bash[17386]: audit 2024-02-13T00:37:59.336866+0000 mon.a (mon.0) 935 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:01.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:00 smithi080 bash[24237]: audit 2024-02-13T00:37:58.877811+0000 mon.a (mon.0) 931 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:01.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:00 smithi080 bash[24237]: audit 2024-02-13T00:37:59.317152+0000 mon.a (mon.0) 932 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:01.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:00 smithi080 bash[24237]: audit 2024-02-13T00:37:59.317272+0000 mon.a (mon.0) 933 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi080-54483-12"}]': finished 2024-02-13T00:38:01.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:00 smithi080 bash[24237]: cluster 2024-02-13T00:37:59.317484+0000 mon.a (mon.0) 934 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2024-02-13T00:38:01.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:00 smithi080 bash[24237]: audit 2024-02-13T00:37:59.336866+0000 mon.a (mon.0) 935 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:01.860 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: api_service: health: HEALTH_OK 2024-02-13T00:38:01.860 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 2024-02-13T00:38:01.860 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: services: 2024-02-13T00:38:01.860 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 13m) 2024-02-13T00:38:01.860 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: mgr: y(active, since 7m), standbys: x 2024-02-13T00:38:01.860 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: osd: 8 osds: 8 up (since 8m), 8 in (since 8m) 2024-02-13T00:38:01.860 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2024-02-13T00:38:01.860 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: laundry: 1 daemon active (1 hosts) 2024-02-13T00:38:01.861 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-02-13T00:38:01.861 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 2024-02-13T00:38:01.861 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: data: 2024-02-13T00:38:01.861 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: pools: 21 pools, 612 pgs 2024-02-13T00:38:01.861 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: objects: 224 objects, 5.7 KiB 2024-02-13T00:38:01.861 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: usage: 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:38:01.861 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: pgs: 22.386% pgs unknown 2024-02-13T00:38:01.861 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 56.046% pgs not active 2024-02-13T00:38:01.861 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 343 creating+peering 2024-02-13T00:38:01.861 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 137 unknown 2024-02-13T00:38:01.861 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 132 active+clean 2024-02-13T00:38:01.861 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 2024-02-13T00:38:01.861 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: io: 2024-02-13T00:38:01.861 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: client: 1.2 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-02-13T00:38:01.861 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 2024-02-13T00:38:01.862 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 2024-02-13T00:38:01.862 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: [ OK ] LibRadosService.StatusFormat (7604 ms) 2024-02-13T00:38:01.862 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: [ RUN ] LibRadosService.Status 2024-02-13T00:38:01.862 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: [ OK ] LibRadosService.Status (20056 ms) 2024-02-13T00:38:01.862 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: [----------] 4 tests from LibRadosService (32758 ms total) 2024-02-13T00:38:01.862 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: 2024-02-13T00:38:01.862 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: [----------] Global test environment tear-down 2024-02-13T00:38:01.862 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: [==========] 4 tests from 1 test suite ran. (32758 ms total) 2024-02-13T00:38:01.862 INFO:tasks.workunit.client.0.smithi080.stdout: api_service: [ PASSED ] 4 tests. 2024-02-13T00:38:02.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:01 smithi106 bash[18459]: cluster 2024-02-13T00:37:59.683267+0000 mgr.y (mgr.24461) 318 : cluster [DBG] pgmap v255: 488 pgs: 64 unknown, 424 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 7.5 KiB/s wr, 6 op/s 2024-02-13T00:38:02.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:01 smithi106 bash[18459]: audit 2024-02-13T00:38:00.504096+0000 mon.a (mon.0) 936 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:02.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:01 smithi106 bash[18459]: audit 2024-02-13T00:38:00.551334+0000 mon.a (mon.0) 937 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:02.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:01 smithi106 bash[18459]: cluster 2024-02-13T00:38:00.551554+0000 mon.a (mon.0) 938 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2024-02-13T00:38:02.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:01 smithi106 bash[18459]: audit 2024-02-13T00:38:00.555213+0000 mon.a (mon.0) 939 : audit [INF] from='client.? 172.21.15.80:0/2584801265' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi080-54175-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:02.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:01 smithi106 bash[18459]: audit 2024-02-13T00:38:00.578423+0000 mon.b (mon.1) 59 : audit [INF] from='client.? 172.21.15.80:0/1313454937' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:01 smithi106 bash[18459]: audit 2024-02-13T00:38:00.708744+0000 mon.c (mon.2) 145 : audit [DBG] from='client.? 172.21.15.80:0/1303178246' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T00:38:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:01 smithi106 bash[18459]: audit 2024-02-13T00:38:01.144782+0000 mon.a (mon.0) 940 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:02.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:01 smithi080 bash[17386]: cluster 2024-02-13T00:37:59.683267+0000 mgr.y (mgr.24461) 318 : cluster [DBG] pgmap v255: 488 pgs: 64 unknown, 424 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 7.5 KiB/s wr, 6 op/s 2024-02-13T00:38:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:01 smithi080 bash[17386]: audit 2024-02-13T00:38:00.504096+0000 mon.a (mon.0) 936 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:01 smithi080 bash[17386]: audit 2024-02-13T00:38:00.551334+0000 mon.a (mon.0) 937 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:01 smithi080 bash[17386]: cluster 2024-02-13T00:38:00.551554+0000 mon.a (mon.0) 938 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2024-02-13T00:38:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:01 smithi080 bash[17386]: audit 2024-02-13T00:38:00.555213+0000 mon.a (mon.0) 939 : audit [INF] from='client.? 172.21.15.80:0/2584801265' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi080-54175-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:01 smithi080 bash[17386]: audit 2024-02-13T00:38:00.578423+0000 mon.b (mon.1) 59 : audit [INF] from='client.? 172.21.15.80:0/1313454937' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:01 smithi080 bash[17386]: audit 2024-02-13T00:38:00.708744+0000 mon.c (mon.2) 145 : audit [DBG] from='client.? 172.21.15.80:0/1303178246' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T00:38:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:01 smithi080 bash[17386]: audit 2024-02-13T00:38:01.144782+0000 mon.a (mon.0) 940 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:02.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:01 smithi080 bash[24237]: cluster 2024-02-13T00:37:59.683267+0000 mgr.y (mgr.24461) 318 : cluster [DBG] pgmap v255: 488 pgs: 64 unknown, 424 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 7.5 KiB/s wr, 6 op/s 2024-02-13T00:38:02.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:01 smithi080 bash[24237]: audit 2024-02-13T00:38:00.504096+0000 mon.a (mon.0) 936 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:02.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:01 smithi080 bash[24237]: audit 2024-02-13T00:38:00.551334+0000 mon.a (mon.0) 937 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:02.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:01 smithi080 bash[24237]: cluster 2024-02-13T00:38:00.551554+0000 mon.a (mon.0) 938 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2024-02-13T00:38:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:01 smithi080 bash[24237]: audit 2024-02-13T00:38:00.555213+0000 mon.a (mon.0) 939 : audit [INF] from='client.? 172.21.15.80:0/2584801265' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi080-54175-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:01 smithi080 bash[24237]: audit 2024-02-13T00:38:00.578423+0000 mon.b (mon.1) 59 : audit [INF] from='client.? 172.21.15.80:0/1313454937' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:01 smithi080 bash[24237]: audit 2024-02-13T00:38:00.708744+0000 mon.c (mon.2) 145 : audit [DBG] from='client.? 172.21.15.80:0/1303178246' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T00:38:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:01 smithi080 bash[24237]: audit 2024-02-13T00:38:01.144782+0000 mon.a (mon.0) 940 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:03.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[17386]: audit 2024-02-13T00:38:00.709494+0000 mgr.y (mgr.24461) 319 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T00:38:03.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[17386]: cluster 2024-02-13T00:38:01.532580+0000 osd.0 (osd.0) 7 : cluster [DBG] 17.7 deep-scrub starts 2024-02-13T00:38:03.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[17386]: cluster 2024-02-13T00:38:01.536352+0000 osd.0 (osd.0) 8 : cluster [DBG] 17.7 deep-scrub ok 2024-02-13T00:38:03.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[17386]: cluster 2024-02-13T00:38:01.671424+0000 mon.a (mon.0) 941 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:38:03.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[17386]: audit 2024-02-13T00:38:01.676542+0000 mon.a (mon.0) 942 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:03.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[17386]: cluster 2024-02-13T00:38:01.683932+0000 mgr.y (mgr.24461) 320 : cluster [DBG] pgmap v257: 520 pgs: 96 unknown, 424 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 6.8 KiB/s wr, 6 op/s 2024-02-13T00:38:03.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[17386]: audit 2024-02-13T00:38:01.686259+0000 mon.a (mon.0) 943 : audit [INF] from='client.? 172.21.15.80:0/2584801265' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi080-54175-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:03.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[17386]: audit 2024-02-13T00:38:01.686396+0000 mon.a (mon.0) 944 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:03.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[17386]: cluster 2024-02-13T00:38:01.686642+0000 mon.a (mon.0) 945 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2024-02-13T00:38:03.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[17386]: audit 2024-02-13T00:38:01.694748+0000 mon.b (mon.1) 60 : audit [INF] from='client.? 172.21.15.80:0/896996457' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:03.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[17386]: audit 2024-02-13T00:38:01.705858+0000 mon.a (mon.0) 946 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:03.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[17386]: audit 2024-02-13T00:38:01.738336+0000 mon.a (mon.0) 947 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:03.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[17386]: audit 2024-02-13T00:38:02.381381+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:38:03.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[17386]: cluster 2024-02-13T00:38:02.680152+0000 mon.a (mon.0) 949 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-13T00:38:03.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[17386]: audit 2024-02-13T00:38:02.680698+0000 mon.a (mon.0) 950 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:03.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[17386]: audit 2024-02-13T00:38:02.689708+0000 mon.a (mon.0) 951 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:03.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[17386]: audit 2024-02-13T00:38:02.689807+0000 mon.a (mon.0) 952 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:03.512 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[17386]: cluster 2024-02-13T00:38:02.690043+0000 mon.a (mon.0) 953 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2024-02-13T00:38:03.513 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:38:03] "GET /metrics HTTP/1.1" 200 209441 "" "Prometheus/2.33.4" 2024-02-13T00:38:03.513 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[24237]: audit 2024-02-13T00:38:00.709494+0000 mgr.y (mgr.24461) 319 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T00:38:03.514 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[24237]: cluster 2024-02-13T00:38:01.532580+0000 osd.0 (osd.0) 7 : cluster [DBG] 17.7 deep-scrub starts 2024-02-13T00:38:03.514 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[24237]: cluster 2024-02-13T00:38:01.536352+0000 osd.0 (osd.0) 8 : cluster [DBG] 17.7 deep-scrub ok 2024-02-13T00:38:03.514 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[24237]: cluster 2024-02-13T00:38:01.671424+0000 mon.a (mon.0) 941 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:38:03.514 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[24237]: audit 2024-02-13T00:38:01.676542+0000 mon.a (mon.0) 942 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:03.514 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[24237]: cluster 2024-02-13T00:38:01.683932+0000 mgr.y (mgr.24461) 320 : cluster [DBG] pgmap v257: 520 pgs: 96 unknown, 424 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 6.8 KiB/s wr, 6 op/s 2024-02-13T00:38:03.514 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[24237]: audit 2024-02-13T00:38:01.686259+0000 mon.a (mon.0) 943 : audit [INF] from='client.? 172.21.15.80:0/2584801265' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi080-54175-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:03.515 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[24237]: audit 2024-02-13T00:38:01.686396+0000 mon.a (mon.0) 944 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:03.515 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[24237]: cluster 2024-02-13T00:38:01.686642+0000 mon.a (mon.0) 945 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2024-02-13T00:38:03.515 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[24237]: audit 2024-02-13T00:38:01.694748+0000 mon.b (mon.1) 60 : audit [INF] from='client.? 172.21.15.80:0/896996457' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:03.515 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[24237]: audit 2024-02-13T00:38:01.705858+0000 mon.a (mon.0) 946 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:03.515 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[24237]: audit 2024-02-13T00:38:01.738336+0000 mon.a (mon.0) 947 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:03.515 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[24237]: audit 2024-02-13T00:38:02.381381+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:38:03.516 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[24237]: cluster 2024-02-13T00:38:02.680152+0000 mon.a (mon.0) 949 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-13T00:38:03.516 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[24237]: audit 2024-02-13T00:38:02.680698+0000 mon.a (mon.0) 950 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:03.516 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[24237]: audit 2024-02-13T00:38:02.689708+0000 mon.a (mon.0) 951 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:03.516 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[24237]: audit 2024-02-13T00:38:02.689807+0000 mon.a (mon.0) 952 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:03.516 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:03 smithi080 bash[24237]: cluster 2024-02-13T00:38:02.690043+0000 mon.a (mon.0) 953 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2024-02-13T00:38:03.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:03 smithi106 bash[18459]: audit 2024-02-13T00:38:00.709494+0000 mgr.y (mgr.24461) 319 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T00:38:03.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:03 smithi106 bash[18459]: cluster 2024-02-13T00:38:01.532580+0000 osd.0 (osd.0) 7 : cluster [DBG] 17.7 deep-scrub starts 2024-02-13T00:38:03.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:03 smithi106 bash[18459]: cluster 2024-02-13T00:38:01.536352+0000 osd.0 (osd.0) 8 : cluster [DBG] 17.7 deep-scrub ok 2024-02-13T00:38:03.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:03 smithi106 bash[18459]: cluster 2024-02-13T00:38:01.671424+0000 mon.a (mon.0) 941 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:38:03.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:03 smithi106 bash[18459]: audit 2024-02-13T00:38:01.676542+0000 mon.a (mon.0) 942 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:03.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:03 smithi106 bash[18459]: cluster 2024-02-13T00:38:01.683932+0000 mgr.y (mgr.24461) 320 : cluster [DBG] pgmap v257: 520 pgs: 96 unknown, 424 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 6.8 KiB/s wr, 6 op/s 2024-02-13T00:38:03.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:03 smithi106 bash[18459]: audit 2024-02-13T00:38:01.686259+0000 mon.a (mon.0) 943 : audit [INF] from='client.? 172.21.15.80:0/2584801265' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi080-54175-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:03.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:03 smithi106 bash[18459]: audit 2024-02-13T00:38:01.686396+0000 mon.a (mon.0) 944 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:03.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:03 smithi106 bash[18459]: cluster 2024-02-13T00:38:01.686642+0000 mon.a (mon.0) 945 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2024-02-13T00:38:03.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:03 smithi106 bash[18459]: audit 2024-02-13T00:38:01.694748+0000 mon.b (mon.1) 60 : audit [INF] from='client.? 172.21.15.80:0/896996457' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:03.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:03 smithi106 bash[18459]: audit 2024-02-13T00:38:01.705858+0000 mon.a (mon.0) 946 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:03.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:03 smithi106 bash[18459]: audit 2024-02-13T00:38:01.738336+0000 mon.a (mon.0) 947 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:03.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:03 smithi106 bash[18459]: audit 2024-02-13T00:38:02.381381+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:38:03.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:03 smithi106 bash[18459]: cluster 2024-02-13T00:38:02.680152+0000 mon.a (mon.0) 949 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-13T00:38:03.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:03 smithi106 bash[18459]: audit 2024-02-13T00:38:02.680698+0000 mon.a (mon.0) 950 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:03.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:03 smithi106 bash[18459]: audit 2024-02-13T00:38:02.689708+0000 mon.a (mon.0) 951 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:03.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:03 smithi106 bash[18459]: audit 2024-02-13T00:38:02.689807+0000 mon.a (mon.0) 952 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:03.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:03 smithi106 bash[18459]: cluster 2024-02-13T00:38:02.690043+0000 mon.a (mon.0) 953 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2024-02-13T00:38:05.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:05 smithi106 bash[18459]: audit 2024-02-13T00:38:02.704544+0000 mon.c (mon.2) 146 : audit [INF] from='client.? 172.21.15.80:0/1083539238' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi080-54454-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:05.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:05 smithi106 bash[18459]: audit 2024-02-13T00:38:03.268182+0000 mon.a (mon.0) 954 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi080-54454-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:05.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:05 smithi106 bash[18459]: audit 2024-02-13T00:38:03.275716+0000 mon.a (mon.0) 955 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:38:05.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:05 smithi106 bash[18459]: audit 2024-02-13T00:38:03.853432+0000 mon.a (mon.0) 956 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi080-54454-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:05.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:05 smithi106 bash[18459]: audit 2024-02-13T00:38:03.853710+0000 mon.a (mon.0) 957 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-7", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:38:05.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:05 smithi106 bash[18459]: cluster 2024-02-13T00:38:03.853893+0000 mon.a (mon.0) 958 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2024-02-13T00:38:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:05 smithi106 bash[18459]: audit 2024-02-13T00:38:03.870304+0000 mon.c (mon.2) 147 : audit [INF] from='client.? 172.21.15.80:0/3467384609' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi080-54175-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:05 smithi106 bash[18459]: audit 2024-02-13T00:38:03.879344+0000 mon.a (mon.0) 959 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:05 smithi106 bash[18459]: audit 2024-02-13T00:38:03.879717+0000 mon.a (mon.0) 960 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-7"}]: dispatch 2024-02-13T00:38:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:05 smithi106 bash[18459]: audit 2024-02-13T00:38:03.907231+0000 mon.a (mon.0) 961 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi080-54175-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:05.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:05 smithi080 bash[17386]: audit 2024-02-13T00:38:02.704544+0000 mon.c (mon.2) 146 : audit [INF] from='client.? 172.21.15.80:0/1083539238' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi080-54454-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:05 smithi080 bash[17386]: audit 2024-02-13T00:38:03.268182+0000 mon.a (mon.0) 954 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi080-54454-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:05 smithi080 bash[17386]: audit 2024-02-13T00:38:03.275716+0000 mon.a (mon.0) 955 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:38:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:05 smithi080 bash[17386]: audit 2024-02-13T00:38:03.853432+0000 mon.a (mon.0) 956 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi080-54454-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:05 smithi080 bash[17386]: audit 2024-02-13T00:38:03.853710+0000 mon.a (mon.0) 957 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-7", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:38:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:05 smithi080 bash[17386]: cluster 2024-02-13T00:38:03.853893+0000 mon.a (mon.0) 958 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2024-02-13T00:38:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:05 smithi080 bash[17386]: audit 2024-02-13T00:38:03.870304+0000 mon.c (mon.2) 147 : audit [INF] from='client.? 172.21.15.80:0/3467384609' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi080-54175-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:05 smithi080 bash[17386]: audit 2024-02-13T00:38:03.879344+0000 mon.a (mon.0) 959 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:05 smithi080 bash[17386]: audit 2024-02-13T00:38:03.879717+0000 mon.a (mon.0) 960 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-7"}]: dispatch 2024-02-13T00:38:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:05 smithi080 bash[17386]: audit 2024-02-13T00:38:03.907231+0000 mon.a (mon.0) 961 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi080-54175-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:05.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:05 smithi080 bash[24237]: audit 2024-02-13T00:38:02.704544+0000 mon.c (mon.2) 146 : audit [INF] from='client.? 172.21.15.80:0/1083539238' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi080-54454-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:05.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:05 smithi080 bash[24237]: audit 2024-02-13T00:38:03.268182+0000 mon.a (mon.0) 954 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi080-54454-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:05 smithi080 bash[24237]: audit 2024-02-13T00:38:03.275716+0000 mon.a (mon.0) 955 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:38:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:05 smithi080 bash[24237]: audit 2024-02-13T00:38:03.853432+0000 mon.a (mon.0) 956 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi080-54454-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:05 smithi080 bash[24237]: audit 2024-02-13T00:38:03.853710+0000 mon.a (mon.0) 957 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-7", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:38:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:05 smithi080 bash[24237]: cluster 2024-02-13T00:38:03.853893+0000 mon.a (mon.0) 958 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2024-02-13T00:38:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:05 smithi080 bash[24237]: audit 2024-02-13T00:38:03.870304+0000 mon.c (mon.2) 147 : audit [INF] from='client.? 172.21.15.80:0/3467384609' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi080-54175-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:05 smithi080 bash[24237]: audit 2024-02-13T00:38:03.879344+0000 mon.a (mon.0) 959 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:05 smithi080 bash[24237]: audit 2024-02-13T00:38:03.879717+0000 mon.a (mon.0) 960 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-7"}]: dispatch 2024-02-13T00:38:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:05 smithi080 bash[24237]: audit 2024-02-13T00:38:03.907231+0000 mon.a (mon.0) 961 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi080-54175-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:05.835 INFO:tasks.workunit.client.0.smithi080.stdout: "zonegroup_name": "default" 2024-02-13T00:38:05.836 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: }, 2024-02-13T00:38:05.836 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "task_status": {} 2024-02-13T00:38:05.836 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: } 2024-02-13T00:38:05.836 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: } 2024-02-13T00:38:05.836 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: } 2024-02-13T00:38:05.836 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: } 2024-02-13T00:38:05.836 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: } 2024-02-13T00:38:05.836 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: 2024-02-13T00:38:05.836 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: attempt 1 of 20 2024-02-13T00:38:05.836 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: failed to deregister: 2024-02-13T00:38:05.836 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: { 2024-02-13T00:38:05.836 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "epoch": 22, 2024-02-13T00:38:05.836 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "modified": "2024-02-13T00:38:03.685674+0000", 2024-02-13T00:38:05.836 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "services": { 2024-02-13T00:38:05.837 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "laundry": { 2024-02-13T00:38:05.837 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "daemons": { 2024-02-13T00:38:05.837 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "summary": "", 2024-02-13T00:38:05.837 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "close-test-pid54604": { 2024-02-13T00:38:05.837 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "start_epoch": 21, 2024-02-13T00:38:05.837 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "start_stamp": "2024-02-13T00:38:00.777374+0000", 2024-02-13T00:38:05.837 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "gid": 27437, 2024-02-13T00:38:05.837 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "addr": "172.21.15.80:0/418836831", 2024-02-13T00:38:05.837 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "metadata": { 2024-02-13T00:38:05.837 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "arch": "x86_64", 2024-02-13T00:38:05.837 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "ceph_release": "pacific", 2024-02-13T00:38:05.837 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "ceph_version": "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)", 2024-02-13T00:38:05.837 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "ceph_version_short": "16.2.14-521-g0e714d9a", 2024-02-13T00:38:05.837 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-02-13T00:38:05.838 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "distro": "ubuntu", 2024-02-13T00:38:05.838 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "distro_description": "Ubuntu 20.04.4 LTS", 2024-02-13T00:38:05.838 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "distro_version": "20.04", 2024-02-13T00:38:05.838 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "foo": "bar", 2024-02-13T00:38:05.838 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "hostname": "smithi080", 2024-02-13T00:38:05.838 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "kernel_description": "#104~20.04.1-Ubuntu SMP Tue Jan 16 13:34:09 UTC 2024", 2024-02-13T00:38:05.838 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "kernel_version": "5.15.0-94-generic", 2024-02-13T00:38:05.838 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "mem_swap_kb": "2097148", 2024-02-13T00:38:05.838 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "mem_total_kb": "32746876", 2024-02-13T00:38:05.838 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "os": "Linux", 2024-02-13T00:38:05.838 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "this": "that" 2024-02-13T00:38:05.838 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: }, 2024-02-13T00:38:05.838 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "task_status": {} 2024-02-13T00:38:05.838 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: } 2024-02-13T00:38:05.838 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: } 2024-02-13T00:38:05.838 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: }, 2024-02-13T00:38:05.839 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "rgw": { 2024-02-13T00:38:05.839 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "daemons": { 2024-02-13T00:38:05.839 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "summary": "", 2024-02-13T00:38:05.839 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "24382": { 2024-02-13T00:38:05.839 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "start_epoch": 13, 2024-02-13T00:38:05.839 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "start_stamp": "2024-02-13T00:29:59.074676+0000", 2024-02-13T00:38:05.839 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "gid": 24382, 2024-02-13T00:38:05.839 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "addr": "172.21.15.80:0/2057131335", 2024-02-13T00:38:05.839 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "metadata": { 2024-02-13T00:38:05.839 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "arch": "x86_64", 2024-02-13T00:38:05.839 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "ceph_release": "pacific", 2024-02-13T00:38:05.839 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "ceph_version": "ceph version 16.2.14-521-g0e714d9a (0e714d9a4bd2a821113e6318adb87bd06cf81ec1) pacific (stable)", 2024-02-13T00:38:05.839 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "ceph_version_short": "16.2.14-521-g0e714d9a", 2024-02-13T00:38:05.839 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "container_hostname": "smithi080", 2024-02-13T00:38:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:06 smithi106 bash[18459]: cluster 2024-02-13T00:38:03.686065+0000 mgr.y (mgr.24461) 321 : cluster [DBG] pgmap v260: 488 pgs: 32 creating+peering, 1 active, 46 creating+activating, 409 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-13T00:38:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:06 smithi106 bash[18459]: audit 2024-02-13T00:38:05.041861+0000 mon.a (mon.0) 962 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:06 smithi106 bash[18459]: audit 2024-02-13T00:38:05.078519+0000 mon.a (mon.0) 963 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-7"}]': finished 2024-02-13T00:38:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:06 smithi106 bash[18459]: audit 2024-02-13T00:38:05.078620+0000 mon.a (mon.0) 964 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi080-54175-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:06 smithi106 bash[18459]: cluster 2024-02-13T00:38:05.079235+0000 mon.a (mon.0) 965 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2024-02-13T00:38:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:06 smithi106 bash[18459]: audit 2024-02-13T00:38:05.098411+0000 mon.a (mon.0) 966 : audit [INF] from='client.? 172.21.15.80:0/1988530159' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:06 smithi106 bash[18459]: audit 2024-02-13T00:38:05.123673+0000 mon.c (mon.2) 148 : audit [INF] from='client.? 172.21.15.80:0/2379729427' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi080-54183-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:06 smithi106 bash[18459]: audit 2024-02-13T00:38:05.124609+0000 mon.a (mon.0) 967 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi080-54183-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:06 smithi106 bash[18459]: audit 2024-02-13T00:38:05.680008+0000 mon.a (mon.0) 968 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:38:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:06 smithi106 bash[18459]: audit 2024-02-13T00:38:05.829433+0000 mon.a (mon.0) 969 : audit [DBG] from='client.? 172.21.15.80:0/3223451774' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T00:38:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:06 smithi106 bash[18459]: audit 2024-02-13T00:38:06.048002+0000 mon.a (mon.0) 970 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:06.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:06 smithi080 bash[17386]: cluster 2024-02-13T00:38:03.686065+0000 mgr.y (mgr.24461) 321 : cluster [DBG] pgmap v260: 488 pgs: 32 creating+peering, 1 active, 46 creating+activating, 409 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-13T00:38:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:06 smithi080 bash[17386]: audit 2024-02-13T00:38:05.041861+0000 mon.a (mon.0) 962 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:06 smithi080 bash[17386]: audit 2024-02-13T00:38:05.078519+0000 mon.a (mon.0) 963 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-7"}]': finished 2024-02-13T00:38:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:06 smithi080 bash[17386]: audit 2024-02-13T00:38:05.078620+0000 mon.a (mon.0) 964 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi080-54175-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:06 smithi080 bash[17386]: cluster 2024-02-13T00:38:05.079235+0000 mon.a (mon.0) 965 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2024-02-13T00:38:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:06 smithi080 bash[17386]: audit 2024-02-13T00:38:05.098411+0000 mon.a (mon.0) 966 : audit [INF] from='client.? 172.21.15.80:0/1988530159' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:06 smithi080 bash[17386]: audit 2024-02-13T00:38:05.123673+0000 mon.c (mon.2) 148 : audit [INF] from='client.? 172.21.15.80:0/2379729427' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi080-54183-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:06 smithi080 bash[17386]: audit 2024-02-13T00:38:05.124609+0000 mon.a (mon.0) 967 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi080-54183-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:06 smithi080 bash[17386]: audit 2024-02-13T00:38:05.680008+0000 mon.a (mon.0) 968 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:38:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:06 smithi080 bash[17386]: audit 2024-02-13T00:38:05.829433+0000 mon.a (mon.0) 969 : audit [DBG] from='client.? 172.21.15.80:0/3223451774' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T00:38:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:06 smithi080 bash[17386]: audit 2024-02-13T00:38:06.048002+0000 mon.a (mon.0) 970 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:06 smithi080 bash[24237]: cluster 2024-02-13T00:38:03.686065+0000 mgr.y (mgr.24461) 321 : cluster [DBG] pgmap v260: 488 pgs: 32 creating+peering, 1 active, 46 creating+activating, 409 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-13T00:38:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:06 smithi080 bash[24237]: audit 2024-02-13T00:38:05.041861+0000 mon.a (mon.0) 962 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:06 smithi080 bash[24237]: audit 2024-02-13T00:38:05.078519+0000 mon.a (mon.0) 963 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-7"}]': finished 2024-02-13T00:38:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:06 smithi080 bash[24237]: audit 2024-02-13T00:38:05.078620+0000 mon.a (mon.0) 964 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi080-54175-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:06 smithi080 bash[24237]: cluster 2024-02-13T00:38:05.079235+0000 mon.a (mon.0) 965 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2024-02-13T00:38:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:06 smithi080 bash[24237]: audit 2024-02-13T00:38:05.098411+0000 mon.a (mon.0) 966 : audit [INF] from='client.? 172.21.15.80:0/1988530159' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:06 smithi080 bash[24237]: audit 2024-02-13T00:38:05.123673+0000 mon.c (mon.2) 148 : audit [INF] from='client.? 172.21.15.80:0/2379729427' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi080-54183-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:06 smithi080 bash[24237]: audit 2024-02-13T00:38:05.124609+0000 mon.a (mon.0) 967 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi080-54183-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:06 smithi080 bash[24237]: audit 2024-02-13T00:38:05.680008+0000 mon.a (mon.0) 968 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:38:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:06 smithi080 bash[24237]: audit 2024-02-13T00:38:05.829433+0000 mon.a (mon.0) 969 : audit [DBG] from='client.? 172.21.15.80:0/3223451774' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T00:38:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:06 smithi080 bash[24237]: audit 2024-02-13T00:38:06.048002+0000 mon.a (mon.0) 970 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:07.159 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "container_image": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@s api_c_write_operations: Running main() from gmock_main.cc 2024-02-13T00:38:07.159 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2024-02-13T00:38:07.160 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [----------] Global test environment set-up. 2024-02-13T00:38:07.160 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2024-02-13T00:38:07.160 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2024-02-13T00:38:07.160 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-02-13T00:38:07.160 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2024-02-13T00:38:07.160 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: 2024-02-13T00:38:07.160 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2024-02-13T00:38:07.160 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2024-02-13T00:38:07.160 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (14313 ms) 2024-02-13T00:38:07.160 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-02-13T00:38:07.160 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (6538 ms) 2024-02-13T00:38:07.160 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2024-02-13T00:38:07.161 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (4786 ms) 2024-02-13T00:38:07.161 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2024-02-13T00:38:07.161 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (2581 ms) 2024-02-13T00:38:07.161 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2024-02-13T00:38:07.161 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (3256 ms) 2024-02-13T00:38:07.161 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2024-02-13T00:38:07.161 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (3306 ms) 2024-02-13T00:38:07.161 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2024-02-13T00:38:07.161 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (3284 ms) 2024-02-13T00:38:07.161 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (38064 ms total) 2024-02-13T00:38:07.161 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: 2024-02-13T00:38:07.161 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [----------] Global test environment tear-down 2024-02-13T00:38:07.161 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (38064 ms total) 2024-02-13T00:38:07.162 INFO:tasks.workunit.client.0.smithi080.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2024-02-13T00:38:07.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:07 smithi106 bash[18459]: cluster 2024-02-13T00:38:05.686799+0000 mgr.y (mgr.24461) 322 : cluster [DBG] pgmap v263: 520 pgs: 96 unknown, 32 creating+peering, 1 active, 22 creating+activating, 369 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:38:07.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:07 smithi106 bash[18459]: audit 2024-02-13T00:38:05.829680+0000 mgr.y (mgr.24461) 323 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T00:38:07.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:07 smithi106 bash[18459]: audit 2024-02-13T00:38:06.084100+0000 mon.a (mon.0) 971 : audit [INF] from='client.? 172.21.15.80:0/1988530159' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:07.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:07 smithi106 bash[18459]: audit 2024-02-13T00:38:06.084198+0000 mon.a (mon.0) 972 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi080-54183-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:07.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:07 smithi106 bash[18459]: audit 2024-02-13T00:38:06.084354+0000 mon.a (mon.0) 973 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:38:07.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:07 smithi106 bash[18459]: cluster 2024-02-13T00:38:06.084470+0000 mon.a (mon.0) 974 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2024-02-13T00:38:07.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:07 smithi106 bash[18459]: audit 2024-02-13T00:38:06.091902+0000 mon.a (mon.0) 975 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-7"}]: dispatch 2024-02-13T00:38:07.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:07 smithi106 bash[18459]: audit 2024-02-13T00:38:06.129290+0000 mon.b (mon.1) 61 : audit [INF] from='client.? 172.21.15.80:0/2597289200' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:07.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:07 smithi106 bash[18459]: audit 2024-02-13T00:38:06.132860+0000 mon.a (mon.0) 976 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:07.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:07 smithi106 bash[18459]: audit 2024-02-13T00:38:06.196569+0000 mon.a (mon.0) 977 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi080-54340-9"}]: dispatch 2024-02-13T00:38:07.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:07 smithi106 bash[18459]: audit 2024-02-13T00:38:06.739309+0000 mon.a (mon.0) 978 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi080-54340-9"}]: dispatch 2024-02-13T00:38:07.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:07 smithi106 bash[18459]: audit 2024-02-13T00:38:06.740982+0000 mon.a (mon.0) 979 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi080-54340-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:38:07.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:07 smithi106 bash[18459]: audit 2024-02-13T00:38:07.049023+0000 mon.a (mon.0) 980 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[17386]: cluster 2024-02-13T00:38:05.686799+0000 mgr.y (mgr.24461) 322 : cluster [DBG] pgmap v263: 520 pgs: 96 unknown, 32 creating+peering, 1 active, 22 creating+activating, 369 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:38:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[17386]: audit 2024-02-13T00:38:05.829680+0000 mgr.y (mgr.24461) 323 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T00:38:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[17386]: audit 2024-02-13T00:38:06.084100+0000 mon.a (mon.0) 971 : audit [INF] from='client.? 172.21.15.80:0/1988530159' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[17386]: audit 2024-02-13T00:38:06.084198+0000 mon.a (mon.0) 972 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi080-54183-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[17386]: audit 2024-02-13T00:38:06.084354+0000 mon.a (mon.0) 973 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:38:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[17386]: cluster 2024-02-13T00:38:06.084470+0000 mon.a (mon.0) 974 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2024-02-13T00:38:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[17386]: audit 2024-02-13T00:38:06.091902+0000 mon.a (mon.0) 975 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-7"}]: dispatch 2024-02-13T00:38:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[17386]: audit 2024-02-13T00:38:06.129290+0000 mon.b (mon.1) 61 : audit [INF] from='client.? 172.21.15.80:0/2597289200' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[17386]: audit 2024-02-13T00:38:06.132860+0000 mon.a (mon.0) 976 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:07.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[17386]: audit 2024-02-13T00:38:06.196569+0000 mon.a (mon.0) 977 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi080-54340-9"}]: dispatch 2024-02-13T00:38:07.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[17386]: audit 2024-02-13T00:38:06.739309+0000 mon.a (mon.0) 978 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi080-54340-9"}]: dispatch 2024-02-13T00:38:07.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[17386]: audit 2024-02-13T00:38:06.740982+0000 mon.a (mon.0) 979 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi080-54340-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:38:07.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[17386]: audit 2024-02-13T00:38:07.049023+0000 mon.a (mon.0) 980 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:07.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[24237]: cluster 2024-02-13T00:38:05.686799+0000 mgr.y (mgr.24461) 322 : cluster [DBG] pgmap v263: 520 pgs: 96 unknown, 32 creating+peering, 1 active, 22 creating+activating, 369 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:38:07.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[24237]: audit 2024-02-13T00:38:05.829680+0000 mgr.y (mgr.24461) 323 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T00:38:07.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[24237]: audit 2024-02-13T00:38:06.084100+0000 mon.a (mon.0) 971 : audit [INF] from='client.? 172.21.15.80:0/1988530159' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54626-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:07.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[24237]: audit 2024-02-13T00:38:06.084198+0000 mon.a (mon.0) 972 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi080-54183-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:07.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[24237]: audit 2024-02-13T00:38:06.084354+0000 mon.a (mon.0) 973 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:38:07.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[24237]: cluster 2024-02-13T00:38:06.084470+0000 mon.a (mon.0) 974 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2024-02-13T00:38:07.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[24237]: audit 2024-02-13T00:38:06.091902+0000 mon.a (mon.0) 975 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-7"}]: dispatch 2024-02-13T00:38:07.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[24237]: audit 2024-02-13T00:38:06.129290+0000 mon.b (mon.1) 61 : audit [INF] from='client.? 172.21.15.80:0/2597289200' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:07.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[24237]: audit 2024-02-13T00:38:06.132860+0000 mon.a (mon.0) 976 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:07.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[24237]: audit 2024-02-13T00:38:06.196569+0000 mon.a (mon.0) 977 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi080-54340-9"}]: dispatch 2024-02-13T00:38:07.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[24237]: audit 2024-02-13T00:38:06.739309+0000 mon.a (mon.0) 978 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi080-54340-9"}]: dispatch 2024-02-13T00:38:07.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[24237]: audit 2024-02-13T00:38:06.740982+0000 mon.a (mon.0) 979 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi080-54340-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:38:07.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:07 smithi080 bash[24237]: audit 2024-02-13T00:38:07.049023+0000 mon.a (mon.0) 980 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:08.505 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:38:08 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:38:09.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:08 smithi106 bash[18459]: audit 2024-02-13T00:38:07.097069+0000 mon.a (mon.0) 981 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-7"}]': finished 2024-02-13T00:38:09.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:08 smithi106 bash[18459]: audit 2024-02-13T00:38:07.097224+0000 mon.a (mon.0) 982 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:09.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:08 smithi106 bash[18459]: audit 2024-02-13T00:38:07.097460+0000 mon.a (mon.0) 983 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi080-54340-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:38:09.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:08 smithi106 bash[18459]: cluster 2024-02-13T00:38:07.097532+0000 mon.a (mon.0) 984 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2024-02-13T00:38:09.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:08 smithi106 bash[18459]: audit 2024-02-13T00:38:07.119432+0000 mon.a (mon.0) 985 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi080-54340-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi080-54340-9"}]: dispatch 2024-02-13T00:38:09.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:08 smithi106 bash[18459]: audit 2024-02-13T00:38:07.124645+0000 mon.a (mon.0) 986 : audit [INF] from='client.? 172.21.15.80:0/2982416495' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi080-54175-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:09.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:08 smithi080 bash[24237]: audit 2024-02-13T00:38:07.097069+0000 mon.a (mon.0) 981 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-7"}]': finished 2024-02-13T00:38:09.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:08 smithi080 bash[24237]: audit 2024-02-13T00:38:07.097224+0000 mon.a (mon.0) 982 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:09.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:08 smithi080 bash[24237]: audit 2024-02-13T00:38:07.097460+0000 mon.a (mon.0) 983 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi080-54340-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:38:09.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:08 smithi080 bash[24237]: cluster 2024-02-13T00:38:07.097532+0000 mon.a (mon.0) 984 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2024-02-13T00:38:09.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:08 smithi080 bash[24237]: audit 2024-02-13T00:38:07.119432+0000 mon.a (mon.0) 985 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi080-54340-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi080-54340-9"}]: dispatch 2024-02-13T00:38:09.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:08 smithi080 bash[24237]: audit 2024-02-13T00:38:07.124645+0000 mon.a (mon.0) 986 : audit [INF] from='client.? 172.21.15.80:0/2982416495' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi080-54175-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:09.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:08 smithi080 bash[17386]: audit 2024-02-13T00:38:07.097069+0000 mon.a (mon.0) 981 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-7"}]': finished 2024-02-13T00:38:09.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:08 smithi080 bash[17386]: audit 2024-02-13T00:38:07.097224+0000 mon.a (mon.0) 982 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:09.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:08 smithi080 bash[17386]: audit 2024-02-13T00:38:07.097460+0000 mon.a (mon.0) 983 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi080-54340-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:38:09.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:08 smithi080 bash[17386]: cluster 2024-02-13T00:38:07.097532+0000 mon.a (mon.0) 984 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2024-02-13T00:38:09.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:08 smithi080 bash[17386]: audit 2024-02-13T00:38:07.119432+0000 mon.a (mon.0) 985 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi080-54340-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi080-54340-9"}]: dispatch 2024-02-13T00:38:09.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:08 smithi080 bash[17386]: audit 2024-02-13T00:38:07.124645+0000 mon.a (mon.0) 986 : audit [INF] from='client.? 172.21.15.80:0/2982416495' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi080-54175-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:10.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:09 smithi106 bash[18459]: cluster 2024-02-13T00:38:07.687471+0000 mgr.y (mgr.24461) 324 : cluster [DBG] pgmap v266: 456 pgs: 64 unknown, 32 creating+peering, 1 active, 22 creating+activating, 337 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:10.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:09 smithi106 bash[18459]: audit 2024-02-13T00:38:08.101993+0000 mgr.y (mgr.24461) 325 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:38:10.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:09 smithi106 bash[18459]: audit 2024-02-13T00:38:08.871368+0000 mon.a (mon.0) 987 : audit [INF] from='client.? 172.21.15.80:0/2982416495' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi080-54175-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:10.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:09 smithi106 bash[18459]: cluster 2024-02-13T00:38:08.871554+0000 mon.a (mon.0) 988 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2024-02-13T00:38:10.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:09 smithi106 bash[18459]: audit 2024-02-13T00:38:08.873631+0000 mon.b (mon.1) 62 : audit [INF] from='client.? 172.21.15.80:0/3536836295' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi080-54183-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:10.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:09 smithi106 bash[18459]: audit 2024-02-13T00:38:08.879896+0000 mon.a (mon.0) 989 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:10.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:09 smithi106 bash[18459]: audit 2024-02-13T00:38:09.451427+0000 mon.a (mon.0) 990 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi080-54340-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi080-54340-9"}]': finished 2024-02-13T00:38:10.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:09 smithi106 bash[18459]: cluster 2024-02-13T00:38:09.451564+0000 mon.a (mon.0) 991 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2024-02-13T00:38:10.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:09 smithi106 bash[18459]: audit 2024-02-13T00:38:09.460977+0000 mon.a (mon.0) 992 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:10.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:09 smithi106 bash[18459]: audit 2024-02-13T00:38:09.471638+0000 mon.a (mon.0) 993 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi080-54183-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:10.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:09 smithi106 bash[18459]: audit 2024-02-13T00:38:09.530011+0000 mon.c (mon.2) 149 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4"}]: dispatch 2024-02-13T00:38:10.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:09 smithi106 bash[18459]: audit 2024-02-13T00:38:09.530431+0000 mon.a (mon.0) 994 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4"}]: dispatch 2024-02-13T00:38:10.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[24237]: cluster 2024-02-13T00:38:07.687471+0000 mgr.y (mgr.24461) 324 : cluster [DBG] pgmap v266: 456 pgs: 64 unknown, 32 creating+peering, 1 active, 22 creating+activating, 337 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:10.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[24237]: audit 2024-02-13T00:38:08.101993+0000 mgr.y (mgr.24461) 325 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:38:10.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[24237]: audit 2024-02-13T00:38:08.871368+0000 mon.a (mon.0) 987 : audit [INF] from='client.? 172.21.15.80:0/2982416495' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi080-54175-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:10.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[24237]: cluster 2024-02-13T00:38:08.871554+0000 mon.a (mon.0) 988 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2024-02-13T00:38:10.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[24237]: audit 2024-02-13T00:38:08.873631+0000 mon.b (mon.1) 62 : audit [INF] from='client.? 172.21.15.80:0/3536836295' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi080-54183-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:10.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[24237]: audit 2024-02-13T00:38:08.879896+0000 mon.a (mon.0) 989 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:10.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[24237]: audit 2024-02-13T00:38:09.451427+0000 mon.a (mon.0) 990 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi080-54340-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi080-54340-9"}]': finished 2024-02-13T00:38:10.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[24237]: cluster 2024-02-13T00:38:09.451564+0000 mon.a (mon.0) 991 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2024-02-13T00:38:10.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[24237]: audit 2024-02-13T00:38:09.460977+0000 mon.a (mon.0) 992 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:10.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[24237]: audit 2024-02-13T00:38:09.471638+0000 mon.a (mon.0) 993 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi080-54183-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:10.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[24237]: audit 2024-02-13T00:38:09.530011+0000 mon.c (mon.2) 149 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4"}]: dispatch 2024-02-13T00:38:10.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[24237]: audit 2024-02-13T00:38:09.530431+0000 mon.a (mon.0) 994 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4"}]: dispatch 2024-02-13T00:38:10.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[17386]: cluster 2024-02-13T00:38:07.687471+0000 mgr.y (mgr.24461) 324 : cluster [DBG] pgmap v266: 456 pgs: 64 unknown, 32 creating+peering, 1 active, 22 creating+activating, 337 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:10.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[17386]: audit 2024-02-13T00:38:08.101993+0000 mgr.y (mgr.24461) 325 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:38:10.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[17386]: audit 2024-02-13T00:38:08.871368+0000 mon.a (mon.0) 987 : audit [INF] from='client.? 172.21.15.80:0/2982416495' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi080-54175-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:10.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[17386]: cluster 2024-02-13T00:38:08.871554+0000 mon.a (mon.0) 988 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2024-02-13T00:38:10.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[17386]: audit 2024-02-13T00:38:08.873631+0000 mon.b (mon.1) 62 : audit [INF] from='client.? 172.21.15.80:0/3536836295' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi080-54183-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:10.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[17386]: audit 2024-02-13T00:38:08.879896+0000 mon.a (mon.0) 989 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:10.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[17386]: audit 2024-02-13T00:38:09.451427+0000 mon.a (mon.0) 990 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi080-54340-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi080-54340-9"}]': finished 2024-02-13T00:38:10.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[17386]: cluster 2024-02-13T00:38:09.451564+0000 mon.a (mon.0) 991 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2024-02-13T00:38:10.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[17386]: audit 2024-02-13T00:38:09.460977+0000 mon.a (mon.0) 992 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:10.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[17386]: audit 2024-02-13T00:38:09.471638+0000 mon.a (mon.0) 993 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi080-54183-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:10.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[17386]: audit 2024-02-13T00:38:09.530011+0000 mon.c (mon.2) 149 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4"}]: dispatch 2024-02-13T00:38:10.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:09 smithi080 bash[17386]: audit 2024-02-13T00:38:09.530431+0000 mon.a (mon.0) 994 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4"}]: dispatch 2024-02-13T00:38:10.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:38:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:38:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:38:10.953 INFO:tasks.workunit.client.0.smithi080.stdout:ha256:a9c1a3337ae6b9328bb9087151b372dee3bd15abdc1220ab67654538650c50dc", 2024-02-13T00:38:10.953 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-02-13T00:38:10.953 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "distro": "centos", 2024-02-13T00:38:10.953 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "distro_description": "CentOS Stream 8", 2024-02-13T00:38:10.954 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "distro_version": "8", 2024-02-13T00:38:10.954 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "frontend_config#0": "beast port=80", 2024-02-13T00:38:10.954 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "frontend_type#0": "beast", 2024-02-13T00:38:10.954 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "hostname": "smithi080", 2024-02-13T00:38:10.954 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "id": "foo.a", 2024-02-13T00:38:10.954 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "kernel_description": "#104~20.04.1-Ubuntu SMP Tue Jan 16 13:34:09 UTC 2024", 2024-02-13T00:38:10.954 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "kernel_version": "5.15.0-94-generic", 2024-02-13T00:38:10.954 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "mem_swap_kb": "2097148", 2024-02-13T00:38:10.954 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "mem_total_kb": "32746876", 2024-02-13T00:38:10.954 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "num_handles": "1", 2024-02-13T00:38:10.954 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "os": "Linux", 2024-02-13T00:38:10.954 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "pid": "7", 2024-02-13T00:38:10.954 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "realm_id": "", 2024-02-13T00:38:10.954 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "realm_name": "", 2024-02-13T00:38:10.954 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "zone_id": "ec35f812-8a0f-49fd-be95-542ff2cd658b", 2024-02-13T00:38:10.955 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "zone_name": "default", 2024-02-13T00:38:10.955 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "zonegroup_id": "03efcb50-5ac8-4290-92a7-93bff9c5b4a5", 2024-02-13T00:38:10.955 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "zonegroup_name": "default" 2024-02-13T00:38:10.955 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: }, 2024-02-13T00:38:10.955 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: "task_status": {} 2024-02-13T00:38:10.955 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: } 2024-02-13T00:38:10.955 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: } 2024-02-13T00:38:10.955 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: } 2024-02-13T00:38:10.955 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: } 2024-02-13T00:38:10.955 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: } 2024-02-13T00:38:10.955 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: 2024-02-13T00:38:10.955 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: attempt 2 of 20 2024-02-13T00:38:10.955 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (15330 ms) 2024-02-13T00:38:10.955 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (41857 ms total) 2024-02-13T00:38:10.955 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: 2024-02-13T00:38:10.955 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: [----------] Global test environment tear-down 2024-02-13T00:38:10.956 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (41858 ms total) 2024-02-13T00:38:10.956 INFO:tasks.workunit.client.0.smithi080.stdout: api_service_pp: [ PASSED ] 4 tests. 2024-02-13T00:38:11.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:11 smithi106 bash[18459]: cluster 2024-02-13T00:38:09.688195+0000 mgr.y (mgr.24461) 326 : cluster [DBG] pgmap v269: 528 pgs: 104 unknown, 32 creating+peering, 392 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T00:38:11.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:11 smithi106 bash[18459]: audit 2024-02-13T00:38:09.890206+0000 mon.a (mon.0) 995 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:11.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:11 smithi106 bash[18459]: audit 2024-02-13T00:38:10.454882+0000 mon.a (mon.0) 996 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:11.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:11 smithi106 bash[18459]: audit 2024-02-13T00:38:10.455014+0000 mon.a (mon.0) 997 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi080-54183-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:11.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:11 smithi106 bash[18459]: audit 2024-02-13T00:38:10.455232+0000 mon.a (mon.0) 998 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4"}]': finished 2024-02-13T00:38:11.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:11 smithi106 bash[18459]: cluster 2024-02-13T00:38:10.455307+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2024-02-13T00:38:11.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:11 smithi106 bash[18459]: audit 2024-02-13T00:38:10.473696+0000 mon.c (mon.2) 150 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6"}]: dispatch 2024-02-13T00:38:11.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:11 smithi106 bash[18459]: audit 2024-02-13T00:38:10.497361+0000 mon.a (mon.0) 1000 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6"}]: dispatch 2024-02-13T00:38:11.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:11 smithi106 bash[18459]: audit 2024-02-13T00:38:10.521561+0000 mon.a (mon.0) 1001 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:38:11.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:11 smithi080 bash[17386]: cluster 2024-02-13T00:38:09.688195+0000 mgr.y (mgr.24461) 326 : cluster [DBG] pgmap v269: 528 pgs: 104 unknown, 32 creating+peering, 392 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T00:38:11.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:11 smithi080 bash[17386]: audit 2024-02-13T00:38:09.890206+0000 mon.a (mon.0) 995 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:11.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:11 smithi080 bash[17386]: audit 2024-02-13T00:38:10.454882+0000 mon.a (mon.0) 996 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:11.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:11 smithi080 bash[17386]: audit 2024-02-13T00:38:10.455014+0000 mon.a (mon.0) 997 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi080-54183-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:11.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:11 smithi080 bash[17386]: audit 2024-02-13T00:38:10.455232+0000 mon.a (mon.0) 998 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4"}]': finished 2024-02-13T00:38:11.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:11 smithi080 bash[17386]: cluster 2024-02-13T00:38:10.455307+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2024-02-13T00:38:11.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:11 smithi080 bash[17386]: audit 2024-02-13T00:38:10.473696+0000 mon.c (mon.2) 150 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6"}]: dispatch 2024-02-13T00:38:11.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:11 smithi080 bash[17386]: audit 2024-02-13T00:38:10.497361+0000 mon.a (mon.0) 1000 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6"}]: dispatch 2024-02-13T00:38:11.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:11 smithi080 bash[17386]: audit 2024-02-13T00:38:10.521561+0000 mon.a (mon.0) 1001 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:38:11.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:11 smithi080 bash[24237]: cluster 2024-02-13T00:38:09.688195+0000 mgr.y (mgr.24461) 326 : cluster [DBG] pgmap v269: 528 pgs: 104 unknown, 32 creating+peering, 392 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T00:38:11.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:11 smithi080 bash[24237]: audit 2024-02-13T00:38:09.890206+0000 mon.a (mon.0) 995 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:11.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:11 smithi080 bash[24237]: audit 2024-02-13T00:38:10.454882+0000 mon.a (mon.0) 996 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:11.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:11 smithi080 bash[24237]: audit 2024-02-13T00:38:10.455014+0000 mon.a (mon.0) 997 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi080-54183-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:11.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:11 smithi080 bash[24237]: audit 2024-02-13T00:38:10.455232+0000 mon.a (mon.0) 998 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4"}]': finished 2024-02-13T00:38:11.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:11 smithi080 bash[24237]: cluster 2024-02-13T00:38:10.455307+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2024-02-13T00:38:11.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:11 smithi080 bash[24237]: audit 2024-02-13T00:38:10.473696+0000 mon.c (mon.2) 150 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6"}]: dispatch 2024-02-13T00:38:11.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:11 smithi080 bash[24237]: audit 2024-02-13T00:38:10.497361+0000 mon.a (mon.0) 1000 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6"}]: dispatch 2024-02-13T00:38:11.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:11 smithi080 bash[24237]: audit 2024-02-13T00:38:10.521561+0000 mon.a (mon.0) 1001 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:38:12.921 INFO:tasks.workunit.client.0.smithi080.stdout:_watch_notify_pp: flushed 2024-02-13T00:38:12.921 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3019 ms) 2024-02-13T00:38:12.921 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-02-13T00:38:12.921 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: trying... 2024-02-13T00:38:12.921 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: handle_notify cookie 94870214334208 notify_id 356482285571 notifier_gid 25172 2024-02-13T00:38:12.921 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: timed out 2024-02-13T00:38:12.922 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: flushing 2024-02-13T00:38:12.922 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: flushed 2024-02-13T00:38:12.922 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3009 ms) 2024-02-13T00:38:12.922 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-02-13T00:38:12.922 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: List watches 2024-02-13T00:38:12.922 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: notify2 2024-02-13T00:38:12.922 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: handle_notify cookie 94870214334208 notify_id 369367187461 notifier_gid 25172 2024-02-13T00:38:12.922 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: notify2 done 2024-02-13T00:38:12.922 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: watch_check 2024-02-13T00:38:12.922 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: unwatch2 2024-02-13T00:38:12.922 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: flushing 2024-02-13T00:38:12.922 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: done 2024-02-13T00:38:12.922 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3013 ms) 2024-02-13T00:38:12.922 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-02-13T00:38:12.922 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: List watches 2024-02-13T00:38:12.923 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: notify2 2024-02-13T00:38:12.923 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: handle_notify cookie 94870214334208 notify_id 382252089350 notifier_gid 25172 2024-02-13T00:38:12.923 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: notify2 done 2024-02-13T00:38:12.923 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: watch_check 2024-02-13T00:38:12.923 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: unwatch2 2024-02-13T00:38:12.923 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: flushing 2024-02-13T00:38:12.923 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: done 2024-02-13T00:38:12.923 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3015 ms) 2024-02-13T00:38:12.923 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (16691 ms total) 2024-02-13T00:38:12.923 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: 2024-02-13T00:38:12.923 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2024-02-13T00:38:12.923 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (43874 ms total) 2024-02-13T00:38:12.923 INFO:tasks.workunit.client.0.smithi080.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2024-02-13T00:38:13.116 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[17386]: audit 2024-02-13T00:38:10.934124+0000 mon.b (mon.1) 63 : audit [DBG] from='client.? 172.21.15.80:0/4100462630' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T00:38:13.116 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[17386]: audit 2024-02-13T00:38:10.936380+0000 mgr.y (mgr.24461) 327 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T00:38:13.116 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[17386]: audit 2024-02-13T00:38:11.114111+0000 mon.a (mon.0) 1002 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:13.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[17386]: cluster 2024-02-13T00:38:11.481334+0000 mon.a (mon.0) 1003 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:38:13.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[17386]: audit 2024-02-13T00:38:11.487157+0000 mon.a (mon.0) 1004 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6"}]': finished 2024-02-13T00:38:13.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[17386]: audit 2024-02-13T00:38:11.487240+0000 mon.a (mon.0) 1005 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-9", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:38:13.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[17386]: cluster 2024-02-13T00:38:11.487356+0000 mon.a (mon.0) 1006 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2024-02-13T00:38:13.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[17386]: audit 2024-02-13T00:38:11.488169+0000 mon.a (mon.0) 1007 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-9"}]: dispatch 2024-02-13T00:38:13.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[17386]: audit 2024-02-13T00:38:11.490418+0000 mon.a (mon.0) 1008 : audit [INF] from='client.? 172.21.15.80:0/2963092738' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi080-54175-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:13.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[17386]: audit 2024-02-13T00:38:11.491021+0000 mon.c (mon.2) 151 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "pool2": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:38:13.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[17386]: audit 2024-02-13T00:38:11.497125+0000 mon.a (mon.0) 1009 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "pool2": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:38:13.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[17386]: audit 2024-02-13T00:38:11.750725+0000 mon.a (mon.0) 1010 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-9"}]': finished 2024-02-13T00:38:13.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[17386]: audit 2024-02-13T00:38:11.750849+0000 mon.a (mon.0) 1011 : audit [INF] from='client.? 172.21.15.80:0/2963092738' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi080-54175-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:13.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[17386]: audit 2024-02-13T00:38:11.750923+0000 mon.a (mon.0) 1012 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "pool2": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "yes_i_really_really_mean_it": true}]': finished 2024-02-13T00:38:13.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[17386]: cluster 2024-02-13T00:38:11.751135+0000 mon.a (mon.0) 1013 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2024-02-13T00:38:13.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[17386]: audit 2024-02-13T00:38:11.755974+0000 mon.a (mon.0) 1014 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-9", "mode": "writeback"}]: dispatch 2024-02-13T00:38:13.118 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:38:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:38:13] "GET /metrics HTTP/1.1" 200 209441 "" "Prometheus/2.33.4" 2024-02-13T00:38:13.118 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[24237]: audit 2024-02-13T00:38:10.934124+0000 mon.b (mon.1) 63 : audit [DBG] from='client.? 172.21.15.80:0/4100462630' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T00:38:13.118 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[24237]: audit 2024-02-13T00:38:10.936380+0000 mgr.y (mgr.24461) 327 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T00:38:13.118 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[24237]: audit 2024-02-13T00:38:11.114111+0000 mon.a (mon.0) 1002 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:13.118 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[24237]: cluster 2024-02-13T00:38:11.481334+0000 mon.a (mon.0) 1003 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:38:13.118 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[24237]: audit 2024-02-13T00:38:11.487157+0000 mon.a (mon.0) 1004 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6"}]': finished 2024-02-13T00:38:13.118 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[24237]: audit 2024-02-13T00:38:11.487240+0000 mon.a (mon.0) 1005 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-9", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:38:13.118 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[24237]: cluster 2024-02-13T00:38:11.487356+0000 mon.a (mon.0) 1006 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2024-02-13T00:38:13.118 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[24237]: audit 2024-02-13T00:38:11.488169+0000 mon.a (mon.0) 1007 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-9"}]: dispatch 2024-02-13T00:38:13.118 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[24237]: audit 2024-02-13T00:38:11.490418+0000 mon.a (mon.0) 1008 : audit [INF] from='client.? 172.21.15.80:0/2963092738' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi080-54175-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:13.119 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[24237]: audit 2024-02-13T00:38:11.491021+0000 mon.c (mon.2) 151 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "pool2": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:38:13.119 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[24237]: audit 2024-02-13T00:38:11.497125+0000 mon.a (mon.0) 1009 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "pool2": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:38:13.119 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[24237]: audit 2024-02-13T00:38:11.750725+0000 mon.a (mon.0) 1010 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-9"}]': finished 2024-02-13T00:38:13.119 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[24237]: audit 2024-02-13T00:38:11.750849+0000 mon.a (mon.0) 1011 : audit [INF] from='client.? 172.21.15.80:0/2963092738' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi080-54175-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:13.119 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[24237]: audit 2024-02-13T00:38:11.750923+0000 mon.a (mon.0) 1012 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "pool2": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "yes_i_really_really_mean_it": true}]': finished 2024-02-13T00:38:13.119 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[24237]: cluster 2024-02-13T00:38:11.751135+0000 mon.a (mon.0) 1013 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2024-02-13T00:38:13.119 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:12 smithi080 bash[24237]: audit 2024-02-13T00:38:11.755974+0000 mon.a (mon.0) 1014 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-9", "mode": "writeback"}]: dispatch 2024-02-13T00:38:13.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:12 smithi106 bash[18459]: audit 2024-02-13T00:38:10.934124+0000 mon.b (mon.1) 63 : audit [DBG] from='client.? 172.21.15.80:0/4100462630' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T00:38:13.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:12 smithi106 bash[18459]: audit 2024-02-13T00:38:10.936380+0000 mgr.y (mgr.24461) 327 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T00:38:13.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:12 smithi106 bash[18459]: audit 2024-02-13T00:38:11.114111+0000 mon.a (mon.0) 1002 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:13.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:12 smithi106 bash[18459]: cluster 2024-02-13T00:38:11.481334+0000 mon.a (mon.0) 1003 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:38:13.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:12 smithi106 bash[18459]: audit 2024-02-13T00:38:11.487157+0000 mon.a (mon.0) 1004 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-4", "tierpool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6"}]': finished 2024-02-13T00:38:13.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:12 smithi106 bash[18459]: audit 2024-02-13T00:38:11.487240+0000 mon.a (mon.0) 1005 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-9", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:38:13.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:12 smithi106 bash[18459]: cluster 2024-02-13T00:38:11.487356+0000 mon.a (mon.0) 1006 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2024-02-13T00:38:13.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:12 smithi106 bash[18459]: audit 2024-02-13T00:38:11.488169+0000 mon.a (mon.0) 1007 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-9"}]: dispatch 2024-02-13T00:38:13.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:12 smithi106 bash[18459]: audit 2024-02-13T00:38:11.490418+0000 mon.a (mon.0) 1008 : audit [INF] from='client.? 172.21.15.80:0/2963092738' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi080-54175-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:13.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:12 smithi106 bash[18459]: audit 2024-02-13T00:38:11.491021+0000 mon.c (mon.2) 151 : audit [INF] from='client.? 172.21.15.80:0/1118290867' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "pool2": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:38:13.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:12 smithi106 bash[18459]: audit 2024-02-13T00:38:11.497125+0000 mon.a (mon.0) 1009 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "pool2": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:38:13.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:12 smithi106 bash[18459]: audit 2024-02-13T00:38:11.750725+0000 mon.a (mon.0) 1010 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-9"}]': finished 2024-02-13T00:38:13.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:12 smithi106 bash[18459]: audit 2024-02-13T00:38:11.750849+0000 mon.a (mon.0) 1011 : audit [INF] from='client.? 172.21.15.80:0/2963092738' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi080-54175-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:13.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:12 smithi106 bash[18459]: audit 2024-02-13T00:38:11.750923+0000 mon.a (mon.0) 1012 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "pool2": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi080-54497-6", "yes_i_really_really_mean_it": true}]': finished 2024-02-13T00:38:13.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:12 smithi106 bash[18459]: cluster 2024-02-13T00:38:11.751135+0000 mon.a (mon.0) 1013 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2024-02-13T00:38:13.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:12 smithi106 bash[18459]: audit 2024-02-13T00:38:11.755974+0000 mon.a (mon.0) 1014 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-9", "mode": "writeback"}]: dispatch 2024-02-13T00:38:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:13 smithi106 bash[18459]: cluster 2024-02-13T00:38:11.688878+0000 mgr.y (mgr.24461) 328 : cluster [DBG] pgmap v272: 432 pgs: 72 unknown, 360 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-02-13T00:38:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:13 smithi106 bash[18459]: cluster 2024-02-13T00:38:12.829238+0000 mon.a (mon.0) 1015 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:38:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:13 smithi106 bash[18459]: audit 2024-02-13T00:38:12.832850+0000 mon.a (mon.0) 1016 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:13 smithi106 bash[18459]: audit 2024-02-13T00:38:12.837738+0000 mon.a (mon.0) 1017 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-9", "mode": "writeback"}]': finished 2024-02-13T00:38:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:13 smithi106 bash[18459]: cluster 2024-02-13T00:38:12.838222+0000 mon.a (mon.0) 1018 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2024-02-13T00:38:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:13 smithi106 bash[18459]: audit 2024-02-13T00:38:12.854559+0000 mon.b (mon.1) 64 : audit [INF] from='client.? 172.21.15.80:0/4248098589' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi080-54183-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:13 smithi106 bash[18459]: audit 2024-02-13T00:38:12.914312+0000 mon.a (mon.0) 1019 : audit [INF] from='client.? 172.21.15.80:0/1355254644' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:13 smithi106 bash[18459]: audit 2024-02-13T00:38:12.931661+0000 mon.a (mon.0) 1020 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi080-54183-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:13 smithi106 bash[18459]: audit 2024-02-13T00:38:13.017003+0000 mon.a (mon.0) 1021 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:38:14.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:13 smithi080 bash[17386]: cluster 2024-02-13T00:38:11.688878+0000 mgr.y (mgr.24461) 328 : cluster [DBG] pgmap v272: 432 pgs: 72 unknown, 360 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-02-13T00:38:14.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:13 smithi080 bash[17386]: cluster 2024-02-13T00:38:12.829238+0000 mon.a (mon.0) 1015 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:38:14.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:13 smithi080 bash[17386]: audit 2024-02-13T00:38:12.832850+0000 mon.a (mon.0) 1016 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:14.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:13 smithi080 bash[17386]: audit 2024-02-13T00:38:12.837738+0000 mon.a (mon.0) 1017 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-9", "mode": "writeback"}]': finished 2024-02-13T00:38:14.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:13 smithi080 bash[17386]: cluster 2024-02-13T00:38:12.838222+0000 mon.a (mon.0) 1018 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2024-02-13T00:38:14.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:13 smithi080 bash[17386]: audit 2024-02-13T00:38:12.854559+0000 mon.b (mon.1) 64 : audit [INF] from='client.? 172.21.15.80:0/4248098589' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi080-54183-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:14.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:13 smithi080 bash[17386]: audit 2024-02-13T00:38:12.914312+0000 mon.a (mon.0) 1019 : audit [INF] from='client.? 172.21.15.80:0/1355254644' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:14.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:13 smithi080 bash[17386]: audit 2024-02-13T00:38:12.931661+0000 mon.a (mon.0) 1020 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi080-54183-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:14.261 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:13 smithi080 bash[17386]: audit 2024-02-13T00:38:13.017003+0000 mon.a (mon.0) 1021 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:38:14.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:13 smithi080 bash[24237]: cluster 2024-02-13T00:38:11.688878+0000 mgr.y (mgr.24461) 328 : cluster [DBG] pgmap v272: 432 pgs: 72 unknown, 360 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-02-13T00:38:14.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:13 smithi080 bash[24237]: cluster 2024-02-13T00:38:12.829238+0000 mon.a (mon.0) 1015 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:38:14.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:13 smithi080 bash[24237]: audit 2024-02-13T00:38:12.832850+0000 mon.a (mon.0) 1016 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:14.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:13 smithi080 bash[24237]: audit 2024-02-13T00:38:12.837738+0000 mon.a (mon.0) 1017 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-9", "mode": "writeback"}]': finished 2024-02-13T00:38:14.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:13 smithi080 bash[24237]: cluster 2024-02-13T00:38:12.838222+0000 mon.a (mon.0) 1018 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2024-02-13T00:38:14.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:13 smithi080 bash[24237]: audit 2024-02-13T00:38:12.854559+0000 mon.b (mon.1) 64 : audit [INF] from='client.? 172.21.15.80:0/4248098589' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi080-54183-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:14.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:13 smithi080 bash[24237]: audit 2024-02-13T00:38:12.914312+0000 mon.a (mon.0) 1019 : audit [INF] from='client.? 172.21.15.80:0/1355254644' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:14.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:13 smithi080 bash[24237]: audit 2024-02-13T00:38:12.931661+0000 mon.a (mon.0) 1020 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi080-54183-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:14.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:13 smithi080 bash[24237]: audit 2024-02-13T00:38:13.017003+0000 mon.a (mon.0) 1021 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:38:15.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:15 smithi106 bash[18459]: cluster 2024-02-13T00:38:13.689499+0000 mgr.y (mgr.24461) 329 : cluster [DBG] pgmap v275: 460 pgs: 64 unknown, 396 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:15.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:15 smithi106 bash[18459]: cluster 2024-02-13T00:38:13.833797+0000 mon.a (mon.0) 1022 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:38:15.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:15 smithi106 bash[18459]: audit 2024-02-13T00:38:13.834992+0000 mon.a (mon.0) 1023 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:15.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:15 smithi106 bash[18459]: audit 2024-02-13T00:38:13.845021+0000 mon.a (mon.0) 1024 : audit [INF] from='client.? 172.21.15.80:0/1355254644' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:15.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:15 smithi106 bash[18459]: audit 2024-02-13T00:38:13.845269+0000 mon.a (mon.0) 1025 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi080-54183-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:15.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:15 smithi106 bash[18459]: audit 2024-02-13T00:38:13.845375+0000 mon.a (mon.0) 1026 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:38:15.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:15 smithi106 bash[18459]: cluster 2024-02-13T00:38:13.845435+0000 mon.a (mon.0) 1027 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2024-02-13T00:38:15.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:15 smithi106 bash[18459]: audit 2024-02-13T00:38:13.880648+0000 mon.a (mon.0) 1028 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-9"}]: dispatch 2024-02-13T00:38:15.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:15 smithi106 bash[18459]: audit 2024-02-13T00:38:14.406810+0000 mon.c (mon.2) 152 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.0"}]: dispatch 2024-02-13T00:38:15.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:15 smithi106 bash[18459]: audit 2024-02-13T00:38:14.418869+0000 mon.c (mon.2) 153 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.1"}]: dispatch 2024-02-13T00:38:15.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:15 smithi106 bash[18459]: audit 2024-02-13T00:38:14.419726+0000 mon.c (mon.2) 154 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.2"}]: dispatch 2024-02-13T00:38:15.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:15 smithi106 bash[18459]: audit 2024-02-13T00:38:14.420554+0000 mon.c (mon.2) 155 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.3"}]: dispatch 2024-02-13T00:38:15.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:15 smithi106 bash[18459]: audit 2024-02-13T00:38:14.421359+0000 mon.c (mon.2) 156 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.4"}]: dispatch 2024-02-13T00:38:15.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:15 smithi106 bash[18459]: audit 2024-02-13T00:38:14.422217+0000 mon.c (mon.2) 157 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.5"}]: dispatch 2024-02-13T00:38:15.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:15 smithi106 bash[18459]: audit 2024-02-13T00:38:14.422892+0000 mon.c (mon.2) 158 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.6"}]: dispatch 2024-02-13T00:38:15.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:15 smithi106 bash[18459]: audit 2024-02-13T00:38:14.423705+0000 mon.c (mon.2) 159 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.7"}]: dispatch 2024-02-13T00:38:15.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:15 smithi106 bash[18459]: audit 2024-02-13T00:38:14.424732+0000 mon.c (mon.2) 160 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.8"}]: dispatch 2024-02-13T00:38:15.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:15 smithi106 bash[18459]: audit 2024-02-13T00:38:14.426536+0000 mon.c (mon.2) 161 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.9"}]: dispatch 2024-02-13T00:38:15.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[17386]: cluster 2024-02-13T00:38:13.689499+0000 mgr.y (mgr.24461) 329 : cluster [DBG] pgmap v275: 460 pgs: 64 unknown, 396 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:15.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[17386]: cluster 2024-02-13T00:38:13.833797+0000 mon.a (mon.0) 1022 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:38:15.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[17386]: audit 2024-02-13T00:38:13.834992+0000 mon.a (mon.0) 1023 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:15.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[17386]: audit 2024-02-13T00:38:13.845021+0000 mon.a (mon.0) 1024 : audit [INF] from='client.? 172.21.15.80:0/1355254644' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:15.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[17386]: audit 2024-02-13T00:38:13.845269+0000 mon.a (mon.0) 1025 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi080-54183-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:15.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[17386]: audit 2024-02-13T00:38:13.845375+0000 mon.a (mon.0) 1026 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:38:15.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[17386]: cluster 2024-02-13T00:38:13.845435+0000 mon.a (mon.0) 1027 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2024-02-13T00:38:15.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[17386]: audit 2024-02-13T00:38:13.880648+0000 mon.a (mon.0) 1028 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-9"}]: dispatch 2024-02-13T00:38:15.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[17386]: audit 2024-02-13T00:38:14.406810+0000 mon.c (mon.2) 152 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.0"}]: dispatch 2024-02-13T00:38:15.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[17386]: audit 2024-02-13T00:38:14.418869+0000 mon.c (mon.2) 153 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.1"}]: dispatch 2024-02-13T00:38:15.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[17386]: audit 2024-02-13T00:38:14.419726+0000 mon.c (mon.2) 154 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.2"}]: dispatch 2024-02-13T00:38:15.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[17386]: audit 2024-02-13T00:38:14.420554+0000 mon.c (mon.2) 155 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.3"}]: dispatch 2024-02-13T00:38:15.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[17386]: audit 2024-02-13T00:38:14.421359+0000 mon.c (mon.2) 156 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.4"}]: dispatch 2024-02-13T00:38:15.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[17386]: audit 2024-02-13T00:38:14.422217+0000 mon.c (mon.2) 157 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.5"}]: dispatch 2024-02-13T00:38:15.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[17386]: audit 2024-02-13T00:38:14.422892+0000 mon.c (mon.2) 158 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.6"}]: dispatch 2024-02-13T00:38:15.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[17386]: audit 2024-02-13T00:38:14.423705+0000 mon.c (mon.2) 159 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.7"}]: dispatch 2024-02-13T00:38:15.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[17386]: audit 2024-02-13T00:38:14.424732+0000 mon.c (mon.2) 160 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.8"}]: dispatch 2024-02-13T00:38:15.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[17386]: audit 2024-02-13T00:38:14.426536+0000 mon.c (mon.2) 161 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.9"}]: dispatch 2024-02-13T00:38:15.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[24237]: cluster 2024-02-13T00:38:13.689499+0000 mgr.y (mgr.24461) 329 : cluster [DBG] pgmap v275: 460 pgs: 64 unknown, 396 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:15.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[24237]: cluster 2024-02-13T00:38:13.833797+0000 mon.a (mon.0) 1022 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:38:15.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[24237]: audit 2024-02-13T00:38:13.834992+0000 mon.a (mon.0) 1023 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:15.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[24237]: audit 2024-02-13T00:38:13.845021+0000 mon.a (mon.0) 1024 : audit [INF] from='client.? 172.21.15.80:0/1355254644' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:15.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[24237]: audit 2024-02-13T00:38:13.845269+0000 mon.a (mon.0) 1025 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi080-54183-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:15.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[24237]: audit 2024-02-13T00:38:13.845375+0000 mon.a (mon.0) 1026 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:38:15.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[24237]: cluster 2024-02-13T00:38:13.845435+0000 mon.a (mon.0) 1027 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2024-02-13T00:38:15.513 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[24237]: audit 2024-02-13T00:38:13.880648+0000 mon.a (mon.0) 1028 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-9"}]: dispatch 2024-02-13T00:38:15.513 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[24237]: audit 2024-02-13T00:38:14.406810+0000 mon.c (mon.2) 152 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.0"}]: dispatch 2024-02-13T00:38:15.513 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[24237]: audit 2024-02-13T00:38:14.418869+0000 mon.c (mon.2) 153 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.1"}]: dispatch 2024-02-13T00:38:15.513 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[24237]: audit 2024-02-13T00:38:14.419726+0000 mon.c (mon.2) 154 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.2"}]: dispatch 2024-02-13T00:38:15.513 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[24237]: audit 2024-02-13T00:38:14.420554+0000 mon.c (mon.2) 155 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.3"}]: dispatch 2024-02-13T00:38:15.513 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[24237]: audit 2024-02-13T00:38:14.421359+0000 mon.c (mon.2) 156 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.4"}]: dispatch 2024-02-13T00:38:15.513 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[24237]: audit 2024-02-13T00:38:14.422217+0000 mon.c (mon.2) 157 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.5"}]: dispatch 2024-02-13T00:38:15.513 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[24237]: audit 2024-02-13T00:38:14.422892+0000 mon.c (mon.2) 158 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.6"}]: dispatch 2024-02-13T00:38:15.513 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[24237]: audit 2024-02-13T00:38:14.423705+0000 mon.c (mon.2) 159 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.7"}]: dispatch 2024-02-13T00:38:15.513 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[24237]: audit 2024-02-13T00:38:14.424732+0000 mon.c (mon.2) 160 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.8"}]: dispatch 2024-02-13T00:38:15.513 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:15 smithi080 bash[24237]: audit 2024-02-13T00:38:14.426536+0000 mon.c (mon.2) 161 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.9"}]: dispatch 2024-02-13T00:38:16.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:16 smithi106 bash[18459]: audit 2024-02-13T00:38:14.408358+0000 mgr.y (mgr.24461) 330 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.0"}]: dispatch 2024-02-13T00:38:16.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:16 smithi106 bash[18459]: audit 2024-02-13T00:38:14.419088+0000 mgr.y (mgr.24461) 331 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.1"}]: dispatch 2024-02-13T00:38:16.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:16 smithi106 bash[18459]: audit 2024-02-13T00:38:14.419950+0000 mgr.y (mgr.24461) 332 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.2"}]: dispatch 2024-02-13T00:38:16.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:16 smithi106 bash[18459]: audit 2024-02-13T00:38:14.420725+0000 mgr.y (mgr.24461) 333 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.3"}]: dispatch 2024-02-13T00:38:16.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:16 smithi106 bash[18459]: audit 2024-02-13T00:38:14.421532+0000 mgr.y (mgr.24461) 334 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.4"}]: dispatch 2024-02-13T00:38:16.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:16 smithi106 bash[18459]: audit 2024-02-13T00:38:14.422396+0000 mgr.y (mgr.24461) 335 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.5"}]: dispatch 2024-02-13T00:38:16.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:16 smithi106 bash[18459]: audit 2024-02-13T00:38:14.423166+0000 mgr.y (mgr.24461) 336 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.6"}]: dispatch 2024-02-13T00:38:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:16 smithi106 bash[18459]: audit 2024-02-13T00:38:14.423978+0000 mgr.y (mgr.24461) 337 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.7"}]: dispatch 2024-02-13T00:38:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:16 smithi106 bash[18459]: audit 2024-02-13T00:38:14.425018+0000 mgr.y (mgr.24461) 338 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.8"}]: dispatch 2024-02-13T00:38:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:16 smithi106 bash[18459]: audit 2024-02-13T00:38:14.426955+0000 mgr.y (mgr.24461) 339 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.9"}]: dispatch 2024-02-13T00:38:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:16 smithi106 bash[18459]: cluster 2024-02-13T00:38:15.044728+0000 mon.a (mon.0) 1029 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:38:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:16 smithi106 bash[18459]: audit 2024-02-13T00:38:15.046984+0000 mon.a (mon.0) 1030 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:16 smithi106 bash[18459]: audit 2024-02-13T00:38:15.087123+0000 mon.a (mon.0) 1031 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-9"}]': finished 2024-02-13T00:38:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:16 smithi106 bash[18459]: cluster 2024-02-13T00:38:15.087255+0000 mon.a (mon.0) 1032 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2024-02-13T00:38:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:16 smithi106 bash[18459]: audit 2024-02-13T00:38:15.104814+0000 mon.a (mon.0) 1033 : audit [INF] from='client.? 172.21.15.80:0/1289237162' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi080-54175-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:16 smithi106 bash[18459]: cluster 2024-02-13T00:38:15.242567+0000 osd.7 (osd.7) 7 : cluster [DBG] 17.0 deep-scrub starts 2024-02-13T00:38:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:16 smithi106 bash[18459]: audit 2024-02-13T00:38:16.048855+0000 mon.a (mon.0) 1034 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:16.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[24237]: audit 2024-02-13T00:38:14.408358+0000 mgr.y (mgr.24461) 330 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.0"}]: dispatch 2024-02-13T00:38:16.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[24237]: audit 2024-02-13T00:38:14.419088+0000 mgr.y (mgr.24461) 331 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.1"}]: dispatch 2024-02-13T00:38:16.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[24237]: audit 2024-02-13T00:38:14.419950+0000 mgr.y (mgr.24461) 332 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.2"}]: dispatch 2024-02-13T00:38:16.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[24237]: audit 2024-02-13T00:38:14.420725+0000 mgr.y (mgr.24461) 333 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.3"}]: dispatch 2024-02-13T00:38:16.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[24237]: audit 2024-02-13T00:38:14.421532+0000 mgr.y (mgr.24461) 334 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.4"}]: dispatch 2024-02-13T00:38:16.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[24237]: audit 2024-02-13T00:38:14.422396+0000 mgr.y (mgr.24461) 335 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.5"}]: dispatch 2024-02-13T00:38:16.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[24237]: audit 2024-02-13T00:38:14.423166+0000 mgr.y (mgr.24461) 336 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.6"}]: dispatch 2024-02-13T00:38:16.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[24237]: audit 2024-02-13T00:38:14.423978+0000 mgr.y (mgr.24461) 337 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.7"}]: dispatch 2024-02-13T00:38:16.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[24237]: audit 2024-02-13T00:38:14.425018+0000 mgr.y (mgr.24461) 338 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.8"}]: dispatch 2024-02-13T00:38:16.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[24237]: audit 2024-02-13T00:38:14.426955+0000 mgr.y (mgr.24461) 339 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.9"}]: dispatch 2024-02-13T00:38:16.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[24237]: cluster 2024-02-13T00:38:15.044728+0000 mon.a (mon.0) 1029 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:38:16.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[24237]: audit 2024-02-13T00:38:15.046984+0000 mon.a (mon.0) 1030 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:16.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[24237]: audit 2024-02-13T00:38:15.087123+0000 mon.a (mon.0) 1031 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-9"}]': finished 2024-02-13T00:38:16.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[24237]: cluster 2024-02-13T00:38:15.087255+0000 mon.a (mon.0) 1032 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2024-02-13T00:38:16.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[24237]: audit 2024-02-13T00:38:15.104814+0000 mon.a (mon.0) 1033 : audit [INF] from='client.? 172.21.15.80:0/1289237162' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi080-54175-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:16.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[24237]: cluster 2024-02-13T00:38:15.242567+0000 osd.7 (osd.7) 7 : cluster [DBG] 17.0 deep-scrub starts 2024-02-13T00:38:16.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[24237]: audit 2024-02-13T00:38:16.048855+0000 mon.a (mon.0) 1034 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:16.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[17386]: audit 2024-02-13T00:38:14.408358+0000 mgr.y (mgr.24461) 330 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.0"}]: dispatch 2024-02-13T00:38:16.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[17386]: audit 2024-02-13T00:38:14.419088+0000 mgr.y (mgr.24461) 331 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.1"}]: dispatch 2024-02-13T00:38:16.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[17386]: audit 2024-02-13T00:38:14.419950+0000 mgr.y (mgr.24461) 332 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.2"}]: dispatch 2024-02-13T00:38:16.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[17386]: audit 2024-02-13T00:38:14.420725+0000 mgr.y (mgr.24461) 333 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.3"}]: dispatch 2024-02-13T00:38:16.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[17386]: audit 2024-02-13T00:38:14.421532+0000 mgr.y (mgr.24461) 334 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.4"}]: dispatch 2024-02-13T00:38:16.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[17386]: audit 2024-02-13T00:38:14.422396+0000 mgr.y (mgr.24461) 335 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.5"}]: dispatch 2024-02-13T00:38:16.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[17386]: audit 2024-02-13T00:38:14.423166+0000 mgr.y (mgr.24461) 336 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.6"}]: dispatch 2024-02-13T00:38:16.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[17386]: audit 2024-02-13T00:38:14.423978+0000 mgr.y (mgr.24461) 337 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.7"}]: dispatch 2024-02-13T00:38:16.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[17386]: audit 2024-02-13T00:38:14.425018+0000 mgr.y (mgr.24461) 338 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.8"}]: dispatch 2024-02-13T00:38:16.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[17386]: audit 2024-02-13T00:38:14.426955+0000 mgr.y (mgr.24461) 339 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "17.9"}]: dispatch 2024-02-13T00:38:16.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[17386]: cluster 2024-02-13T00:38:15.044728+0000 mon.a (mon.0) 1029 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:38:16.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[17386]: audit 2024-02-13T00:38:15.046984+0000 mon.a (mon.0) 1030 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:16.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[17386]: audit 2024-02-13T00:38:15.087123+0000 mon.a (mon.0) 1031 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-9"}]': finished 2024-02-13T00:38:16.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[17386]: cluster 2024-02-13T00:38:15.087255+0000 mon.a (mon.0) 1032 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2024-02-13T00:38:16.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[17386]: audit 2024-02-13T00:38:15.104814+0000 mon.a (mon.0) 1033 : audit [INF] from='client.? 172.21.15.80:0/1289237162' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi080-54175-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:16.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[17386]: cluster 2024-02-13T00:38:15.242567+0000 osd.7 (osd.7) 7 : cluster [DBG] 17.0 deep-scrub starts 2024-02-13T00:38:16.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:16 smithi080 bash[17386]: audit 2024-02-13T00:38:16.048855+0000 mon.a (mon.0) 1034 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:17.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:17 smithi106 bash[18459]: cluster 2024-02-13T00:38:15.293402+0000 osd.7 (osd.7) 8 : cluster [DBG] 17.0 deep-scrub ok 2024-02-13T00:38:17.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:17 smithi106 bash[18459]: cluster 2024-02-13T00:38:15.669587+0000 osd.0 (osd.0) 9 : cluster [DBG] 17.1 deep-scrub starts 2024-02-13T00:38:17.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:17 smithi106 bash[18459]: cluster 2024-02-13T00:38:15.673877+0000 osd.0 (osd.0) 10 : cluster [DBG] 17.1 deep-scrub ok 2024-02-13T00:38:17.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:17 smithi106 bash[18459]: cluster 2024-02-13T00:38:15.690446+0000 mgr.y (mgr.24461) 340 : cluster [DBG] pgmap v278: 460 pgs: 96 unknown, 364 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:17.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:17 smithi106 bash[18459]: audit 2024-02-13T00:38:16.087185+0000 mon.a (mon.0) 1035 : audit [INF] from='client.? 172.21.15.80:0/1289237162' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi080-54175-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:17.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:17 smithi106 bash[18459]: cluster 2024-02-13T00:38:16.087373+0000 mon.a (mon.0) 1036 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2024-02-13T00:38:17.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:17 smithi106 bash[18459]: audit 2024-02-13T00:38:16.106977+0000 mon.b (mon.1) 65 : audit [INF] from='client.? 172.21.15.80:0/2586774849' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi080-54183-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:17 smithi106 bash[18459]: audit 2024-02-13T00:38:16.654012+0000 mon.a (mon.0) 1037 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi080-54183-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:17 smithi106 bash[18459]: audit 2024-02-13T00:38:16.755713+0000 mon.a (mon.0) 1038 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi080-54183-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:17 smithi106 bash[18459]: cluster 2024-02-13T00:38:16.755838+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2024-02-13T00:38:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:17 smithi106 bash[18459]: audit 2024-02-13T00:38:16.772655+0000 mon.a (mon.0) 1040 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:17.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:17 smithi080 bash[17386]: cluster 2024-02-13T00:38:15.293402+0000 osd.7 (osd.7) 8 : cluster [DBG] 17.0 deep-scrub ok 2024-02-13T00:38:17.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:17 smithi080 bash[17386]: cluster 2024-02-13T00:38:15.669587+0000 osd.0 (osd.0) 9 : cluster [DBG] 17.1 deep-scrub starts 2024-02-13T00:38:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:17 smithi080 bash[17386]: cluster 2024-02-13T00:38:15.673877+0000 osd.0 (osd.0) 10 : cluster [DBG] 17.1 deep-scrub ok 2024-02-13T00:38:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:17 smithi080 bash[17386]: cluster 2024-02-13T00:38:15.690446+0000 mgr.y (mgr.24461) 340 : cluster [DBG] pgmap v278: 460 pgs: 96 unknown, 364 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:17 smithi080 bash[17386]: audit 2024-02-13T00:38:16.087185+0000 mon.a (mon.0) 1035 : audit [INF] from='client.? 172.21.15.80:0/1289237162' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi080-54175-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:17 smithi080 bash[17386]: cluster 2024-02-13T00:38:16.087373+0000 mon.a (mon.0) 1036 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2024-02-13T00:38:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:17 smithi080 bash[17386]: audit 2024-02-13T00:38:16.106977+0000 mon.b (mon.1) 65 : audit [INF] from='client.? 172.21.15.80:0/2586774849' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi080-54183-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:17 smithi080 bash[17386]: audit 2024-02-13T00:38:16.654012+0000 mon.a (mon.0) 1037 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi080-54183-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:17 smithi080 bash[17386]: audit 2024-02-13T00:38:16.755713+0000 mon.a (mon.0) 1038 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi080-54183-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:17 smithi080 bash[17386]: cluster 2024-02-13T00:38:16.755838+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2024-02-13T00:38:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:17 smithi080 bash[17386]: audit 2024-02-13T00:38:16.772655+0000 mon.a (mon.0) 1040 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:17.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:17 smithi080 bash[24237]: cluster 2024-02-13T00:38:15.293402+0000 osd.7 (osd.7) 8 : cluster [DBG] 17.0 deep-scrub ok 2024-02-13T00:38:17.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:17 smithi080 bash[24237]: cluster 2024-02-13T00:38:15.669587+0000 osd.0 (osd.0) 9 : cluster [DBG] 17.1 deep-scrub starts 2024-02-13T00:38:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:17 smithi080 bash[24237]: cluster 2024-02-13T00:38:15.673877+0000 osd.0 (osd.0) 10 : cluster [DBG] 17.1 deep-scrub ok 2024-02-13T00:38:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:17 smithi080 bash[24237]: cluster 2024-02-13T00:38:15.690446+0000 mgr.y (mgr.24461) 340 : cluster [DBG] pgmap v278: 460 pgs: 96 unknown, 364 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:17 smithi080 bash[24237]: audit 2024-02-13T00:38:16.087185+0000 mon.a (mon.0) 1035 : audit [INF] from='client.? 172.21.15.80:0/1289237162' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi080-54175-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:17 smithi080 bash[24237]: cluster 2024-02-13T00:38:16.087373+0000 mon.a (mon.0) 1036 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2024-02-13T00:38:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:17 smithi080 bash[24237]: audit 2024-02-13T00:38:16.106977+0000 mon.b (mon.1) 65 : audit [INF] from='client.? 172.21.15.80:0/2586774849' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi080-54183-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:17 smithi080 bash[24237]: audit 2024-02-13T00:38:16.654012+0000 mon.a (mon.0) 1037 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi080-54183-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:17 smithi080 bash[24237]: audit 2024-02-13T00:38:16.755713+0000 mon.a (mon.0) 1038 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi080-54183-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:17 smithi080 bash[24237]: cluster 2024-02-13T00:38:16.755838+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2024-02-13T00:38:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:17 smithi080 bash[24237]: audit 2024-02-13T00:38:16.772655+0000 mon.a (mon.0) 1040 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:18.505 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:38:18 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:38:19.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:18 smithi106 bash[18459]: cluster 2024-02-13T00:38:16.688873+0000 osd.0 (osd.0) 11 : cluster [DBG] 17.4 deep-scrub starts 2024-02-13T00:38:19.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:18 smithi106 bash[18459]: cluster 2024-02-13T00:38:16.691013+0000 osd.0 (osd.0) 12 : cluster [DBG] 17.4 deep-scrub ok 2024-02-13T00:38:19.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:18 smithi106 bash[18459]: audit 2024-02-13T00:38:17.409420+0000 mon.a (mon.0) 1041 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:19.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:18 smithi106 bash[18459]: audit 2024-02-13T00:38:17.419535+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:38:19.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:18 smithi106 bash[18459]: cluster 2024-02-13T00:38:17.631327+0000 osd.6 (osd.6) 7 : cluster [DBG] 17.5 deep-scrub starts 2024-02-13T00:38:19.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:18 smithi106 bash[18459]: cluster 2024-02-13T00:38:17.634796+0000 osd.6 (osd.6) 8 : cluster [DBG] 17.5 deep-scrub ok 2024-02-13T00:38:19.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:18 smithi106 bash[18459]: audit 2024-02-13T00:38:17.976974+0000 mon.a (mon.0) 1043 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:19.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:18 smithi106 bash[18459]: cluster 2024-02-13T00:38:17.977324+0000 mon.a (mon.0) 1044 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2024-02-13T00:38:19.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:18 smithi106 bash[18459]: audit 2024-02-13T00:38:17.989312+0000 mon.b (mon.1) 66 : audit [INF] from='client.? 172.21.15.80:0/3976956842' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:19.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:18 smithi106 bash[18459]: audit 2024-02-13T00:38:18.027949+0000 mon.a (mon.0) 1045 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:19.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:18 smithi106 bash[18459]: audit 2024-02-13T00:38:18.053124+0000 mon.a (mon.0) 1046 : audit [INF] from='client.? 172.21.15.80:0/3434933650' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi080-54175-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:19.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:18 smithi080 bash[17386]: cluster 2024-02-13T00:38:16.688873+0000 osd.0 (osd.0) 11 : cluster [DBG] 17.4 deep-scrub starts 2024-02-13T00:38:19.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:18 smithi080 bash[17386]: cluster 2024-02-13T00:38:16.691013+0000 osd.0 (osd.0) 12 : cluster [DBG] 17.4 deep-scrub ok 2024-02-13T00:38:19.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:18 smithi080 bash[17386]: audit 2024-02-13T00:38:17.409420+0000 mon.a (mon.0) 1041 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:19.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:18 smithi080 bash[17386]: audit 2024-02-13T00:38:17.419535+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:38:19.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:18 smithi080 bash[17386]: cluster 2024-02-13T00:38:17.631327+0000 osd.6 (osd.6) 7 : cluster [DBG] 17.5 deep-scrub starts 2024-02-13T00:38:19.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:18 smithi080 bash[17386]: cluster 2024-02-13T00:38:17.634796+0000 osd.6 (osd.6) 8 : cluster [DBG] 17.5 deep-scrub ok 2024-02-13T00:38:19.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:18 smithi080 bash[17386]: audit 2024-02-13T00:38:17.976974+0000 mon.a (mon.0) 1043 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:19.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:18 smithi080 bash[17386]: cluster 2024-02-13T00:38:17.977324+0000 mon.a (mon.0) 1044 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2024-02-13T00:38:19.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:18 smithi080 bash[17386]: audit 2024-02-13T00:38:17.989312+0000 mon.b (mon.1) 66 : audit [INF] from='client.? 172.21.15.80:0/3976956842' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:19.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:18 smithi080 bash[17386]: audit 2024-02-13T00:38:18.027949+0000 mon.a (mon.0) 1045 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:19.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:18 smithi080 bash[17386]: audit 2024-02-13T00:38:18.053124+0000 mon.a (mon.0) 1046 : audit [INF] from='client.? 172.21.15.80:0/3434933650' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi080-54175-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:19.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:18 smithi080 bash[24237]: cluster 2024-02-13T00:38:16.688873+0000 osd.0 (osd.0) 11 : cluster [DBG] 17.4 deep-scrub starts 2024-02-13T00:38:19.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:18 smithi080 bash[24237]: cluster 2024-02-13T00:38:16.691013+0000 osd.0 (osd.0) 12 : cluster [DBG] 17.4 deep-scrub ok 2024-02-13T00:38:19.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:18 smithi080 bash[24237]: audit 2024-02-13T00:38:17.409420+0000 mon.a (mon.0) 1041 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:19.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:18 smithi080 bash[24237]: audit 2024-02-13T00:38:17.419535+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:38:19.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:18 smithi080 bash[24237]: cluster 2024-02-13T00:38:17.631327+0000 osd.6 (osd.6) 7 : cluster [DBG] 17.5 deep-scrub starts 2024-02-13T00:38:19.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:18 smithi080 bash[24237]: cluster 2024-02-13T00:38:17.634796+0000 osd.6 (osd.6) 8 : cluster [DBG] 17.5 deep-scrub ok 2024-02-13T00:38:19.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:18 smithi080 bash[24237]: audit 2024-02-13T00:38:17.976974+0000 mon.a (mon.0) 1043 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:19.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:18 smithi080 bash[24237]: cluster 2024-02-13T00:38:17.977324+0000 mon.a (mon.0) 1044 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2024-02-13T00:38:19.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:18 smithi080 bash[24237]: audit 2024-02-13T00:38:17.989312+0000 mon.b (mon.1) 66 : audit [INF] from='client.? 172.21.15.80:0/3976956842' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:19.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:18 smithi080 bash[24237]: audit 2024-02-13T00:38:18.027949+0000 mon.a (mon.0) 1045 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:19.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:18 smithi080 bash[24237]: audit 2024-02-13T00:38:18.053124+0000 mon.a (mon.0) 1046 : audit [INF] from='client.? 172.21.15.80:0/3434933650' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi080-54175-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:20.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:19 smithi106 bash[18459]: cluster 2024-02-13T00:38:17.691287+0000 mgr.y (mgr.24461) 341 : cluster [DBG] pgmap v281: 396 pgs: 64 unknown, 332 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:20.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:19 smithi106 bash[18459]: audit 2024-02-13T00:38:18.109604+0000 mgr.y (mgr.24461) 342 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:38:20.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:19 smithi106 bash[18459]: audit 2024-02-13T00:38:18.617855+0000 mon.a (mon.0) 1047 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:20.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:19 smithi106 bash[18459]: audit 2024-02-13T00:38:18.978456+0000 mon.a (mon.0) 1048 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:20.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:19 smithi106 bash[18459]: audit 2024-02-13T00:38:18.978684+0000 mon.a (mon.0) 1049 : audit [INF] from='client.? 172.21.15.80:0/3434933650' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi080-54175-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:20.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:19 smithi106 bash[18459]: cluster 2024-02-13T00:38:18.978818+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2024-02-13T00:38:20.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:19 smithi106 bash[18459]: audit 2024-02-13T00:38:19.008027+0000 mon.c (mon.2) 162 : audit [INF] from='client.? 172.21.15.80:0/927453863' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi080-54183-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:20.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:19 smithi106 bash[18459]: audit 2024-02-13T00:38:19.455875+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:38:20.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:19 smithi106 bash[18459]: audit 2024-02-13T00:38:19.457874+0000 mon.a (mon.0) 1052 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi080-54183-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:20.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:19 smithi080 bash[17386]: cluster 2024-02-13T00:38:17.691287+0000 mgr.y (mgr.24461) 341 : cluster [DBG] pgmap v281: 396 pgs: 64 unknown, 332 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:20.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:19 smithi080 bash[17386]: audit 2024-02-13T00:38:18.109604+0000 mgr.y (mgr.24461) 342 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:38:20.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:19 smithi080 bash[17386]: audit 2024-02-13T00:38:18.617855+0000 mon.a (mon.0) 1047 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:20.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:19 smithi080 bash[17386]: audit 2024-02-13T00:38:18.978456+0000 mon.a (mon.0) 1048 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:20.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:19 smithi080 bash[17386]: audit 2024-02-13T00:38:18.978684+0000 mon.a (mon.0) 1049 : audit [INF] from='client.? 172.21.15.80:0/3434933650' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi080-54175-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:20.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:19 smithi080 bash[17386]: cluster 2024-02-13T00:38:18.978818+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2024-02-13T00:38:20.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:19 smithi080 bash[17386]: audit 2024-02-13T00:38:19.008027+0000 mon.c (mon.2) 162 : audit [INF] from='client.? 172.21.15.80:0/927453863' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi080-54183-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:20.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:19 smithi080 bash[17386]: audit 2024-02-13T00:38:19.455875+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:38:20.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:19 smithi080 bash[17386]: audit 2024-02-13T00:38:19.457874+0000 mon.a (mon.0) 1052 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi080-54183-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:20.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:19 smithi080 bash[24237]: cluster 2024-02-13T00:38:17.691287+0000 mgr.y (mgr.24461) 341 : cluster [DBG] pgmap v281: 396 pgs: 64 unknown, 332 active+clean; 144 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:20.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:19 smithi080 bash[24237]: audit 2024-02-13T00:38:18.109604+0000 mgr.y (mgr.24461) 342 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:38:20.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:19 smithi080 bash[24237]: audit 2024-02-13T00:38:18.617855+0000 mon.a (mon.0) 1047 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:20.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:19 smithi080 bash[24237]: audit 2024-02-13T00:38:18.978456+0000 mon.a (mon.0) 1048 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54260-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:20.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:19 smithi080 bash[24237]: audit 2024-02-13T00:38:18.978684+0000 mon.a (mon.0) 1049 : audit [INF] from='client.? 172.21.15.80:0/3434933650' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi080-54175-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:20.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:19 smithi080 bash[24237]: cluster 2024-02-13T00:38:18.978818+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2024-02-13T00:38:20.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:19 smithi080 bash[24237]: audit 2024-02-13T00:38:19.008027+0000 mon.c (mon.2) 162 : audit [INF] from='client.? 172.21.15.80:0/927453863' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi080-54183-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:20.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:19 smithi080 bash[24237]: audit 2024-02-13T00:38:19.455875+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:38:20.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:19 smithi080 bash[24237]: audit 2024-02-13T00:38:19.457874+0000 mon.a (mon.0) 1052 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi080-54183-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:20.011 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2024-02-13T00:38:20.012 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [----------] Global test environment set-up. 2024-02-13T00:38:20.012 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2024-02-13T00:38:20.012 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2024-02-13T00:38:20.012 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2024-02-13T00:38:20.012 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-02-13T00:38:20.012 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: 2024-02-13T00:38:20.012 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2024-02-13T00:38:20.012 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-02-13T00:38:20.012 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: 2024-02-13T00:37:29.022+0000 7f9916477540 -1 failed for service _ceph-mon._tcp 2024-02-13T00:38:20.012 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2024-02-13T00:38:20.013 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: 2024-02-13T00:37:29.022+0000 7f9916477540 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-02-13T00:38:20.013 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (63 ms) 2024-02-13T00:38:20.013 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-02-13T00:38:20.013 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2022 ms) 2024-02-13T00:38:20.013 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (2085 ms total) 2024-02-13T00:38:20.013 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: 2024-02-13T00:38:20.013 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2024-02-13T00:38:20.013 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2024-02-13T00:38:20.013 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: started 0x55dc345e6010 2024-02-13T00:38:20.014 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: started 0x55dc345ef4f0 2024-02-13T00:38:20.014 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: started 2 aios 2024-02-13T00:38:20.014 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: waiting 0x55dc345e6010 2024-02-13T00:38:20.014 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: waiting 0x55dc345ef4f0 2024-02-13T00:38:20.014 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: done. 2024-02-13T00:38:20.014 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (16741 ms) 2024-02-13T00:38:20.014 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (16741 ms total) 2024-02-13T00:38:20.014 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: 2024-02-13T00:38:20.014 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2024-02-13T00:38:20.015 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2024-02-13T00:38:20.015 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-02-13T00:38:20.015 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2024-02-13T00:38:20.015 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ OK ] LibRadosMisc.Exec (78 ms) 2024-02-13T00:38:20.015 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2024-02-13T00:38:20.015 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (27 ms) 2024-02-13T00:38:20.015 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2024-02-13T00:38:20.015 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (5 ms) 2024-02-13T00:38:20.015 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2024-02-13T00:38:20.016 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ OK ] LibRadosMisc.Applications (5373 ms) 2024-02-13T00:38:20.016 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2024-02-13T00:38:20.016 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-02-13T00:38:20.016 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2024-02-13T00:38:20.016 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-02-13T00:38:20.016 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2024-02-13T00:38:20.016 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (22245 ms) 2024-02-13T00:38:20.016 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [----------] 8 tests from LibRadosMisc (27729 ms total) 2024-02-13T00:38:20.016 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: 2024-02-13T00:38:20.016 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [----------] Global test environment tear-down 2024-02-13T00:38:20.016 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (51025 ms total) 2024-02-13T00:38:20.016 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc: [ PASSED ] 12 tests. 2024-02-13T00:38:20.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:38:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:38:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:38:21.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:20 smithi106 bash[18459]: cluster 2024-02-13T00:38:19.256079+0000 osd.7 (osd.7) 9 : cluster [DBG] 17.8 deep-scrub starts 2024-02-13T00:38:21.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:20 smithi106 bash[18459]: cluster 2024-02-13T00:38:19.258203+0000 osd.7 (osd.7) 10 : cluster [DBG] 17.8 deep-scrub ok 2024-02-13T00:38:21.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:20 smithi106 bash[18459]: audit 2024-02-13T00:38:19.619345+0000 mon.a (mon.0) 1053 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:21.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:20 smithi106 bash[18459]: cluster 2024-02-13T00:38:19.692293+0000 mgr.y (mgr.24461) 343 : cluster [DBG] pgmap v284: 460 pgs: 32 creating+peering, 96 unknown, 332 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.5 KiB/s rd, 18 MiB/s wr, 7 op/s 2024-02-13T00:38:21.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:20 smithi106 bash[18459]: audit 2024-02-13T00:38:19.986097+0000 mon.a (mon.0) 1054 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-11", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:38:21.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:20 smithi106 bash[18459]: audit 2024-02-13T00:38:19.986245+0000 mon.a (mon.0) 1055 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi080-54183-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:21.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:20 smithi106 bash[18459]: cluster 2024-02-13T00:38:19.986401+0000 mon.a (mon.0) 1056 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2024-02-13T00:38:21.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:20 smithi106 bash[18459]: audit 2024-02-13T00:38:19.988340+0000 mon.a (mon.0) 1057 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-11"}]: dispatch 2024-02-13T00:38:21.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:20 smithi106 bash[18459]: audit 2024-02-13T00:38:19.991182+0000 mon.a (mon.0) 1058 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi080-54340-9"}]: dispatch 2024-02-13T00:38:21.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:20 smithi106 bash[18459]: audit 2024-02-13T00:38:19.995854+0000 mon.b (mon.1) 67 : audit [INF] from='client.? 172.21.15.80:0/3976956842' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54260-10", "tierpool":"test-rados-api-smithi080-54260-10-cache", "force_nonempty":""}]: dispatch 2024-02-13T00:38:21.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:20 smithi106 bash[18459]: audit 2024-02-13T00:38:19.999213+0000 mon.a (mon.0) 1059 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54260-10", "tierpool":"test-rados-api-smithi080-54260-10-cache", "force_nonempty":""}]: dispatch 2024-02-13T00:38:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:20 smithi080 bash[17386]: cluster 2024-02-13T00:38:19.256079+0000 osd.7 (osd.7) 9 : cluster [DBG] 17.8 deep-scrub starts 2024-02-13T00:38:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:20 smithi080 bash[17386]: cluster 2024-02-13T00:38:19.258203+0000 osd.7 (osd.7) 10 : cluster [DBG] 17.8 deep-scrub ok 2024-02-13T00:38:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:20 smithi080 bash[17386]: audit 2024-02-13T00:38:19.619345+0000 mon.a (mon.0) 1053 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:20 smithi080 bash[17386]: cluster 2024-02-13T00:38:19.692293+0000 mgr.y (mgr.24461) 343 : cluster [DBG] pgmap v284: 460 pgs: 32 creating+peering, 96 unknown, 332 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.5 KiB/s rd, 18 MiB/s wr, 7 op/s 2024-02-13T00:38:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:20 smithi080 bash[17386]: audit 2024-02-13T00:38:19.986097+0000 mon.a (mon.0) 1054 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-11", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:38:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:20 smithi080 bash[17386]: audit 2024-02-13T00:38:19.986245+0000 mon.a (mon.0) 1055 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi080-54183-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:20 smithi080 bash[17386]: cluster 2024-02-13T00:38:19.986401+0000 mon.a (mon.0) 1056 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2024-02-13T00:38:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:20 smithi080 bash[17386]: audit 2024-02-13T00:38:19.988340+0000 mon.a (mon.0) 1057 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-11"}]: dispatch 2024-02-13T00:38:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:20 smithi080 bash[17386]: audit 2024-02-13T00:38:19.991182+0000 mon.a (mon.0) 1058 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi080-54340-9"}]: dispatch 2024-02-13T00:38:21.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:20 smithi080 bash[17386]: audit 2024-02-13T00:38:19.995854+0000 mon.b (mon.1) 67 : audit [INF] from='client.? 172.21.15.80:0/3976956842' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54260-10", "tierpool":"test-rados-api-smithi080-54260-10-cache", "force_nonempty":""}]: dispatch 2024-02-13T00:38:21.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:20 smithi080 bash[17386]: audit 2024-02-13T00:38:19.999213+0000 mon.a (mon.0) 1059 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54260-10", "tierpool":"test-rados-api-smithi080-54260-10-cache", "force_nonempty":""}]: dispatch 2024-02-13T00:38:21.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:20 smithi080 bash[24237]: cluster 2024-02-13T00:38:19.256079+0000 osd.7 (osd.7) 9 : cluster [DBG] 17.8 deep-scrub starts 2024-02-13T00:38:21.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:20 smithi080 bash[24237]: cluster 2024-02-13T00:38:19.258203+0000 osd.7 (osd.7) 10 : cluster [DBG] 17.8 deep-scrub ok 2024-02-13T00:38:21.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:20 smithi080 bash[24237]: audit 2024-02-13T00:38:19.619345+0000 mon.a (mon.0) 1053 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:21.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:20 smithi080 bash[24237]: cluster 2024-02-13T00:38:19.692293+0000 mgr.y (mgr.24461) 343 : cluster [DBG] pgmap v284: 460 pgs: 32 creating+peering, 96 unknown, 332 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.5 KiB/s rd, 18 MiB/s wr, 7 op/s 2024-02-13T00:38:21.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:20 smithi080 bash[24237]: audit 2024-02-13T00:38:19.986097+0000 mon.a (mon.0) 1054 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-11", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:38:21.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:20 smithi080 bash[24237]: audit 2024-02-13T00:38:19.986245+0000 mon.a (mon.0) 1055 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi080-54183-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:21.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:20 smithi080 bash[24237]: cluster 2024-02-13T00:38:19.986401+0000 mon.a (mon.0) 1056 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2024-02-13T00:38:21.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:20 smithi080 bash[24237]: audit 2024-02-13T00:38:19.988340+0000 mon.a (mon.0) 1057 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-11"}]: dispatch 2024-02-13T00:38:21.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:20 smithi080 bash[24237]: audit 2024-02-13T00:38:19.991182+0000 mon.a (mon.0) 1058 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi080-54340-9"}]: dispatch 2024-02-13T00:38:21.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:20 smithi080 bash[24237]: audit 2024-02-13T00:38:19.995854+0000 mon.b (mon.1) 67 : audit [INF] from='client.? 172.21.15.80:0/3976956842' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54260-10", "tierpool":"test-rados-api-smithi080-54260-10-cache", "force_nonempty":""}]: dispatch 2024-02-13T00:38:21.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:20 smithi080 bash[24237]: audit 2024-02-13T00:38:19.999213+0000 mon.a (mon.0) 1059 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54260-10", "tierpool":"test-rados-api-smithi080-54260-10-cache", "force_nonempty":""}]: dispatch 2024-02-13T00:38:22.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:21 smithi106 bash[18459]: audit 2024-02-13T00:38:20.622004+0000 mon.a (mon.0) 1060 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:22.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:21 smithi106 bash[18459]: audit 2024-02-13T00:38:20.991149+0000 mon.a (mon.0) 1061 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-11"}]': finished 2024-02-13T00:38:22.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:21 smithi106 bash[18459]: audit 2024-02-13T00:38:20.991285+0000 mon.a (mon.0) 1062 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi080-54340-9"}]': finished 2024-02-13T00:38:22.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:21 smithi106 bash[18459]: audit 2024-02-13T00:38:20.991542+0000 mon.a (mon.0) 1063 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54260-10", "tierpool":"test-rados-api-smithi080-54260-10-cache", "force_nonempty":""}]': finished 2024-02-13T00:38:22.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:21 smithi106 bash[18459]: cluster 2024-02-13T00:38:20.991965+0000 mon.a (mon.0) 1064 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2024-02-13T00:38:22.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:21 smithi106 bash[18459]: audit 2024-02-13T00:38:20.994759+0000 mon.b (mon.1) 68 : audit [INF] from='client.? 172.21.15.80:0/3976956842' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54260-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:22.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:21 smithi106 bash[18459]: audit 2024-02-13T00:38:20.996928+0000 mon.a (mon.0) 1065 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-11", "mode": "writeback"}]: dispatch 2024-02-13T00:38:22.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:21 smithi106 bash[18459]: audit 2024-02-13T00:38:20.998166+0000 mon.a (mon.0) 1066 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi080-54340-9"}]: dispatch 2024-02-13T00:38:22.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:21 smithi106 bash[18459]: audit 2024-02-13T00:38:20.998723+0000 mon.a (mon.0) 1067 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54260-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:22.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:21 smithi106 bash[18459]: audit 2024-02-13T00:38:20.999223+0000 mon.c (mon.2) 163 : audit [INF] from='client.? 172.21.15.80:0/1270516831' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi080-54175-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:22.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:21 smithi106 bash[18459]: audit 2024-02-13T00:38:21.000137+0000 mon.a (mon.0) 1068 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi080-54175-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:22.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:21 smithi106 bash[18459]: audit 2024-02-13T00:38:21.623552+0000 mon.a (mon.0) 1069 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:22.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[17386]: audit 2024-02-13T00:38:20.622004+0000 mon.a (mon.0) 1060 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:22.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[17386]: audit 2024-02-13T00:38:20.991149+0000 mon.a (mon.0) 1061 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-11"}]': finished 2024-02-13T00:38:22.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[17386]: audit 2024-02-13T00:38:20.991285+0000 mon.a (mon.0) 1062 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi080-54340-9"}]': finished 2024-02-13T00:38:22.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[17386]: audit 2024-02-13T00:38:20.991542+0000 mon.a (mon.0) 1063 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54260-10", "tierpool":"test-rados-api-smithi080-54260-10-cache", "force_nonempty":""}]': finished 2024-02-13T00:38:22.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[17386]: cluster 2024-02-13T00:38:20.991965+0000 mon.a (mon.0) 1064 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2024-02-13T00:38:22.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[17386]: audit 2024-02-13T00:38:20.994759+0000 mon.b (mon.1) 68 : audit [INF] from='client.? 172.21.15.80:0/3976956842' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54260-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:22.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[17386]: audit 2024-02-13T00:38:20.996928+0000 mon.a (mon.0) 1065 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-11", "mode": "writeback"}]: dispatch 2024-02-13T00:38:22.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[17386]: audit 2024-02-13T00:38:20.998166+0000 mon.a (mon.0) 1066 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi080-54340-9"}]: dispatch 2024-02-13T00:38:22.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[17386]: audit 2024-02-13T00:38:20.998723+0000 mon.a (mon.0) 1067 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54260-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:22.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[17386]: audit 2024-02-13T00:38:20.999223+0000 mon.c (mon.2) 163 : audit [INF] from='client.? 172.21.15.80:0/1270516831' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi080-54175-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:22.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[17386]: audit 2024-02-13T00:38:21.000137+0000 mon.a (mon.0) 1068 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi080-54175-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:22.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[17386]: audit 2024-02-13T00:38:21.623552+0000 mon.a (mon.0) 1069 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:22.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[24237]: audit 2024-02-13T00:38:20.622004+0000 mon.a (mon.0) 1060 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:22.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[24237]: audit 2024-02-13T00:38:20.991149+0000 mon.a (mon.0) 1061 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-11"}]': finished 2024-02-13T00:38:22.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[24237]: audit 2024-02-13T00:38:20.991285+0000 mon.a (mon.0) 1062 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi080-54340-9"}]': finished 2024-02-13T00:38:22.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[24237]: audit 2024-02-13T00:38:20.991542+0000 mon.a (mon.0) 1063 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54260-10", "tierpool":"test-rados-api-smithi080-54260-10-cache", "force_nonempty":""}]': finished 2024-02-13T00:38:22.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[24237]: cluster 2024-02-13T00:38:20.991965+0000 mon.a (mon.0) 1064 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2024-02-13T00:38:22.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[24237]: audit 2024-02-13T00:38:20.994759+0000 mon.b (mon.1) 68 : audit [INF] from='client.? 172.21.15.80:0/3976956842' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54260-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:22.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[24237]: audit 2024-02-13T00:38:20.996928+0000 mon.a (mon.0) 1065 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-11", "mode": "writeback"}]: dispatch 2024-02-13T00:38:22.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[24237]: audit 2024-02-13T00:38:20.998166+0000 mon.a (mon.0) 1066 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi080-54340-9"}]: dispatch 2024-02-13T00:38:22.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[24237]: audit 2024-02-13T00:38:20.998723+0000 mon.a (mon.0) 1067 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54260-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:22.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[24237]: audit 2024-02-13T00:38:20.999223+0000 mon.c (mon.2) 163 : audit [INF] from='client.? 172.21.15.80:0/1270516831' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi080-54175-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:22.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[24237]: audit 2024-02-13T00:38:21.000137+0000 mon.a (mon.0) 1068 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi080-54175-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:22.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:21 smithi080 bash[24237]: audit 2024-02-13T00:38:21.623552+0000 mon.a (mon.0) 1069 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:22 smithi106 bash[18459]: cluster 2024-02-13T00:38:21.256867+0000 osd.4 (osd.4) 7 : cluster [DBG] 17.2 deep-scrub starts 2024-02-13T00:38:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:22 smithi106 bash[18459]: cluster 2024-02-13T00:38:21.303325+0000 osd.4 (osd.4) 8 : cluster [DBG] 17.2 deep-scrub ok 2024-02-13T00:38:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:22 smithi106 bash[18459]: cluster 2024-02-13T00:38:21.555204+0000 osd.6 (osd.6) 9 : cluster [DBG] 17.6 deep-scrub starts 2024-02-13T00:38:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:22 smithi106 bash[18459]: cluster 2024-02-13T00:38:21.560956+0000 osd.6 (osd.6) 10 : cluster [DBG] 17.6 deep-scrub ok 2024-02-13T00:38:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:22 smithi106 bash[18459]: cluster 2024-02-13T00:38:21.693306+0000 mgr.y (mgr.24461) 344 : cluster [DBG] pgmap v287: 420 pgs: 32 creating+peering, 96 unknown, 292 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 767 B/s rd, 18 MiB/s wr, 4 op/s 2024-02-13T00:38:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:22 smithi106 bash[18459]: cluster 2024-02-13T00:38:21.746236+0000 mon.a (mon.0) 1070 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:38:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:22 smithi106 bash[18459]: audit 2024-02-13T00:38:21.755028+0000 mon.a (mon.0) 1071 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-11", "mode": "writeback"}]': finished 2024-02-13T00:38:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:22 smithi106 bash[18459]: audit 2024-02-13T00:38:21.755172+0000 mon.a (mon.0) 1072 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi080-54340-9"}]': finished 2024-02-13T00:38:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:22 smithi106 bash[18459]: audit 2024-02-13T00:38:21.755359+0000 mon.a (mon.0) 1073 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54260-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:22 smithi106 bash[18459]: audit 2024-02-13T00:38:21.755572+0000 mon.a (mon.0) 1074 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi080-54175-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:22 smithi106 bash[18459]: cluster 2024-02-13T00:38:21.755973+0000 mon.a (mon.0) 1075 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2024-02-13T00:38:23.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:22 smithi106 bash[18459]: audit 2024-02-13T00:38:21.759846+0000 mon.b (mon.1) 69 : audit [INF] from='client.? 172.21.15.80:0/3976956842' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54260-10", "tierpool":"test-rados-api-smithi080-54260-10-cache"}]: dispatch 2024-02-13T00:38:23.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:22 smithi106 bash[18459]: audit 2024-02-13T00:38:21.764682+0000 mon.a (mon.0) 1076 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54260-10", "tierpool":"test-rados-api-smithi080-54260-10-cache"}]: dispatch 2024-02-13T00:38:23.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:22 smithi106 bash[18459]: audit 2024-02-13T00:38:21.766633+0000 mon.a (mon.0) 1077 : audit [INF] from='client.? 172.21.15.80:0/87478548' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi080-54183-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:23.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:22 smithi106 bash[18459]: audit 2024-02-13T00:38:21.797939+0000 mon.c (mon.2) 164 : audit [INF] from='client.? 172.21.15.80:0/306267812' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:23.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:22 smithi106 bash[18459]: audit 2024-02-13T00:38:21.798381+0000 mon.a (mon.0) 1078 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:23.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:22 smithi106 bash[18459]: audit 2024-02-13T00:38:21.801279+0000 mon.c (mon.2) 165 : audit [INF] from='client.? 172.21.15.80:0/306267812' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:23.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:22 smithi106 bash[18459]: audit 2024-02-13T00:38:21.801580+0000 mon.a (mon.0) 1079 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:23.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:22 smithi106 bash[18459]: audit 2024-02-13T00:38:21.802068+0000 mon.c (mon.2) 166 : audit [INF] from='client.? 172.21.15.80:0/306267812' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:38:23.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:22 smithi106 bash[18459]: audit 2024-02-13T00:38:21.802364+0000 mon.a (mon.0) 1080 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:38:23.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:22 smithi106 bash[18459]: audit 2024-02-13T00:38:22.625196+0000 mon.a (mon.0) 1081 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:23.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[24237]: cluster 2024-02-13T00:38:21.256867+0000 osd.4 (osd.4) 7 : cluster [DBG] 17.2 deep-scrub starts 2024-02-13T00:38:23.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[24237]: cluster 2024-02-13T00:38:21.303325+0000 osd.4 (osd.4) 8 : cluster [DBG] 17.2 deep-scrub ok 2024-02-13T00:38:23.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[24237]: cluster 2024-02-13T00:38:21.555204+0000 osd.6 (osd.6) 9 : cluster [DBG] 17.6 deep-scrub starts 2024-02-13T00:38:23.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[24237]: cluster 2024-02-13T00:38:21.560956+0000 osd.6 (osd.6) 10 : cluster [DBG] 17.6 deep-scrub ok 2024-02-13T00:38:23.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[24237]: cluster 2024-02-13T00:38:21.693306+0000 mgr.y (mgr.24461) 344 : cluster [DBG] pgmap v287: 420 pgs: 32 creating+peering, 96 unknown, 292 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 767 B/s rd, 18 MiB/s wr, 4 op/s 2024-02-13T00:38:23.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[24237]: cluster 2024-02-13T00:38:21.746236+0000 mon.a (mon.0) 1070 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:38:23.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[24237]: audit 2024-02-13T00:38:21.755028+0000 mon.a (mon.0) 1071 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-11", "mode": "writeback"}]': finished 2024-02-13T00:38:23.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[24237]: audit 2024-02-13T00:38:21.755172+0000 mon.a (mon.0) 1072 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi080-54340-9"}]': finished 2024-02-13T00:38:23.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[24237]: audit 2024-02-13T00:38:21.755359+0000 mon.a (mon.0) 1073 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54260-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:23.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[24237]: audit 2024-02-13T00:38:21.755572+0000 mon.a (mon.0) 1074 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi080-54175-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:23.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[24237]: cluster 2024-02-13T00:38:21.755973+0000 mon.a (mon.0) 1075 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2024-02-13T00:38:23.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[24237]: audit 2024-02-13T00:38:21.759846+0000 mon.b (mon.1) 69 : audit [INF] from='client.? 172.21.15.80:0/3976956842' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54260-10", "tierpool":"test-rados-api-smithi080-54260-10-cache"}]: dispatch 2024-02-13T00:38:23.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[24237]: audit 2024-02-13T00:38:21.764682+0000 mon.a (mon.0) 1076 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54260-10", "tierpool":"test-rados-api-smithi080-54260-10-cache"}]: dispatch 2024-02-13T00:38:23.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[24237]: audit 2024-02-13T00:38:21.766633+0000 mon.a (mon.0) 1077 : audit [INF] from='client.? 172.21.15.80:0/87478548' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi080-54183-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:23.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[24237]: audit 2024-02-13T00:38:21.797939+0000 mon.c (mon.2) 164 : audit [INF] from='client.? 172.21.15.80:0/306267812' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:23.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[24237]: audit 2024-02-13T00:38:21.798381+0000 mon.a (mon.0) 1078 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:23.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[24237]: audit 2024-02-13T00:38:21.801279+0000 mon.c (mon.2) 165 : audit [INF] from='client.? 172.21.15.80:0/306267812' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:23.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[17386]: cluster 2024-02-13T00:38:21.256867+0000 osd.4 (osd.4) 7 : cluster [DBG] 17.2 deep-scrub starts 2024-02-13T00:38:23.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[17386]: cluster 2024-02-13T00:38:21.303325+0000 osd.4 (osd.4) 8 : cluster [DBG] 17.2 deep-scrub ok 2024-02-13T00:38:23.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[17386]: cluster 2024-02-13T00:38:21.555204+0000 osd.6 (osd.6) 9 : cluster [DBG] 17.6 deep-scrub starts 2024-02-13T00:38:23.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[17386]: cluster 2024-02-13T00:38:21.560956+0000 osd.6 (osd.6) 10 : cluster [DBG] 17.6 deep-scrub ok 2024-02-13T00:38:23.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[17386]: cluster 2024-02-13T00:38:21.693306+0000 mgr.y (mgr.24461) 344 : cluster [DBG] pgmap v287: 420 pgs: 32 creating+peering, 96 unknown, 292 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 767 B/s rd, 18 MiB/s wr, 4 op/s 2024-02-13T00:38:23.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[17386]: cluster 2024-02-13T00:38:21.746236+0000 mon.a (mon.0) 1070 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:38:23.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[17386]: audit 2024-02-13T00:38:21.755028+0000 mon.a (mon.0) 1071 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-11", "mode": "writeback"}]': finished 2024-02-13T00:38:23.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[17386]: audit 2024-02-13T00:38:21.755172+0000 mon.a (mon.0) 1072 : audit [INF] from='client.? 172.21.15.80:0/3881089361' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi080-54340-9"}]': finished 2024-02-13T00:38:23.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[17386]: audit 2024-02-13T00:38:21.755359+0000 mon.a (mon.0) 1073 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54260-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:23.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[17386]: audit 2024-02-13T00:38:21.755572+0000 mon.a (mon.0) 1074 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi080-54175-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:23.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[17386]: cluster 2024-02-13T00:38:21.755973+0000 mon.a (mon.0) 1075 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2024-02-13T00:38:23.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[17386]: audit 2024-02-13T00:38:21.759846+0000 mon.b (mon.1) 69 : audit [INF] from='client.? 172.21.15.80:0/3976956842' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54260-10", "tierpool":"test-rados-api-smithi080-54260-10-cache"}]: dispatch 2024-02-13T00:38:23.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[17386]: audit 2024-02-13T00:38:21.764682+0000 mon.a (mon.0) 1076 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54260-10", "tierpool":"test-rados-api-smithi080-54260-10-cache"}]: dispatch 2024-02-13T00:38:23.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[17386]: audit 2024-02-13T00:38:21.766633+0000 mon.a (mon.0) 1077 : audit [INF] from='client.? 172.21.15.80:0/87478548' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi080-54183-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:23.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[17386]: audit 2024-02-13T00:38:21.797939+0000 mon.c (mon.2) 164 : audit [INF] from='client.? 172.21.15.80:0/306267812' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:23.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[17386]: audit 2024-02-13T00:38:21.798381+0000 mon.a (mon.0) 1078 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:23.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[17386]: audit 2024-02-13T00:38:21.801279+0000 mon.c (mon.2) 165 : audit [INF] from='client.? 172.21.15.80:0/306267812' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:23.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[24237]: audit 2024-02-13T00:38:21.801580+0000 mon.a (mon.0) 1079 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:23.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[24237]: audit 2024-02-13T00:38:21.802068+0000 mon.c (mon.2) 166 : audit [INF] from='client.? 172.21.15.80:0/306267812' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:38:23.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[24237]: audit 2024-02-13T00:38:21.802364+0000 mon.a (mon.0) 1080 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:38:23.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[24237]: audit 2024-02-13T00:38:22.625196+0000 mon.a (mon.0) 1081 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:23.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[17386]: audit 2024-02-13T00:38:21.801580+0000 mon.a (mon.0) 1079 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:23.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[17386]: audit 2024-02-13T00:38:21.802068+0000 mon.c (mon.2) 166 : audit [INF] from='client.? 172.21.15.80:0/306267812' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:38:23.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[17386]: audit 2024-02-13T00:38:21.802364+0000 mon.a (mon.0) 1080 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:38:23.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:22 smithi080 bash[17386]: audit 2024-02-13T00:38:22.625196+0000 mon.a (mon.0) 1081 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:23.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:38:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:38:23] "GET /metrics HTTP/1.1" 200 198015 "" "Prometheus/2.33.4" 2024-02-13T00:38:24.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:23 smithi106 bash[18459]: cluster 2024-02-13T00:38:22.633125+0000 mon.a (mon.0) 1082 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:38:24.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:23 smithi106 bash[18459]: audit 2024-02-13T00:38:22.759364+0000 mon.a (mon.0) 1083 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54260-10", "tierpool":"test-rados-api-smithi080-54260-10-cache"}]': finished 2024-02-13T00:38:24.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:23 smithi106 bash[18459]: audit 2024-02-13T00:38:22.759550+0000 mon.a (mon.0) 1084 : audit [INF] from='client.? 172.21.15.80:0/87478548' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi080-54183-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:24.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:23 smithi106 bash[18459]: audit 2024-02-13T00:38:22.759769+0000 mon.a (mon.0) 1085 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:38:24.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:23 smithi106 bash[18459]: cluster 2024-02-13T00:38:22.759892+0000 mon.a (mon.0) 1086 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2024-02-13T00:38:24.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:23 smithi106 bash[18459]: audit 2024-02-13T00:38:22.763328+0000 mon.c (mon.2) 167 : audit [INF] from='client.? 172.21.15.80:0/306267812' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi080-54340-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:24.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:23 smithi106 bash[18459]: audit 2024-02-13T00:38:22.766446+0000 mon.a (mon.0) 1087 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi080-54340-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:24.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:23 smithi106 bash[18459]: audit 2024-02-13T00:38:23.261823+0000 mon.a (mon.0) 1088 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:38:24.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:23 smithi106 bash[18459]: audit 2024-02-13T00:38:23.626954+0000 mon.a (mon.0) 1089 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:24.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:23 smithi080 bash[24237]: cluster 2024-02-13T00:38:22.633125+0000 mon.a (mon.0) 1082 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:38:24.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:23 smithi080 bash[24237]: audit 2024-02-13T00:38:22.759364+0000 mon.a (mon.0) 1083 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54260-10", "tierpool":"test-rados-api-smithi080-54260-10-cache"}]': finished 2024-02-13T00:38:24.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:23 smithi080 bash[24237]: audit 2024-02-13T00:38:22.759550+0000 mon.a (mon.0) 1084 : audit [INF] from='client.? 172.21.15.80:0/87478548' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi080-54183-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:24.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:23 smithi080 bash[24237]: audit 2024-02-13T00:38:22.759769+0000 mon.a (mon.0) 1085 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:38:24.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:23 smithi080 bash[24237]: cluster 2024-02-13T00:38:22.759892+0000 mon.a (mon.0) 1086 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2024-02-13T00:38:24.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:23 smithi080 bash[24237]: audit 2024-02-13T00:38:22.763328+0000 mon.c (mon.2) 167 : audit [INF] from='client.? 172.21.15.80:0/306267812' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi080-54340-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:24.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:23 smithi080 bash[24237]: audit 2024-02-13T00:38:22.766446+0000 mon.a (mon.0) 1087 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi080-54340-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:24.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:23 smithi080 bash[24237]: audit 2024-02-13T00:38:23.261823+0000 mon.a (mon.0) 1088 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:38:24.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:23 smithi080 bash[24237]: audit 2024-02-13T00:38:23.626954+0000 mon.a (mon.0) 1089 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:24.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:23 smithi080 bash[17386]: cluster 2024-02-13T00:38:22.633125+0000 mon.a (mon.0) 1082 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:38:24.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:23 smithi080 bash[17386]: audit 2024-02-13T00:38:22.759364+0000 mon.a (mon.0) 1083 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54260-10", "tierpool":"test-rados-api-smithi080-54260-10-cache"}]': finished 2024-02-13T00:38:24.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:23 smithi080 bash[17386]: audit 2024-02-13T00:38:22.759550+0000 mon.a (mon.0) 1084 : audit [INF] from='client.? 172.21.15.80:0/87478548' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi080-54183-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:24.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:23 smithi080 bash[17386]: audit 2024-02-13T00:38:22.759769+0000 mon.a (mon.0) 1085 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:38:24.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:23 smithi080 bash[17386]: cluster 2024-02-13T00:38:22.759892+0000 mon.a (mon.0) 1086 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2024-02-13T00:38:24.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:23 smithi080 bash[17386]: audit 2024-02-13T00:38:22.763328+0000 mon.c (mon.2) 167 : audit [INF] from='client.? 172.21.15.80:0/306267812' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi080-54340-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:24.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:23 smithi080 bash[17386]: audit 2024-02-13T00:38:22.766446+0000 mon.a (mon.0) 1087 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi080-54340-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:24.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:23 smithi080 bash[17386]: audit 2024-02-13T00:38:23.261823+0000 mon.a (mon.0) 1088 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:38:24.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:23 smithi080 bash[17386]: audit 2024-02-13T00:38:23.626954+0000 mon.a (mon.0) 1089 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:24.790 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: Running main() from gmock_main.cc 2024-02-13T00:38:24.790 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2024-02-13T00:38:24.790 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [----------] Global test environment set-up. 2024-02-13T00:38:24.791 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [----------] 9 tests from LibRadosPools 2024-02-13T00:38:24.791 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2024-02-13T00:38:24.791 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [ OK ] LibRadosPools.PoolList (13355 ms) 2024-02-13T00:38:24.791 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2024-02-13T00:38:24.791 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (5471 ms) 2024-02-13T00:38:24.791 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2024-02-13T00:38:24.791 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (5053 ms) 2024-02-13T00:38:24.791 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-02-13T00:38:24.791 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (3455 ms) 2024-02-13T00:38:24.791 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-02-13T00:38:24.791 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3071 ms) 2024-02-13T00:38:24.791 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2024-02-13T00:38:24.791 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (5721 ms) 2024-02-13T00:38:24.791 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2024-02-13T00:38:24.791 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (6427 ms) 2024-02-13T00:38:24.791 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-02-13T00:38:24.792 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5257 ms) 2024-02-13T00:38:24.792 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2024-02-13T00:38:24.792 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (8006 ms) 2024-02-13T00:38:24.792 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [----------] 9 tests from LibRadosPools (55817 ms total) 2024-02-13T00:38:24.792 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: 2024-02-13T00:38:24.792 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [----------] Global test environment tear-down 2024-02-13T00:38:24.792 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (55818 ms total) 2024-02-13T00:38:24.792 INFO:tasks.workunit.client.0.smithi080.stdout: api_pool: [ PASSED ] 9 tests. 2024-02-13T00:38:25.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:24 smithi106 bash[18459]: cluster 2024-02-13T00:38:23.695782+0000 mgr.y (mgr.24461) 345 : cluster [DBG] pgmap v290: 420 pgs: 4 active+clean+snaptrim, 11 creating+activating, 14 creating+peering, 10 active+clean+snaptrim_wait, 381 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 2.2 KiB/s rd, 255 KiB/s wr, 3 op/s 2024-02-13T00:38:25.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:24 smithi106 bash[18459]: cluster 2024-02-13T00:38:23.712217+0000 osd.0 (osd.0) 13 : cluster [DBG] 17.7 deep-scrub starts 2024-02-13T00:38:25.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:24 smithi106 bash[18459]: cluster 2024-02-13T00:38:23.716306+0000 osd.0 (osd.0) 14 : cluster [DBG] 17.7 deep-scrub ok 2024-02-13T00:38:25.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:24 smithi106 bash[18459]: audit 2024-02-13T00:38:24.210404+0000 mon.a (mon.0) 1090 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:38:25.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:24 smithi106 bash[18459]: cluster 2024-02-13T00:38:24.210578+0000 mon.a (mon.0) 1091 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2024-02-13T00:38:25.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:24 smithi106 bash[18459]: audit 2024-02-13T00:38:24.211915+0000 mon.a (mon.0) 1092 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-11"}]: dispatch 2024-02-13T00:38:25.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:24 smithi106 bash[18459]: audit 2024-02-13T00:38:24.212311+0000 mon.c (mon.2) 168 : audit [INF] from='client.? 172.21.15.80:0/535030099' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi080-54175-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:25.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:24 smithi106 bash[18459]: audit 2024-02-13T00:38:24.217522+0000 mon.a (mon.0) 1093 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi080-54175-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:25.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:24 smithi106 bash[18459]: audit 2024-02-13T00:38:24.658311+0000 mon.a (mon.0) 1094 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:25.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:24 smithi080 bash[17386]: cluster 2024-02-13T00:38:23.695782+0000 mgr.y (mgr.24461) 345 : cluster [DBG] pgmap v290: 420 pgs: 4 active+clean+snaptrim, 11 creating+activating, 14 creating+peering, 10 active+clean+snaptrim_wait, 381 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 2.2 KiB/s rd, 255 KiB/s wr, 3 op/s 2024-02-13T00:38:25.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:24 smithi080 bash[17386]: cluster 2024-02-13T00:38:23.712217+0000 osd.0 (osd.0) 13 : cluster [DBG] 17.7 deep-scrub starts 2024-02-13T00:38:25.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:24 smithi080 bash[17386]: cluster 2024-02-13T00:38:23.716306+0000 osd.0 (osd.0) 14 : cluster [DBG] 17.7 deep-scrub ok 2024-02-13T00:38:25.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:24 smithi080 bash[17386]: audit 2024-02-13T00:38:24.210404+0000 mon.a (mon.0) 1090 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:38:25.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:24 smithi080 bash[17386]: cluster 2024-02-13T00:38:24.210578+0000 mon.a (mon.0) 1091 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2024-02-13T00:38:25.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:24 smithi080 bash[17386]: audit 2024-02-13T00:38:24.211915+0000 mon.a (mon.0) 1092 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-11"}]: dispatch 2024-02-13T00:38:25.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:24 smithi080 bash[17386]: audit 2024-02-13T00:38:24.212311+0000 mon.c (mon.2) 168 : audit [INF] from='client.? 172.21.15.80:0/535030099' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi080-54175-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:25.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:24 smithi080 bash[17386]: audit 2024-02-13T00:38:24.217522+0000 mon.a (mon.0) 1093 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi080-54175-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:25.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:24 smithi080 bash[17386]: audit 2024-02-13T00:38:24.658311+0000 mon.a (mon.0) 1094 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:25.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:24 smithi080 bash[24237]: cluster 2024-02-13T00:38:23.695782+0000 mgr.y (mgr.24461) 345 : cluster [DBG] pgmap v290: 420 pgs: 4 active+clean+snaptrim, 11 creating+activating, 14 creating+peering, 10 active+clean+snaptrim_wait, 381 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 2.2 KiB/s rd, 255 KiB/s wr, 3 op/s 2024-02-13T00:38:25.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:24 smithi080 bash[24237]: cluster 2024-02-13T00:38:23.712217+0000 osd.0 (osd.0) 13 : cluster [DBG] 17.7 deep-scrub starts 2024-02-13T00:38:25.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:24 smithi080 bash[24237]: cluster 2024-02-13T00:38:23.716306+0000 osd.0 (osd.0) 14 : cluster [DBG] 17.7 deep-scrub ok 2024-02-13T00:38:25.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:24 smithi080 bash[24237]: audit 2024-02-13T00:38:24.210404+0000 mon.a (mon.0) 1090 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:38:25.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:24 smithi080 bash[24237]: cluster 2024-02-13T00:38:24.210578+0000 mon.a (mon.0) 1091 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2024-02-13T00:38:25.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:24 smithi080 bash[24237]: audit 2024-02-13T00:38:24.211915+0000 mon.a (mon.0) 1092 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-11"}]: dispatch 2024-02-13T00:38:25.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:24 smithi080 bash[24237]: audit 2024-02-13T00:38:24.212311+0000 mon.c (mon.2) 168 : audit [INF] from='client.? 172.21.15.80:0/535030099' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi080-54175-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:25.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:24 smithi080 bash[24237]: audit 2024-02-13T00:38:24.217522+0000 mon.a (mon.0) 1093 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi080-54175-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:25.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:24 smithi080 bash[24237]: audit 2024-02-13T00:38:24.658311+0000 mon.a (mon.0) 1094 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:26.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:25 smithi106 bash[18459]: cluster 2024-02-13T00:38:24.759800+0000 mon.a (mon.0) 1095 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:38:26.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:25 smithi106 bash[18459]: audit 2024-02-13T00:38:24.773969+0000 mon.a (mon.0) 1096 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi080-54340-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]': finished 2024-02-13T00:38:26.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:25 smithi106 bash[18459]: audit 2024-02-13T00:38:24.774127+0000 mon.a (mon.0) 1097 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-11"}]': finished 2024-02-13T00:38:26.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:25 smithi106 bash[18459]: audit 2024-02-13T00:38:24.774433+0000 mon.a (mon.0) 1098 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi080-54175-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:26.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:25 smithi106 bash[18459]: cluster 2024-02-13T00:38:24.774642+0000 mon.a (mon.0) 1099 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2024-02-13T00:38:26.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:25 smithi106 bash[18459]: audit 2024-02-13T00:38:24.798051+0000 mon.c (mon.2) 169 : audit [INF] from='client.? 172.21.15.80:0/2691493709' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi080-54183-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:26.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:25 smithi106 bash[18459]: audit 2024-02-13T00:38:24.798875+0000 mon.a (mon.0) 1100 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi080-54183-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:26.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:25 smithi106 bash[18459]: audit 2024-02-13T00:38:25.659457+0000 mon.a (mon.0) 1101 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:26.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:25 smithi080 bash[24237]: cluster 2024-02-13T00:38:24.759800+0000 mon.a (mon.0) 1095 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:38:26.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:25 smithi080 bash[24237]: audit 2024-02-13T00:38:24.773969+0000 mon.a (mon.0) 1096 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi080-54340-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]': finished 2024-02-13T00:38:26.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:25 smithi080 bash[24237]: audit 2024-02-13T00:38:24.774127+0000 mon.a (mon.0) 1097 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-11"}]': finished 2024-02-13T00:38:26.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:25 smithi080 bash[24237]: audit 2024-02-13T00:38:24.774433+0000 mon.a (mon.0) 1098 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi080-54175-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:26.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:25 smithi080 bash[24237]: cluster 2024-02-13T00:38:24.774642+0000 mon.a (mon.0) 1099 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2024-02-13T00:38:26.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:25 smithi080 bash[24237]: audit 2024-02-13T00:38:24.798051+0000 mon.c (mon.2) 169 : audit [INF] from='client.? 172.21.15.80:0/2691493709' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi080-54183-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:26.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:25 smithi080 bash[24237]: audit 2024-02-13T00:38:24.798875+0000 mon.a (mon.0) 1100 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi080-54183-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:26.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:25 smithi080 bash[24237]: audit 2024-02-13T00:38:25.659457+0000 mon.a (mon.0) 1101 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:26.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:25 smithi080 bash[17386]: cluster 2024-02-13T00:38:24.759800+0000 mon.a (mon.0) 1095 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:38:26.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:25 smithi080 bash[17386]: audit 2024-02-13T00:38:24.773969+0000 mon.a (mon.0) 1096 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi080-54340-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]': finished 2024-02-13T00:38:26.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:25 smithi080 bash[17386]: audit 2024-02-13T00:38:24.774127+0000 mon.a (mon.0) 1097 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-11"}]': finished 2024-02-13T00:38:26.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:25 smithi080 bash[17386]: audit 2024-02-13T00:38:24.774433+0000 mon.a (mon.0) 1098 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi080-54175-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:26.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:25 smithi080 bash[17386]: cluster 2024-02-13T00:38:24.774642+0000 mon.a (mon.0) 1099 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2024-02-13T00:38:26.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:25 smithi080 bash[17386]: audit 2024-02-13T00:38:24.798051+0000 mon.c (mon.2) 169 : audit [INF] from='client.? 172.21.15.80:0/2691493709' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi080-54183-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:26.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:25 smithi080 bash[17386]: audit 2024-02-13T00:38:24.798875+0000 mon.a (mon.0) 1100 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi080-54183-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:26.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:25 smithi080 bash[17386]: audit 2024-02-13T00:38:25.659457+0000 mon.a (mon.0) 1101 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:27.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:26 smithi106 bash[18459]: cluster 2024-02-13T00:38:25.696880+0000 mgr.y (mgr.24461) 346 : cluster [DBG] pgmap v293: 396 pgs: 4 active+clean+snaptrim, 72 unknown, 10 active+clean+snaptrim_wait, 310 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 258 KiB/s wr, 6 op/s 2024-02-13T00:38:27.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:26 smithi106 bash[18459]: audit 2024-02-13T00:38:25.785421+0000 mon.a (mon.0) 1102 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi080-54183-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:27.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:26 smithi106 bash[18459]: cluster 2024-02-13T00:38:25.786134+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e109: 8 total, 8 up, 8 in 2024-02-13T00:38:27.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:26 smithi106 bash[18459]: audit 2024-02-13T00:38:26.683179+0000 mon.a (mon.0) 1104 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:27.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:26 smithi106 bash[18459]: cluster 2024-02-13T00:38:26.762828+0000 mon.a (mon.0) 1105 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2024-02-13T00:38:27.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:26 smithi106 bash[18459]: audit 2024-02-13T00:38:26.764425+0000 mon.c (mon.2) 170 : audit [INF] from='client.? 172.21.15.80:0/1770219120' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi080-54175-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:27.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:26 smithi106 bash[18459]: audit 2024-02-13T00:38:26.770638+0000 mon.a (mon.0) 1106 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi080-54175-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:27.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:26 smithi080 bash[17386]: cluster 2024-02-13T00:38:25.696880+0000 mgr.y (mgr.24461) 346 : cluster [DBG] pgmap v293: 396 pgs: 4 active+clean+snaptrim, 72 unknown, 10 active+clean+snaptrim_wait, 310 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 258 KiB/s wr, 6 op/s 2024-02-13T00:38:27.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:26 smithi080 bash[17386]: audit 2024-02-13T00:38:25.785421+0000 mon.a (mon.0) 1102 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi080-54183-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:27.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:26 smithi080 bash[17386]: cluster 2024-02-13T00:38:25.786134+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e109: 8 total, 8 up, 8 in 2024-02-13T00:38:27.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:26 smithi080 bash[17386]: audit 2024-02-13T00:38:26.683179+0000 mon.a (mon.0) 1104 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:27.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:26 smithi080 bash[17386]: cluster 2024-02-13T00:38:26.762828+0000 mon.a (mon.0) 1105 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2024-02-13T00:38:27.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:26 smithi080 bash[17386]: audit 2024-02-13T00:38:26.764425+0000 mon.c (mon.2) 170 : audit [INF] from='client.? 172.21.15.80:0/1770219120' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi080-54175-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:27.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:26 smithi080 bash[17386]: audit 2024-02-13T00:38:26.770638+0000 mon.a (mon.0) 1106 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi080-54175-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:27.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:26 smithi080 bash[24237]: cluster 2024-02-13T00:38:25.696880+0000 mgr.y (mgr.24461) 346 : cluster [DBG] pgmap v293: 396 pgs: 4 active+clean+snaptrim, 72 unknown, 10 active+clean+snaptrim_wait, 310 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.0 KiB/s rd, 258 KiB/s wr, 6 op/s 2024-02-13T00:38:27.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:26 smithi080 bash[24237]: audit 2024-02-13T00:38:25.785421+0000 mon.a (mon.0) 1102 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi080-54183-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:27.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:26 smithi080 bash[24237]: cluster 2024-02-13T00:38:25.786134+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e109: 8 total, 8 up, 8 in 2024-02-13T00:38:27.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:26 smithi080 bash[24237]: audit 2024-02-13T00:38:26.683179+0000 mon.a (mon.0) 1104 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:27.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:26 smithi080 bash[24237]: cluster 2024-02-13T00:38:26.762828+0000 mon.a (mon.0) 1105 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2024-02-13T00:38:27.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:26 smithi080 bash[24237]: audit 2024-02-13T00:38:26.764425+0000 mon.c (mon.2) 170 : audit [INF] from='client.? 172.21.15.80:0/1770219120' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi080-54175-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:27.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:26 smithi080 bash[24237]: audit 2024-02-13T00:38:26.770638+0000 mon.a (mon.0) 1106 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi080-54175-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:28.121 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:27 smithi106 bash[18459]: audit 2024-02-13T00:38:26.784187+0000 mon.a (mon.0) 1107 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:28.121 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:27 smithi106 bash[18459]: cluster 2024-02-13T00:38:26.865191+0000 osd.3 (osd.3) 5 : cluster [DBG] 17.9 deep-scrub starts 2024-02-13T00:38:28.121 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:27 smithi106 bash[18459]: cluster 2024-02-13T00:38:26.870486+0000 osd.3 (osd.3) 6 : cluster [DBG] 17.9 deep-scrub ok 2024-02-13T00:38:28.121 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:27 smithi106 bash[18459]: audit 2024-02-13T00:38:27.685005+0000 mon.a (mon.0) 1108 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:28.121 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:27 smithi106 bash[18459]: audit 2024-02-13T00:38:27.768790+0000 mon.a (mon.0) 1109 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi080-54175-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:28.121 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:27 smithi106 bash[18459]: audit 2024-02-13T00:38:27.769113+0000 mon.a (mon.0) 1110 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:28.121 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:27 smithi106 bash[18459]: cluster 2024-02-13T00:38:27.769709+0000 mon.a (mon.0) 1111 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2024-02-13T00:38:28.121 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:27 smithi106 bash[18459]: audit 2024-02-13T00:38:27.772569+0000 mon.c (mon.2) 171 : audit [INF] from='client.? 172.21.15.80:0/4211416491' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi080-54183-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:28.121 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:27 smithi106 bash[18459]: audit 2024-02-13T00:38:27.777217+0000 mon.a (mon.0) 1112 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi080-54183-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:28.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:27 smithi080 bash[17386]: audit 2024-02-13T00:38:26.784187+0000 mon.a (mon.0) 1107 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:28.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:27 smithi080 bash[17386]: cluster 2024-02-13T00:38:26.865191+0000 osd.3 (osd.3) 5 : cluster [DBG] 17.9 deep-scrub starts 2024-02-13T00:38:28.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:27 smithi080 bash[17386]: cluster 2024-02-13T00:38:26.870486+0000 osd.3 (osd.3) 6 : cluster [DBG] 17.9 deep-scrub ok 2024-02-13T00:38:28.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:27 smithi080 bash[17386]: audit 2024-02-13T00:38:27.685005+0000 mon.a (mon.0) 1108 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:28.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:27 smithi080 bash[17386]: audit 2024-02-13T00:38:27.768790+0000 mon.a (mon.0) 1109 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi080-54175-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:28.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:27 smithi080 bash[17386]: audit 2024-02-13T00:38:27.769113+0000 mon.a (mon.0) 1110 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:28.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:27 smithi080 bash[17386]: cluster 2024-02-13T00:38:27.769709+0000 mon.a (mon.0) 1111 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2024-02-13T00:38:28.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:27 smithi080 bash[17386]: audit 2024-02-13T00:38:27.772569+0000 mon.c (mon.2) 171 : audit [INF] from='client.? 172.21.15.80:0/4211416491' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi080-54183-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:28.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:27 smithi080 bash[17386]: audit 2024-02-13T00:38:27.777217+0000 mon.a (mon.0) 1112 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi080-54183-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:28.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:27 smithi080 bash[24237]: audit 2024-02-13T00:38:26.784187+0000 mon.a (mon.0) 1107 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:28.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:27 smithi080 bash[24237]: cluster 2024-02-13T00:38:26.865191+0000 osd.3 (osd.3) 5 : cluster [DBG] 17.9 deep-scrub starts 2024-02-13T00:38:28.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:27 smithi080 bash[24237]: cluster 2024-02-13T00:38:26.870486+0000 osd.3 (osd.3) 6 : cluster [DBG] 17.9 deep-scrub ok 2024-02-13T00:38:28.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:27 smithi080 bash[24237]: audit 2024-02-13T00:38:27.685005+0000 mon.a (mon.0) 1108 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:28.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:27 smithi080 bash[24237]: audit 2024-02-13T00:38:27.768790+0000 mon.a (mon.0) 1109 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi080-54175-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:28.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:27 smithi080 bash[24237]: audit 2024-02-13T00:38:27.769113+0000 mon.a (mon.0) 1110 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:28.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:27 smithi080 bash[24237]: cluster 2024-02-13T00:38:27.769709+0000 mon.a (mon.0) 1111 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2024-02-13T00:38:28.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:27 smithi080 bash[24237]: audit 2024-02-13T00:38:27.772569+0000 mon.c (mon.2) 171 : audit [INF] from='client.? 172.21.15.80:0/4211416491' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi080-54183-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:28.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:27 smithi080 bash[24237]: audit 2024-02-13T00:38:27.777217+0000 mon.a (mon.0) 1112 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi080-54183-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:28.505 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:38:28 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:38:29.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:29 smithi106 bash[18459]: cluster 2024-02-13T00:38:27.252721+0000 osd.4 (osd.4) 9 : cluster [DBG] 17.3 deep-scrub starts 2024-02-13T00:38:29.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:29 smithi106 bash[18459]: cluster 2024-02-13T00:38:27.305533+0000 osd.4 (osd.4) 10 : cluster [DBG] 17.3 deep-scrub ok 2024-02-13T00:38:29.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:29 smithi106 bash[18459]: cluster 2024-02-13T00:38:27.697810+0000 mgr.y (mgr.24461) 347 : cluster [DBG] pgmap v296: 364 pgs: 3 active+clean+snaptrim, 72 unknown, 7 active+clean+snaptrim_wait, 282 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:29.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:29 smithi106 bash[18459]: audit 2024-02-13T00:38:28.117554+0000 mgr.y (mgr.24461) 348 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:38:29.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:29 smithi106 bash[18459]: audit 2024-02-13T00:38:28.686621+0000 mon.a (mon.0) 1113 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:29.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:29 smithi106 bash[18459]: audit 2024-02-13T00:38:28.768407+0000 mon.a (mon.0) 1114 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi080-54183-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:29.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:29 smithi106 bash[18459]: cluster 2024-02-13T00:38:28.768762+0000 mon.a (mon.0) 1115 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-02-13T00:38:29.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:29 smithi080 bash[24237]: cluster 2024-02-13T00:38:27.252721+0000 osd.4 (osd.4) 9 : cluster [DBG] 17.3 deep-scrub starts 2024-02-13T00:38:29.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:29 smithi080 bash[24237]: cluster 2024-02-13T00:38:27.305533+0000 osd.4 (osd.4) 10 : cluster [DBG] 17.3 deep-scrub ok 2024-02-13T00:38:29.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:29 smithi080 bash[24237]: cluster 2024-02-13T00:38:27.697810+0000 mgr.y (mgr.24461) 347 : cluster [DBG] pgmap v296: 364 pgs: 3 active+clean+snaptrim, 72 unknown, 7 active+clean+snaptrim_wait, 282 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:29.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:29 smithi080 bash[24237]: audit 2024-02-13T00:38:28.117554+0000 mgr.y (mgr.24461) 348 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:38:29.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:29 smithi080 bash[24237]: audit 2024-02-13T00:38:28.686621+0000 mon.a (mon.0) 1113 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:29.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:29 smithi080 bash[24237]: audit 2024-02-13T00:38:28.768407+0000 mon.a (mon.0) 1114 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi080-54183-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:29.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:29 smithi080 bash[24237]: cluster 2024-02-13T00:38:28.768762+0000 mon.a (mon.0) 1115 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-02-13T00:38:29.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:29 smithi080 bash[17386]: cluster 2024-02-13T00:38:27.252721+0000 osd.4 (osd.4) 9 : cluster [DBG] 17.3 deep-scrub starts 2024-02-13T00:38:29.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:29 smithi080 bash[17386]: cluster 2024-02-13T00:38:27.305533+0000 osd.4 (osd.4) 10 : cluster [DBG] 17.3 deep-scrub ok 2024-02-13T00:38:29.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:29 smithi080 bash[17386]: cluster 2024-02-13T00:38:27.697810+0000 mgr.y (mgr.24461) 347 : cluster [DBG] pgmap v296: 364 pgs: 3 active+clean+snaptrim, 72 unknown, 7 active+clean+snaptrim_wait, 282 active+clean; 217 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:29.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:29 smithi080 bash[17386]: audit 2024-02-13T00:38:28.117554+0000 mgr.y (mgr.24461) 348 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:38:29.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:29 smithi080 bash[17386]: audit 2024-02-13T00:38:28.686621+0000 mon.a (mon.0) 1113 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:29.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:29 smithi080 bash[17386]: audit 2024-02-13T00:38:28.768407+0000 mon.a (mon.0) 1114 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi080-54183-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:29.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:29 smithi080 bash[17386]: cluster 2024-02-13T00:38:28.768762+0000 mon.a (mon.0) 1115 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2024-02-13T00:38:30.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:38:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:38:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:38:30.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:30 smithi106 bash[18459]: audit 2024-02-13T00:38:29.688369+0000 mon.a (mon.0) 1116 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:30.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:30 smithi106 bash[18459]: cluster 2024-02-13T00:38:29.698804+0000 mgr.y (mgr.24461) 349 : cluster [DBG] pgmap v299: 364 pgs: 3 creating+activating, 28 creating+peering, 21 unknown, 312 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s wr, 1 op/s 2024-02-13T00:38:30.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:30 smithi106 bash[18459]: cluster 2024-02-13T00:38:29.773353+0000 mon.a (mon.0) 1117 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2024-02-13T00:38:30.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:30 smithi106 bash[18459]: audit 2024-02-13T00:38:29.785216+0000 mon.c (mon.2) 172 : audit [INF] from='client.? 172.21.15.80:0/3979803317' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi080-54175-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:30.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:30 smithi106 bash[18459]: audit 2024-02-13T00:38:29.787786+0000 mon.a (mon.0) 1118 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi080-54175-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:30 smithi080 bash[17386]: audit 2024-02-13T00:38:29.688369+0000 mon.a (mon.0) 1116 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:30 smithi080 bash[17386]: cluster 2024-02-13T00:38:29.698804+0000 mgr.y (mgr.24461) 349 : cluster [DBG] pgmap v299: 364 pgs: 3 creating+activating, 28 creating+peering, 21 unknown, 312 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s wr, 1 op/s 2024-02-13T00:38:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:30 smithi080 bash[17386]: cluster 2024-02-13T00:38:29.773353+0000 mon.a (mon.0) 1117 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2024-02-13T00:38:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:30 smithi080 bash[17386]: audit 2024-02-13T00:38:29.785216+0000 mon.c (mon.2) 172 : audit [INF] from='client.? 172.21.15.80:0/3979803317' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi080-54175-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:30 smithi080 bash[17386]: audit 2024-02-13T00:38:29.787786+0000 mon.a (mon.0) 1118 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi080-54175-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:30.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:30 smithi080 bash[24237]: audit 2024-02-13T00:38:29.688369+0000 mon.a (mon.0) 1116 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:30.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:30 smithi080 bash[24237]: cluster 2024-02-13T00:38:29.698804+0000 mgr.y (mgr.24461) 349 : cluster [DBG] pgmap v299: 364 pgs: 3 creating+activating, 28 creating+peering, 21 unknown, 312 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 5.5 KiB/s wr, 1 op/s 2024-02-13T00:38:30.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:30 smithi080 bash[24237]: cluster 2024-02-13T00:38:29.773353+0000 mon.a (mon.0) 1117 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2024-02-13T00:38:30.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:30 smithi080 bash[24237]: audit 2024-02-13T00:38:29.785216+0000 mon.c (mon.2) 172 : audit [INF] from='client.? 172.21.15.80:0/3979803317' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi080-54175-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:30.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:30 smithi080 bash[24237]: audit 2024-02-13T00:38:29.787786+0000 mon.a (mon.0) 1118 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi080-54175-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:31.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:31 smithi106 bash[18459]: cluster 2024-02-13T00:38:30.282091+0000 mon.a (mon.0) 1119 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:38:31.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:31 smithi106 bash[18459]: audit 2024-02-13T00:38:30.690072+0000 mon.a (mon.0) 1120 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:31.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:31 smithi106 bash[18459]: audit 2024-02-13T00:38:30.775332+0000 mon.a (mon.0) 1121 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi080-54175-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:31.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:31 smithi106 bash[18459]: cluster 2024-02-13T00:38:30.775601+0000 mon.a (mon.0) 1122 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2024-02-13T00:38:31.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:31 smithi106 bash[18459]: audit 2024-02-13T00:38:30.782777+0000 mon.c (mon.2) 173 : audit [INF] from='client.? 172.21.15.80:0/3757044944' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi080-54183-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:31.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:31 smithi106 bash[18459]: audit 2024-02-13T00:38:30.789552+0000 mon.a (mon.0) 1123 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi080-54183-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:31.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:31 smithi080 bash[24237]: cluster 2024-02-13T00:38:30.282091+0000 mon.a (mon.0) 1119 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:38:31.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:31 smithi080 bash[24237]: audit 2024-02-13T00:38:30.690072+0000 mon.a (mon.0) 1120 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:31.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:31 smithi080 bash[24237]: audit 2024-02-13T00:38:30.775332+0000 mon.a (mon.0) 1121 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi080-54175-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:31.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:31 smithi080 bash[24237]: cluster 2024-02-13T00:38:30.775601+0000 mon.a (mon.0) 1122 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2024-02-13T00:38:31.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:31 smithi080 bash[24237]: audit 2024-02-13T00:38:30.782777+0000 mon.c (mon.2) 173 : audit [INF] from='client.? 172.21.15.80:0/3757044944' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi080-54183-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:31.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:31 smithi080 bash[24237]: audit 2024-02-13T00:38:30.789552+0000 mon.a (mon.0) 1123 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi080-54183-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:31.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:31 smithi080 bash[17386]: cluster 2024-02-13T00:38:30.282091+0000 mon.a (mon.0) 1119 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:38:31.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:31 smithi080 bash[17386]: audit 2024-02-13T00:38:30.690072+0000 mon.a (mon.0) 1120 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:31.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:31 smithi080 bash[17386]: audit 2024-02-13T00:38:30.775332+0000 mon.a (mon.0) 1121 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi080-54175-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:31.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:31 smithi080 bash[17386]: cluster 2024-02-13T00:38:30.775601+0000 mon.a (mon.0) 1122 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2024-02-13T00:38:31.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:31 smithi080 bash[17386]: audit 2024-02-13T00:38:30.782777+0000 mon.c (mon.2) 173 : audit [INF] from='client.? 172.21.15.80:0/3757044944' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi080-54183-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:31.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:31 smithi080 bash[17386]: audit 2024-02-13T00:38:30.789552+0000 mon.a (mon.0) 1123 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi080-54183-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:32.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:32 smithi106 bash[18459]: audit 2024-02-13T00:38:31.691644+0000 mon.a (mon.0) 1124 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:32.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:32 smithi106 bash[18459]: cluster 2024-02-13T00:38:31.699935+0000 mgr.y (mgr.24461) 350 : cluster [DBG] pgmap v302: 396 pgs: 3 creating+activating, 17 creating+peering, 64 unknown, 312 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 5.5 KiB/s wr, 3 op/s 2024-02-13T00:38:32.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:32 smithi106 bash[18459]: audit 2024-02-13T00:38:31.762763+0000 mon.a (mon.0) 1125 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi080-54183-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:32.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:32 smithi106 bash[18459]: cluster 2024-02-13T00:38:31.763152+0000 mon.a (mon.0) 1126 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2024-02-13T00:38:32.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:32 smithi106 bash[18459]: audit 2024-02-13T00:38:32.271424+0000 mon.a (mon.0) 1127 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:38:32.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:32 smithi080 bash[17386]: audit 2024-02-13T00:38:31.691644+0000 mon.a (mon.0) 1124 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:32.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:32 smithi080 bash[17386]: cluster 2024-02-13T00:38:31.699935+0000 mgr.y (mgr.24461) 350 : cluster [DBG] pgmap v302: 396 pgs: 3 creating+activating, 17 creating+peering, 64 unknown, 312 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 5.5 KiB/s wr, 3 op/s 2024-02-13T00:38:32.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:32 smithi080 bash[17386]: audit 2024-02-13T00:38:31.762763+0000 mon.a (mon.0) 1125 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi080-54183-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:32.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:32 smithi080 bash[17386]: cluster 2024-02-13T00:38:31.763152+0000 mon.a (mon.0) 1126 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2024-02-13T00:38:32.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:32 smithi080 bash[17386]: audit 2024-02-13T00:38:32.271424+0000 mon.a (mon.0) 1127 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:38:32.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:32 smithi080 bash[24237]: audit 2024-02-13T00:38:31.691644+0000 mon.a (mon.0) 1124 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:32.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:32 smithi080 bash[24237]: cluster 2024-02-13T00:38:31.699935+0000 mgr.y (mgr.24461) 350 : cluster [DBG] pgmap v302: 396 pgs: 3 creating+activating, 17 creating+peering, 64 unknown, 312 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 5.5 KiB/s wr, 3 op/s 2024-02-13T00:38:32.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:32 smithi080 bash[24237]: audit 2024-02-13T00:38:31.762763+0000 mon.a (mon.0) 1125 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi080-54183-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:32.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:32 smithi080 bash[24237]: cluster 2024-02-13T00:38:31.763152+0000 mon.a (mon.0) 1126 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2024-02-13T00:38:32.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:32 smithi080 bash[24237]: audit 2024-02-13T00:38:32.271424+0000 mon.a (mon.0) 1127 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:38:33.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:38:33 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:38:33] "GET /metrics HTTP/1.1" 200 196058 "" "Prometheus/2.33.4" 2024-02-13T00:38:33.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:33 smithi080 bash[17386]: audit 2024-02-13T00:38:32.693269+0000 mon.a (mon.0) 1128 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:33.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:33 smithi080 bash[17386]: audit 2024-02-13T00:38:32.769342+0000 mon.a (mon.0) 1129 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-13", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:38:33.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:33 smithi080 bash[17386]: cluster 2024-02-13T00:38:32.769500+0000 mon.a (mon.0) 1130 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2024-02-13T00:38:33.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:33 smithi080 bash[17386]: audit 2024-02-13T00:38:32.774290+0000 mon.a (mon.0) 1131 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-13"}]: dispatch 2024-02-13T00:38:33.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:33 smithi080 bash[17386]: audit 2024-02-13T00:38:32.782904+0000 mon.c (mon.2) 174 : audit [INF] from='client.? 172.21.15.80:0/3341235190' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi080-54175-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:33.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:33 smithi080 bash[17386]: audit 2024-02-13T00:38:32.783492+0000 mon.a (mon.0) 1132 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi080-54175-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:33.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:33 smithi080 bash[24237]: audit 2024-02-13T00:38:32.693269+0000 mon.a (mon.0) 1128 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:33.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:33 smithi080 bash[24237]: audit 2024-02-13T00:38:32.769342+0000 mon.a (mon.0) 1129 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-13", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:38:33.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:33 smithi080 bash[24237]: cluster 2024-02-13T00:38:32.769500+0000 mon.a (mon.0) 1130 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2024-02-13T00:38:33.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:33 smithi080 bash[24237]: audit 2024-02-13T00:38:32.774290+0000 mon.a (mon.0) 1131 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-13"}]: dispatch 2024-02-13T00:38:33.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:33 smithi080 bash[24237]: audit 2024-02-13T00:38:32.782904+0000 mon.c (mon.2) 174 : audit [INF] from='client.? 172.21.15.80:0/3341235190' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi080-54175-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:33.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:33 smithi080 bash[24237]: audit 2024-02-13T00:38:32.783492+0000 mon.a (mon.0) 1132 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi080-54175-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:33.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:33 smithi106 bash[18459]: audit 2024-02-13T00:38:32.693269+0000 mon.a (mon.0) 1128 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:33.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:33 smithi106 bash[18459]: audit 2024-02-13T00:38:32.769342+0000 mon.a (mon.0) 1129 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-13", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:38:33.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:33 smithi106 bash[18459]: cluster 2024-02-13T00:38:32.769500+0000 mon.a (mon.0) 1130 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2024-02-13T00:38:33.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:33 smithi106 bash[18459]: audit 2024-02-13T00:38:32.774290+0000 mon.a (mon.0) 1131 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-13"}]: dispatch 2024-02-13T00:38:33.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:33 smithi106 bash[18459]: audit 2024-02-13T00:38:32.782904+0000 mon.c (mon.2) 174 : audit [INF] from='client.? 172.21.15.80:0/3341235190' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi080-54175-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:33.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:33 smithi106 bash[18459]: audit 2024-02-13T00:38:32.783492+0000 mon.a (mon.0) 1132 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi080-54175-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:34.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:34 smithi106 bash[18459]: audit 2024-02-13T00:38:33.695001+0000 mon.a (mon.0) 1133 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:34.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:34 smithi106 bash[18459]: cluster 2024-02-13T00:38:33.702042+0000 mgr.y (mgr.24461) 351 : cluster [DBG] pgmap v305: 364 pgs: 16 creating+peering, 16 unknown, 332 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 128 KiB/s wr, 126 op/s 2024-02-13T00:38:34.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:34 smithi106 bash[18459]: audit 2024-02-13T00:38:33.771723+0000 mon.a (mon.0) 1134 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-13"}]': finished 2024-02-13T00:38:34.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:34 smithi106 bash[18459]: audit 2024-02-13T00:38:33.772010+0000 mon.a (mon.0) 1135 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi080-54175-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:34.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:34 smithi106 bash[18459]: cluster 2024-02-13T00:38:33.772733+0000 mon.a (mon.0) 1136 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2024-02-13T00:38:34.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:34 smithi106 bash[18459]: audit 2024-02-13T00:38:33.774975+0000 mon.c (mon.2) 175 : audit [INF] from='client.? 172.21.15.80:0/306267812' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:34.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:34 smithi106 bash[18459]: audit 2024-02-13T00:38:33.775371+0000 mon.c (mon.2) 176 : audit [INF] from='client.? 172.21.15.80:0/2810617011' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi080-54183-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:34.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:34 smithi106 bash[18459]: audit 2024-02-13T00:38:33.780379+0000 mon.a (mon.0) 1137 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-13", "mode": "writeback"}]: dispatch 2024-02-13T00:38:34.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:34 smithi106 bash[18459]: audit 2024-02-13T00:38:33.780755+0000 mon.a (mon.0) 1138 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:34.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:34 smithi106 bash[18459]: audit 2024-02-13T00:38:33.781078+0000 mon.a (mon.0) 1139 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi080-54183-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:34.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:34 smithi080 bash[17386]: audit 2024-02-13T00:38:33.695001+0000 mon.a (mon.0) 1133 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:34.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:34 smithi080 bash[17386]: cluster 2024-02-13T00:38:33.702042+0000 mgr.y (mgr.24461) 351 : cluster [DBG] pgmap v305: 364 pgs: 16 creating+peering, 16 unknown, 332 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 128 KiB/s wr, 126 op/s 2024-02-13T00:38:34.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:34 smithi080 bash[17386]: audit 2024-02-13T00:38:33.771723+0000 mon.a (mon.0) 1134 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-13"}]': finished 2024-02-13T00:38:34.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:34 smithi080 bash[17386]: audit 2024-02-13T00:38:33.772010+0000 mon.a (mon.0) 1135 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi080-54175-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:34.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:34 smithi080 bash[17386]: cluster 2024-02-13T00:38:33.772733+0000 mon.a (mon.0) 1136 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2024-02-13T00:38:34.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:34 smithi080 bash[17386]: audit 2024-02-13T00:38:33.774975+0000 mon.c (mon.2) 175 : audit [INF] from='client.? 172.21.15.80:0/306267812' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:34.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:34 smithi080 bash[17386]: audit 2024-02-13T00:38:33.775371+0000 mon.c (mon.2) 176 : audit [INF] from='client.? 172.21.15.80:0/2810617011' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi080-54183-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:34.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:34 smithi080 bash[17386]: audit 2024-02-13T00:38:33.780379+0000 mon.a (mon.0) 1137 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-13", "mode": "writeback"}]: dispatch 2024-02-13T00:38:34.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:34 smithi080 bash[17386]: audit 2024-02-13T00:38:33.780755+0000 mon.a (mon.0) 1138 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:34.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:34 smithi080 bash[17386]: audit 2024-02-13T00:38:33.781078+0000 mon.a (mon.0) 1139 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi080-54183-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:34.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:34 smithi080 bash[24237]: audit 2024-02-13T00:38:33.695001+0000 mon.a (mon.0) 1133 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:34.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:34 smithi080 bash[24237]: cluster 2024-02-13T00:38:33.702042+0000 mgr.y (mgr.24461) 351 : cluster [DBG] pgmap v305: 364 pgs: 16 creating+peering, 16 unknown, 332 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.2 KiB/s rd, 128 KiB/s wr, 126 op/s 2024-02-13T00:38:34.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:34 smithi080 bash[24237]: audit 2024-02-13T00:38:33.771723+0000 mon.a (mon.0) 1134 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-13"}]': finished 2024-02-13T00:38:34.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:34 smithi080 bash[24237]: audit 2024-02-13T00:38:33.772010+0000 mon.a (mon.0) 1135 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi080-54175-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:34.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:34 smithi080 bash[24237]: cluster 2024-02-13T00:38:33.772733+0000 mon.a (mon.0) 1136 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2024-02-13T00:38:34.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:34 smithi080 bash[24237]: audit 2024-02-13T00:38:33.774975+0000 mon.c (mon.2) 175 : audit [INF] from='client.? 172.21.15.80:0/306267812' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:34.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:34 smithi080 bash[24237]: audit 2024-02-13T00:38:33.775371+0000 mon.c (mon.2) 176 : audit [INF] from='client.? 172.21.15.80:0/2810617011' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi080-54183-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:34.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:34 smithi080 bash[24237]: audit 2024-02-13T00:38:33.780379+0000 mon.a (mon.0) 1137 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-13", "mode": "writeback"}]: dispatch 2024-02-13T00:38:34.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:34 smithi080 bash[24237]: audit 2024-02-13T00:38:33.780755+0000 mon.a (mon.0) 1138 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:34.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:34 smithi080 bash[24237]: audit 2024-02-13T00:38:33.781078+0000 mon.a (mon.0) 1139 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi080-54183-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:35.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:35 smithi106 bash[18459]: audit 2024-02-13T00:38:34.696786+0000 mon.a (mon.0) 1140 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:35.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:35 smithi106 bash[18459]: cluster 2024-02-13T00:38:34.765181+0000 mon.a (mon.0) 1141 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:38:35.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:35 smithi106 bash[18459]: audit 2024-02-13T00:38:34.774285+0000 mon.a (mon.0) 1142 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-13", "mode": "writeback"}]': finished 2024-02-13T00:38:35.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:35 smithi106 bash[18459]: audit 2024-02-13T00:38:34.774404+0000 mon.a (mon.0) 1143 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]': finished 2024-02-13T00:38:35.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:35 smithi106 bash[18459]: audit 2024-02-13T00:38:34.774594+0000 mon.a (mon.0) 1144 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi080-54183-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:35.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:35 smithi106 bash[18459]: cluster 2024-02-13T00:38:34.774944+0000 mon.a (mon.0) 1145 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2024-02-13T00:38:35.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:35 smithi106 bash[18459]: audit 2024-02-13T00:38:34.776073+0000 mon.c (mon.2) 177 : audit [INF] from='client.? 172.21.15.80:0/306267812' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:35.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:35 smithi106 bash[18459]: audit 2024-02-13T00:38:34.779065+0000 mon.a (mon.0) 1146 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:35.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:35 smithi080 bash[17386]: audit 2024-02-13T00:38:34.696786+0000 mon.a (mon.0) 1140 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:35.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:35 smithi080 bash[17386]: cluster 2024-02-13T00:38:34.765181+0000 mon.a (mon.0) 1141 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:38:35.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:35 smithi080 bash[17386]: audit 2024-02-13T00:38:34.774285+0000 mon.a (mon.0) 1142 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-13", "mode": "writeback"}]': finished 2024-02-13T00:38:35.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:35 smithi080 bash[17386]: audit 2024-02-13T00:38:34.774404+0000 mon.a (mon.0) 1143 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]': finished 2024-02-13T00:38:35.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:35 smithi080 bash[17386]: audit 2024-02-13T00:38:34.774594+0000 mon.a (mon.0) 1144 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi080-54183-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:35.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:35 smithi080 bash[17386]: cluster 2024-02-13T00:38:34.774944+0000 mon.a (mon.0) 1145 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2024-02-13T00:38:35.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:35 smithi080 bash[17386]: audit 2024-02-13T00:38:34.776073+0000 mon.c (mon.2) 177 : audit [INF] from='client.? 172.21.15.80:0/306267812' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:35.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:35 smithi080 bash[17386]: audit 2024-02-13T00:38:34.779065+0000 mon.a (mon.0) 1146 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:35 smithi080 bash[24237]: audit 2024-02-13T00:38:34.696786+0000 mon.a (mon.0) 1140 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:35 smithi080 bash[24237]: cluster 2024-02-13T00:38:34.765181+0000 mon.a (mon.0) 1141 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:38:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:35 smithi080 bash[24237]: audit 2024-02-13T00:38:34.774285+0000 mon.a (mon.0) 1142 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-13", "mode": "writeback"}]': finished 2024-02-13T00:38:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:35 smithi080 bash[24237]: audit 2024-02-13T00:38:34.774404+0000 mon.a (mon.0) 1143 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]': finished 2024-02-13T00:38:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:35 smithi080 bash[24237]: audit 2024-02-13T00:38:34.774594+0000 mon.a (mon.0) 1144 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi080-54183-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:35 smithi080 bash[24237]: cluster 2024-02-13T00:38:34.774944+0000 mon.a (mon.0) 1145 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2024-02-13T00:38:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:35 smithi080 bash[24237]: audit 2024-02-13T00:38:34.776073+0000 mon.c (mon.2) 177 : audit [INF] from='client.? 172.21.15.80:0/306267812' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:35 smithi080 bash[24237]: audit 2024-02-13T00:38:34.779065+0000 mon.a (mon.0) 1146 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]: dispatch 2024-02-13T00:38:35.794 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: Running main() from gmock_main.cc 2024-02-13T00:38:35.794 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [==========] Running 12 tests from 4 test suites. 2024-02-13T00:38:35.794 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [----------] Global test environment set-up. 2024-02-13T00:38:35.794 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2024-02-13T00:38:35.794 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2024-02-13T00:38:35.794 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (2665 ms) 2024-02-13T00:38:35.794 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2024-02-13T00:38:35.794 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (2460 ms) 2024-02-13T00:38:35.794 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2024-02-13T00:38:35.794 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (4927 ms) 2024-02-13T00:38:35.794 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2024-02-13T00:38:35.794 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (2026 ms) 2024-02-13T00:38:35.795 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (12078 ms total) 2024-02-13T00:38:35.795 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: 2024-02-13T00:38:35.795 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManaged 2024-02-13T00:38:35.795 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-02-13T00:38:35.795 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (4296 ms) 2024-02-13T00:38:35.795 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-02-13T00:38:35.795 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (4547 ms) 2024-02-13T00:38:35.795 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManaged (8843 ms total) 2024-02-13T00:38:35.795 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: 2024-02-13T00:38:35.795 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2024-02-13T00:38:35.795 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2024-02-13T00:38:35.795 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (2262 ms) 2024-02-13T00:38:35.795 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-02-13T00:38:35.795 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (3351 ms) 2024-02-13T00:38:35.795 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2024-02-13T00:38:35.796 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (1660 ms) 2024-02-13T00:38:35.796 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-02-13T00:38:35.796 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (2231 ms) 2024-02-13T00:38:35.796 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (9504 ms total) 2024-02-13T00:38:35.796 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: 2024-02-13T00:38:35.796 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-02-13T00:38:35.796 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-02-13T00:38:35.796 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (4024 ms) 2024-02-13T00:38:35.796 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-02-13T00:38:35.796 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (3991 ms) 2024-02-13T00:38:35.796 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (8015 ms total) 2024-02-13T00:38:35.796 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: 2024-02-13T00:38:35.796 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [----------] Global test environment tear-down 2024-02-13T00:38:35.796 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [==========] 12 tests from 4 test suites ran. (66776 ms total) 2024-02-13T00:38:35.797 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots: [ PASSED ] 12 tests. 2024-02-13T00:38:36.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:36 smithi106 bash[18459]: audit 2024-02-13T00:38:35.698280+0000 mon.a (mon.0) 1147 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:36.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:36 smithi106 bash[18459]: cluster 2024-02-13T00:38:35.702811+0000 mgr.y (mgr.24461) 352 : cluster [DBG] pgmap v308: 356 pgs: 32 unknown, 324 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 0 B/s rd, 120 KiB/s wr, 124 op/s 2024-02-13T00:38:36.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:36 smithi106 bash[18459]: audit 2024-02-13T00:38:35.775548+0000 mon.a (mon.0) 1148 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]': finished 2024-02-13T00:38:36.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:36 smithi106 bash[18459]: cluster 2024-02-13T00:38:35.775798+0000 mon.a (mon.0) 1149 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2024-02-13T00:38:36.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:36 smithi106 bash[18459]: audit 2024-02-13T00:38:35.784506+0000 mon.c (mon.2) 178 : audit [INF] from='client.? 172.21.15.80:0/4029333887' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi080-54175-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:36.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:36 smithi106 bash[18459]: audit 2024-02-13T00:38:35.785541+0000 mon.a (mon.0) 1150 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi080-54175-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:36.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:36 smithi106 bash[18459]: audit 2024-02-13T00:38:36.272951+0000 mon.a (mon.0) 1151 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2024-02-13T00:38:36.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:36 smithi106 bash[18459]: audit 2024-02-13T00:38:36.274480+0000 mon.a (mon.0) 1152 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2024-02-13T00:38:36.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:36 smithi106 bash[18459]: audit 2024-02-13T00:38:36.275531+0000 mon.a (mon.0) 1153 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2024-02-13T00:38:36.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:36 smithi106 bash[18459]: audit 2024-02-13T00:38:36.276549+0000 mon.a (mon.0) 1154 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2024-02-13T00:38:36.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:36 smithi106 bash[18459]: audit 2024-02-13T00:38:36.277605+0000 mon.a (mon.0) 1155 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2024-02-13T00:38:36.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:36 smithi106 bash[18459]: audit 2024-02-13T00:38:36.278539+0000 mon.a (mon.0) 1156 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2024-02-13T00:38:36.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:36 smithi106 bash[18459]: audit 2024-02-13T00:38:36.279595+0000 mon.a (mon.0) 1157 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2024-02-13T00:38:36.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:36 smithi106 bash[18459]: audit 2024-02-13T00:38:36.280498+0000 mon.a (mon.0) 1158 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2024-02-13T00:38:36.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:36 smithi106 bash[18459]: audit 2024-02-13T00:38:36.281254+0000 mon.a (mon.0) 1159 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2024-02-13T00:38:36.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:36 smithi106 bash[18459]: audit 2024-02-13T00:38:36.281982+0000 mon.a (mon.0) 1160 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2024-02-13T00:38:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[17386]: audit 2024-02-13T00:38:35.698280+0000 mon.a (mon.0) 1147 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[17386]: cluster 2024-02-13T00:38:35.702811+0000 mgr.y (mgr.24461) 352 : cluster [DBG] pgmap v308: 356 pgs: 32 unknown, 324 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 0 B/s rd, 120 KiB/s wr, 124 op/s 2024-02-13T00:38:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[17386]: audit 2024-02-13T00:38:35.775548+0000 mon.a (mon.0) 1148 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]': finished 2024-02-13T00:38:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[17386]: cluster 2024-02-13T00:38:35.775798+0000 mon.a (mon.0) 1149 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2024-02-13T00:38:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[17386]: audit 2024-02-13T00:38:35.784506+0000 mon.c (mon.2) 178 : audit [INF] from='client.? 172.21.15.80:0/4029333887' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi080-54175-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[17386]: audit 2024-02-13T00:38:35.785541+0000 mon.a (mon.0) 1150 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi080-54175-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[17386]: audit 2024-02-13T00:38:36.272951+0000 mon.a (mon.0) 1151 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2024-02-13T00:38:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[17386]: audit 2024-02-13T00:38:36.274480+0000 mon.a (mon.0) 1152 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2024-02-13T00:38:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[17386]: audit 2024-02-13T00:38:36.275531+0000 mon.a (mon.0) 1153 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2024-02-13T00:38:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[17386]: audit 2024-02-13T00:38:36.276549+0000 mon.a (mon.0) 1154 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2024-02-13T00:38:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[17386]: audit 2024-02-13T00:38:36.277605+0000 mon.a (mon.0) 1155 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2024-02-13T00:38:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[17386]: audit 2024-02-13T00:38:36.278539+0000 mon.a (mon.0) 1156 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2024-02-13T00:38:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[17386]: audit 2024-02-13T00:38:36.279595+0000 mon.a (mon.0) 1157 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2024-02-13T00:38:36.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[17386]: audit 2024-02-13T00:38:36.280498+0000 mon.a (mon.0) 1158 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2024-02-13T00:38:36.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[17386]: audit 2024-02-13T00:38:36.281254+0000 mon.a (mon.0) 1159 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2024-02-13T00:38:36.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[17386]: audit 2024-02-13T00:38:36.281982+0000 mon.a (mon.0) 1160 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2024-02-13T00:38:36.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[24237]: audit 2024-02-13T00:38:35.698280+0000 mon.a (mon.0) 1147 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:36.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[24237]: cluster 2024-02-13T00:38:35.702811+0000 mgr.y (mgr.24461) 352 : cluster [DBG] pgmap v308: 356 pgs: 32 unknown, 324 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 0 B/s rd, 120 KiB/s wr, 124 op/s 2024-02-13T00:38:36.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[24237]: audit 2024-02-13T00:38:35.775548+0000 mon.a (mon.0) 1148 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi080-54340-14"}]': finished 2024-02-13T00:38:36.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[24237]: cluster 2024-02-13T00:38:35.775798+0000 mon.a (mon.0) 1149 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2024-02-13T00:38:36.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[24237]: audit 2024-02-13T00:38:35.784506+0000 mon.c (mon.2) 178 : audit [INF] from='client.? 172.21.15.80:0/4029333887' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi080-54175-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:36.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[24237]: audit 2024-02-13T00:38:35.785541+0000 mon.a (mon.0) 1150 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi080-54175-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:36.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[24237]: audit 2024-02-13T00:38:36.272951+0000 mon.a (mon.0) 1151 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2024-02-13T00:38:36.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[24237]: audit 2024-02-13T00:38:36.274480+0000 mon.a (mon.0) 1152 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2024-02-13T00:38:36.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[24237]: audit 2024-02-13T00:38:36.275531+0000 mon.a (mon.0) 1153 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2024-02-13T00:38:36.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[24237]: audit 2024-02-13T00:38:36.276549+0000 mon.a (mon.0) 1154 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2024-02-13T00:38:36.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[24237]: audit 2024-02-13T00:38:36.277605+0000 mon.a (mon.0) 1155 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2024-02-13T00:38:36.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[24237]: audit 2024-02-13T00:38:36.278539+0000 mon.a (mon.0) 1156 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2024-02-13T00:38:36.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[24237]: audit 2024-02-13T00:38:36.279595+0000 mon.a (mon.0) 1157 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2024-02-13T00:38:36.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[24237]: audit 2024-02-13T00:38:36.280498+0000 mon.a (mon.0) 1158 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2024-02-13T00:38:36.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[24237]: audit 2024-02-13T00:38:36.281254+0000 mon.a (mon.0) 1159 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2024-02-13T00:38:36.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:36 smithi080 bash[24237]: audit 2024-02-13T00:38:36.281982+0000 mon.a (mon.0) 1160 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2024-02-13T00:38:37.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:37 smithi106 bash[18459]: audit 2024-02-13T00:38:36.273351+0000 mgr.y (mgr.24461) 353 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2024-02-13T00:38:37.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:37 smithi106 bash[18459]: audit 2024-02-13T00:38:36.274774+0000 mgr.y (mgr.24461) 354 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2024-02-13T00:38:37.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:37 smithi106 bash[18459]: audit 2024-02-13T00:38:36.275788+0000 mgr.y (mgr.24461) 355 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2024-02-13T00:38:37.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:37 smithi106 bash[18459]: audit 2024-02-13T00:38:36.276831+0000 mgr.y (mgr.24461) 356 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2024-02-13T00:38:37.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:37 smithi106 bash[18459]: audit 2024-02-13T00:38:36.277885+0000 mgr.y (mgr.24461) 357 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2024-02-13T00:38:37.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:37 smithi106 bash[18459]: audit 2024-02-13T00:38:36.278760+0000 mgr.y (mgr.24461) 358 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2024-02-13T00:38:37.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:37 smithi106 bash[18459]: audit 2024-02-13T00:38:36.279888+0000 mgr.y (mgr.24461) 359 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2024-02-13T00:38:37.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:37 smithi106 bash[18459]: audit 2024-02-13T00:38:36.280695+0000 mgr.y (mgr.24461) 360 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2024-02-13T00:38:37.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:37 smithi106 bash[18459]: audit 2024-02-13T00:38:36.281428+0000 mgr.y (mgr.24461) 361 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2024-02-13T00:38:37.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:37 smithi106 bash[18459]: audit 2024-02-13T00:38:36.282148+0000 mgr.y (mgr.24461) 362 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2024-02-13T00:38:37.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:37 smithi106 bash[18459]: cluster 2024-02-13T00:38:36.323608+0000 mon.a (mon.0) 1161 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:38:37.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:37 smithi106 bash[18459]: cluster 2024-02-13T00:38:36.509392+0000 osd.2 (osd.2) 3 : cluster [DBG] 94.2 scrub starts 2024-02-13T00:38:37.758 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:37 smithi106 bash[18459]: cluster 2024-02-13T00:38:36.513959+0000 osd.2 (osd.2) 4 : cluster [DBG] 94.2 scrub ok 2024-02-13T00:38:37.758 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:37 smithi106 bash[18459]: cluster 2024-02-13T00:38:36.592800+0000 osd.6 (osd.6) 11 : cluster [DBG] 94.3 scrub starts 2024-02-13T00:38:37.758 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:37 smithi106 bash[18459]: cluster 2024-02-13T00:38:36.597030+0000 osd.6 (osd.6) 12 : cluster [DBG] 94.3 scrub ok 2024-02-13T00:38:37.758 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:37 smithi106 bash[18459]: audit 2024-02-13T00:38:36.700071+0000 mon.a (mon.0) 1162 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:37.758 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:37 smithi106 bash[18459]: audit 2024-02-13T00:38:36.766286+0000 mon.a (mon.0) 1163 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi080-54175-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:37.758 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:37 smithi106 bash[18459]: cluster 2024-02-13T00:38:36.766796+0000 mon.a (mon.0) 1164 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2024-02-13T00:38:37.759 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:37 smithi106 bash[18459]: audit 2024-02-13T00:38:36.769877+0000 mon.c (mon.2) 179 : audit [INF] from='client.? 172.21.15.80:0/3971325824' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi080-54183-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:37.759 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:37 smithi106 bash[18459]: audit 2024-02-13T00:38:36.784667+0000 mon.a (mon.0) 1165 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi080-54183-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:37.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[17386]: audit 2024-02-13T00:38:36.273351+0000 mgr.y (mgr.24461) 353 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2024-02-13T00:38:37.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[17386]: audit 2024-02-13T00:38:36.274774+0000 mgr.y (mgr.24461) 354 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2024-02-13T00:38:37.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[17386]: audit 2024-02-13T00:38:36.275788+0000 mgr.y (mgr.24461) 355 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2024-02-13T00:38:37.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[17386]: audit 2024-02-13T00:38:36.276831+0000 mgr.y (mgr.24461) 356 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2024-02-13T00:38:37.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[17386]: audit 2024-02-13T00:38:36.277885+0000 mgr.y (mgr.24461) 357 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2024-02-13T00:38:37.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[17386]: audit 2024-02-13T00:38:36.278760+0000 mgr.y (mgr.24461) 358 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2024-02-13T00:38:37.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[17386]: audit 2024-02-13T00:38:36.279888+0000 mgr.y (mgr.24461) 359 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2024-02-13T00:38:37.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[17386]: audit 2024-02-13T00:38:36.280695+0000 mgr.y (mgr.24461) 360 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2024-02-13T00:38:37.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[17386]: audit 2024-02-13T00:38:36.281428+0000 mgr.y (mgr.24461) 361 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2024-02-13T00:38:37.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[17386]: audit 2024-02-13T00:38:36.282148+0000 mgr.y (mgr.24461) 362 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2024-02-13T00:38:37.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[17386]: cluster 2024-02-13T00:38:36.323608+0000 mon.a (mon.0) 1161 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:38:37.761 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[17386]: cluster 2024-02-13T00:38:36.509392+0000 osd.2 (osd.2) 3 : cluster [DBG] 94.2 scrub starts 2024-02-13T00:38:37.762 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[17386]: cluster 2024-02-13T00:38:36.513959+0000 osd.2 (osd.2) 4 : cluster [DBG] 94.2 scrub ok 2024-02-13T00:38:37.762 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[17386]: cluster 2024-02-13T00:38:36.592800+0000 osd.6 (osd.6) 11 : cluster [DBG] 94.3 scrub starts 2024-02-13T00:38:37.762 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[17386]: cluster 2024-02-13T00:38:36.597030+0000 osd.6 (osd.6) 12 : cluster [DBG] 94.3 scrub ok 2024-02-13T00:38:37.762 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[17386]: audit 2024-02-13T00:38:36.700071+0000 mon.a (mon.0) 1162 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:37.762 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[17386]: audit 2024-02-13T00:38:36.766286+0000 mon.a (mon.0) 1163 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi080-54175-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:37.763 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[17386]: cluster 2024-02-13T00:38:36.766796+0000 mon.a (mon.0) 1164 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2024-02-13T00:38:37.763 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[17386]: audit 2024-02-13T00:38:36.769877+0000 mon.c (mon.2) 179 : audit [INF] from='client.? 172.21.15.80:0/3971325824' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi080-54183-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:37.763 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[17386]: audit 2024-02-13T00:38:36.784667+0000 mon.a (mon.0) 1165 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi080-54183-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:37.763 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[24237]: audit 2024-02-13T00:38:36.273351+0000 mgr.y (mgr.24461) 353 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2024-02-13T00:38:37.764 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[24237]: audit 2024-02-13T00:38:36.274774+0000 mgr.y (mgr.24461) 354 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2024-02-13T00:38:37.764 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[24237]: audit 2024-02-13T00:38:36.275788+0000 mgr.y (mgr.24461) 355 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2024-02-13T00:38:37.764 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[24237]: audit 2024-02-13T00:38:36.276831+0000 mgr.y (mgr.24461) 356 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2024-02-13T00:38:37.764 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[24237]: audit 2024-02-13T00:38:36.277885+0000 mgr.y (mgr.24461) 357 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2024-02-13T00:38:37.764 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[24237]: audit 2024-02-13T00:38:36.278760+0000 mgr.y (mgr.24461) 358 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2024-02-13T00:38:37.764 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[24237]: audit 2024-02-13T00:38:36.279888+0000 mgr.y (mgr.24461) 359 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2024-02-13T00:38:37.764 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[24237]: audit 2024-02-13T00:38:36.280695+0000 mgr.y (mgr.24461) 360 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2024-02-13T00:38:37.764 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[24237]: audit 2024-02-13T00:38:36.281428+0000 mgr.y (mgr.24461) 361 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2024-02-13T00:38:37.765 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[24237]: audit 2024-02-13T00:38:36.282148+0000 mgr.y (mgr.24461) 362 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2024-02-13T00:38:37.765 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[24237]: cluster 2024-02-13T00:38:36.323608+0000 mon.a (mon.0) 1161 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:38:37.765 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[24237]: cluster 2024-02-13T00:38:36.509392+0000 osd.2 (osd.2) 3 : cluster [DBG] 94.2 scrub starts 2024-02-13T00:38:37.765 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[24237]: cluster 2024-02-13T00:38:36.513959+0000 osd.2 (osd.2) 4 : cluster [DBG] 94.2 scrub ok 2024-02-13T00:38:37.765 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[24237]: cluster 2024-02-13T00:38:36.592800+0000 osd.6 (osd.6) 11 : cluster [DBG] 94.3 scrub starts 2024-02-13T00:38:37.765 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[24237]: cluster 2024-02-13T00:38:36.597030+0000 osd.6 (osd.6) 12 : cluster [DBG] 94.3 scrub ok 2024-02-13T00:38:37.766 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[24237]: audit 2024-02-13T00:38:36.700071+0000 mon.a (mon.0) 1162 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:37.766 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[24237]: audit 2024-02-13T00:38:36.766286+0000 mon.a (mon.0) 1163 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi080-54175-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:37.766 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[24237]: cluster 2024-02-13T00:38:36.766796+0000 mon.a (mon.0) 1164 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2024-02-13T00:38:37.766 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[24237]: audit 2024-02-13T00:38:36.769877+0000 mon.c (mon.2) 179 : audit [INF] from='client.? 172.21.15.80:0/3971325824' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi080-54183-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:37.766 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:37 smithi080 bash[24237]: audit 2024-02-13T00:38:36.784667+0000 mon.a (mon.0) 1165 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi080-54183-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:38.505 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:38:38 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:38:38.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:38 smithi106 bash[18459]: audit 2024-02-13T00:38:37.701804+0000 mon.a (mon.0) 1166 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:38.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:38 smithi106 bash[18459]: cluster 2024-02-13T00:38:37.703721+0000 mgr.y (mgr.24461) 363 : cluster [DBG] pgmap v311: 388 pgs: 64 unknown, 324 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:38.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:38 smithi106 bash[18459]: audit 2024-02-13T00:38:37.790097+0000 mon.a (mon.0) 1167 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi080-54183-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:38.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:38 smithi106 bash[18459]: cluster 2024-02-13T00:38:37.793900+0000 mon.a (mon.0) 1168 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2024-02-13T00:38:38.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:38 smithi106 bash[18459]: audit 2024-02-13T00:38:38.123554+0000 mgr.y (mgr.24461) 364 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:38:38.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:38 smithi080 bash[17386]: audit 2024-02-13T00:38:37.701804+0000 mon.a (mon.0) 1166 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:38.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:38 smithi080 bash[17386]: cluster 2024-02-13T00:38:37.703721+0000 mgr.y (mgr.24461) 363 : cluster [DBG] pgmap v311: 388 pgs: 64 unknown, 324 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:38.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:38 smithi080 bash[17386]: audit 2024-02-13T00:38:37.790097+0000 mon.a (mon.0) 1167 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi080-54183-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:38.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:38 smithi080 bash[17386]: cluster 2024-02-13T00:38:37.793900+0000 mon.a (mon.0) 1168 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2024-02-13T00:38:38.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:38 smithi080 bash[17386]: audit 2024-02-13T00:38:38.123554+0000 mgr.y (mgr.24461) 364 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:38:38.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:38 smithi080 bash[24237]: audit 2024-02-13T00:38:37.701804+0000 mon.a (mon.0) 1166 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:38.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:38 smithi080 bash[24237]: cluster 2024-02-13T00:38:37.703721+0000 mgr.y (mgr.24461) 363 : cluster [DBG] pgmap v311: 388 pgs: 64 unknown, 324 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:38.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:38 smithi080 bash[24237]: audit 2024-02-13T00:38:37.790097+0000 mon.a (mon.0) 1167 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi080-54183-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:38.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:38 smithi080 bash[24237]: cluster 2024-02-13T00:38:37.793900+0000 mon.a (mon.0) 1168 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2024-02-13T00:38:38.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:38 smithi080 bash[24237]: audit 2024-02-13T00:38:38.123554+0000 mgr.y (mgr.24461) 364 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:38:39.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:39 smithi106 bash[18459]: cluster 2024-02-13T00:38:38.467005+0000 osd.2 (osd.2) 5 : cluster [DBG] 94.6 scrub starts 2024-02-13T00:38:39.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:39 smithi106 bash[18459]: cluster 2024-02-13T00:38:38.471226+0000 osd.2 (osd.2) 6 : cluster [DBG] 94.6 scrub ok 2024-02-13T00:38:39.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:39 smithi106 bash[18459]: audit 2024-02-13T00:38:38.703457+0000 mon.a (mon.0) 1169 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:39.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:39 smithi106 bash[18459]: cluster 2024-02-13T00:38:38.794065+0000 mon.a (mon.0) 1170 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2024-02-13T00:38:39.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:39 smithi106 bash[18459]: audit 2024-02-13T00:38:38.800487+0000 mon.a (mon.0) 1171 : audit [INF] from='client.? 172.21.15.80:0/123123292' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi080-54175-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:39.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:39 smithi080 bash[17386]: cluster 2024-02-13T00:38:38.467005+0000 osd.2 (osd.2) 5 : cluster [DBG] 94.6 scrub starts 2024-02-13T00:38:39.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:39 smithi080 bash[17386]: cluster 2024-02-13T00:38:38.471226+0000 osd.2 (osd.2) 6 : cluster [DBG] 94.6 scrub ok 2024-02-13T00:38:39.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:39 smithi080 bash[17386]: audit 2024-02-13T00:38:38.703457+0000 mon.a (mon.0) 1169 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:39.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:39 smithi080 bash[17386]: cluster 2024-02-13T00:38:38.794065+0000 mon.a (mon.0) 1170 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2024-02-13T00:38:39.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:39 smithi080 bash[17386]: audit 2024-02-13T00:38:38.800487+0000 mon.a (mon.0) 1171 : audit [INF] from='client.? 172.21.15.80:0/123123292' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi080-54175-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:39.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:39 smithi080 bash[24237]: cluster 2024-02-13T00:38:38.467005+0000 osd.2 (osd.2) 5 : cluster [DBG] 94.6 scrub starts 2024-02-13T00:38:39.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:39 smithi080 bash[24237]: cluster 2024-02-13T00:38:38.471226+0000 osd.2 (osd.2) 6 : cluster [DBG] 94.6 scrub ok 2024-02-13T00:38:39.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:39 smithi080 bash[24237]: audit 2024-02-13T00:38:38.703457+0000 mon.a (mon.0) 1169 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:39.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:39 smithi080 bash[24237]: cluster 2024-02-13T00:38:38.794065+0000 mon.a (mon.0) 1170 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2024-02-13T00:38:39.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:39 smithi080 bash[24237]: audit 2024-02-13T00:38:38.800487+0000 mon.a (mon.0) 1171 : audit [INF] from='client.? 172.21.15.80:0/123123292' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi080-54175-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:40.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:38:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:38:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:38:40.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:40 smithi106 bash[18459]: cluster 2024-02-13T00:38:39.704799+0000 mgr.y (mgr.24461) 365 : cluster [DBG] pgmap v314: 356 pgs: 32 unknown, 324 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 57 KiB/s rd, 76 op/s 2024-02-13T00:38:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:40 smithi106 bash[18459]: audit 2024-02-13T00:38:39.705259+0000 mon.a (mon.0) 1172 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:40 smithi106 bash[18459]: audit 2024-02-13T00:38:39.796417+0000 mon.a (mon.0) 1173 : audit [INF] from='client.? 172.21.15.80:0/123123292' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi080-54175-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:40 smithi106 bash[18459]: cluster 2024-02-13T00:38:39.796680+0000 mon.a (mon.0) 1174 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2024-02-13T00:38:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:40 smithi106 bash[18459]: audit 2024-02-13T00:38:39.816459+0000 mon.a (mon.0) 1175 : audit [INF] from='client.? 172.21.15.80:0/2287090086' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi080-54183-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:40 smithi106 bash[18459]: cluster 2024-02-13T00:38:39.893516+0000 osd.0 (osd.0) 15 : cluster [DBG] 94.5 scrub starts 2024-02-13T00:38:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:40 smithi106 bash[18459]: cluster 2024-02-13T00:38:39.897089+0000 osd.0 (osd.0) 16 : cluster [DBG] 94.5 scrub ok 2024-02-13T00:38:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:40 smithi106 bash[18459]: cluster 2024-02-13T00:38:40.191181+0000 osd.7 (osd.7) 11 : cluster [DBG] 94.1 scrub starts 2024-02-13T00:38:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:40 smithi106 bash[18459]: cluster 2024-02-13T00:38:40.196758+0000 osd.7 (osd.7) 12 : cluster [DBG] 94.1 scrub ok 2024-02-13T00:38:40.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:40 smithi080 bash[17386]: cluster 2024-02-13T00:38:39.704799+0000 mgr.y (mgr.24461) 365 : cluster [DBG] pgmap v314: 356 pgs: 32 unknown, 324 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 57 KiB/s rd, 76 op/s 2024-02-13T00:38:40.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:40 smithi080 bash[17386]: audit 2024-02-13T00:38:39.705259+0000 mon.a (mon.0) 1172 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:40.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:40 smithi080 bash[17386]: audit 2024-02-13T00:38:39.796417+0000 mon.a (mon.0) 1173 : audit [INF] from='client.? 172.21.15.80:0/123123292' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi080-54175-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:40.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:40 smithi080 bash[17386]: cluster 2024-02-13T00:38:39.796680+0000 mon.a (mon.0) 1174 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2024-02-13T00:38:40.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:40 smithi080 bash[17386]: audit 2024-02-13T00:38:39.816459+0000 mon.a (mon.0) 1175 : audit [INF] from='client.? 172.21.15.80:0/2287090086' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi080-54183-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:40.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:40 smithi080 bash[17386]: cluster 2024-02-13T00:38:39.893516+0000 osd.0 (osd.0) 15 : cluster [DBG] 94.5 scrub starts 2024-02-13T00:38:40.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:40 smithi080 bash[17386]: cluster 2024-02-13T00:38:39.897089+0000 osd.0 (osd.0) 16 : cluster [DBG] 94.5 scrub ok 2024-02-13T00:38:40.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:40 smithi080 bash[17386]: cluster 2024-02-13T00:38:40.191181+0000 osd.7 (osd.7) 11 : cluster [DBG] 94.1 scrub starts 2024-02-13T00:38:40.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:40 smithi080 bash[17386]: cluster 2024-02-13T00:38:40.196758+0000 osd.7 (osd.7) 12 : cluster [DBG] 94.1 scrub ok 2024-02-13T00:38:40.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:40 smithi080 bash[24237]: cluster 2024-02-13T00:38:39.704799+0000 mgr.y (mgr.24461) 365 : cluster [DBG] pgmap v314: 356 pgs: 32 unknown, 324 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 57 KiB/s rd, 76 op/s 2024-02-13T00:38:40.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:40 smithi080 bash[24237]: audit 2024-02-13T00:38:39.705259+0000 mon.a (mon.0) 1172 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:40.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:40 smithi080 bash[24237]: audit 2024-02-13T00:38:39.796417+0000 mon.a (mon.0) 1173 : audit [INF] from='client.? 172.21.15.80:0/123123292' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi080-54175-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:40.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:40 smithi080 bash[24237]: cluster 2024-02-13T00:38:39.796680+0000 mon.a (mon.0) 1174 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2024-02-13T00:38:40.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:40 smithi080 bash[24237]: audit 2024-02-13T00:38:39.816459+0000 mon.a (mon.0) 1175 : audit [INF] from='client.? 172.21.15.80:0/2287090086' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi080-54183-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:40.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:40 smithi080 bash[24237]: cluster 2024-02-13T00:38:39.893516+0000 osd.0 (osd.0) 15 : cluster [DBG] 94.5 scrub starts 2024-02-13T00:38:40.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:40 smithi080 bash[24237]: cluster 2024-02-13T00:38:39.897089+0000 osd.0 (osd.0) 16 : cluster [DBG] 94.5 scrub ok 2024-02-13T00:38:40.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:40 smithi080 bash[24237]: cluster 2024-02-13T00:38:40.191181+0000 osd.7 (osd.7) 11 : cluster [DBG] 94.1 scrub starts 2024-02-13T00:38:40.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:40 smithi080 bash[24237]: cluster 2024-02-13T00:38:40.196758+0000 osd.7 (osd.7) 12 : cluster [DBG] 94.1 scrub ok 2024-02-13T00:38:41.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:41 smithi106 bash[18459]: audit 2024-02-13T00:38:40.707046+0000 mon.a (mon.0) 1176 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:41.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:41 smithi106 bash[18459]: audit 2024-02-13T00:38:40.798228+0000 mon.a (mon.0) 1177 : audit [INF] from='client.? 172.21.15.80:0/2287090086' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi080-54183-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:41.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:41 smithi106 bash[18459]: cluster 2024-02-13T00:38:40.798548+0000 mon.a (mon.0) 1178 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2024-02-13T00:38:41.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:41 smithi080 bash[17386]: audit 2024-02-13T00:38:40.707046+0000 mon.a (mon.0) 1176 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:41.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:41 smithi080 bash[17386]: audit 2024-02-13T00:38:40.798228+0000 mon.a (mon.0) 1177 : audit [INF] from='client.? 172.21.15.80:0/2287090086' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi080-54183-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:41.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:41 smithi080 bash[17386]: cluster 2024-02-13T00:38:40.798548+0000 mon.a (mon.0) 1178 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2024-02-13T00:38:41.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:41 smithi080 bash[24237]: audit 2024-02-13T00:38:40.707046+0000 mon.a (mon.0) 1176 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:41.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:41 smithi080 bash[24237]: audit 2024-02-13T00:38:40.798228+0000 mon.a (mon.0) 1177 : audit [INF] from='client.? 172.21.15.80:0/2287090086' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi080-54183-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:41.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:41 smithi080 bash[24237]: cluster 2024-02-13T00:38:40.798548+0000 mon.a (mon.0) 1178 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2024-02-13T00:38:42.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:42 smithi106 bash[18459]: cluster 2024-02-13T00:38:41.705789+0000 mgr.y (mgr.24461) 366 : cluster [DBG] pgmap v317: 356 pgs: 32 unknown, 324 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 57 KiB/s rd, 76 op/s 2024-02-13T00:38:42.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:42 smithi106 bash[18459]: audit 2024-02-13T00:38:41.709377+0000 mon.a (mon.0) 1179 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:42.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:42 smithi106 bash[18459]: cluster 2024-02-13T00:38:41.801303+0000 mon.a (mon.0) 1180 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2024-02-13T00:38:42.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:42 smithi106 bash[18459]: audit 2024-02-13T00:38:41.805262+0000 mon.c (mon.2) 180 : audit [INF] from='client.? 172.21.15.80:0/1384620174' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi080-54175-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:42.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:42 smithi106 bash[18459]: audit 2024-02-13T00:38:41.806201+0000 mon.a (mon.0) 1181 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi080-54175-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:42.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:42 smithi080 bash[17386]: cluster 2024-02-13T00:38:41.705789+0000 mgr.y (mgr.24461) 366 : cluster [DBG] pgmap v317: 356 pgs: 32 unknown, 324 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 57 KiB/s rd, 76 op/s 2024-02-13T00:38:42.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:42 smithi080 bash[17386]: audit 2024-02-13T00:38:41.709377+0000 mon.a (mon.0) 1179 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:42.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:42 smithi080 bash[17386]: cluster 2024-02-13T00:38:41.801303+0000 mon.a (mon.0) 1180 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2024-02-13T00:38:42.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:42 smithi080 bash[17386]: audit 2024-02-13T00:38:41.805262+0000 mon.c (mon.2) 180 : audit [INF] from='client.? 172.21.15.80:0/1384620174' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi080-54175-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:42.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:42 smithi080 bash[17386]: audit 2024-02-13T00:38:41.806201+0000 mon.a (mon.0) 1181 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi080-54175-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:42.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:42 smithi080 bash[24237]: cluster 2024-02-13T00:38:41.705789+0000 mgr.y (mgr.24461) 366 : cluster [DBG] pgmap v317: 356 pgs: 32 unknown, 324 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 57 KiB/s rd, 76 op/s 2024-02-13T00:38:42.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:42 smithi080 bash[24237]: audit 2024-02-13T00:38:41.709377+0000 mon.a (mon.0) 1179 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:42.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:42 smithi080 bash[24237]: cluster 2024-02-13T00:38:41.801303+0000 mon.a (mon.0) 1180 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2024-02-13T00:38:42.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:42 smithi080 bash[24237]: audit 2024-02-13T00:38:41.805262+0000 mon.c (mon.2) 180 : audit [INF] from='client.? 172.21.15.80:0/1384620174' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi080-54175-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:42.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:42 smithi080 bash[24237]: audit 2024-02-13T00:38:41.806201+0000 mon.a (mon.0) 1181 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi080-54175-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:43.379 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:38:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:38:43] "GET /metrics HTTP/1.1" 200 196058 "" "Prometheus/2.33.4" 2024-02-13T00:38:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:43 smithi106 bash[18459]: cluster 2024-02-13T00:38:42.492413+0000 osd.2 (osd.2) 7 : cluster [DBG] 94.7 scrub starts 2024-02-13T00:38:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:43 smithi106 bash[18459]: cluster 2024-02-13T00:38:42.497552+0000 osd.2 (osd.2) 8 : cluster [DBG] 94.7 scrub ok 2024-02-13T00:38:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:43 smithi106 bash[18459]: audit 2024-02-13T00:38:42.711124+0000 mon.a (mon.0) 1182 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:43 smithi106 bash[18459]: audit 2024-02-13T00:38:42.806020+0000 mon.a (mon.0) 1183 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi080-54175-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:43 smithi106 bash[18459]: cluster 2024-02-13T00:38:42.806402+0000 mon.a (mon.0) 1184 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2024-02-13T00:38:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:43 smithi106 bash[18459]: audit 2024-02-13T00:38:42.811175+0000 mon.b (mon.1) 70 : audit [INF] from='client.? 172.21.15.80:0/2628892740' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi080-54183-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:43 smithi106 bash[18459]: audit 2024-02-13T00:38:42.812504+0000 mon.a (mon.0) 1185 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi080-54183-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:43 smithi106 bash[18459]: cluster 2024-02-13T00:38:42.834239+0000 osd.0 (osd.0) 17 : cluster [DBG] 94.8 scrub starts 2024-02-13T00:38:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:43 smithi106 bash[18459]: cluster 2024-02-13T00:38:42.838585+0000 osd.0 (osd.0) 18 : cluster [DBG] 94.8 scrub ok 2024-02-13T00:38:43.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:43 smithi080 bash[17386]: cluster 2024-02-13T00:38:42.492413+0000 osd.2 (osd.2) 7 : cluster [DBG] 94.7 scrub starts 2024-02-13T00:38:43.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:43 smithi080 bash[17386]: cluster 2024-02-13T00:38:42.497552+0000 osd.2 (osd.2) 8 : cluster [DBG] 94.7 scrub ok 2024-02-13T00:38:43.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:43 smithi080 bash[17386]: audit 2024-02-13T00:38:42.711124+0000 mon.a (mon.0) 1182 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:43.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:43 smithi080 bash[17386]: audit 2024-02-13T00:38:42.806020+0000 mon.a (mon.0) 1183 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi080-54175-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:43.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:43 smithi080 bash[17386]: cluster 2024-02-13T00:38:42.806402+0000 mon.a (mon.0) 1184 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2024-02-13T00:38:43.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:43 smithi080 bash[17386]: audit 2024-02-13T00:38:42.811175+0000 mon.b (mon.1) 70 : audit [INF] from='client.? 172.21.15.80:0/2628892740' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi080-54183-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:43.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:43 smithi080 bash[17386]: audit 2024-02-13T00:38:42.812504+0000 mon.a (mon.0) 1185 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi080-54183-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:43.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:43 smithi080 bash[17386]: cluster 2024-02-13T00:38:42.834239+0000 osd.0 (osd.0) 17 : cluster [DBG] 94.8 scrub starts 2024-02-13T00:38:43.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:43 smithi080 bash[17386]: cluster 2024-02-13T00:38:42.838585+0000 osd.0 (osd.0) 18 : cluster [DBG] 94.8 scrub ok 2024-02-13T00:38:43.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:43 smithi080 bash[24237]: cluster 2024-02-13T00:38:42.492413+0000 osd.2 (osd.2) 7 : cluster [DBG] 94.7 scrub starts 2024-02-13T00:38:43.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:43 smithi080 bash[24237]: cluster 2024-02-13T00:38:42.497552+0000 osd.2 (osd.2) 8 : cluster [DBG] 94.7 scrub ok 2024-02-13T00:38:43.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:43 smithi080 bash[24237]: audit 2024-02-13T00:38:42.711124+0000 mon.a (mon.0) 1182 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:43.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:43 smithi080 bash[24237]: audit 2024-02-13T00:38:42.806020+0000 mon.a (mon.0) 1183 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi080-54175-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:43.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:43 smithi080 bash[24237]: cluster 2024-02-13T00:38:42.806402+0000 mon.a (mon.0) 1184 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2024-02-13T00:38:43.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:43 smithi080 bash[24237]: audit 2024-02-13T00:38:42.811175+0000 mon.b (mon.1) 70 : audit [INF] from='client.? 172.21.15.80:0/2628892740' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi080-54183-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:43.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:43 smithi080 bash[24237]: audit 2024-02-13T00:38:42.812504+0000 mon.a (mon.0) 1185 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi080-54183-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:43.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:43 smithi080 bash[24237]: cluster 2024-02-13T00:38:42.834239+0000 osd.0 (osd.0) 17 : cluster [DBG] 94.8 scrub starts 2024-02-13T00:38:43.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:43 smithi080 bash[24237]: cluster 2024-02-13T00:38:42.838585+0000 osd.0 (osd.0) 18 : cluster [DBG] 94.8 scrub ok 2024-02-13T00:38:45.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:44 smithi106 bash[18459]: cluster 2024-02-13T00:38:43.240005+0000 osd.1 (osd.1) 3 : cluster [DBG] 94.0 scrub starts 2024-02-13T00:38:45.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:44 smithi106 bash[18459]: cluster 2024-02-13T00:38:43.243058+0000 osd.1 (osd.1) 4 : cluster [DBG] 94.0 scrub ok 2024-02-13T00:38:45.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:44 smithi106 bash[18459]: cluster 2024-02-13T00:38:43.707793+0000 mgr.y (mgr.24461) 367 : cluster [DBG] pgmap v320: 388 pgs: 1 active+clean+scrubbing, 1 active, 5 creating+activating, 31 creating+peering, 21 unknown, 329 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:38:45.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:44 smithi106 bash[18459]: audit 2024-02-13T00:38:43.712792+0000 mon.a (mon.0) 1186 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:45.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:44 smithi106 bash[18459]: audit 2024-02-13T00:38:43.809340+0000 mon.a (mon.0) 1187 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi080-54183-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:45.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:44 smithi106 bash[18459]: cluster 2024-02-13T00:38:43.809604+0000 mon.a (mon.0) 1188 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2024-02-13T00:38:45.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:44 smithi106 bash[18459]: audit 2024-02-13T00:38:44.441595+0000 mon.c (mon.2) 181 : audit [DBG] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-02-13T00:38:45.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:44 smithi106 bash[18459]: audit 2024-02-13T00:38:44.442354+0000 mon.c (mon.2) 182 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:45.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:44 smithi080 bash[24237]: cluster 2024-02-13T00:38:43.240005+0000 osd.1 (osd.1) 3 : cluster [DBG] 94.0 scrub starts 2024-02-13T00:38:45.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:44 smithi080 bash[24237]: cluster 2024-02-13T00:38:43.243058+0000 osd.1 (osd.1) 4 : cluster [DBG] 94.0 scrub ok 2024-02-13T00:38:45.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:44 smithi080 bash[24237]: cluster 2024-02-13T00:38:43.707793+0000 mgr.y (mgr.24461) 367 : cluster [DBG] pgmap v320: 388 pgs: 1 active+clean+scrubbing, 1 active, 5 creating+activating, 31 creating+peering, 21 unknown, 329 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:38:45.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:44 smithi080 bash[24237]: audit 2024-02-13T00:38:43.712792+0000 mon.a (mon.0) 1186 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:45.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:44 smithi080 bash[24237]: audit 2024-02-13T00:38:43.809340+0000 mon.a (mon.0) 1187 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi080-54183-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:45.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:44 smithi080 bash[24237]: cluster 2024-02-13T00:38:43.809604+0000 mon.a (mon.0) 1188 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2024-02-13T00:38:45.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:44 smithi080 bash[24237]: audit 2024-02-13T00:38:44.441595+0000 mon.c (mon.2) 181 : audit [DBG] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-02-13T00:38:45.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:44 smithi080 bash[24237]: audit 2024-02-13T00:38:44.442354+0000 mon.c (mon.2) 182 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:45.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:44 smithi080 bash[17386]: cluster 2024-02-13T00:38:43.240005+0000 osd.1 (osd.1) 3 : cluster [DBG] 94.0 scrub starts 2024-02-13T00:38:45.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:44 smithi080 bash[17386]: cluster 2024-02-13T00:38:43.243058+0000 osd.1 (osd.1) 4 : cluster [DBG] 94.0 scrub ok 2024-02-13T00:38:45.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:44 smithi080 bash[17386]: cluster 2024-02-13T00:38:43.707793+0000 mgr.y (mgr.24461) 367 : cluster [DBG] pgmap v320: 388 pgs: 1 active+clean+scrubbing, 1 active, 5 creating+activating, 31 creating+peering, 21 unknown, 329 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:38:45.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:44 smithi080 bash[17386]: audit 2024-02-13T00:38:43.712792+0000 mon.a (mon.0) 1186 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:45.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:44 smithi080 bash[17386]: audit 2024-02-13T00:38:43.809340+0000 mon.a (mon.0) 1187 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi080-54183-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:45.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:44 smithi080 bash[17386]: cluster 2024-02-13T00:38:43.809604+0000 mon.a (mon.0) 1188 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2024-02-13T00:38:45.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:44 smithi080 bash[17386]: audit 2024-02-13T00:38:44.441595+0000 mon.c (mon.2) 181 : audit [DBG] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-02-13T00:38:45.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:44 smithi080 bash[17386]: audit 2024-02-13T00:38:44.442354+0000 mon.c (mon.2) 182 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:46.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:45 smithi106 bash[18459]: audit 2024-02-13T00:38:44.773543+0000 mon.a (mon.0) 1189 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:46.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:45 smithi106 bash[18459]: audit 2024-02-13T00:38:44.774036+0000 mon.a (mon.0) 1190 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:46.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:45 smithi106 bash[18459]: audit 2024-02-13T00:38:44.811345+0000 mon.a (mon.0) 1191 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:46.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:45 smithi106 bash[18459]: cluster 2024-02-13T00:38:44.811497+0000 mon.a (mon.0) 1192 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2024-02-13T00:38:46.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:45 smithi106 bash[18459]: audit 2024-02-13T00:38:44.814171+0000 mon.a (mon.0) 1193 : audit [INF] from='client.? 172.21.15.80:0/973969076' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi080-54175-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:45 smithi106 bash[18459]: audit 2024-02-13T00:38:44.815921+0000 mon.c (mon.2) 183 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "app2"}]: dispatch 2024-02-13T00:38:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:45 smithi106 bash[18459]: audit 2024-02-13T00:38:44.817966+0000 mon.c (mon.2) 184 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:45 smithi106 bash[18459]: audit 2024-02-13T00:38:44.822709+0000 mon.c (mon.2) 185 : audit [INF] from='client.? 172.21.15.80:0/4182000568' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54454-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:45 smithi106 bash[18459]: audit 2024-02-13T00:38:44.829747+0000 mon.a (mon.0) 1194 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:45 smithi106 bash[18459]: audit 2024-02-13T00:38:44.830450+0000 mon.a (mon.0) 1195 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54454-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:46.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:45 smithi080 bash[17386]: audit 2024-02-13T00:38:44.773543+0000 mon.a (mon.0) 1189 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:46.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:45 smithi080 bash[17386]: audit 2024-02-13T00:38:44.774036+0000 mon.a (mon.0) 1190 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:46.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:45 smithi080 bash[17386]: audit 2024-02-13T00:38:44.811345+0000 mon.a (mon.0) 1191 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:46.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:45 smithi080 bash[17386]: cluster 2024-02-13T00:38:44.811497+0000 mon.a (mon.0) 1192 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2024-02-13T00:38:46.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:45 smithi080 bash[17386]: audit 2024-02-13T00:38:44.814171+0000 mon.a (mon.0) 1193 : audit [INF] from='client.? 172.21.15.80:0/973969076' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi080-54175-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:46.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:45 smithi080 bash[17386]: audit 2024-02-13T00:38:44.815921+0000 mon.c (mon.2) 183 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "app2"}]: dispatch 2024-02-13T00:38:46.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:45 smithi080 bash[17386]: audit 2024-02-13T00:38:44.817966+0000 mon.c (mon.2) 184 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:46.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:45 smithi080 bash[17386]: audit 2024-02-13T00:38:44.822709+0000 mon.c (mon.2) 185 : audit [INF] from='client.? 172.21.15.80:0/4182000568' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54454-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:46.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:45 smithi080 bash[17386]: audit 2024-02-13T00:38:44.829747+0000 mon.a (mon.0) 1194 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:46.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:45 smithi080 bash[17386]: audit 2024-02-13T00:38:44.830450+0000 mon.a (mon.0) 1195 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54454-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:46.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:45 smithi080 bash[24237]: audit 2024-02-13T00:38:44.773543+0000 mon.a (mon.0) 1189 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:46.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:45 smithi080 bash[24237]: audit 2024-02-13T00:38:44.774036+0000 mon.a (mon.0) 1190 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:46.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:45 smithi080 bash[24237]: audit 2024-02-13T00:38:44.811345+0000 mon.a (mon.0) 1191 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:46.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:45 smithi080 bash[24237]: cluster 2024-02-13T00:38:44.811497+0000 mon.a (mon.0) 1192 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2024-02-13T00:38:46.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:45 smithi080 bash[24237]: audit 2024-02-13T00:38:44.814171+0000 mon.a (mon.0) 1193 : audit [INF] from='client.? 172.21.15.80:0/973969076' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi080-54175-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:46.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:45 smithi080 bash[24237]: audit 2024-02-13T00:38:44.815921+0000 mon.c (mon.2) 183 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "app2"}]: dispatch 2024-02-13T00:38:46.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:45 smithi080 bash[24237]: audit 2024-02-13T00:38:44.817966+0000 mon.c (mon.2) 184 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:46.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:45 smithi080 bash[24237]: audit 2024-02-13T00:38:44.822709+0000 mon.c (mon.2) 185 : audit [INF] from='client.? 172.21.15.80:0/4182000568' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54454-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:46.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:45 smithi080 bash[24237]: audit 2024-02-13T00:38:44.829747+0000 mon.a (mon.0) 1194 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:46.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:45 smithi080 bash[24237]: audit 2024-02-13T00:38:44.830450+0000 mon.a (mon.0) 1195 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54454-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:47.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:46 smithi106 bash[18459]: cluster 2024-02-13T00:38:45.708776+0000 mgr.y (mgr.24461) 368 : cluster [DBG] pgmap v323: 356 pgs: 1 active+clean+scrubbing, 64 unknown, 291 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:47.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:46 smithi106 bash[18459]: audit 2024-02-13T00:38:45.776057+0000 mon.a (mon.0) 1196 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:47.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:46 smithi106 bash[18459]: audit 2024-02-13T00:38:45.815522+0000 mon.a (mon.0) 1197 : audit [INF] from='client.? 172.21.15.80:0/973969076' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi080-54175-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:47.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:46 smithi106 bash[18459]: audit 2024-02-13T00:38:45.815867+0000 mon.a (mon.0) 1198 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:47.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:46 smithi106 bash[18459]: audit 2024-02-13T00:38:45.816146+0000 mon.a (mon.0) 1199 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54454-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:47.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:46 smithi106 bash[18459]: cluster 2024-02-13T00:38:45.816375+0000 mon.a (mon.0) 1200 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2024-02-13T00:38:47.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:46 smithi106 bash[18459]: audit 2024-02-13T00:38:45.818786+0000 mon.c (mon.2) 186 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi080-54247-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-02-13T00:38:47.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:46 smithi106 bash[18459]: audit 2024-02-13T00:38:45.822116+0000 mon.c (mon.2) 187 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-13T00:38:47.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:46 smithi106 bash[18459]: audit 2024-02-13T00:38:45.824742+0000 mon.a (mon.0) 1201 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-13T00:38:47.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:46 smithi106 bash[18459]: audit 2024-02-13T00:38:45.825493+0000 mon.a (mon.0) 1202 : audit [INF] from='client.? 172.21.15.80:0/3845879073' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi080-54183-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:47.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:46 smithi106 bash[18459]: cluster 2024-02-13T00:38:46.180972+0000 osd.1 (osd.1) 5 : cluster [DBG] 94.4 scrub starts 2024-02-13T00:38:47.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:46 smithi106 bash[18459]: cluster 2024-02-13T00:38:46.186102+0000 osd.1 (osd.1) 6 : cluster [DBG] 94.4 scrub ok 2024-02-13T00:38:47.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[24237]: cluster 2024-02-13T00:38:45.708776+0000 mgr.y (mgr.24461) 368 : cluster [DBG] pgmap v323: 356 pgs: 1 active+clean+scrubbing, 64 unknown, 291 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:47.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[24237]: audit 2024-02-13T00:38:45.776057+0000 mon.a (mon.0) 1196 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:47.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[24237]: audit 2024-02-13T00:38:45.815522+0000 mon.a (mon.0) 1197 : audit [INF] from='client.? 172.21.15.80:0/973969076' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi080-54175-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:47.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[24237]: audit 2024-02-13T00:38:45.815867+0000 mon.a (mon.0) 1198 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:47.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[24237]: audit 2024-02-13T00:38:45.816146+0000 mon.a (mon.0) 1199 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54454-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:47.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[24237]: cluster 2024-02-13T00:38:45.816375+0000 mon.a (mon.0) 1200 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2024-02-13T00:38:47.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[24237]: audit 2024-02-13T00:38:45.818786+0000 mon.c (mon.2) 186 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi080-54247-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-02-13T00:38:47.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[24237]: audit 2024-02-13T00:38:45.822116+0000 mon.c (mon.2) 187 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-13T00:38:47.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[24237]: audit 2024-02-13T00:38:45.824742+0000 mon.a (mon.0) 1201 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-13T00:38:47.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[24237]: audit 2024-02-13T00:38:45.825493+0000 mon.a (mon.0) 1202 : audit [INF] from='client.? 172.21.15.80:0/3845879073' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi080-54183-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:47.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[24237]: cluster 2024-02-13T00:38:46.180972+0000 osd.1 (osd.1) 5 : cluster [DBG] 94.4 scrub starts 2024-02-13T00:38:47.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[24237]: cluster 2024-02-13T00:38:46.186102+0000 osd.1 (osd.1) 6 : cluster [DBG] 94.4 scrub ok 2024-02-13T00:38:47.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[17386]: cluster 2024-02-13T00:38:45.708776+0000 mgr.y (mgr.24461) 368 : cluster [DBG] pgmap v323: 356 pgs: 1 active+clean+scrubbing, 64 unknown, 291 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:47.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[17386]: audit 2024-02-13T00:38:45.776057+0000 mon.a (mon.0) 1196 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:47.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[17386]: audit 2024-02-13T00:38:45.815522+0000 mon.a (mon.0) 1197 : audit [INF] from='client.? 172.21.15.80:0/973969076' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi080-54175-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:47.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[17386]: audit 2024-02-13T00:38:45.815867+0000 mon.a (mon.0) 1198 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi080-54247-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:47.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[17386]: audit 2024-02-13T00:38:45.816146+0000 mon.a (mon.0) 1199 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54454-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:47.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[17386]: cluster 2024-02-13T00:38:45.816375+0000 mon.a (mon.0) 1200 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2024-02-13T00:38:47.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[17386]: audit 2024-02-13T00:38:45.818786+0000 mon.c (mon.2) 186 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi080-54247-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-02-13T00:38:47.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[17386]: audit 2024-02-13T00:38:45.822116+0000 mon.c (mon.2) 187 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-13T00:38:47.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[17386]: audit 2024-02-13T00:38:45.824742+0000 mon.a (mon.0) 1201 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-13T00:38:47.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[17386]: audit 2024-02-13T00:38:45.825493+0000 mon.a (mon.0) 1202 : audit [INF] from='client.? 172.21.15.80:0/3845879073' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi080-54183-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:47.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[17386]: cluster 2024-02-13T00:38:46.180972+0000 osd.1 (osd.1) 5 : cluster [DBG] 94.4 scrub starts 2024-02-13T00:38:47.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:46 smithi080 bash[17386]: cluster 2024-02-13T00:38:46.186102+0000 osd.1 (osd.1) 6 : cluster [DBG] 94.4 scrub ok 2024-02-13T00:38:48.136 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:47 smithi106 bash[18459]: audit 2024-02-13T00:38:46.777815+0000 mon.a (mon.0) 1203 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:48.137 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:47 smithi106 bash[18459]: audit 2024-02-13T00:38:46.819272+0000 mon.a (mon.0) 1204 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-02-13T00:38:48.137 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:47 smithi106 bash[18459]: audit 2024-02-13T00:38:46.819439+0000 mon.a (mon.0) 1205 : audit [INF] from='client.? 172.21.15.80:0/3845879073' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi080-54183-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:48.137 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:47 smithi106 bash[18459]: cluster 2024-02-13T00:38:46.819755+0000 mon.a (mon.0) 1206 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2024-02-13T00:38:48.137 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:47 smithi106 bash[18459]: audit 2024-02-13T00:38:46.851236+0000 mon.c (mon.2) 188 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-13T00:38:48.137 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:47 smithi106 bash[18459]: audit 2024-02-13T00:38:46.851970+0000 mon.a (mon.0) 1207 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-13T00:38:48.137 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:47 smithi106 bash[18459]: audit 2024-02-13T00:38:47.326715+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:38:48.137 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:47 smithi106 bash[18459]: audit 2024-02-13T00:38:47.779309+0000 mon.a (mon.0) 1209 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:48.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:47 smithi080 bash[24237]: audit 2024-02-13T00:38:46.777815+0000 mon.a (mon.0) 1203 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:48.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:47 smithi080 bash[24237]: audit 2024-02-13T00:38:46.819272+0000 mon.a (mon.0) 1204 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-02-13T00:38:48.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:47 smithi080 bash[24237]: audit 2024-02-13T00:38:46.819439+0000 mon.a (mon.0) 1205 : audit [INF] from='client.? 172.21.15.80:0/3845879073' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi080-54183-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:48.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:47 smithi080 bash[24237]: cluster 2024-02-13T00:38:46.819755+0000 mon.a (mon.0) 1206 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2024-02-13T00:38:48.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:47 smithi080 bash[24237]: audit 2024-02-13T00:38:46.851236+0000 mon.c (mon.2) 188 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-13T00:38:48.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:47 smithi080 bash[24237]: audit 2024-02-13T00:38:46.851970+0000 mon.a (mon.0) 1207 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-13T00:38:48.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:47 smithi080 bash[24237]: audit 2024-02-13T00:38:47.326715+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:38:48.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:47 smithi080 bash[24237]: audit 2024-02-13T00:38:47.779309+0000 mon.a (mon.0) 1209 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:48.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:47 smithi080 bash[17386]: audit 2024-02-13T00:38:46.777815+0000 mon.a (mon.0) 1203 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:48.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:47 smithi080 bash[17386]: audit 2024-02-13T00:38:46.819272+0000 mon.a (mon.0) 1204 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-02-13T00:38:48.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:47 smithi080 bash[17386]: audit 2024-02-13T00:38:46.819439+0000 mon.a (mon.0) 1205 : audit [INF] from='client.? 172.21.15.80:0/3845879073' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi080-54183-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:48.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:47 smithi080 bash[17386]: cluster 2024-02-13T00:38:46.819755+0000 mon.a (mon.0) 1206 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2024-02-13T00:38:48.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:47 smithi080 bash[17386]: audit 2024-02-13T00:38:46.851236+0000 mon.c (mon.2) 188 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-13T00:38:48.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:47 smithi080 bash[17386]: audit 2024-02-13T00:38:46.851970+0000 mon.a (mon.0) 1207 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-13T00:38:48.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:47 smithi080 bash[17386]: audit 2024-02-13T00:38:47.326715+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:38:48.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:47 smithi080 bash[17386]: audit 2024-02-13T00:38:47.779309+0000 mon.a (mon.0) 1209 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:48.505 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:38:48 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:38:49.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:48 smithi106 bash[18459]: cluster 2024-02-13T00:38:47.709612+0000 mgr.y (mgr.24461) 369 : cluster [DBG] pgmap v326: 356 pgs: 1 active+clean+scrubbing, 64 unknown, 291 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:49.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:48 smithi106 bash[18459]: audit 2024-02-13T00:38:47.822515+0000 mon.a (mon.0) 1210 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-02-13T00:38:49.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:48 smithi106 bash[18459]: cluster 2024-02-13T00:38:47.822880+0000 mon.a (mon.0) 1211 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2024-02-13T00:38:49.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:48 smithi106 bash[18459]: audit 2024-02-13T00:38:47.840524+0000 mon.c (mon.2) 189 : audit [INF] from='client.? 172.21.15.80:0/2043896814' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi080-54175-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:49.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:48 smithi106 bash[18459]: audit 2024-02-13T00:38:47.841548+0000 mon.a (mon.0) 1212 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi080-54175-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:49.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:48 smithi106 bash[18459]: audit 2024-02-13T00:38:47.849555+0000 mon.c (mon.2) 190 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key1"}]: dispatch 2024-02-13T00:38:49.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:48 smithi106 bash[18459]: audit 2024-02-13T00:38:47.850423+0000 mon.a (mon.0) 1213 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key1"}]: dispatch 2024-02-13T00:38:49.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:48 smithi106 bash[18459]: audit 2024-02-13T00:38:48.133500+0000 mgr.y (mgr.24461) 370 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:38:49.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:48 smithi106 bash[18459]: audit 2024-02-13T00:38:48.781183+0000 mon.a (mon.0) 1214 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:49.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:48 smithi080 bash[17386]: cluster 2024-02-13T00:38:47.709612+0000 mgr.y (mgr.24461) 369 : cluster [DBG] pgmap v326: 356 pgs: 1 active+clean+scrubbing, 64 unknown, 291 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:49.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:48 smithi080 bash[17386]: audit 2024-02-13T00:38:47.822515+0000 mon.a (mon.0) 1210 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-02-13T00:38:49.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:48 smithi080 bash[17386]: cluster 2024-02-13T00:38:47.822880+0000 mon.a (mon.0) 1211 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2024-02-13T00:38:49.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:48 smithi080 bash[17386]: audit 2024-02-13T00:38:47.840524+0000 mon.c (mon.2) 189 : audit [INF] from='client.? 172.21.15.80:0/2043896814' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi080-54175-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:49.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:48 smithi080 bash[17386]: audit 2024-02-13T00:38:47.841548+0000 mon.a (mon.0) 1212 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi080-54175-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:49.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:48 smithi080 bash[17386]: audit 2024-02-13T00:38:47.849555+0000 mon.c (mon.2) 190 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key1"}]: dispatch 2024-02-13T00:38:49.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:48 smithi080 bash[17386]: audit 2024-02-13T00:38:47.850423+0000 mon.a (mon.0) 1213 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key1"}]: dispatch 2024-02-13T00:38:49.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:48 smithi080 bash[17386]: audit 2024-02-13T00:38:48.133500+0000 mgr.y (mgr.24461) 370 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:38:49.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:48 smithi080 bash[17386]: audit 2024-02-13T00:38:48.781183+0000 mon.a (mon.0) 1214 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:49.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:48 smithi080 bash[24237]: cluster 2024-02-13T00:38:47.709612+0000 mgr.y (mgr.24461) 369 : cluster [DBG] pgmap v326: 356 pgs: 1 active+clean+scrubbing, 64 unknown, 291 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:49.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:48 smithi080 bash[24237]: audit 2024-02-13T00:38:47.822515+0000 mon.a (mon.0) 1210 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-02-13T00:38:49.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:48 smithi080 bash[24237]: cluster 2024-02-13T00:38:47.822880+0000 mon.a (mon.0) 1211 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2024-02-13T00:38:49.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:48 smithi080 bash[24237]: audit 2024-02-13T00:38:47.840524+0000 mon.c (mon.2) 189 : audit [INF] from='client.? 172.21.15.80:0/2043896814' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi080-54175-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:49.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:48 smithi080 bash[24237]: audit 2024-02-13T00:38:47.841548+0000 mon.a (mon.0) 1212 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi080-54175-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:49.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:48 smithi080 bash[24237]: audit 2024-02-13T00:38:47.849555+0000 mon.c (mon.2) 190 : audit [INF] from='client.? 172.21.15.80:0/2323280376' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key1"}]: dispatch 2024-02-13T00:38:49.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:48 smithi080 bash[24237]: audit 2024-02-13T00:38:47.850423+0000 mon.a (mon.0) 1213 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key1"}]: dispatch 2024-02-13T00:38:49.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:48 smithi080 bash[24237]: audit 2024-02-13T00:38:48.133500+0000 mgr.y (mgr.24461) 370 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:38:49.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:48 smithi080 bash[24237]: audit 2024-02-13T00:38:48.781183+0000 mon.a (mon.0) 1214 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:49.847 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2024-02-13T00:38:49.847 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [----------] Global test environment set-up. 2024-02-13T00:38:49.847 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2024-02-13T00:38:49.847 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2024-02-13T00:38:49.847 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-02-13T00:38:49.847 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-02-13T00:38:49.847 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: 2024-02-13T00:38:49.847 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2024-02-13T00:38:49.847 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: seed 54247 2024-02-13T00:38:49.847 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-02-13T00:38:49.847 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (3 ms) 2024-02-13T00:38:49.847 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2024-02-13T00:38:49.848 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (311 ms) 2024-02-13T00:38:49.848 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2024-02-13T00:38:49.848 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (21 ms) 2024-02-13T00:38:49.848 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2024-02-13T00:38:49.848 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (15 ms) 2024-02-13T00:38:49.848 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-02-13T00:38:49.848 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (16 ms) 2024-02-13T00:38:49.848 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2024-02-13T00:38:49.848 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (3 ms) 2024-02-13T00:38:49.848 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2024-02-13T00:38:49.848 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (4 ms) 2024-02-13T00:38:49.848 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2024-02-13T00:38:49.848 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (8 ms) 2024-02-13T00:38:49.848 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2024-02-13T00:38:49.849 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (3 ms) 2024-02-13T00:38:49.849 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2024-02-13T00:38:49.849 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (13 ms) 2024-02-13T00:38:49.849 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2024-02-13T00:38:49.849 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (5 ms) 2024-02-13T00:38:49.849 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2024-02-13T00:38:49.849 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (6 ms) 2024-02-13T00:38:49.849 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2024-02-13T00:38:49.849 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (9 ms) 2024-02-13T00:38:49.849 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2024-02-13T00:38:49.849 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: osd_max_attr_size = 0 2024-02-13T00:38:49.849 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2024-02-13T00:38:49.849 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (2390 ms) 2024-02-13T00:38:49.849 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2024-02-13T00:38:49.849 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (573 ms) 2024-02-13T00:38:49.849 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2024-02-13T00:38:49.850 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: waiting for initial deep scrubs... 2024-02-13T00:38:49.850 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: done waiting, doing copies 2024-02-13T00:38:49.850 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: waiting for final deep scrubs... 2024-02-13T00:38:49.850 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: done waiting 2024-02-13T00:38:49.850 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (60867 ms) 2024-02-13T00:38:49.850 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2024-02-13T00:38:49.850 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (8 ms) 2024-02-13T00:38:49.850 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2024-02-13T00:38:49.850 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (6 ms) 2024-02-13T00:38:49.850 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2024-02-13T00:38:49.850 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4421 ms) 2024-02-13T00:38:49.850 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2024-02-13T00:38:49.850 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-02-13T00:38:49.850 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2024-02-13T00:38:49.850 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-02-13T00:38:49.851 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2024-02-13T00:38:49.851 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2024-02-13T00:38:50.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:49 smithi106 bash[18459]: audit 2024-02-13T00:38:48.829595+0000 mon.a (mon.0) 1215 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi080-54175-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:50.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:49 smithi106 bash[18459]: audit 2024-02-13T00:38:48.830152+0000 mon.a (mon.0) 1216 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key1"}]': finished 2024-02-13T00:38:50.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:49 smithi106 bash[18459]: cluster 2024-02-13T00:38:48.830522+0000 mon.a (mon.0) 1217 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2024-02-13T00:38:50.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:49 smithi106 bash[18459]: audit 2024-02-13T00:38:48.835486+0000 mon.a (mon.0) 1218 : audit [INF] from='client.? 172.21.15.80:0/549589587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi080-54183-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:50.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:49 smithi106 bash[18459]: audit 2024-02-13T00:38:48.897087+0000 mon.c (mon.2) 191 : audit [INF] from='client.? 172.21.15.80:0/1129214965' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:38:50.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:49 smithi106 bash[18459]: audit 2024-02-13T00:38:48.897467+0000 mon.a (mon.0) 1219 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:38:50.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:49 smithi106 bash[18459]: audit 2024-02-13T00:38:48.899618+0000 mon.c (mon.2) 192 : audit [INF] from='client.? 172.21.15.80:0/1129214965' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:38:50.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:49 smithi106 bash[18459]: audit 2024-02-13T00:38:48.900059+0000 mon.a (mon.0) 1220 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:38:50.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:49 smithi106 bash[18459]: audit 2024-02-13T00:38:48.900924+0000 mon.c (mon.2) 193 : audit [INF] from='client.? 172.21.15.80:0/1129214965' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:38:50.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:49 smithi106 bash[18459]: audit 2024-02-13T00:38:48.901227+0000 mon.a (mon.0) 1221 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:38:50.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:49 smithi106 bash[18459]: audit 2024-02-13T00:38:49.782923+0000 mon.a (mon.0) 1222 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:50.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:49 smithi106 bash[18459]: audit 2024-02-13T00:38:49.831176+0000 mon.a (mon.0) 1223 : audit [INF] from='client.? 172.21.15.80:0/549589587' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi080-54183-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:50.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:49 smithi106 bash[18459]: audit 2024-02-13T00:38:49.832443+0000 mon.a (mon.0) 1224 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:38:50.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:49 smithi106 bash[18459]: cluster 2024-02-13T00:38:49.832707+0000 mon.a (mon.0) 1225 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2024-02-13T00:38:50.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:49 smithi106 bash[18459]: audit 2024-02-13T00:38:49.835964+0000 mon.c (mon.2) 194 : audit [INF] from='client.? 172.21.15.80:0/1129214965' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi080-54454-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:38:50.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:49 smithi106 bash[18459]: audit 2024-02-13T00:38:49.836862+0000 mon.a (mon.0) 1226 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi080-54454-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:38:50.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[17386]: audit 2024-02-13T00:38:48.829595+0000 mon.a (mon.0) 1215 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi080-54175-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:50.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[17386]: audit 2024-02-13T00:38:48.830152+0000 mon.a (mon.0) 1216 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key1"}]': finished 2024-02-13T00:38:50.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[17386]: cluster 2024-02-13T00:38:48.830522+0000 mon.a (mon.0) 1217 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2024-02-13T00:38:50.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[17386]: audit 2024-02-13T00:38:48.835486+0000 mon.a (mon.0) 1218 : audit [INF] from='client.? 172.21.15.80:0/549589587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi080-54183-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:50.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[17386]: audit 2024-02-13T00:38:48.897087+0000 mon.c (mon.2) 191 : audit [INF] from='client.? 172.21.15.80:0/1129214965' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:38:50.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[17386]: audit 2024-02-13T00:38:48.897467+0000 mon.a (mon.0) 1219 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:38:50.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[17386]: audit 2024-02-13T00:38:48.899618+0000 mon.c (mon.2) 192 : audit [INF] from='client.? 172.21.15.80:0/1129214965' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:38:50.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[17386]: audit 2024-02-13T00:38:48.900059+0000 mon.a (mon.0) 1220 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:38:50.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[17386]: audit 2024-02-13T00:38:48.900924+0000 mon.c (mon.2) 193 : audit [INF] from='client.? 172.21.15.80:0/1129214965' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:38:50.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[17386]: audit 2024-02-13T00:38:48.901227+0000 mon.a (mon.0) 1221 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:38:50.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[17386]: audit 2024-02-13T00:38:49.782923+0000 mon.a (mon.0) 1222 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:50.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[17386]: audit 2024-02-13T00:38:49.831176+0000 mon.a (mon.0) 1223 : audit [INF] from='client.? 172.21.15.80:0/549589587' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi080-54183-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:50.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[17386]: audit 2024-02-13T00:38:49.832443+0000 mon.a (mon.0) 1224 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:38:50.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[17386]: cluster 2024-02-13T00:38:49.832707+0000 mon.a (mon.0) 1225 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2024-02-13T00:38:50.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[17386]: audit 2024-02-13T00:38:49.835964+0000 mon.c (mon.2) 194 : audit [INF] from='client.? 172.21.15.80:0/1129214965' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi080-54454-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:38:50.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[17386]: audit 2024-02-13T00:38:49.836862+0000 mon.a (mon.0) 1226 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi080-54454-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:38:50.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[24237]: audit 2024-02-13T00:38:48.829595+0000 mon.a (mon.0) 1215 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi080-54175-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:50.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[24237]: audit 2024-02-13T00:38:48.830152+0000 mon.a (mon.0) 1216 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi080-54247-1","app":"app1","key":"key1"}]': finished 2024-02-13T00:38:50.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[24237]: cluster 2024-02-13T00:38:48.830522+0000 mon.a (mon.0) 1217 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2024-02-13T00:38:50.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[24237]: audit 2024-02-13T00:38:48.835486+0000 mon.a (mon.0) 1218 : audit [INF] from='client.? 172.21.15.80:0/549589587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi080-54183-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:50.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[24237]: audit 2024-02-13T00:38:48.897087+0000 mon.c (mon.2) 191 : audit [INF] from='client.? 172.21.15.80:0/1129214965' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:38:50.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[24237]: audit 2024-02-13T00:38:48.897467+0000 mon.a (mon.0) 1219 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:38:50.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[24237]: audit 2024-02-13T00:38:48.899618+0000 mon.c (mon.2) 192 : audit [INF] from='client.? 172.21.15.80:0/1129214965' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:38:50.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[24237]: audit 2024-02-13T00:38:48.900059+0000 mon.a (mon.0) 1220 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:38:50.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[24237]: audit 2024-02-13T00:38:48.900924+0000 mon.c (mon.2) 193 : audit [INF] from='client.? 172.21.15.80:0/1129214965' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:38:50.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[24237]: audit 2024-02-13T00:38:48.901227+0000 mon.a (mon.0) 1221 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:38:50.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[24237]: audit 2024-02-13T00:38:49.782923+0000 mon.a (mon.0) 1222 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:50.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[24237]: audit 2024-02-13T00:38:49.831176+0000 mon.a (mon.0) 1223 : audit [INF] from='client.? 172.21.15.80:0/549589587' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi080-54183-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:50.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[24237]: audit 2024-02-13T00:38:49.832443+0000 mon.a (mon.0) 1224 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:38:50.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[24237]: cluster 2024-02-13T00:38:49.832707+0000 mon.a (mon.0) 1225 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2024-02-13T00:38:50.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[24237]: audit 2024-02-13T00:38:49.835964+0000 mon.c (mon.2) 194 : audit [INF] from='client.? 172.21.15.80:0/1129214965' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi080-54454-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:38:50.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:49 smithi080 bash[24237]: audit 2024-02-13T00:38:49.836862+0000 mon.a (mon.0) 1226 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi080-54454-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:38:50.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:38:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:38:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:38:51.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:51 smithi106 bash[18459]: cluster 2024-02-13T00:38:49.710559+0000 mgr.y (mgr.24461) 371 : cluster [DBG] pgmap v329: 356 pgs: 12 creating+peering, 52 unknown, 292 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T00:38:51.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:51 smithi106 bash[18459]: audit 2024-02-13T00:38:49.882397+0000 mon.c (mon.2) 195 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:51.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:51 smithi106 bash[18459]: audit 2024-02-13T00:38:50.335097+0000 mon.a (mon.0) 1227 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:51.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:51 smithi106 bash[18459]: audit 2024-02-13T00:38:50.336572+0000 mon.c (mon.2) 196 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:51.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:51 smithi106 bash[18459]: audit 2024-02-13T00:38:50.337154+0000 mon.a (mon.0) 1228 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:51.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:51 smithi106 bash[18459]: audit 2024-02-13T00:38:50.338243+0000 mon.c (mon.2) 197 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54247-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:38:51.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:51 smithi106 bash[18459]: audit 2024-02-13T00:38:50.338812+0000 mon.a (mon.0) 1229 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54247-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:38:51.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:51 smithi106 bash[18459]: audit 2024-02-13T00:38:50.784795+0000 mon.a (mon.0) 1230 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:51.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:51 smithi080 bash[24237]: cluster 2024-02-13T00:38:49.710559+0000 mgr.y (mgr.24461) 371 : cluster [DBG] pgmap v329: 356 pgs: 12 creating+peering, 52 unknown, 292 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T00:38:51.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:51 smithi080 bash[24237]: audit 2024-02-13T00:38:49.882397+0000 mon.c (mon.2) 195 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:51.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:51 smithi080 bash[24237]: audit 2024-02-13T00:38:50.335097+0000 mon.a (mon.0) 1227 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:51.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:51 smithi080 bash[24237]: audit 2024-02-13T00:38:50.336572+0000 mon.c (mon.2) 196 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:51.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:51 smithi080 bash[24237]: audit 2024-02-13T00:38:50.337154+0000 mon.a (mon.0) 1228 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:51.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:51 smithi080 bash[24237]: audit 2024-02-13T00:38:50.338243+0000 mon.c (mon.2) 197 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54247-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:38:51.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:51 smithi080 bash[24237]: audit 2024-02-13T00:38:50.338812+0000 mon.a (mon.0) 1229 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54247-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:38:51.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:51 smithi080 bash[24237]: audit 2024-02-13T00:38:50.784795+0000 mon.a (mon.0) 1230 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:51.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:51 smithi080 bash[17386]: cluster 2024-02-13T00:38:49.710559+0000 mgr.y (mgr.24461) 371 : cluster [DBG] pgmap v329: 356 pgs: 12 creating+peering, 52 unknown, 292 active+clean; 216 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T00:38:51.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:51 smithi080 bash[17386]: audit 2024-02-13T00:38:49.882397+0000 mon.c (mon.2) 195 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:51.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:51 smithi080 bash[17386]: audit 2024-02-13T00:38:50.335097+0000 mon.a (mon.0) 1227 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:51.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:51 smithi080 bash[17386]: audit 2024-02-13T00:38:50.336572+0000 mon.c (mon.2) 196 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:51.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:51 smithi080 bash[17386]: audit 2024-02-13T00:38:50.337154+0000 mon.a (mon.0) 1228 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:51.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:51 smithi080 bash[17386]: audit 2024-02-13T00:38:50.338243+0000 mon.c (mon.2) 197 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54247-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:38:51.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:51 smithi080 bash[17386]: audit 2024-02-13T00:38:50.338812+0000 mon.a (mon.0) 1229 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54247-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:38:51.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:51 smithi080 bash[17386]: audit 2024-02-13T00:38:50.784795+0000 mon.a (mon.0) 1230 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:52.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:52 smithi106 bash[18459]: cluster 2024-02-13T00:38:50.685033+0000 osd.0 (osd.0) 19 : cluster [DBG] 94.9 scrub starts 2024-02-13T00:38:52.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:52 smithi106 bash[18459]: cluster 2024-02-13T00:38:50.688599+0000 osd.0 (osd.0) 20 : cluster [DBG] 94.9 scrub ok 2024-02-13T00:38:52.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:52 smithi106 bash[18459]: audit 2024-02-13T00:38:51.284789+0000 mon.a (mon.0) 1231 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54247-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:38:52.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:52 smithi106 bash[18459]: cluster 2024-02-13T00:38:51.284915+0000 mon.a (mon.0) 1232 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2024-02-13T00:38:52.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:52 smithi106 bash[18459]: audit 2024-02-13T00:38:51.286264+0000 mon.c (mon.2) 198 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54247-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:52.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:52 smithi106 bash[18459]: audit 2024-02-13T00:38:51.295991+0000 mon.a (mon.0) 1233 : audit [INF] from='client.? 172.21.15.80:0/4130610019' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi080-54175-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:52 smithi106 bash[18459]: audit 2024-02-13T00:38:51.296607+0000 mon.a (mon.0) 1234 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54247-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:52 smithi106 bash[18459]: cluster 2024-02-13T00:38:51.711414+0000 mgr.y (mgr.24461) 372 : cluster [DBG] pgmap v332: 292 pgs: 32 unknown, 260 active+clean; 15 KiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:52 smithi106 bash[18459]: audit 2024-02-13T00:38:51.786531+0000 mon.a (mon.0) 1235 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:52 smithi106 bash[18459]: audit 2024-02-13T00:38:51.838894+0000 mon.a (mon.0) 1236 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi080-54454-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]': finished 2024-02-13T00:38:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:52 smithi106 bash[18459]: audit 2024-02-13T00:38:51.839419+0000 mon.a (mon.0) 1237 : audit [INF] from='client.? 172.21.15.80:0/4130610019' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi080-54175-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:52 smithi106 bash[18459]: cluster 2024-02-13T00:38:52.275548+0000 mon.a (mon.0) 1238 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2024-02-13T00:38:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:52 smithi106 bash[18459]: audit 2024-02-13T00:38:52.276962+0000 mon.c (mon.2) 199 : audit [INF] from='client.? 172.21.15.80:0/4012412812' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi080-54183-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:52 smithi106 bash[18459]: audit 2024-02-13T00:38:52.281693+0000 mon.a (mon.0) 1239 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi080-54183-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:52.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[17386]: cluster 2024-02-13T00:38:50.685033+0000 osd.0 (osd.0) 19 : cluster [DBG] 94.9 scrub starts 2024-02-13T00:38:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[17386]: cluster 2024-02-13T00:38:50.688599+0000 osd.0 (osd.0) 20 : cluster [DBG] 94.9 scrub ok 2024-02-13T00:38:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[17386]: audit 2024-02-13T00:38:51.284789+0000 mon.a (mon.0) 1231 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54247-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:38:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[17386]: cluster 2024-02-13T00:38:51.284915+0000 mon.a (mon.0) 1232 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2024-02-13T00:38:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[17386]: audit 2024-02-13T00:38:51.286264+0000 mon.c (mon.2) 198 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54247-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[17386]: audit 2024-02-13T00:38:51.295991+0000 mon.a (mon.0) 1233 : audit [INF] from='client.? 172.21.15.80:0/4130610019' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi080-54175-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[17386]: audit 2024-02-13T00:38:51.296607+0000 mon.a (mon.0) 1234 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54247-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[17386]: cluster 2024-02-13T00:38:51.711414+0000 mgr.y (mgr.24461) 372 : cluster [DBG] pgmap v332: 292 pgs: 32 unknown, 260 active+clean; 15 KiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[17386]: audit 2024-02-13T00:38:51.786531+0000 mon.a (mon.0) 1235 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[17386]: audit 2024-02-13T00:38:51.838894+0000 mon.a (mon.0) 1236 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi080-54454-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]': finished 2024-02-13T00:38:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[17386]: audit 2024-02-13T00:38:51.839419+0000 mon.a (mon.0) 1237 : audit [INF] from='client.? 172.21.15.80:0/4130610019' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi080-54175-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[17386]: cluster 2024-02-13T00:38:52.275548+0000 mon.a (mon.0) 1238 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2024-02-13T00:38:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[17386]: audit 2024-02-13T00:38:52.276962+0000 mon.c (mon.2) 199 : audit [INF] from='client.? 172.21.15.80:0/4012412812' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi080-54183-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[17386]: audit 2024-02-13T00:38:52.281693+0000 mon.a (mon.0) 1239 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi080-54183-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[24237]: cluster 2024-02-13T00:38:50.685033+0000 osd.0 (osd.0) 19 : cluster [DBG] 94.9 scrub starts 2024-02-13T00:38:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[24237]: cluster 2024-02-13T00:38:50.688599+0000 osd.0 (osd.0) 20 : cluster [DBG] 94.9 scrub ok 2024-02-13T00:38:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[24237]: audit 2024-02-13T00:38:51.284789+0000 mon.a (mon.0) 1231 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54247-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:38:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[24237]: cluster 2024-02-13T00:38:51.284915+0000 mon.a (mon.0) 1232 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2024-02-13T00:38:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[24237]: audit 2024-02-13T00:38:51.286264+0000 mon.c (mon.2) 198 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54247-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[24237]: audit 2024-02-13T00:38:51.295991+0000 mon.a (mon.0) 1233 : audit [INF] from='client.? 172.21.15.80:0/4130610019' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi080-54175-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[24237]: audit 2024-02-13T00:38:51.296607+0000 mon.a (mon.0) 1234 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54247-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[24237]: cluster 2024-02-13T00:38:51.711414+0000 mgr.y (mgr.24461) 372 : cluster [DBG] pgmap v332: 292 pgs: 32 unknown, 260 active+clean; 15 KiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2024-02-13T00:38:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[24237]: audit 2024-02-13T00:38:51.786531+0000 mon.a (mon.0) 1235 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[24237]: audit 2024-02-13T00:38:51.838894+0000 mon.a (mon.0) 1236 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi080-54454-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]': finished 2024-02-13T00:38:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[24237]: audit 2024-02-13T00:38:51.839419+0000 mon.a (mon.0) 1237 : audit [INF] from='client.? 172.21.15.80:0/4130610019' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi080-54175-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[24237]: cluster 2024-02-13T00:38:52.275548+0000 mon.a (mon.0) 1238 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2024-02-13T00:38:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[24237]: audit 2024-02-13T00:38:52.276962+0000 mon.c (mon.2) 199 : audit [INF] from='client.? 172.21.15.80:0/4012412812' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi080-54183-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:52 smithi080 bash[24237]: audit 2024-02-13T00:38:52.281693+0000 mon.a (mon.0) 1239 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi080-54183-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:53.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:38:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:38:53] "GET /metrics HTTP/1.1" 200 194070 "" "Prometheus/2.33.4" 2024-02-13T00:38:54.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:53 smithi106 bash[18459]: audit 2024-02-13T00:38:52.788184+0000 mon.a (mon.0) 1240 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:54.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:53 smithi106 bash[18459]: audit 2024-02-13T00:38:52.842674+0000 mon.a (mon.0) 1241 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54247-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54247-24"}]': finished 2024-02-13T00:38:54.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:53 smithi106 bash[18459]: audit 2024-02-13T00:38:52.843120+0000 mon.a (mon.0) 1242 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi080-54183-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:54.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:53 smithi106 bash[18459]: cluster 2024-02-13T00:38:52.843331+0000 mon.a (mon.0) 1243 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2024-02-13T00:38:54.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:53 smithi080 bash[17386]: audit 2024-02-13T00:38:52.788184+0000 mon.a (mon.0) 1240 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:54.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:53 smithi080 bash[17386]: audit 2024-02-13T00:38:52.842674+0000 mon.a (mon.0) 1241 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54247-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54247-24"}]': finished 2024-02-13T00:38:54.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:53 smithi080 bash[17386]: audit 2024-02-13T00:38:52.843120+0000 mon.a (mon.0) 1242 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi080-54183-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:54.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:53 smithi080 bash[17386]: cluster 2024-02-13T00:38:52.843331+0000 mon.a (mon.0) 1243 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2024-02-13T00:38:54.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:53 smithi080 bash[24237]: audit 2024-02-13T00:38:52.788184+0000 mon.a (mon.0) 1240 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:54.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:53 smithi080 bash[24237]: audit 2024-02-13T00:38:52.842674+0000 mon.a (mon.0) 1241 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54247-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54247-24"}]': finished 2024-02-13T00:38:54.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:53 smithi080 bash[24237]: audit 2024-02-13T00:38:52.843120+0000 mon.a (mon.0) 1242 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi080-54183-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:54.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:53 smithi080 bash[24237]: cluster 2024-02-13T00:38:52.843331+0000 mon.a (mon.0) 1243 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2024-02-13T00:38:55.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:54 smithi106 bash[18459]: cluster 2024-02-13T00:38:53.712887+0000 mgr.y (mgr.24461) 373 : cluster [DBG] pgmap v335: 308 pgs: 14 creating+activating, 27 creating+peering, 7 unknown, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:38:55.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:54 smithi106 bash[18459]: audit 2024-02-13T00:38:53.789725+0000 mon.a (mon.0) 1244 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:55.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:54 smithi106 bash[18459]: audit 2024-02-13T00:38:53.795732+0000 mon.c (mon.2) 200 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:38:55.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:54 smithi106 bash[18459]: cluster 2024-02-13T00:38:53.853626+0000 mon.a (mon.0) 1245 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2024-02-13T00:38:55.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:54 smithi106 bash[18459]: audit 2024-02-13T00:38:53.869639+0000 mon.c (mon.2) 201 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54247-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:55.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:54 smithi106 bash[18459]: audit 2024-02-13T00:38:53.869976+0000 mon.c (mon.2) 202 : audit [INF] from='client.? 172.21.15.80:0/2782174230' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi080-54175-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:55.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:54 smithi106 bash[18459]: audit 2024-02-13T00:38:53.876789+0000 mon.a (mon.0) 1246 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54247-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:55.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:54 smithi106 bash[18459]: audit 2024-02-13T00:38:53.877183+0000 mon.a (mon.0) 1247 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi080-54175-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:55.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:54 smithi106 bash[18459]: audit 2024-02-13T00:38:54.154657+0000 mon.c (mon.2) 203 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:38:55.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:54 smithi106 bash[18459]: audit 2024-02-13T00:38:54.155759+0000 mon.c (mon.2) 204 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:38:55.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:54 smithi106 bash[18459]: cluster 2024-02-13T00:38:54.157952+0000 mgr.y (mgr.24461) 374 : cluster [DBG] pgmap v337: 340 pgs: 2 creating+activating, 7 creating+peering, 71 unknown, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-13T00:38:55.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:54 smithi106 bash[18459]: audit 2024-02-13T00:38:54.360331+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:38:55.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[17386]: cluster 2024-02-13T00:38:53.712887+0000 mgr.y (mgr.24461) 373 : cluster [DBG] pgmap v335: 308 pgs: 14 creating+activating, 27 creating+peering, 7 unknown, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:38:55.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[17386]: audit 2024-02-13T00:38:53.789725+0000 mon.a (mon.0) 1244 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:55.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[17386]: audit 2024-02-13T00:38:53.795732+0000 mon.c (mon.2) 200 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:38:55.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[17386]: cluster 2024-02-13T00:38:53.853626+0000 mon.a (mon.0) 1245 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2024-02-13T00:38:55.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[17386]: audit 2024-02-13T00:38:53.869639+0000 mon.c (mon.2) 201 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54247-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:55.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[17386]: audit 2024-02-13T00:38:53.869976+0000 mon.c (mon.2) 202 : audit [INF] from='client.? 172.21.15.80:0/2782174230' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi080-54175-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:55.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[17386]: audit 2024-02-13T00:38:53.876789+0000 mon.a (mon.0) 1246 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54247-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:55.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[17386]: audit 2024-02-13T00:38:53.877183+0000 mon.a (mon.0) 1247 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi080-54175-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:55.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[17386]: audit 2024-02-13T00:38:54.154657+0000 mon.c (mon.2) 203 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:38:55.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[17386]: audit 2024-02-13T00:38:54.155759+0000 mon.c (mon.2) 204 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:38:55.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[17386]: cluster 2024-02-13T00:38:54.157952+0000 mgr.y (mgr.24461) 374 : cluster [DBG] pgmap v337: 340 pgs: 2 creating+activating, 7 creating+peering, 71 unknown, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-13T00:38:55.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[17386]: audit 2024-02-13T00:38:54.360331+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:38:55.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[24237]: cluster 2024-02-13T00:38:53.712887+0000 mgr.y (mgr.24461) 373 : cluster [DBG] pgmap v335: 308 pgs: 14 creating+activating, 27 creating+peering, 7 unknown, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:38:55.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[24237]: audit 2024-02-13T00:38:53.789725+0000 mon.a (mon.0) 1244 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:55.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[24237]: audit 2024-02-13T00:38:53.795732+0000 mon.c (mon.2) 200 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:38:55.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[24237]: cluster 2024-02-13T00:38:53.853626+0000 mon.a (mon.0) 1245 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2024-02-13T00:38:55.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[24237]: audit 2024-02-13T00:38:53.869639+0000 mon.c (mon.2) 201 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54247-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:55.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[24237]: audit 2024-02-13T00:38:53.869976+0000 mon.c (mon.2) 202 : audit [INF] from='client.? 172.21.15.80:0/2782174230' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi080-54175-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:55.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[24237]: audit 2024-02-13T00:38:53.876789+0000 mon.a (mon.0) 1246 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54247-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:55.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[24237]: audit 2024-02-13T00:38:53.877183+0000 mon.a (mon.0) 1247 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi080-54175-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:55.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[24237]: audit 2024-02-13T00:38:54.154657+0000 mon.c (mon.2) 203 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:38:55.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[24237]: audit 2024-02-13T00:38:54.155759+0000 mon.c (mon.2) 204 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:38:55.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[24237]: cluster 2024-02-13T00:38:54.157952+0000 mgr.y (mgr.24461) 374 : cluster [DBG] pgmap v337: 340 pgs: 2 creating+activating, 7 creating+peering, 71 unknown, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-13T00:38:55.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:54 smithi080 bash[24237]: audit 2024-02-13T00:38:54.360331+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:38:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:55 smithi106 bash[18459]: audit 2024-02-13T00:38:54.791375+0000 mon.a (mon.0) 1249 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:55 smithi106 bash[18459]: cluster 2024-02-13T00:38:54.845125+0000 mon.a (mon.0) 1250 : cluster [INF] Health check cleared: CEPHADM_STRAY_DAEMON (was: 2 stray daemon(s) not managed by cephadm) 2024-02-13T00:38:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:55 smithi106 bash[18459]: audit 2024-02-13T00:38:54.858326+0000 mon.a (mon.0) 1251 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54247-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:55 smithi106 bash[18459]: audit 2024-02-13T00:38:54.858464+0000 mon.a (mon.0) 1252 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi080-54175-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:55 smithi106 bash[18459]: cluster 2024-02-13T00:38:54.858771+0000 mon.a (mon.0) 1253 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2024-02-13T00:38:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:55 smithi106 bash[18459]: audit 2024-02-13T00:38:54.867438+0000 mon.c (mon.2) 205 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54247-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:55 smithi106 bash[18459]: audit 2024-02-13T00:38:54.868155+0000 mon.a (mon.0) 1254 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54247-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:55 smithi106 bash[18459]: audit 2024-02-13T00:38:54.872707+0000 mon.a (mon.0) 1255 : audit [INF] from='client.? 172.21.15.80:0/993203342' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi080-54183-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:56.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:55 smithi080 bash[24237]: audit 2024-02-13T00:38:54.791375+0000 mon.a (mon.0) 1249 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:56.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:55 smithi080 bash[24237]: cluster 2024-02-13T00:38:54.845125+0000 mon.a (mon.0) 1250 : cluster [INF] Health check cleared: CEPHADM_STRAY_DAEMON (was: 2 stray daemon(s) not managed by cephadm) 2024-02-13T00:38:56.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:55 smithi080 bash[24237]: audit 2024-02-13T00:38:54.858326+0000 mon.a (mon.0) 1251 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54247-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:56.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:55 smithi080 bash[24237]: audit 2024-02-13T00:38:54.858464+0000 mon.a (mon.0) 1252 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi080-54175-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:56.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:55 smithi080 bash[24237]: cluster 2024-02-13T00:38:54.858771+0000 mon.a (mon.0) 1253 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2024-02-13T00:38:56.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:55 smithi080 bash[24237]: audit 2024-02-13T00:38:54.867438+0000 mon.c (mon.2) 205 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54247-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:56.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:55 smithi080 bash[24237]: audit 2024-02-13T00:38:54.868155+0000 mon.a (mon.0) 1254 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54247-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:56.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:55 smithi080 bash[24237]: audit 2024-02-13T00:38:54.872707+0000 mon.a (mon.0) 1255 : audit [INF] from='client.? 172.21.15.80:0/993203342' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi080-54183-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:55 smithi080 bash[17386]: audit 2024-02-13T00:38:54.791375+0000 mon.a (mon.0) 1249 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:55 smithi080 bash[17386]: cluster 2024-02-13T00:38:54.845125+0000 mon.a (mon.0) 1250 : cluster [INF] Health check cleared: CEPHADM_STRAY_DAEMON (was: 2 stray daemon(s) not managed by cephadm) 2024-02-13T00:38:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:55 smithi080 bash[17386]: audit 2024-02-13T00:38:54.858326+0000 mon.a (mon.0) 1251 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54247-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:55 smithi080 bash[17386]: audit 2024-02-13T00:38:54.858464+0000 mon.a (mon.0) 1252 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi080-54175-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:55 smithi080 bash[17386]: cluster 2024-02-13T00:38:54.858771+0000 mon.a (mon.0) 1253 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2024-02-13T00:38:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:55 smithi080 bash[17386]: audit 2024-02-13T00:38:54.867438+0000 mon.c (mon.2) 205 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54247-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:55 smithi080 bash[17386]: audit 2024-02-13T00:38:54.868155+0000 mon.a (mon.0) 1254 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54247-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:55 smithi080 bash[17386]: audit 2024-02-13T00:38:54.872707+0000 mon.a (mon.0) 1255 : audit [INF] from='client.? 172.21.15.80:0/993203342' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi080-54183-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:57.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:56 smithi106 bash[18459]: audit 2024-02-13T00:38:55.793203+0000 mon.a (mon.0) 1256 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:57.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:56 smithi106 bash[18459]: audit 2024-02-13T00:38:55.863782+0000 mon.a (mon.0) 1257 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54247-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:57.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:56 smithi106 bash[18459]: audit 2024-02-13T00:38:55.863997+0000 mon.a (mon.0) 1258 : audit [INF] from='client.? 172.21.15.80:0/993203342' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi080-54183-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:57.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:56 smithi106 bash[18459]: cluster 2024-02-13T00:38:55.864283+0000 mon.a (mon.0) 1259 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2024-02-13T00:38:57.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:56 smithi106 bash[18459]: cluster 2024-02-13T00:38:56.158786+0000 mgr.y (mgr.24461) 375 : cluster [DBG] pgmap v340: 340 pgs: 2 creating+activating, 7 creating+peering, 71 unknown, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:38:57.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:56 smithi080 bash[24237]: audit 2024-02-13T00:38:55.793203+0000 mon.a (mon.0) 1256 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:57.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:56 smithi080 bash[24237]: audit 2024-02-13T00:38:55.863782+0000 mon.a (mon.0) 1257 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54247-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:57.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:56 smithi080 bash[24237]: audit 2024-02-13T00:38:55.863997+0000 mon.a (mon.0) 1258 : audit [INF] from='client.? 172.21.15.80:0/993203342' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi080-54183-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:57.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:56 smithi080 bash[24237]: cluster 2024-02-13T00:38:55.864283+0000 mon.a (mon.0) 1259 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2024-02-13T00:38:57.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:56 smithi080 bash[24237]: cluster 2024-02-13T00:38:56.158786+0000 mgr.y (mgr.24461) 375 : cluster [DBG] pgmap v340: 340 pgs: 2 creating+activating, 7 creating+peering, 71 unknown, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:38:57.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:56 smithi080 bash[17386]: audit 2024-02-13T00:38:55.793203+0000 mon.a (mon.0) 1256 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:57.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:56 smithi080 bash[17386]: audit 2024-02-13T00:38:55.863782+0000 mon.a (mon.0) 1257 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54247-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:57.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:56 smithi080 bash[17386]: audit 2024-02-13T00:38:55.863997+0000 mon.a (mon.0) 1258 : audit [INF] from='client.? 172.21.15.80:0/993203342' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi080-54183-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:57.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:56 smithi080 bash[17386]: cluster 2024-02-13T00:38:55.864283+0000 mon.a (mon.0) 1259 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2024-02-13T00:38:57.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:56 smithi080 bash[17386]: cluster 2024-02-13T00:38:56.158786+0000 mgr.y (mgr.24461) 375 : cluster [DBG] pgmap v340: 340 pgs: 2 creating+activating, 7 creating+peering, 71 unknown, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:38:58.148 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:57 smithi106 bash[18459]: audit 2024-02-13T00:38:56.794872+0000 mon.a (mon.0) 1260 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:58.148 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:57 smithi106 bash[18459]: cluster 2024-02-13T00:38:56.868289+0000 mon.a (mon.0) 1261 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2024-02-13T00:38:58.148 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:57 smithi106 bash[18459]: audit 2024-02-13T00:38:56.873241+0000 mon.a (mon.0) 1262 : audit [INF] from='client.? 172.21.15.80:0/2546621231' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi080-54175-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:58.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:57 smithi080 bash[17386]: audit 2024-02-13T00:38:56.794872+0000 mon.a (mon.0) 1260 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:58.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:57 smithi080 bash[17386]: cluster 2024-02-13T00:38:56.868289+0000 mon.a (mon.0) 1261 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2024-02-13T00:38:58.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:57 smithi080 bash[17386]: audit 2024-02-13T00:38:56.873241+0000 mon.a (mon.0) 1262 : audit [INF] from='client.? 172.21.15.80:0/2546621231' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi080-54175-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:58.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:57 smithi080 bash[24237]: audit 2024-02-13T00:38:56.794872+0000 mon.a (mon.0) 1260 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:58.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:57 smithi080 bash[24237]: cluster 2024-02-13T00:38:56.868289+0000 mon.a (mon.0) 1261 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2024-02-13T00:38:58.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:57 smithi080 bash[24237]: audit 2024-02-13T00:38:56.873241+0000 mon.a (mon.0) 1262 : audit [INF] from='client.? 172.21.15.80:0/2546621231' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi080-54175-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:58.505 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:38:58 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:38:59.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:58 smithi106 bash[18459]: audit 2024-02-13T00:38:57.796425+0000 mon.a (mon.0) 1263 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:59.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:58 smithi106 bash[18459]: audit 2024-02-13T00:38:57.870232+0000 mon.a (mon.0) 1264 : audit [INF] from='client.? 172.21.15.80:0/2546621231' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi080-54175-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:59.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:58 smithi106 bash[18459]: cluster 2024-02-13T00:38:57.872597+0000 mon.a (mon.0) 1265 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2024-02-13T00:38:59.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:58 smithi106 bash[18459]: audit 2024-02-13T00:38:57.879902+0000 mon.c (mon.2) 206 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:59.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:58 smithi106 bash[18459]: audit 2024-02-13T00:38:57.883597+0000 mon.a (mon.0) 1266 : audit [INF] from='client.? 172.21.15.80:0/1576804553' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi080-54183-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:59.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:58 smithi106 bash[18459]: audit 2024-02-13T00:38:57.884160+0000 mon.a (mon.0) 1267 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:59.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:58 smithi106 bash[18459]: audit 2024-02-13T00:38:58.144904+0000 mgr.y (mgr.24461) 376 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:38:59.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:58 smithi106 bash[18459]: cluster 2024-02-13T00:38:58.160099+0000 mgr.y (mgr.24461) 377 : cluster [DBG] pgmap v343: 332 pgs: 32 creating+peering, 32 unknown, 268 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-13T00:38:59.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:58 smithi080 bash[17386]: audit 2024-02-13T00:38:57.796425+0000 mon.a (mon.0) 1263 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:59.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:58 smithi080 bash[17386]: audit 2024-02-13T00:38:57.870232+0000 mon.a (mon.0) 1264 : audit [INF] from='client.? 172.21.15.80:0/2546621231' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi080-54175-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:59.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:58 smithi080 bash[17386]: cluster 2024-02-13T00:38:57.872597+0000 mon.a (mon.0) 1265 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2024-02-13T00:38:59.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:58 smithi080 bash[17386]: audit 2024-02-13T00:38:57.879902+0000 mon.c (mon.2) 206 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:59.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:58 smithi080 bash[17386]: audit 2024-02-13T00:38:57.883597+0000 mon.a (mon.0) 1266 : audit [INF] from='client.? 172.21.15.80:0/1576804553' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi080-54183-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:59.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:58 smithi080 bash[17386]: audit 2024-02-13T00:38:57.884160+0000 mon.a (mon.0) 1267 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:59.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:58 smithi080 bash[17386]: audit 2024-02-13T00:38:58.144904+0000 mgr.y (mgr.24461) 376 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:38:59.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:58 smithi080 bash[17386]: cluster 2024-02-13T00:38:58.160099+0000 mgr.y (mgr.24461) 377 : cluster [DBG] pgmap v343: 332 pgs: 32 creating+peering, 32 unknown, 268 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-13T00:38:59.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:58 smithi080 bash[24237]: audit 2024-02-13T00:38:57.796425+0000 mon.a (mon.0) 1263 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:38:59.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:58 smithi080 bash[24237]: audit 2024-02-13T00:38:57.870232+0000 mon.a (mon.0) 1264 : audit [INF] from='client.? 172.21.15.80:0/2546621231' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi080-54175-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:38:59.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:58 smithi080 bash[24237]: cluster 2024-02-13T00:38:57.872597+0000 mon.a (mon.0) 1265 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2024-02-13T00:38:59.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:58 smithi080 bash[24237]: audit 2024-02-13T00:38:57.879902+0000 mon.c (mon.2) 206 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:59.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:58 smithi080 bash[24237]: audit 2024-02-13T00:38:57.883597+0000 mon.a (mon.0) 1266 : audit [INF] from='client.? 172.21.15.80:0/1576804553' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi080-54183-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:38:59.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:58 smithi080 bash[24237]: audit 2024-02-13T00:38:57.884160+0000 mon.a (mon.0) 1267 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:38:59.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:58 smithi080 bash[24237]: audit 2024-02-13T00:38:58.144904+0000 mgr.y (mgr.24461) 376 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:38:59.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:58 smithi080 bash[24237]: cluster 2024-02-13T00:38:58.160099+0000 mgr.y (mgr.24461) 377 : cluster [DBG] pgmap v343: 332 pgs: 32 creating+peering, 32 unknown, 268 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-13T00:39:00.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:59 smithi106 bash[18459]: audit 2024-02-13T00:38:58.798035+0000 mon.a (mon.0) 1268 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:00.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:59 smithi106 bash[18459]: cluster 2024-02-13T00:38:58.865355+0000 mon.a (mon.0) 1269 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:39:00.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:59 smithi106 bash[18459]: audit 2024-02-13T00:38:58.874772+0000 mon.a (mon.0) 1270 : audit [INF] from='client.? 172.21.15.80:0/1576804553' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi080-54183-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:00.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:59 smithi106 bash[18459]: audit 2024-02-13T00:38:58.874922+0000 mon.a (mon.0) 1271 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54247-24"}]': finished 2024-02-13T00:39:00.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:59 smithi106 bash[18459]: cluster 2024-02-13T00:38:58.875198+0000 mon.a (mon.0) 1272 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2024-02-13T00:39:00.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:59 smithi106 bash[18459]: audit 2024-02-13T00:38:58.876021+0000 mon.c (mon.2) 207 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:39:00.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:38:59 smithi106 bash[18459]: audit 2024-02-13T00:38:58.877659+0000 mon.a (mon.0) 1273 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:39:00.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:59 smithi080 bash[17386]: audit 2024-02-13T00:38:58.798035+0000 mon.a (mon.0) 1268 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:00.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:59 smithi080 bash[17386]: cluster 2024-02-13T00:38:58.865355+0000 mon.a (mon.0) 1269 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:39:00.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:59 smithi080 bash[17386]: audit 2024-02-13T00:38:58.874772+0000 mon.a (mon.0) 1270 : audit [INF] from='client.? 172.21.15.80:0/1576804553' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi080-54183-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:00.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:59 smithi080 bash[17386]: audit 2024-02-13T00:38:58.874922+0000 mon.a (mon.0) 1271 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54247-24"}]': finished 2024-02-13T00:39:00.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:59 smithi080 bash[17386]: cluster 2024-02-13T00:38:58.875198+0000 mon.a (mon.0) 1272 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2024-02-13T00:39:00.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:59 smithi080 bash[17386]: audit 2024-02-13T00:38:58.876021+0000 mon.c (mon.2) 207 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:39:00.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:38:59 smithi080 bash[17386]: audit 2024-02-13T00:38:58.877659+0000 mon.a (mon.0) 1273 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:39:00.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:59 smithi080 bash[24237]: audit 2024-02-13T00:38:58.798035+0000 mon.a (mon.0) 1268 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:00.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:59 smithi080 bash[24237]: cluster 2024-02-13T00:38:58.865355+0000 mon.a (mon.0) 1269 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:39:00.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:59 smithi080 bash[24237]: audit 2024-02-13T00:38:58.874772+0000 mon.a (mon.0) 1270 : audit [INF] from='client.? 172.21.15.80:0/1576804553' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi080-54183-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:00.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:59 smithi080 bash[24237]: audit 2024-02-13T00:38:58.874922+0000 mon.a (mon.0) 1271 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54247-24"}]': finished 2024-02-13T00:39:00.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:59 smithi080 bash[24237]: cluster 2024-02-13T00:38:58.875198+0000 mon.a (mon.0) 1272 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2024-02-13T00:39:00.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:59 smithi080 bash[24237]: audit 2024-02-13T00:38:58.876021+0000 mon.c (mon.2) 207 : audit [INF] from='client.? 172.21.15.80:0/980523883' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:39:00.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:38:59 smithi080 bash[24237]: audit 2024-02-13T00:38:58.877659+0000 mon.a (mon.0) 1273 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54247-24"}]: dispatch 2024-02-13T00:39:00.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:39:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:39:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:39:01.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:00 smithi106 bash[18459]: audit 2024-02-13T00:38:59.799520+0000 mon.a (mon.0) 1274 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:01.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:00 smithi106 bash[18459]: audit 2024-02-13T00:38:59.878044+0000 mon.a (mon.0) 1275 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54247-24"}]': finished 2024-02-13T00:39:01.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:00 smithi106 bash[18459]: cluster 2024-02-13T00:38:59.878361+0000 mon.a (mon.0) 1276 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2024-02-13T00:39:01.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:00 smithi106 bash[18459]: audit 2024-02-13T00:38:59.883663+0000 mon.c (mon.2) 208 : audit [INF] from='client.? 172.21.15.80:0/4227798854' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi080-54175-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:01.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:00 smithi106 bash[18459]: audit 2024-02-13T00:38:59.884930+0000 mon.a (mon.0) 1277 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi080-54175-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:01.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:00 smithi080 bash[17386]: audit 2024-02-13T00:38:59.799520+0000 mon.a (mon.0) 1274 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:01.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:00 smithi080 bash[17386]: audit 2024-02-13T00:38:59.878044+0000 mon.a (mon.0) 1275 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54247-24"}]': finished 2024-02-13T00:39:01.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:00 smithi080 bash[17386]: cluster 2024-02-13T00:38:59.878361+0000 mon.a (mon.0) 1276 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2024-02-13T00:39:01.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:00 smithi080 bash[17386]: audit 2024-02-13T00:38:59.883663+0000 mon.c (mon.2) 208 : audit [INF] from='client.? 172.21.15.80:0/4227798854' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi080-54175-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:01.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:00 smithi080 bash[17386]: audit 2024-02-13T00:38:59.884930+0000 mon.a (mon.0) 1277 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi080-54175-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:01.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:00 smithi080 bash[24237]: audit 2024-02-13T00:38:59.799520+0000 mon.a (mon.0) 1274 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:01.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:00 smithi080 bash[24237]: audit 2024-02-13T00:38:59.878044+0000 mon.a (mon.0) 1275 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54247-24"}]': finished 2024-02-13T00:39:01.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:00 smithi080 bash[24237]: cluster 2024-02-13T00:38:59.878361+0000 mon.a (mon.0) 1276 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2024-02-13T00:39:01.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:00 smithi080 bash[24237]: audit 2024-02-13T00:38:59.883663+0000 mon.c (mon.2) 208 : audit [INF] from='client.? 172.21.15.80:0/4227798854' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi080-54175-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:01.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:00 smithi080 bash[24237]: audit 2024-02-13T00:38:59.884930+0000 mon.a (mon.0) 1277 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi080-54175-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:02.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:01 smithi106 bash[18459]: cluster 2024-02-13T00:39:00.160951+0000 mgr.y (mgr.24461) 378 : cluster [DBG] pgmap v346: 300 pgs: 32 unknown, 268 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-13T00:39:02.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:01 smithi106 bash[18459]: audit 2024-02-13T00:39:00.817535+0000 mon.a (mon.0) 1278 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:02.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:01 smithi106 bash[18459]: audit 2024-02-13T00:39:00.888980+0000 mon.a (mon.0) 1279 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi080-54175-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:02.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:01 smithi106 bash[18459]: cluster 2024-02-13T00:39:00.889267+0000 mon.a (mon.0) 1280 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2024-02-13T00:39:02.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:01 smithi106 bash[18459]: audit 2024-02-13T00:39:00.892856+0000 mon.c (mon.2) 209 : audit [INF] from='client.? 172.21.15.80:0/2990214380' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi080-54183-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:02.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:01 smithi106 bash[18459]: audit 2024-02-13T00:39:00.895076+0000 mon.b (mon.1) 71 : audit [INF] from='client.? 172.21.15.80:0/874772747' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi080-54247-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:02.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:01 smithi106 bash[18459]: audit 2024-02-13T00:39:00.896029+0000 mon.a (mon.0) 1281 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi080-54183-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:02.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:01 smithi106 bash[18459]: audit 2024-02-13T00:39:00.896374+0000 mon.a (mon.0) 1282 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi080-54247-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:02.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:01 smithi106 bash[18459]: audit 2024-02-13T00:39:01.777907+0000 mon.a (mon.0) 1283 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi080-54183-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:02.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:01 smithi106 bash[18459]: audit 2024-02-13T00:39:01.778073+0000 mon.a (mon.0) 1284 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi080-54247-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:02.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:01 smithi106 bash[18459]: cluster 2024-02-13T00:39:01.778446+0000 mon.a (mon.0) 1285 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2024-02-13T00:39:02.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:01 smithi106 bash[18459]: audit 2024-02-13T00:39:01.781568+0000 mon.c (mon.2) 210 : audit [INF] from='client.? 172.21.15.80:0/1129214965' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:39:02.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:01 smithi106 bash[18459]: audit 2024-02-13T00:39:01.801103+0000 mon.a (mon.0) 1286 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:39:02.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[17386]: cluster 2024-02-13T00:39:00.160951+0000 mgr.y (mgr.24461) 378 : cluster [DBG] pgmap v346: 300 pgs: 32 unknown, 268 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-13T00:39:02.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[17386]: audit 2024-02-13T00:39:00.817535+0000 mon.a (mon.0) 1278 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:02.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[17386]: audit 2024-02-13T00:39:00.888980+0000 mon.a (mon.0) 1279 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi080-54175-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:02.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[17386]: cluster 2024-02-13T00:39:00.889267+0000 mon.a (mon.0) 1280 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2024-02-13T00:39:02.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[17386]: audit 2024-02-13T00:39:00.892856+0000 mon.c (mon.2) 209 : audit [INF] from='client.? 172.21.15.80:0/2990214380' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi080-54183-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:02.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[17386]: audit 2024-02-13T00:39:00.895076+0000 mon.b (mon.1) 71 : audit [INF] from='client.? 172.21.15.80:0/874772747' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi080-54247-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:02.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[17386]: audit 2024-02-13T00:39:00.896029+0000 mon.a (mon.0) 1281 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi080-54183-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:02.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[17386]: audit 2024-02-13T00:39:00.896374+0000 mon.a (mon.0) 1282 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi080-54247-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:02.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[17386]: audit 2024-02-13T00:39:01.777907+0000 mon.a (mon.0) 1283 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi080-54183-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:02.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[17386]: audit 2024-02-13T00:39:01.778073+0000 mon.a (mon.0) 1284 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi080-54247-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:02.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[17386]: cluster 2024-02-13T00:39:01.778446+0000 mon.a (mon.0) 1285 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2024-02-13T00:39:02.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[17386]: audit 2024-02-13T00:39:01.781568+0000 mon.c (mon.2) 210 : audit [INF] from='client.? 172.21.15.80:0/1129214965' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:39:02.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[17386]: audit 2024-02-13T00:39:01.801103+0000 mon.a (mon.0) 1286 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:39:02.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[24237]: cluster 2024-02-13T00:39:00.160951+0000 mgr.y (mgr.24461) 378 : cluster [DBG] pgmap v346: 300 pgs: 32 unknown, 268 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-13T00:39:02.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[24237]: audit 2024-02-13T00:39:00.817535+0000 mon.a (mon.0) 1278 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:02.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[24237]: audit 2024-02-13T00:39:00.888980+0000 mon.a (mon.0) 1279 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi080-54175-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:02.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[24237]: cluster 2024-02-13T00:39:00.889267+0000 mon.a (mon.0) 1280 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2024-02-13T00:39:02.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[24237]: audit 2024-02-13T00:39:00.892856+0000 mon.c (mon.2) 209 : audit [INF] from='client.? 172.21.15.80:0/2990214380' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi080-54183-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:02.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[24237]: audit 2024-02-13T00:39:00.895076+0000 mon.b (mon.1) 71 : audit [INF] from='client.? 172.21.15.80:0/874772747' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi080-54247-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:02.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[24237]: audit 2024-02-13T00:39:00.896029+0000 mon.a (mon.0) 1281 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi080-54183-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:02.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[24237]: audit 2024-02-13T00:39:00.896374+0000 mon.a (mon.0) 1282 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi080-54247-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:02.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[24237]: audit 2024-02-13T00:39:01.777907+0000 mon.a (mon.0) 1283 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi080-54183-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:02.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[24237]: audit 2024-02-13T00:39:01.778073+0000 mon.a (mon.0) 1284 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi080-54247-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:02.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[24237]: cluster 2024-02-13T00:39:01.778446+0000 mon.a (mon.0) 1285 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2024-02-13T00:39:02.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[24237]: audit 2024-02-13T00:39:01.781568+0000 mon.c (mon.2) 210 : audit [INF] from='client.? 172.21.15.80:0/1129214965' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:39:02.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:01 smithi080 bash[24237]: audit 2024-02-13T00:39:01.801103+0000 mon.a (mon.0) 1286 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:39:03.116 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[24237]: audit 2024-02-13T00:39:01.819569+0000 mon.a (mon.0) 1287 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:03.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[24237]: audit 2024-02-13T00:39:01.831582+0000 mon.a (mon.0) 1288 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi080-54175-26"}]: dispatch 2024-02-13T00:39:03.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[24237]: audit 2024-02-13T00:39:01.834376+0000 mon.a (mon.0) 1289 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi080-54175-26"}]: dispatch 2024-02-13T00:39:03.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[24237]: audit 2024-02-13T00:39:01.834921+0000 mon.a (mon.0) 1290 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi080-54175-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:03.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[24237]: audit 2024-02-13T00:39:01.911934+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:39:03.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[24237]: cluster 2024-02-13T00:39:02.161845+0000 mgr.y (mgr.24461) 379 : cluster [DBG] pgmap v349: 324 pgs: 64 unknown, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:39:03.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[24237]: audit 2024-02-13T00:39:02.798949+0000 mon.a (mon.0) 1292 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]': finished 2024-02-13T00:39:03.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[24237]: audit 2024-02-13T00:39:02.799235+0000 mon.a (mon.0) 1293 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi080-54175-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:03.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[24237]: cluster 2024-02-13T00:39:02.799522+0000 mon.a (mon.0) 1294 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2024-02-13T00:39:03.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[24237]: audit 2024-02-13T00:39:02.800123+0000 mon.c (mon.2) 211 : audit [INF] from='client.? 172.21.15.80:0/1129214965' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:39:03.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[24237]: audit 2024-02-13T00:39:02.801437+0000 mon.a (mon.0) 1295 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi080-54175-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi080-54175-26"}]: dispatch 2024-02-13T00:39:03.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[24237]: audit 2024-02-13T00:39:02.802414+0000 mon.a (mon.0) 1296 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:39:03.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[24237]: audit 2024-02-13T00:39:02.820623+0000 mon.a (mon.0) 1297 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:03.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[17386]: audit 2024-02-13T00:39:01.819569+0000 mon.a (mon.0) 1287 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:03.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[17386]: audit 2024-02-13T00:39:01.831582+0000 mon.a (mon.0) 1288 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi080-54175-26"}]: dispatch 2024-02-13T00:39:03.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[17386]: audit 2024-02-13T00:39:01.834376+0000 mon.a (mon.0) 1289 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi080-54175-26"}]: dispatch 2024-02-13T00:39:03.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[17386]: audit 2024-02-13T00:39:01.834921+0000 mon.a (mon.0) 1290 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi080-54175-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:03.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[17386]: audit 2024-02-13T00:39:01.911934+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:39:03.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[17386]: cluster 2024-02-13T00:39:02.161845+0000 mgr.y (mgr.24461) 379 : cluster [DBG] pgmap v349: 324 pgs: 64 unknown, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:39:03.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[17386]: audit 2024-02-13T00:39:02.798949+0000 mon.a (mon.0) 1292 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]': finished 2024-02-13T00:39:03.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[17386]: audit 2024-02-13T00:39:02.799235+0000 mon.a (mon.0) 1293 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi080-54175-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:03.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[17386]: cluster 2024-02-13T00:39:02.799522+0000 mon.a (mon.0) 1294 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2024-02-13T00:39:03.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[17386]: audit 2024-02-13T00:39:02.800123+0000 mon.c (mon.2) 211 : audit [INF] from='client.? 172.21.15.80:0/1129214965' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:39:03.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[17386]: audit 2024-02-13T00:39:02.801437+0000 mon.a (mon.0) 1295 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi080-54175-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi080-54175-26"}]: dispatch 2024-02-13T00:39:03.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[17386]: audit 2024-02-13T00:39:02.802414+0000 mon.a (mon.0) 1296 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:39:03.119 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:02 smithi080 bash[17386]: audit 2024-02-13T00:39:02.820623+0000 mon.a (mon.0) 1297 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:03.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:02 smithi106 bash[18459]: audit 2024-02-13T00:39:01.819569+0000 mon.a (mon.0) 1287 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:03.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:02 smithi106 bash[18459]: audit 2024-02-13T00:39:01.831582+0000 mon.a (mon.0) 1288 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi080-54175-26"}]: dispatch 2024-02-13T00:39:03.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:02 smithi106 bash[18459]: audit 2024-02-13T00:39:01.834376+0000 mon.a (mon.0) 1289 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi080-54175-26"}]: dispatch 2024-02-13T00:39:03.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:02 smithi106 bash[18459]: audit 2024-02-13T00:39:01.834921+0000 mon.a (mon.0) 1290 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi080-54175-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:03.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:02 smithi106 bash[18459]: audit 2024-02-13T00:39:01.911934+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:39:03.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:02 smithi106 bash[18459]: cluster 2024-02-13T00:39:02.161845+0000 mgr.y (mgr.24461) 379 : cluster [DBG] pgmap v349: 324 pgs: 64 unknown, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:39:03.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:02 smithi106 bash[18459]: audit 2024-02-13T00:39:02.798949+0000 mon.a (mon.0) 1292 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi080-54454-15"}]': finished 2024-02-13T00:39:03.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:02 smithi106 bash[18459]: audit 2024-02-13T00:39:02.799235+0000 mon.a (mon.0) 1293 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi080-54175-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:03.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:02 smithi106 bash[18459]: cluster 2024-02-13T00:39:02.799522+0000 mon.a (mon.0) 1294 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2024-02-13T00:39:03.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:02 smithi106 bash[18459]: audit 2024-02-13T00:39:02.800123+0000 mon.c (mon.2) 211 : audit [INF] from='client.? 172.21.15.80:0/1129214965' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:39:03.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:02 smithi106 bash[18459]: audit 2024-02-13T00:39:02.801437+0000 mon.a (mon.0) 1295 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi080-54175-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi080-54175-26"}]: dispatch 2024-02-13T00:39:03.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:02 smithi106 bash[18459]: audit 2024-02-13T00:39:02.802414+0000 mon.a (mon.0) 1296 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi080-54454-15"}]: dispatch 2024-02-13T00:39:03.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:02 smithi106 bash[18459]: audit 2024-02-13T00:39:02.820623+0000 mon.a (mon.0) 1297 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:03.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:39:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:39:03] "GET /metrics HTTP/1.1" 200 191930 "" "Prometheus/2.33.4" 2024-02-13T00:39:04.240 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP api_snapshots_pp: Running main() from gmock_main.cc 2024-02-13T00:39:04.241 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [==========] Running 20 tests from 5 test suites. 2024-02-13T00:39:04.241 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2024-02-13T00:39:04.241 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2024-02-13T00:39:04.241 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: seed 54454 2024-02-13T00:39:04.241 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-02-13T00:39:04.241 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (4312 ms) 2024-02-13T00:39:04.241 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-02-13T00:39:04.241 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (4190 ms) 2024-02-13T00:39:04.241 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-02-13T00:39:04.241 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (4151 ms) 2024-02-13T00:39:04.241 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-02-13T00:39:04.241 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (3459 ms) 2024-02-13T00:39:04.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-02-13T00:39:04.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4264 ms) 2024-02-13T00:39:04.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (20377 ms total) 2024-02-13T00:39:04.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: 2024-02-13T00:39:04.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [----------] 6 tests from LibRadosSnapshotsSelfManagedPP 2024-02-13T00:39:04.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-02-13T00:39:04.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (5010 ms) 2024-02-13T00:39:04.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-02-13T00:39:04.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (4974 ms) 2024-02-13T00:39:04.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-02-13T00:39:04.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (6145 ms) 2024-02-13T00:39:04.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-02-13T00:39:04.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (4218 ms) 2024-02-13T00:39:04.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-02-13T00:39:04.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (1637 ms) 2024-02-13T00:39:04.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-02-13T00:39:04.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: deleting snap 23 in pool LibRadosSnapshotsSelfManagedPP_smithi080-54454-7 2024-02-13T00:39:04.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: waiting for snaps to purge 2024-02-13T00:39:04.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17926 ms) 2024-02-13T00:39:04.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [----------] 6 tests from LibRadosSnapshotsSelfManagedPP (39910 ms total) 2024-02-13T00:39:04.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: 2024-02-13T00:39:04.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-02-13T00:39:04.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-02-13T00:39:04.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (16 ms) 2024-02-13T00:39:04.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-02-13T00:39:04.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5050 ms) 2024-02-13T00:39:04.244 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5066 ms total) 2024-02-13T00:39:04.244 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: 2024-02-13T00:39:04.244 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2024-02-13T00:39:04.244 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-02-13T00:39:04.244 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3023 ms) 2024-02-13T00:39:04.244 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-02-13T00:39:04.244 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (2006 ms) 2024-02-13T00:39:04.244 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-02-13T00:39:04.244 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (2004 ms) 2024-02-13T00:39:04.244 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-02-13T00:39:04.244 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (2015 ms) 2024-02-13T00:39:04.244 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (9048 ms total) 2024-02-13T00:39:04.245 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: 2024-02-13T00:39:05.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:04 smithi106 bash[18459]: cluster 2024-02-13T00:39:04.162675+0000 mgr.y (mgr.24461) 380 : cluster [DBG] pgmap v352: 324 pgs: 64 unknown, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:39:05.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:04 smithi106 bash[18459]: audit 2024-02-13T00:39:04.234714+0000 mon.a (mon.0) 1298 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi080-54454-15"}]': finished 2024-02-13T00:39:05.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:04 smithi106 bash[18459]: cluster 2024-02-13T00:39:04.234824+0000 mon.a (mon.0) 1299 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2024-02-13T00:39:05.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:04 smithi106 bash[18459]: audit 2024-02-13T00:39:04.236600+0000 mon.c (mon.2) 212 : audit [INF] from='client.? 172.21.15.80:0/95529814' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi080-54183-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:05.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:04 smithi106 bash[18459]: audit 2024-02-13T00:39:04.236956+0000 mon.c (mon.2) 213 : audit [INF] from='client.? 172.21.15.80:0/1529374666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi080-54247-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:05.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:04 smithi106 bash[18459]: audit 2024-02-13T00:39:04.237163+0000 mon.a (mon.0) 1300 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:05.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:04 smithi106 bash[18459]: audit 2024-02-13T00:39:04.244063+0000 mon.a (mon.0) 1301 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi080-54183-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:05.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:04 smithi106 bash[18459]: audit 2024-02-13T00:39:04.244590+0000 mon.a (mon.0) 1302 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi080-54247-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:05.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:04 smithi106 bash[18459]: audit 2024-02-13T00:39:04.256432+0000 mon.a (mon.0) 1303 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]: dispatch 2024-02-13T00:39:05.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:04 smithi106 bash[18459]: audit 2024-02-13T00:39:04.257150+0000 mon.a (mon.0) 1304 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]: dispatch 2024-02-13T00:39:05.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:04 smithi106 bash[18459]: audit 2024-02-13T00:39:04.257548+0000 mon.a (mon.0) 1305 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:05.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:04 smithi080 bash[17386]: cluster 2024-02-13T00:39:04.162675+0000 mgr.y (mgr.24461) 380 : cluster [DBG] pgmap v352: 324 pgs: 64 unknown, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:39:05.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:04 smithi080 bash[17386]: audit 2024-02-13T00:39:04.234714+0000 mon.a (mon.0) 1298 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi080-54454-15"}]': finished 2024-02-13T00:39:05.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:04 smithi080 bash[17386]: cluster 2024-02-13T00:39:04.234824+0000 mon.a (mon.0) 1299 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2024-02-13T00:39:05.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:04 smithi080 bash[17386]: audit 2024-02-13T00:39:04.236600+0000 mon.c (mon.2) 212 : audit [INF] from='client.? 172.21.15.80:0/95529814' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi080-54183-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:05.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:04 smithi080 bash[17386]: audit 2024-02-13T00:39:04.236956+0000 mon.c (mon.2) 213 : audit [INF] from='client.? 172.21.15.80:0/1529374666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi080-54247-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:05.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:04 smithi080 bash[17386]: audit 2024-02-13T00:39:04.237163+0000 mon.a (mon.0) 1300 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:05.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:04 smithi080 bash[17386]: audit 2024-02-13T00:39:04.244063+0000 mon.a (mon.0) 1301 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi080-54183-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:05.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:04 smithi080 bash[17386]: audit 2024-02-13T00:39:04.244590+0000 mon.a (mon.0) 1302 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi080-54247-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:05.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:04 smithi080 bash[17386]: audit 2024-02-13T00:39:04.256432+0000 mon.a (mon.0) 1303 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]: dispatch 2024-02-13T00:39:05.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:04 smithi080 bash[17386]: audit 2024-02-13T00:39:04.257150+0000 mon.a (mon.0) 1304 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]: dispatch 2024-02-13T00:39:05.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:04 smithi080 bash[17386]: audit 2024-02-13T00:39:04.257548+0000 mon.a (mon.0) 1305 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:05.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:04 smithi080 bash[24237]: cluster 2024-02-13T00:39:04.162675+0000 mgr.y (mgr.24461) 380 : cluster [DBG] pgmap v352: 324 pgs: 64 unknown, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:39:05.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:04 smithi080 bash[24237]: audit 2024-02-13T00:39:04.234714+0000 mon.a (mon.0) 1298 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi080-54454-15"}]': finished 2024-02-13T00:39:05.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:04 smithi080 bash[24237]: cluster 2024-02-13T00:39:04.234824+0000 mon.a (mon.0) 1299 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2024-02-13T00:39:05.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:04 smithi080 bash[24237]: audit 2024-02-13T00:39:04.236600+0000 mon.c (mon.2) 212 : audit [INF] from='client.? 172.21.15.80:0/95529814' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi080-54183-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:05.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:04 smithi080 bash[24237]: audit 2024-02-13T00:39:04.236956+0000 mon.c (mon.2) 213 : audit [INF] from='client.? 172.21.15.80:0/1529374666' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi080-54247-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:05.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:04 smithi080 bash[24237]: audit 2024-02-13T00:39:04.237163+0000 mon.a (mon.0) 1300 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:05.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:04 smithi080 bash[24237]: audit 2024-02-13T00:39:04.244063+0000 mon.a (mon.0) 1301 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi080-54183-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:05.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:04 smithi080 bash[24237]: audit 2024-02-13T00:39:04.244590+0000 mon.a (mon.0) 1302 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi080-54247-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:05.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:04 smithi080 bash[24237]: audit 2024-02-13T00:39:04.256432+0000 mon.a (mon.0) 1303 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]: dispatch 2024-02-13T00:39:05.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:04 smithi080 bash[24237]: audit 2024-02-13T00:39:04.257150+0000 mon.a (mon.0) 1304 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]: dispatch 2024-02-13T00:39:05.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:04 smithi080 bash[24237]: audit 2024-02-13T00:39:04.257548+0000 mon.a (mon.0) 1305 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:06 smithi106 bash[18459]: audit 2024-02-13T00:39:04.807305+0000 mon.a (mon.0) 1306 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi080-54175-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi080-54175-26"}]': finished 2024-02-13T00:39:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:06 smithi106 bash[18459]: audit 2024-02-13T00:39:04.807638+0000 mon.a (mon.0) 1307 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi080-54183-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:06.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:06 smithi106 bash[18459]: audit 2024-02-13T00:39:04.807749+0000 mon.a (mon.0) 1308 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi080-54247-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:06.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:06 smithi106 bash[18459]: audit 2024-02-13T00:39:04.807857+0000 mon.a (mon.0) 1309 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:06.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:06 smithi106 bash[18459]: cluster 2024-02-13T00:39:04.807935+0000 mon.a (mon.0) 1310 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2024-02-13T00:39:06.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:06 smithi106 bash[18459]: audit 2024-02-13T00:39:04.815310+0000 mon.a (mon.0) 1311 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]: dispatch 2024-02-13T00:39:06.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:06 smithi106 bash[18459]: audit 2024-02-13T00:39:05.240895+0000 mon.a (mon.0) 1312 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:06 smithi080 bash[17386]: audit 2024-02-13T00:39:04.807305+0000 mon.a (mon.0) 1306 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi080-54175-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi080-54175-26"}]': finished 2024-02-13T00:39:06.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:06 smithi080 bash[17386]: audit 2024-02-13T00:39:04.807638+0000 mon.a (mon.0) 1307 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi080-54183-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:06.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:06 smithi080 bash[17386]: audit 2024-02-13T00:39:04.807749+0000 mon.a (mon.0) 1308 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi080-54247-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:06.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:06 smithi080 bash[17386]: audit 2024-02-13T00:39:04.807857+0000 mon.a (mon.0) 1309 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:06.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:06 smithi080 bash[17386]: cluster 2024-02-13T00:39:04.807935+0000 mon.a (mon.0) 1310 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2024-02-13T00:39:06.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:06 smithi080 bash[17386]: audit 2024-02-13T00:39:04.815310+0000 mon.a (mon.0) 1311 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]: dispatch 2024-02-13T00:39:06.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:06 smithi080 bash[17386]: audit 2024-02-13T00:39:05.240895+0000 mon.a (mon.0) 1312 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:06.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:06 smithi080 bash[24237]: audit 2024-02-13T00:39:04.807305+0000 mon.a (mon.0) 1306 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi080-54175-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi080-54175-26"}]': finished 2024-02-13T00:39:06.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:06 smithi080 bash[24237]: audit 2024-02-13T00:39:04.807638+0000 mon.a (mon.0) 1307 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi080-54183-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:06.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:06 smithi080 bash[24237]: audit 2024-02-13T00:39:04.807749+0000 mon.a (mon.0) 1308 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi080-54247-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:06.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:06 smithi080 bash[24237]: audit 2024-02-13T00:39:04.807857+0000 mon.a (mon.0) 1309 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:06.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:06 smithi080 bash[24237]: cluster 2024-02-13T00:39:04.807935+0000 mon.a (mon.0) 1310 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2024-02-13T00:39:06.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:06 smithi080 bash[24237]: audit 2024-02-13T00:39:04.815310+0000 mon.a (mon.0) 1311 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]: dispatch 2024-02-13T00:39:06.512 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:06 smithi080 bash[24237]: audit 2024-02-13T00:39:05.240895+0000 mon.a (mon.0) 1312 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:07 smithi080 bash[17386]: cluster 2024-02-13T00:39:06.163500+0000 mgr.y (mgr.24461) 381 : cluster [DBG] pgmap v355: 268 pgs: 8 unknown, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:39:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:07 smithi080 bash[17386]: cluster 2024-02-13T00:39:06.244640+0000 mon.a (mon.0) 1313 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2024-02-13T00:39:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:07 smithi080 bash[17386]: audit 2024-02-13T00:39:06.248203+0000 mon.a (mon.0) 1314 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:07 smithi080 bash[17386]: cluster 2024-02-13T00:39:07.159598+0000 mon.a (mon.0) 1315 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:39:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:07 smithi080 bash[17386]: audit 2024-02-13T00:39:07.173245+0000 mon.a (mon.0) 1316 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]': finished 2024-02-13T00:39:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:07 smithi080 bash[17386]: cluster 2024-02-13T00:39:07.173576+0000 mon.a (mon.0) 1317 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2024-02-13T00:39:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:07 smithi080 bash[17386]: audit 2024-02-13T00:39:07.176672+0000 mon.c (mon.2) 214 : audit [INF] from='client.? 172.21.15.80:0/800756146' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi080-54183-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:07.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:07 smithi080 bash[17386]: audit 2024-02-13T00:39:07.185658+0000 mon.a (mon.0) 1318 : audit [INF] from='client.? 172.21.15.80:0/1706022307' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi080-54247-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:07.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:07 smithi080 bash[17386]: audit 2024-02-13T00:39:07.186007+0000 mon.a (mon.0) 1319 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi080-54183-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:07.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:07 smithi080 bash[17386]: audit 2024-02-13T00:39:07.190127+0000 mon.a (mon.0) 1320 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi080-54175-26"}]: dispatch 2024-02-13T00:39:07.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:07 smithi080 bash[24237]: cluster 2024-02-13T00:39:06.163500+0000 mgr.y (mgr.24461) 381 : cluster [DBG] pgmap v355: 268 pgs: 8 unknown, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:39:07.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:07 smithi080 bash[24237]: cluster 2024-02-13T00:39:06.244640+0000 mon.a (mon.0) 1313 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2024-02-13T00:39:07.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:07 smithi080 bash[24237]: audit 2024-02-13T00:39:06.248203+0000 mon.a (mon.0) 1314 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:07.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:07 smithi080 bash[24237]: cluster 2024-02-13T00:39:07.159598+0000 mon.a (mon.0) 1315 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:39:07.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:07 smithi080 bash[24237]: audit 2024-02-13T00:39:07.173245+0000 mon.a (mon.0) 1316 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]': finished 2024-02-13T00:39:07.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:07 smithi080 bash[24237]: cluster 2024-02-13T00:39:07.173576+0000 mon.a (mon.0) 1317 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2024-02-13T00:39:07.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:07 smithi080 bash[24237]: audit 2024-02-13T00:39:07.176672+0000 mon.c (mon.2) 214 : audit [INF] from='client.? 172.21.15.80:0/800756146' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi080-54183-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:07.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:07 smithi080 bash[24237]: audit 2024-02-13T00:39:07.185658+0000 mon.a (mon.0) 1318 : audit [INF] from='client.? 172.21.15.80:0/1706022307' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi080-54247-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:07.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:07 smithi080 bash[24237]: audit 2024-02-13T00:39:07.186007+0000 mon.a (mon.0) 1319 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi080-54183-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:07.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:07 smithi080 bash[24237]: audit 2024-02-13T00:39:07.190127+0000 mon.a (mon.0) 1320 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi080-54175-26"}]: dispatch 2024-02-13T00:39:07.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:07 smithi106 bash[18459]: cluster 2024-02-13T00:39:06.163500+0000 mgr.y (mgr.24461) 381 : cluster [DBG] pgmap v355: 268 pgs: 8 unknown, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:39:07.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:07 smithi106 bash[18459]: cluster 2024-02-13T00:39:06.244640+0000 mon.a (mon.0) 1313 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2024-02-13T00:39:07.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:07 smithi106 bash[18459]: audit 2024-02-13T00:39:06.248203+0000 mon.a (mon.0) 1314 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:07.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:07 smithi106 bash[18459]: cluster 2024-02-13T00:39:07.159598+0000 mon.a (mon.0) 1315 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:39:07.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:07 smithi106 bash[18459]: audit 2024-02-13T00:39:07.173245+0000 mon.a (mon.0) 1316 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]': finished 2024-02-13T00:39:07.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:07 smithi106 bash[18459]: cluster 2024-02-13T00:39:07.173576+0000 mon.a (mon.0) 1317 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2024-02-13T00:39:07.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:07 smithi106 bash[18459]: audit 2024-02-13T00:39:07.176672+0000 mon.c (mon.2) 214 : audit [INF] from='client.? 172.21.15.80:0/800756146' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi080-54183-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:07.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:07 smithi106 bash[18459]: audit 2024-02-13T00:39:07.185658+0000 mon.a (mon.0) 1318 : audit [INF] from='client.? 172.21.15.80:0/1706022307' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi080-54247-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:07.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:07 smithi106 bash[18459]: audit 2024-02-13T00:39:07.186007+0000 mon.a (mon.0) 1319 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi080-54183-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:07.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:07 smithi106 bash[18459]: audit 2024-02-13T00:39:07.190127+0000 mon.a (mon.0) 1320 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi080-54175-26"}]: dispatch 2024-02-13T00:39:08.505 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:39:08 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:39:08.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:08 smithi106 bash[18459]: audit 2024-02-13T00:39:07.250318+0000 mon.a (mon.0) 1321 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:08.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:08 smithi106 bash[18459]: audit 2024-02-13T00:39:08.156423+0000 mgr.y (mgr.24461) 382 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:39:08.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:08 smithi106 bash[18459]: audit 2024-02-13T00:39:08.176418+0000 mon.a (mon.0) 1322 : audit [INF] from='client.? 172.21.15.80:0/1706022307' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi080-54247-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:08.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:08 smithi106 bash[18459]: audit 2024-02-13T00:39:08.176523+0000 mon.a (mon.0) 1323 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi080-54183-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:08.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:08 smithi106 bash[18459]: audit 2024-02-13T00:39:08.176681+0000 mon.a (mon.0) 1324 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi080-54175-26"}]': finished 2024-02-13T00:39:08.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:08 smithi106 bash[18459]: cluster 2024-02-13T00:39:08.176851+0000 mon.a (mon.0) 1325 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2024-02-13T00:39:08.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:08 smithi106 bash[18459]: audit 2024-02-13T00:39:08.178963+0000 mon.a (mon.0) 1326 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi080-54175-26"}]: dispatch 2024-02-13T00:39:08.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:08 smithi080 bash[17386]: audit 2024-02-13T00:39:07.250318+0000 mon.a (mon.0) 1321 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:08.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:08 smithi080 bash[17386]: audit 2024-02-13T00:39:08.156423+0000 mgr.y (mgr.24461) 382 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:39:08.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:08 smithi080 bash[17386]: audit 2024-02-13T00:39:08.176418+0000 mon.a (mon.0) 1322 : audit [INF] from='client.? 172.21.15.80:0/1706022307' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi080-54247-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:08 smithi080 bash[17386]: audit 2024-02-13T00:39:08.176523+0000 mon.a (mon.0) 1323 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi080-54183-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:08 smithi080 bash[17386]: audit 2024-02-13T00:39:08.176681+0000 mon.a (mon.0) 1324 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi080-54175-26"}]': finished 2024-02-13T00:39:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:08 smithi080 bash[17386]: cluster 2024-02-13T00:39:08.176851+0000 mon.a (mon.0) 1325 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2024-02-13T00:39:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:08 smithi080 bash[17386]: audit 2024-02-13T00:39:08.178963+0000 mon.a (mon.0) 1326 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi080-54175-26"}]: dispatch 2024-02-13T00:39:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:08 smithi080 bash[24237]: audit 2024-02-13T00:39:07.250318+0000 mon.a (mon.0) 1321 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:08 smithi080 bash[24237]: audit 2024-02-13T00:39:08.156423+0000 mgr.y (mgr.24461) 382 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:39:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:08 smithi080 bash[24237]: audit 2024-02-13T00:39:08.176418+0000 mon.a (mon.0) 1322 : audit [INF] from='client.? 172.21.15.80:0/1706022307' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi080-54247-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:08 smithi080 bash[24237]: audit 2024-02-13T00:39:08.176523+0000 mon.a (mon.0) 1323 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi080-54183-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:08 smithi080 bash[24237]: audit 2024-02-13T00:39:08.176681+0000 mon.a (mon.0) 1324 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi080-54175-26"}]': finished 2024-02-13T00:39:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:08 smithi080 bash[24237]: cluster 2024-02-13T00:39:08.176851+0000 mon.a (mon.0) 1325 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2024-02-13T00:39:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:08 smithi080 bash[24237]: audit 2024-02-13T00:39:08.178963+0000 mon.a (mon.0) 1326 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi080-54175-26"}]: dispatch 2024-02-13T00:39:09.199 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_p api_aio: Running main() from gmock_main.cc 2024-02-13T00:39:09.200 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [==========] Running 41 tests from 2 test suites. 2024-02-13T00:39:09.200 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [----------] Global test environment set-up. 2024-02-13T00:39:09.200 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [----------] 25 tests from LibRadosAio 2024-02-13T00:39:09.200 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2024-02-13T00:39:09.200 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.TooBig (11247 ms) 2024-02-13T00:39:09.200 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2024-02-13T00:39:09.200 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (7607 ms) 2024-02-13T00:39:09.200 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2024-02-13T00:39:09.200 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (5045 ms) 2024-02-13T00:39:09.200 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2024-02-13T00:39:09.200 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (3458 ms) 2024-02-13T00:39:09.200 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2024-02-13T00:39:09.200 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (3030 ms) 2024-02-13T00:39:09.201 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2024-02-13T00:39:09.201 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (3380 ms) 2024-02-13T00:39:09.201 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2024-02-13T00:39:09.201 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (3423 ms) 2024-02-13T00:39:09.201 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2024-02-13T00:39:09.201 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (4348 ms) 2024-02-13T00:39:09.201 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2024-02-13T00:39:09.201 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (3420 ms) 2024-02-13T00:39:09.201 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2024-02-13T00:39:09.201 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (2879 ms) 2024-02-13T00:39:09.201 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2024-02-13T00:39:09.201 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (3220 ms) 2024-02-13T00:39:09.201 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2024-02-13T00:39:09.201 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (2769 ms) 2024-02-13T00:39:09.201 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2024-02-13T00:39:09.202 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (3026 ms) 2024-02-13T00:39:09.202 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2024-02-13T00:39:09.202 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (2987 ms) 2024-02-13T00:39:09.202 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2024-02-13T00:39:09.202 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.Flush (2992 ms) 2024-02-13T00:39:09.202 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2024-02-13T00:39:09.202 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (3009 ms) 2024-02-13T00:39:09.202 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2024-02-13T00:39:09.202 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (3021 ms) 2024-02-13T00:39:09.202 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2024-02-13T00:39:09.202 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3004 ms) 2024-02-13T00:39:09.202 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2024-02-13T00:39:09.202 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3016 ms) 2024-02-13T00:39:09.202 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2024-02-13T00:39:09.202 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (3012 ms) 2024-02-13T00:39:09.202 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2024-02-13T00:39:09.203 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (3010 ms) 2024-02-13T00:39:09.203 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2024-02-13T00:39:09.203 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (3007 ms) 2024-02-13T00:39:09.203 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2024-02-13T00:39:09.203 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3024 ms) 2024-02-13T00:39:09.203 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2024-02-13T00:39:09.203 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (3005 ms) 2024-02-13T00:39:09.203 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2024-02-13T00:39:09.203 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (2904 ms) 2024-02-13T00:39:09.203 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [----------] 25 tests from LibRadosAio (92845 ms total) 2024-02-13T00:39:09.203 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: 2024-02-13T00:39:09.203 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2024-02-13T00:39:09.203 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2024-02-13T00:39:09.203 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (7414 ms) 2024-02-13T00:39:10.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:09 smithi106 bash[18459]: cluster 2024-02-13T00:39:08.166550+0000 mgr.y (mgr.24461) 383 : cluster [DBG] pgmap v357: 332 pgs: 72 creating+peering, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-13T00:39:10.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:09 smithi106 bash[18459]: audit 2024-02-13T00:39:08.251644+0000 mon.a (mon.0) 1327 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:10.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:09 smithi106 bash[18459]: audit 2024-02-13T00:39:09.183119+0000 mon.a (mon.0) 1328 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi080-54175-26"}]': finished 2024-02-13T00:39:10.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:09 smithi106 bash[18459]: cluster 2024-02-13T00:39:09.183391+0000 mon.a (mon.0) 1329 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2024-02-13T00:39:10.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:09 smithi080 bash[17386]: cluster 2024-02-13T00:39:08.166550+0000 mgr.y (mgr.24461) 383 : cluster [DBG] pgmap v357: 332 pgs: 72 creating+peering, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-13T00:39:10.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:09 smithi080 bash[17386]: audit 2024-02-13T00:39:08.251644+0000 mon.a (mon.0) 1327 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:10.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:09 smithi080 bash[17386]: audit 2024-02-13T00:39:09.183119+0000 mon.a (mon.0) 1328 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi080-54175-26"}]': finished 2024-02-13T00:39:10.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:09 smithi080 bash[17386]: cluster 2024-02-13T00:39:09.183391+0000 mon.a (mon.0) 1329 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2024-02-13T00:39:10.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:09 smithi080 bash[24237]: cluster 2024-02-13T00:39:08.166550+0000 mgr.y (mgr.24461) 383 : cluster [DBG] pgmap v357: 332 pgs: 72 creating+peering, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-13T00:39:10.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:09 smithi080 bash[24237]: audit 2024-02-13T00:39:08.251644+0000 mon.a (mon.0) 1327 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:10.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:09 smithi080 bash[24237]: audit 2024-02-13T00:39:09.183119+0000 mon.a (mon.0) 1328 : audit [INF] from='client.? 172.21.15.80:0/2746630210' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi080-54175-26"}]': finished 2024-02-13T00:39:10.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:09 smithi080 bash[24237]: cluster 2024-02-13T00:39:09.183391+0000 mon.a (mon.0) 1329 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2024-02-13T00:39:10.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:39:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:39:11.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[18459]: audit 2024-02-13T00:39:09.239822+0000 mon.c (mon.2) 215 : audit [INF] from='client.? 172.21.15.80:0/3054591355' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:11.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[18459]: audit 2024-02-13T00:39:09.242315+0000 mon.c (mon.2) 216 : audit [INF] from='client.? 172.21.15.80:0/2954931417' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:11.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[18459]: audit 2024-02-13T00:39:09.693565+0000 mon.a (mon.0) 1330 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:11.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[18459]: audit 2024-02-13T00:39:09.694108+0000 mon.a (mon.0) 1331 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:11.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[18459]: audit 2024-02-13T00:39:09.694802+0000 mon.c (mon.2) 217 : audit [INF] from='client.? 172.21.15.80:0/3054591355' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:11.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[18459]: audit 2024-02-13T00:39:09.699701+0000 mon.a (mon.0) 1332 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:11.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[18459]: audit 2024-02-13T00:39:09.700205+0000 mon.a (mon.0) 1333 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:11.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[18459]: audit 2024-02-13T00:39:09.700563+0000 mon.c (mon.2) 218 : audit [INF] from='client.? 172.21.15.80:0/2954931417' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:11.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[18459]: audit 2024-02-13T00:39:09.700865+0000 mon.a (mon.0) 1334 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:11.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[18459]: audit 2024-02-13T00:39:09.700871+0000 mon.c (mon.2) 219 : audit [INF] from='client.? 172.21.15.80:0/3054591355' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi080-54175-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:11.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[18459]: audit 2024-02-13T00:39:09.701251+0000 mon.a (mon.0) 1335 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi080-54175-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:11.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[18459]: audit 2024-02-13T00:39:09.701433+0000 mon.c (mon.2) 220 : audit [INF] from='client.? 172.21.15.80:0/2954931417' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:11.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[18459]: audit 2024-02-13T00:39:09.701722+0000 mon.a (mon.0) 1336 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:11.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[18459]: audit 2024-02-13T00:39:10.187573+0000 mon.a (mon.0) 1337 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi080-54175-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:11.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[18459]: audit 2024-02-13T00:39:10.187700+0000 mon.a (mon.0) 1338 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:11.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[18459]: cluster 2024-02-13T00:39:10.187783+0000 mon.a (mon.0) 1339 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2024-02-13T00:39:11.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[18459]: audit 2024-02-13T00:39:10.190675+0000 mon.c (mon.2) 221 : audit [INF] from='client.? 172.21.15.80:0/3054591355' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi080-54175-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:11.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[18459]: audit 2024-02-13T00:39:10.191074+0000 mon.c (mon.2) 222 : audit [INF] from='client.? 172.21.15.80:0/2954931417' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi080-54247-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:11.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[18459]: audit 2024-02-13T00:39:10.191782+0000 mon.c (mon.2) 223 : audit [INF] from='client.? 172.21.15.80:0/3731165108' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi080-54183-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:11.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[18459]: audit 2024-02-13T00:39:10.192912+0000 mon.a (mon.0) 1340 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi080-54175-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:11.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[18459]: audit 2024-02-13T00:39:10.193940+0000 mon.a (mon.0) 1341 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi080-54247-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:11.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:10 smithi106 bash[18459]: audit 2024-02-13T00:39:10.195509+0000 mon.a (mon.0) 1342 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi080-54183-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:11.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[17386]: audit 2024-02-13T00:39:09.239822+0000 mon.c (mon.2) 215 : audit [INF] from='client.? 172.21.15.80:0/3054591355' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:11.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[17386]: audit 2024-02-13T00:39:09.242315+0000 mon.c (mon.2) 216 : audit [INF] from='client.? 172.21.15.80:0/2954931417' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:11.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[17386]: audit 2024-02-13T00:39:09.693565+0000 mon.a (mon.0) 1330 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:11.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[17386]: audit 2024-02-13T00:39:09.694108+0000 mon.a (mon.0) 1331 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:11.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[17386]: audit 2024-02-13T00:39:09.694802+0000 mon.c (mon.2) 217 : audit [INF] from='client.? 172.21.15.80:0/3054591355' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:11.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[17386]: audit 2024-02-13T00:39:09.699701+0000 mon.a (mon.0) 1332 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:11.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[17386]: audit 2024-02-13T00:39:09.700205+0000 mon.a (mon.0) 1333 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:11.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[17386]: audit 2024-02-13T00:39:09.700563+0000 mon.c (mon.2) 218 : audit [INF] from='client.? 172.21.15.80:0/2954931417' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:11.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[17386]: audit 2024-02-13T00:39:09.700865+0000 mon.a (mon.0) 1334 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:11.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[17386]: audit 2024-02-13T00:39:09.700871+0000 mon.c (mon.2) 219 : audit [INF] from='client.? 172.21.15.80:0/3054591355' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi080-54175-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:11.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[17386]: audit 2024-02-13T00:39:09.701251+0000 mon.a (mon.0) 1335 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi080-54175-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:11.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[17386]: audit 2024-02-13T00:39:09.701433+0000 mon.c (mon.2) 220 : audit [INF] from='client.? 172.21.15.80:0/2954931417' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:11.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[17386]: audit 2024-02-13T00:39:09.701722+0000 mon.a (mon.0) 1336 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:11.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[17386]: audit 2024-02-13T00:39:10.187573+0000 mon.a (mon.0) 1337 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi080-54175-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:11.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[24237]: audit 2024-02-13T00:39:09.239822+0000 mon.c (mon.2) 215 : audit [INF] from='client.? 172.21.15.80:0/3054591355' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:11.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[24237]: audit 2024-02-13T00:39:09.242315+0000 mon.c (mon.2) 216 : audit [INF] from='client.? 172.21.15.80:0/2954931417' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:11.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[24237]: audit 2024-02-13T00:39:09.693565+0000 mon.a (mon.0) 1330 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:11.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[24237]: audit 2024-02-13T00:39:09.694108+0000 mon.a (mon.0) 1331 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:11.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[24237]: audit 2024-02-13T00:39:09.694802+0000 mon.c (mon.2) 217 : audit [INF] from='client.? 172.21.15.80:0/3054591355' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:11.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[24237]: audit 2024-02-13T00:39:09.699701+0000 mon.a (mon.0) 1332 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:11.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[24237]: audit 2024-02-13T00:39:09.700205+0000 mon.a (mon.0) 1333 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:11.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[24237]: audit 2024-02-13T00:39:09.700563+0000 mon.c (mon.2) 218 : audit [INF] from='client.? 172.21.15.80:0/2954931417' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:11.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[24237]: audit 2024-02-13T00:39:09.700865+0000 mon.a (mon.0) 1334 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:11.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[24237]: audit 2024-02-13T00:39:09.700871+0000 mon.c (mon.2) 219 : audit [INF] from='client.? 172.21.15.80:0/3054591355' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi080-54175-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:11.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[24237]: audit 2024-02-13T00:39:09.701251+0000 mon.a (mon.0) 1335 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi080-54175-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:11.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[24237]: audit 2024-02-13T00:39:09.701433+0000 mon.c (mon.2) 220 : audit [INF] from='client.? 172.21.15.80:0/2954931417' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:11.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[24237]: audit 2024-02-13T00:39:09.701722+0000 mon.a (mon.0) 1336 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:11.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[24237]: audit 2024-02-13T00:39:10.187573+0000 mon.a (mon.0) 1337 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi080-54175-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:11.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[17386]: audit 2024-02-13T00:39:10.187700+0000 mon.a (mon.0) 1338 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:11.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[17386]: cluster 2024-02-13T00:39:10.187783+0000 mon.a (mon.0) 1339 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2024-02-13T00:39:11.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[17386]: audit 2024-02-13T00:39:10.190675+0000 mon.c (mon.2) 221 : audit [INF] from='client.? 172.21.15.80:0/3054591355' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi080-54175-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:11.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[17386]: audit 2024-02-13T00:39:10.191074+0000 mon.c (mon.2) 222 : audit [INF] from='client.? 172.21.15.80:0/2954931417' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi080-54247-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:11.013 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[17386]: audit 2024-02-13T00:39:10.191782+0000 mon.c (mon.2) 223 : audit [INF] from='client.? 172.21.15.80:0/3731165108' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi080-54183-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:11.013 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[17386]: audit 2024-02-13T00:39:10.192912+0000 mon.a (mon.0) 1340 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi080-54175-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:11.013 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[17386]: audit 2024-02-13T00:39:10.193940+0000 mon.a (mon.0) 1341 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi080-54247-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:11.013 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[17386]: audit 2024-02-13T00:39:10.195509+0000 mon.a (mon.0) 1342 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi080-54183-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:11.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[24237]: audit 2024-02-13T00:39:10.187700+0000 mon.a (mon.0) 1338 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:11.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[24237]: cluster 2024-02-13T00:39:10.187783+0000 mon.a (mon.0) 1339 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2024-02-13T00:39:11.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[24237]: audit 2024-02-13T00:39:10.190675+0000 mon.c (mon.2) 221 : audit [INF] from='client.? 172.21.15.80:0/3054591355' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi080-54175-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:11.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[24237]: audit 2024-02-13T00:39:10.191074+0000 mon.c (mon.2) 222 : audit [INF] from='client.? 172.21.15.80:0/2954931417' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi080-54247-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:11.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[24237]: audit 2024-02-13T00:39:10.191782+0000 mon.c (mon.2) 223 : audit [INF] from='client.? 172.21.15.80:0/3731165108' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi080-54183-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:11.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[24237]: audit 2024-02-13T00:39:10.192912+0000 mon.a (mon.0) 1340 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi080-54175-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:11.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[24237]: audit 2024-02-13T00:39:10.193940+0000 mon.a (mon.0) 1341 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi080-54247-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:11.014 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:10 smithi080 bash[24237]: audit 2024-02-13T00:39:10.195509+0000 mon.a (mon.0) 1342 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi080-54183-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:12.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:12 smithi106 bash[18459]: cluster 2024-02-13T00:39:10.167416+0000 mgr.y (mgr.24461) 384 : cluster [DBG] pgmap v360: 268 pgs: 8 creating+peering, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-13T00:39:12.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:12 smithi106 bash[18459]: audit 2024-02-13T00:39:10.695980+0000 mon.a (mon.0) 1343 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:12.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:12 smithi080 bash[17386]: cluster 2024-02-13T00:39:10.167416+0000 mgr.y (mgr.24461) 384 : cluster [DBG] pgmap v360: 268 pgs: 8 creating+peering, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-13T00:39:12.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:12 smithi080 bash[17386]: audit 2024-02-13T00:39:10.695980+0000 mon.a (mon.0) 1343 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:12.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:12 smithi080 bash[24237]: cluster 2024-02-13T00:39:10.167416+0000 mgr.y (mgr.24461) 384 : cluster [DBG] pgmap v360: 268 pgs: 8 creating+peering, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-13T00:39:12.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:12 smithi080 bash[24237]: audit 2024-02-13T00:39:10.695980+0000 mon.a (mon.0) 1343 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:13.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:13 smithi106 bash[18459]: audit 2024-02-13T00:39:12.074333+0000 mon.a (mon.0) 1344 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi080-54183-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:13.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:13 smithi106 bash[18459]: cluster 2024-02-13T00:39:12.074673+0000 mon.a (mon.0) 1345 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2024-02-13T00:39:13.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:13 smithi106 bash[18459]: audit 2024-02-13T00:39:12.078224+0000 mon.a (mon.0) 1346 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:13.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:13 smithi106 bash[18459]: audit 2024-02-13T00:39:12.193478+0000 mon.a (mon.0) 1347 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi080-54175-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi080-54175-27"}]': finished 2024-02-13T00:39:13.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:13 smithi106 bash[18459]: audit 2024-02-13T00:39:12.193665+0000 mon.a (mon.0) 1348 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi080-54247-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi080-54247-36"}]': finished 2024-02-13T00:39:13.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:13 smithi106 bash[18459]: cluster 2024-02-13T00:39:12.193879+0000 mon.a (mon.0) 1349 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2024-02-13T00:39:13.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:13 smithi106 bash[18459]: audit 2024-02-13T00:39:12.680102+0000 mon.a (mon.0) 1350 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:39:13.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:39:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:39:13] "GET /metrics HTTP/1.1" 200 191930 "" "Prometheus/2.33.4" 2024-02-13T00:39:13.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:13 smithi080 bash[17386]: audit 2024-02-13T00:39:12.074333+0000 mon.a (mon.0) 1344 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi080-54183-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:13.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:13 smithi080 bash[17386]: cluster 2024-02-13T00:39:12.074673+0000 mon.a (mon.0) 1345 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2024-02-13T00:39:13.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:13 smithi080 bash[17386]: audit 2024-02-13T00:39:12.078224+0000 mon.a (mon.0) 1346 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:13.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:13 smithi080 bash[17386]: audit 2024-02-13T00:39:12.193478+0000 mon.a (mon.0) 1347 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi080-54175-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi080-54175-27"}]': finished 2024-02-13T00:39:13.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:13 smithi080 bash[17386]: audit 2024-02-13T00:39:12.193665+0000 mon.a (mon.0) 1348 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi080-54247-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi080-54247-36"}]': finished 2024-02-13T00:39:13.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:13 smithi080 bash[17386]: cluster 2024-02-13T00:39:12.193879+0000 mon.a (mon.0) 1349 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2024-02-13T00:39:13.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:13 smithi080 bash[17386]: audit 2024-02-13T00:39:12.680102+0000 mon.a (mon.0) 1350 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:39:13.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:13 smithi080 bash[24237]: audit 2024-02-13T00:39:12.074333+0000 mon.a (mon.0) 1344 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi080-54183-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:13.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:13 smithi080 bash[24237]: cluster 2024-02-13T00:39:12.074673+0000 mon.a (mon.0) 1345 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2024-02-13T00:39:13.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:13 smithi080 bash[24237]: audit 2024-02-13T00:39:12.078224+0000 mon.a (mon.0) 1346 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:13.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:13 smithi080 bash[24237]: audit 2024-02-13T00:39:12.193478+0000 mon.a (mon.0) 1347 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi080-54175-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi080-54175-27"}]': finished 2024-02-13T00:39:13.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:13 smithi080 bash[24237]: audit 2024-02-13T00:39:12.193665+0000 mon.a (mon.0) 1348 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi080-54247-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi080-54247-36"}]': finished 2024-02-13T00:39:13.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:13 smithi080 bash[24237]: cluster 2024-02-13T00:39:12.193879+0000 mon.a (mon.0) 1349 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2024-02-13T00:39:13.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:13 smithi080 bash[24237]: audit 2024-02-13T00:39:12.680102+0000 mon.a (mon.0) 1350 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:39:14.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:14 smithi106 bash[18459]: cluster 2024-02-13T00:39:12.167973+0000 mgr.y (mgr.24461) 385 : cluster [DBG] pgmap v363: 300 pgs: 32 unknown, 8 creating+peering, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:39:14.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:14 smithi106 bash[18459]: audit 2024-02-13T00:39:13.080035+0000 mon.a (mon.0) 1351 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:14.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:14 smithi106 bash[18459]: audit 2024-02-13T00:39:13.198729+0000 mon.a (mon.0) 1352 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:39:14.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:14 smithi106 bash[18459]: cluster 2024-02-13T00:39:13.198841+0000 mon.a (mon.0) 1353 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2024-02-13T00:39:14.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:14 smithi106 bash[18459]: audit 2024-02-13T00:39:13.200087+0000 mon.a (mon.0) 1354 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-13"}]: dispatch 2024-02-13T00:39:14.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:14 smithi106 bash[18459]: audit 2024-02-13T00:39:13.201580+0000 mon.c (mon.2) 224 : audit [INF] from='client.? 172.21.15.80:0/2636260821' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi080-54183-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:14.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:14 smithi106 bash[18459]: audit 2024-02-13T00:39:13.203926+0000 mon.a (mon.0) 1355 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi080-54183-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:14.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:14 smithi106 bash[18459]: audit 2024-02-13T00:39:14.081675+0000 mon.a (mon.0) 1356 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:14.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:14 smithi080 bash[24237]: cluster 2024-02-13T00:39:12.167973+0000 mgr.y (mgr.24461) 385 : cluster [DBG] pgmap v363: 300 pgs: 32 unknown, 8 creating+peering, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:39:14.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:14 smithi080 bash[24237]: audit 2024-02-13T00:39:13.080035+0000 mon.a (mon.0) 1351 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:14.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:14 smithi080 bash[24237]: audit 2024-02-13T00:39:13.198729+0000 mon.a (mon.0) 1352 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:39:14.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:14 smithi080 bash[24237]: cluster 2024-02-13T00:39:13.198841+0000 mon.a (mon.0) 1353 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2024-02-13T00:39:14.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:14 smithi080 bash[24237]: audit 2024-02-13T00:39:13.200087+0000 mon.a (mon.0) 1354 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-13"}]: dispatch 2024-02-13T00:39:14.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:14 smithi080 bash[24237]: audit 2024-02-13T00:39:13.201580+0000 mon.c (mon.2) 224 : audit [INF] from='client.? 172.21.15.80:0/2636260821' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi080-54183-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:14.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:14 smithi080 bash[24237]: audit 2024-02-13T00:39:13.203926+0000 mon.a (mon.0) 1355 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi080-54183-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:14.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:14 smithi080 bash[24237]: audit 2024-02-13T00:39:14.081675+0000 mon.a (mon.0) 1356 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:14 smithi080 bash[17386]: cluster 2024-02-13T00:39:12.167973+0000 mgr.y (mgr.24461) 385 : cluster [DBG] pgmap v363: 300 pgs: 32 unknown, 8 creating+peering, 260 active+clean; 15 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:39:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:14 smithi080 bash[17386]: audit 2024-02-13T00:39:13.080035+0000 mon.a (mon.0) 1351 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:14 smithi080 bash[17386]: audit 2024-02-13T00:39:13.198729+0000 mon.a (mon.0) 1352 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:39:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:14 smithi080 bash[17386]: cluster 2024-02-13T00:39:13.198841+0000 mon.a (mon.0) 1353 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2024-02-13T00:39:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:14 smithi080 bash[17386]: audit 2024-02-13T00:39:13.200087+0000 mon.a (mon.0) 1354 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-13"}]: dispatch 2024-02-13T00:39:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:14 smithi080 bash[17386]: audit 2024-02-13T00:39:13.201580+0000 mon.c (mon.2) 224 : audit [INF] from='client.? 172.21.15.80:0/2636260821' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi080-54183-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:14 smithi080 bash[17386]: audit 2024-02-13T00:39:13.203926+0000 mon.a (mon.0) 1355 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi080-54183-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:14.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:14 smithi080 bash[17386]: audit 2024-02-13T00:39:14.081675+0000 mon.a (mon.0) 1356 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:15.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:15 smithi106 bash[18459]: cluster 2024-02-13T00:39:14.191415+0000 mon.a (mon.0) 1357 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:39:15.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:15 smithi106 bash[18459]: audit 2024-02-13T00:39:14.202377+0000 mon.a (mon.0) 1358 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-13"}]': finished 2024-02-13T00:39:15.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:15 smithi106 bash[18459]: audit 2024-02-13T00:39:14.202481+0000 mon.a (mon.0) 1359 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi080-54183-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:15.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:15 smithi106 bash[18459]: cluster 2024-02-13T00:39:14.202923+0000 mon.a (mon.0) 1360 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2024-02-13T00:39:15.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:15 smithi106 bash[18459]: audit 2024-02-13T00:39:14.206230+0000 mon.c (mon.2) 225 : audit [INF] from='client.? 172.21.15.80:0/3054591355' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:15.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:15 smithi106 bash[18459]: audit 2024-02-13T00:39:14.211454+0000 mon.c (mon.2) 226 : audit [INF] from='client.? 172.21.15.80:0/2954931417' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:15.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:15 smithi106 bash[18459]: audit 2024-02-13T00:39:14.220162+0000 mon.a (mon.0) 1361 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:15.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:15 smithi106 bash[18459]: audit 2024-02-13T00:39:14.220485+0000 mon.a (mon.0) 1362 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:15.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:15 smithi106 bash[18459]: audit 2024-02-13T00:39:15.083254+0000 mon.a (mon.0) 1363 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:15.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:15 smithi080 bash[17386]: cluster 2024-02-13T00:39:14.191415+0000 mon.a (mon.0) 1357 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:39:15.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:15 smithi080 bash[17386]: audit 2024-02-13T00:39:14.202377+0000 mon.a (mon.0) 1358 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-13"}]': finished 2024-02-13T00:39:15.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:15 smithi080 bash[17386]: audit 2024-02-13T00:39:14.202481+0000 mon.a (mon.0) 1359 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi080-54183-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:15.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:15 smithi080 bash[17386]: cluster 2024-02-13T00:39:14.202923+0000 mon.a (mon.0) 1360 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2024-02-13T00:39:15.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:15 smithi080 bash[17386]: audit 2024-02-13T00:39:14.206230+0000 mon.c (mon.2) 225 : audit [INF] from='client.? 172.21.15.80:0/3054591355' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:15.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:15 smithi080 bash[17386]: audit 2024-02-13T00:39:14.211454+0000 mon.c (mon.2) 226 : audit [INF] from='client.? 172.21.15.80:0/2954931417' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:15.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:15 smithi080 bash[17386]: audit 2024-02-13T00:39:14.220162+0000 mon.a (mon.0) 1361 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:15.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:15 smithi080 bash[17386]: audit 2024-02-13T00:39:14.220485+0000 mon.a (mon.0) 1362 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:15.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:15 smithi080 bash[17386]: audit 2024-02-13T00:39:15.083254+0000 mon.a (mon.0) 1363 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:15.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:15 smithi080 bash[24237]: cluster 2024-02-13T00:39:14.191415+0000 mon.a (mon.0) 1357 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:39:15.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:15 smithi080 bash[24237]: audit 2024-02-13T00:39:14.202377+0000 mon.a (mon.0) 1358 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-13"}]': finished 2024-02-13T00:39:15.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:15 smithi080 bash[24237]: audit 2024-02-13T00:39:14.202481+0000 mon.a (mon.0) 1359 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi080-54183-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:15.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:15 smithi080 bash[24237]: cluster 2024-02-13T00:39:14.202923+0000 mon.a (mon.0) 1360 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2024-02-13T00:39:15.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:15 smithi080 bash[24237]: audit 2024-02-13T00:39:14.206230+0000 mon.c (mon.2) 225 : audit [INF] from='client.? 172.21.15.80:0/3054591355' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:15.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:15 smithi080 bash[24237]: audit 2024-02-13T00:39:14.211454+0000 mon.c (mon.2) 226 : audit [INF] from='client.? 172.21.15.80:0/2954931417' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:15.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:15 smithi080 bash[24237]: audit 2024-02-13T00:39:14.220162+0000 mon.a (mon.0) 1361 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:15.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:15 smithi080 bash[24237]: audit 2024-02-13T00:39:14.220485+0000 mon.a (mon.0) 1362 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:15.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:15 smithi080 bash[24237]: audit 2024-02-13T00:39:15.083254+0000 mon.a (mon.0) 1363 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:16.241 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForCompl (68682 ms total) 2024-02-13T00:39:16.241 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: 2024-02-13T00:39:16.241 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2024-02-13T00:39:16.241 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-02-13T00:39:16.241 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (169 ms) 2024-02-13T00:39:16.241 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (169 ms total) 2024-02-13T00:39:16.241 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: 2024-02-13T00:39:16.241 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-02-13T00:39:16.241 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2024-02-13T00:39:16.241 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (20 ms) 2024-02-13T00:39:16.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2024-02-13T00:39:16.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (19 ms) 2024-02-13T00:39:16.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (39 ms total) 2024-02-13T00:39:16.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: 2024-02-13T00:39:16.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-02-13T00:39:16.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2024-02-13T00:39:16.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (38 ms) 2024-02-13T00:39:16.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2024-02-13T00:39:16.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (8 ms) 2024-02-13T00:39:16.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (46 ms total) 2024-02-13T00:39:16.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: 2024-02-13T00:39:16.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-02-13T00:39:16.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2024-02-13T00:39:16.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (58 ms) 2024-02-13T00:39:16.242 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2024-02-13T00:39:16.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (6 ms) 2024-02-13T00:39:16.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (64 ms total) 2024-02-13T00:39:16.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: 2024-02-13T00:39:16.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2024-02-13T00:39:16.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-02-13T00:39:16.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1025 ms) 2024-02-13T00:39:16.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1025 ms total) 2024-02-13T00:39:16.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: 2024-02-13T00:39:16.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [----------] Global test environment tear-down 2024-02-13T00:39:16.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (107268 ms total) 2024-02-13T00:39:16.243 INFO:tasks.workunit.client.0.smithi080.stdout: api_misc_pp: [ PASSED ] 31 tests. 2024-02-13T00:39:16.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:16 smithi106 bash[18459]: cluster 2024-02-13T00:39:14.169016+0000 mgr.y (mgr.24461) 386 : cluster [DBG] pgmap v366: 316 pgs: 32 unknown, 16 creating+peering, 268 active+clean; 33 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 23 op/s 2024-02-13T00:39:16.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:16 smithi106 bash[18459]: cluster 2024-02-13T00:39:15.086707+0000 mon.a (mon.0) 1364 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:39:16.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:16 smithi106 bash[18459]: audit 2024-02-13T00:39:15.204054+0000 mon.a (mon.0) 1365 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi080-54175-27"}]': finished 2024-02-13T00:39:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:16 smithi106 bash[18459]: audit 2024-02-13T00:39:15.204286+0000 mon.a (mon.0) 1366 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36"}]': finished 2024-02-13T00:39:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:16 smithi106 bash[18459]: cluster 2024-02-13T00:39:15.204580+0000 mon.a (mon.0) 1367 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2024-02-13T00:39:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:16 smithi106 bash[18459]: audit 2024-02-13T00:39:15.211093+0000 mon.c (mon.2) 227 : audit [INF] from='client.? 172.21.15.80:0/3054591355' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:16 smithi106 bash[18459]: audit 2024-02-13T00:39:15.214194+0000 mon.c (mon.2) 228 : audit [INF] from='client.? 172.21.15.80:0/2954931417' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:16 smithi106 bash[18459]: audit 2024-02-13T00:39:15.665136+0000 mon.a (mon.0) 1368 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:16 smithi106 bash[18459]: audit 2024-02-13T00:39:15.666135+0000 mon.a (mon.0) 1369 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:16.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:16 smithi080 bash[17386]: cluster 2024-02-13T00:39:14.169016+0000 mgr.y (mgr.24461) 386 : cluster [DBG] pgmap v366: 316 pgs: 32 unknown, 16 creating+peering, 268 active+clean; 33 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 23 op/s 2024-02-13T00:39:16.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:16 smithi080 bash[17386]: cluster 2024-02-13T00:39:15.086707+0000 mon.a (mon.0) 1364 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:39:16.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:16 smithi080 bash[17386]: audit 2024-02-13T00:39:15.204054+0000 mon.a (mon.0) 1365 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi080-54175-27"}]': finished 2024-02-13T00:39:16.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:16 smithi080 bash[17386]: audit 2024-02-13T00:39:15.204286+0000 mon.a (mon.0) 1366 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36"}]': finished 2024-02-13T00:39:16.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:16 smithi080 bash[17386]: cluster 2024-02-13T00:39:15.204580+0000 mon.a (mon.0) 1367 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2024-02-13T00:39:16.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:16 smithi080 bash[17386]: audit 2024-02-13T00:39:15.211093+0000 mon.c (mon.2) 227 : audit [INF] from='client.? 172.21.15.80:0/3054591355' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:16.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:16 smithi080 bash[17386]: audit 2024-02-13T00:39:15.214194+0000 mon.c (mon.2) 228 : audit [INF] from='client.? 172.21.15.80:0/2954931417' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:16.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:16 smithi080 bash[17386]: audit 2024-02-13T00:39:15.665136+0000 mon.a (mon.0) 1368 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:16.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:16 smithi080 bash[17386]: audit 2024-02-13T00:39:15.666135+0000 mon.a (mon.0) 1369 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:16.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:16 smithi080 bash[24237]: cluster 2024-02-13T00:39:14.169016+0000 mgr.y (mgr.24461) 386 : cluster [DBG] pgmap v366: 316 pgs: 32 unknown, 16 creating+peering, 268 active+clean; 33 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 23 op/s 2024-02-13T00:39:16.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:16 smithi080 bash[24237]: cluster 2024-02-13T00:39:15.086707+0000 mon.a (mon.0) 1364 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:39:16.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:16 smithi080 bash[24237]: audit 2024-02-13T00:39:15.204054+0000 mon.a (mon.0) 1365 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi080-54175-27"}]': finished 2024-02-13T00:39:16.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:16 smithi080 bash[24237]: audit 2024-02-13T00:39:15.204286+0000 mon.a (mon.0) 1366 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi080-54247-36"}]': finished 2024-02-13T00:39:16.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:16 smithi080 bash[24237]: cluster 2024-02-13T00:39:15.204580+0000 mon.a (mon.0) 1367 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2024-02-13T00:39:16.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:16 smithi080 bash[24237]: audit 2024-02-13T00:39:15.211093+0000 mon.c (mon.2) 227 : audit [INF] from='client.? 172.21.15.80:0/3054591355' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:16.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:16 smithi080 bash[24237]: audit 2024-02-13T00:39:15.214194+0000 mon.c (mon.2) 228 : audit [INF] from='client.? 172.21.15.80:0/2954931417' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:16.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:16 smithi080 bash[24237]: audit 2024-02-13T00:39:15.665136+0000 mon.a (mon.0) 1368 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi080-54175-27"}]: dispatch 2024-02-13T00:39:16.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:16 smithi080 bash[24237]: audit 2024-02-13T00:39:15.666135+0000 mon.a (mon.0) 1369 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi080-54247-36"}]: dispatch 2024-02-13T00:39:17.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:17 smithi106 bash[18459]: audit 2024-02-13T00:39:16.103029+0000 mon.a (mon.0) 1370 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:17.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:17 smithi106 bash[18459]: audit 2024-02-13T00:39:16.211946+0000 mon.a (mon.0) 1371 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi080-54175-27"}]': finished 2024-02-13T00:39:17.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:17 smithi106 bash[18459]: audit 2024-02-13T00:39:16.212089+0000 mon.a (mon.0) 1372 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi080-54247-36"}]': finished 2024-02-13T00:39:17.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:17 smithi106 bash[18459]: cluster 2024-02-13T00:39:16.212474+0000 mon.a (mon.0) 1373 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2024-02-13T00:39:17.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:17 smithi106 bash[18459]: audit 2024-02-13T00:39:16.220098+0000 mon.a (mon.0) 1374 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:17.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:17 smithi106 bash[18459]: audit 2024-02-13T00:39:16.232528+0000 mon.c (mon.2) 229 : audit [INF] from='client.? 172.21.15.80:0/4093602883' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi080-54183-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:17.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:17 smithi106 bash[18459]: audit 2024-02-13T00:39:16.233074+0000 mon.a (mon.0) 1375 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi080-54183-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:17.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:17 smithi106 bash[18459]: audit 2024-02-13T00:39:16.238932+0000 mon.c (mon.2) 230 : audit [INF] from='client.? 172.21.15.80:0/1674569583' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:17.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:17 smithi106 bash[18459]: audit 2024-02-13T00:39:16.239362+0000 mon.a (mon.0) 1376 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:17.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:17 smithi106 bash[18459]: audit 2024-02-13T00:39:16.240009+0000 mon.c (mon.2) 231 : audit [INF] from='client.? 172.21.15.80:0/1674569583' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:17.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:17 smithi106 bash[18459]: audit 2024-02-13T00:39:16.240367+0000 mon.a (mon.0) 1377 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:17.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:17 smithi106 bash[18459]: audit 2024-02-13T00:39:16.240893+0000 mon.c (mon.2) 232 : audit [INF] from='client.? 172.21.15.80:0/1674569583' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi080-54175-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:17.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:17 smithi106 bash[18459]: audit 2024-02-13T00:39:16.241276+0000 mon.a (mon.0) 1378 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi080-54175-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:17.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:17 smithi106 bash[18459]: audit 2024-02-13T00:39:16.912493+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:39:17.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[17386]: audit 2024-02-13T00:39:16.103029+0000 mon.a (mon.0) 1370 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:17.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[17386]: audit 2024-02-13T00:39:16.211946+0000 mon.a (mon.0) 1371 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi080-54175-27"}]': finished 2024-02-13T00:39:17.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[17386]: audit 2024-02-13T00:39:16.212089+0000 mon.a (mon.0) 1372 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi080-54247-36"}]': finished 2024-02-13T00:39:17.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[17386]: cluster 2024-02-13T00:39:16.212474+0000 mon.a (mon.0) 1373 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2024-02-13T00:39:17.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[17386]: audit 2024-02-13T00:39:16.220098+0000 mon.a (mon.0) 1374 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:17.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[17386]: audit 2024-02-13T00:39:16.232528+0000 mon.c (mon.2) 229 : audit [INF] from='client.? 172.21.15.80:0/4093602883' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi080-54183-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:17.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[17386]: audit 2024-02-13T00:39:16.233074+0000 mon.a (mon.0) 1375 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi080-54183-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:17.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[17386]: audit 2024-02-13T00:39:16.238932+0000 mon.c (mon.2) 230 : audit [INF] from='client.? 172.21.15.80:0/1674569583' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:17.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[17386]: audit 2024-02-13T00:39:16.239362+0000 mon.a (mon.0) 1376 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:17.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[17386]: audit 2024-02-13T00:39:16.240009+0000 mon.c (mon.2) 231 : audit [INF] from='client.? 172.21.15.80:0/1674569583' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:17.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[17386]: audit 2024-02-13T00:39:16.240367+0000 mon.a (mon.0) 1377 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:17.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[17386]: audit 2024-02-13T00:39:16.240893+0000 mon.c (mon.2) 232 : audit [INF] from='client.? 172.21.15.80:0/1674569583' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi080-54175-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:17.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[17386]: audit 2024-02-13T00:39:16.241276+0000 mon.a (mon.0) 1378 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi080-54175-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:17.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[17386]: audit 2024-02-13T00:39:16.912493+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:39:17.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[24237]: audit 2024-02-13T00:39:16.103029+0000 mon.a (mon.0) 1370 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:17.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[24237]: audit 2024-02-13T00:39:16.211946+0000 mon.a (mon.0) 1371 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi080-54175-27"}]': finished 2024-02-13T00:39:17.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[24237]: audit 2024-02-13T00:39:16.212089+0000 mon.a (mon.0) 1372 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi080-54247-36"}]': finished 2024-02-13T00:39:17.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[24237]: cluster 2024-02-13T00:39:16.212474+0000 mon.a (mon.0) 1373 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2024-02-13T00:39:17.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[24237]: audit 2024-02-13T00:39:16.220098+0000 mon.a (mon.0) 1374 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:17.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[24237]: audit 2024-02-13T00:39:16.232528+0000 mon.c (mon.2) 229 : audit [INF] from='client.? 172.21.15.80:0/4093602883' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi080-54183-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:17.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[24237]: audit 2024-02-13T00:39:16.233074+0000 mon.a (mon.0) 1375 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi080-54183-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:17.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[24237]: audit 2024-02-13T00:39:16.238932+0000 mon.c (mon.2) 230 : audit [INF] from='client.? 172.21.15.80:0/1674569583' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:17.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[24237]: audit 2024-02-13T00:39:16.239362+0000 mon.a (mon.0) 1376 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:17.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[24237]: audit 2024-02-13T00:39:16.240009+0000 mon.c (mon.2) 231 : audit [INF] from='client.? 172.21.15.80:0/1674569583' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:17.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[24237]: audit 2024-02-13T00:39:16.240367+0000 mon.a (mon.0) 1377 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:17.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[24237]: audit 2024-02-13T00:39:16.240893+0000 mon.c (mon.2) 232 : audit [INF] from='client.? 172.21.15.80:0/1674569583' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi080-54175-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:17.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[24237]: audit 2024-02-13T00:39:16.241276+0000 mon.a (mon.0) 1378 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi080-54175-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:17.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:17 smithi080 bash[24237]: audit 2024-02-13T00:39:16.912493+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:39:18.505 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:39:18 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:39:18.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:18 smithi106 bash[18459]: cluster 2024-02-13T00:39:16.169802+0000 mgr.y (mgr.24461) 387 : cluster [DBG] pgmap v369: 236 pgs: 236 active+clean; 33 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 10 KiB/s wr, 1 op/s 2024-02-13T00:39:18.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:18 smithi106 bash[18459]: audit 2024-02-13T00:39:17.105546+0000 mon.a (mon.0) 1380 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:18.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:18 smithi106 bash[18459]: audit 2024-02-13T00:39:17.173150+0000 mon.a (mon.0) 1381 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:18.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:18 smithi106 bash[18459]: audit 2024-02-13T00:39:17.173359+0000 mon.a (mon.0) 1382 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi080-54183-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:18.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:18 smithi106 bash[18459]: audit 2024-02-13T00:39:17.173484+0000 mon.a (mon.0) 1383 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi080-54175-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:18.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:18 smithi106 bash[18459]: cluster 2024-02-13T00:39:17.173571+0000 mon.a (mon.0) 1384 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2024-02-13T00:39:18.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:18 smithi106 bash[18459]: audit 2024-02-13T00:39:17.187143+0000 mon.c (mon.2) 233 : audit [INF] from='client.? 172.21.15.80:0/1674569583' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi080-54175-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:18.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:18 smithi106 bash[18459]: audit 2024-02-13T00:39:17.199681+0000 mon.a (mon.0) 1385 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi080-54175-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:18.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:18 smithi080 bash[17386]: cluster 2024-02-13T00:39:16.169802+0000 mgr.y (mgr.24461) 387 : cluster [DBG] pgmap v369: 236 pgs: 236 active+clean; 33 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 10 KiB/s wr, 1 op/s 2024-02-13T00:39:18.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:18 smithi080 bash[17386]: audit 2024-02-13T00:39:17.105546+0000 mon.a (mon.0) 1380 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:18.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:18 smithi080 bash[17386]: audit 2024-02-13T00:39:17.173150+0000 mon.a (mon.0) 1381 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:18.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:18 smithi080 bash[17386]: audit 2024-02-13T00:39:17.173359+0000 mon.a (mon.0) 1382 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi080-54183-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:18.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:18 smithi080 bash[17386]: audit 2024-02-13T00:39:17.173484+0000 mon.a (mon.0) 1383 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi080-54175-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:18.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:18 smithi080 bash[17386]: cluster 2024-02-13T00:39:17.173571+0000 mon.a (mon.0) 1384 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2024-02-13T00:39:18.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:18 smithi080 bash[17386]: audit 2024-02-13T00:39:17.187143+0000 mon.c (mon.2) 233 : audit [INF] from='client.? 172.21.15.80:0/1674569583' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi080-54175-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:18.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:18 smithi080 bash[17386]: audit 2024-02-13T00:39:17.199681+0000 mon.a (mon.0) 1385 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi080-54175-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:18.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:18 smithi080 bash[24237]: cluster 2024-02-13T00:39:16.169802+0000 mgr.y (mgr.24461) 387 : cluster [DBG] pgmap v369: 236 pgs: 236 active+clean; 33 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 10 KiB/s wr, 1 op/s 2024-02-13T00:39:18.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:18 smithi080 bash[24237]: audit 2024-02-13T00:39:17.105546+0000 mon.a (mon.0) 1380 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:18.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:18 smithi080 bash[24237]: audit 2024-02-13T00:39:17.173150+0000 mon.a (mon.0) 1381 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:18.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:18 smithi080 bash[24237]: audit 2024-02-13T00:39:17.173359+0000 mon.a (mon.0) 1382 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi080-54183-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:18.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:18 smithi080 bash[24237]: audit 2024-02-13T00:39:17.173484+0000 mon.a (mon.0) 1383 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi080-54175-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:18.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:18 smithi080 bash[24237]: cluster 2024-02-13T00:39:17.173571+0000 mon.a (mon.0) 1384 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2024-02-13T00:39:18.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:18 smithi080 bash[24237]: audit 2024-02-13T00:39:17.187143+0000 mon.c (mon.2) 233 : audit [INF] from='client.? 172.21.15.80:0/1674569583' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi080-54175-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:18.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:18 smithi080 bash[24237]: audit 2024-02-13T00:39:17.199681+0000 mon.a (mon.0) 1385 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi080-54175-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:19.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:19 smithi106 bash[18459]: audit 2024-02-13T00:39:18.107951+0000 mon.a (mon.0) 1386 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:19.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:19 smithi106 bash[18459]: audit 2024-02-13T00:39:18.109275+0000 mon.a (mon.0) 1387 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pg_num","val":"11"}]: dispatch 2024-02-13T00:39:19.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:19 smithi106 bash[18459]: audit 2024-02-13T00:39:18.645739+0000 mon.a (mon.0) 1388 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pg_num","val":"11"}]': finished 2024-02-13T00:39:19.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:19 smithi106 bash[18459]: cluster 2024-02-13T00:39:18.645953+0000 mon.a (mon.0) 1389 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2024-02-13T00:39:19.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:19 smithi106 bash[18459]: audit 2024-02-13T00:39:18.647349+0000 mon.a (mon.0) 1390 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:19.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:19 smithi106 bash[18459]: audit 2024-02-13T00:39:18.648465+0000 mon.a (mon.0) 1391 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:19.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:19 smithi106 bash[18459]: audit 2024-02-13T00:39:18.649879+0000 mon.a (mon.0) 1392 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-13T00:39:19.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:19 smithi106 bash[18459]: audit 2024-02-13T00:39:18.660720+0000 mon.a (mon.0) 1393 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:39:19.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:19 smithi080 bash[17386]: audit 2024-02-13T00:39:18.107951+0000 mon.a (mon.0) 1386 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:19.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:19 smithi080 bash[17386]: audit 2024-02-13T00:39:18.109275+0000 mon.a (mon.0) 1387 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pg_num","val":"11"}]: dispatch 2024-02-13T00:39:19.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:19 smithi080 bash[17386]: audit 2024-02-13T00:39:18.645739+0000 mon.a (mon.0) 1388 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pg_num","val":"11"}]': finished 2024-02-13T00:39:19.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:19 smithi080 bash[17386]: cluster 2024-02-13T00:39:18.645953+0000 mon.a (mon.0) 1389 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2024-02-13T00:39:19.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:19 smithi080 bash[17386]: audit 2024-02-13T00:39:18.647349+0000 mon.a (mon.0) 1390 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:19.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:19 smithi080 bash[17386]: audit 2024-02-13T00:39:18.648465+0000 mon.a (mon.0) 1391 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:19.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:19 smithi080 bash[17386]: audit 2024-02-13T00:39:18.649879+0000 mon.a (mon.0) 1392 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-13T00:39:19.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:19 smithi080 bash[17386]: audit 2024-02-13T00:39:18.660720+0000 mon.a (mon.0) 1393 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:39:19.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:19 smithi080 bash[24237]: audit 2024-02-13T00:39:18.107951+0000 mon.a (mon.0) 1386 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:19.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:19 smithi080 bash[24237]: audit 2024-02-13T00:39:18.109275+0000 mon.a (mon.0) 1387 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pg_num","val":"11"}]: dispatch 2024-02-13T00:39:19.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:19 smithi080 bash[24237]: audit 2024-02-13T00:39:18.645739+0000 mon.a (mon.0) 1388 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pg_num","val":"11"}]': finished 2024-02-13T00:39:19.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:19 smithi080 bash[24237]: cluster 2024-02-13T00:39:18.645953+0000 mon.a (mon.0) 1389 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2024-02-13T00:39:19.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:19 smithi080 bash[24237]: audit 2024-02-13T00:39:18.647349+0000 mon.a (mon.0) 1390 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:19.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:19 smithi080 bash[24237]: audit 2024-02-13T00:39:18.648465+0000 mon.a (mon.0) 1391 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:19.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:19 smithi080 bash[24237]: audit 2024-02-13T00:39:18.649879+0000 mon.a (mon.0) 1392 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-13T00:39:19.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:19 smithi080 bash[24237]: audit 2024-02-13T00:39:18.660720+0000 mon.a (mon.0) 1393 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:39:20.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:39:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:39:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:39:20.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:20 smithi106 bash[18459]: audit 2024-02-13T00:39:18.167813+0000 mgr.y (mgr.24461) 388 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:39:20.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:20 smithi106 bash[18459]: cluster 2024-02-13T00:39:18.172316+0000 mgr.y (mgr.24461) 389 : cluster [DBG] pgmap v372: 300 pgs: 300 active+clean; 41 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:39:20.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:20 smithi106 bash[18459]: audit 2024-02-13T00:39:19.203696+0000 mon.a (mon.0) 1394 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi080-54175-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi080-54175-28"}]': finished 2024-02-13T00:39:20.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:20 smithi106 bash[18459]: audit 2024-02-13T00:39:19.203913+0000 mon.a (mon.0) 1395 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pgp_num","val":"11"}]': finished 2024-02-13T00:39:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:20 smithi106 bash[18459]: audit 2024-02-13T00:39:19.204031+0000 mon.a (mon.0) 1396 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-15", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:39:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:20 smithi106 bash[18459]: cluster 2024-02-13T00:39:19.204173+0000 mon.a (mon.0) 1397 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2024-02-13T00:39:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:20 smithi106 bash[18459]: audit 2024-02-13T00:39:19.206494+0000 mon.a (mon.0) 1398 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:20 smithi106 bash[18459]: audit 2024-02-13T00:39:19.207126+0000 mon.a (mon.0) 1399 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-15"}]: dispatch 2024-02-13T00:39:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:20 smithi106 bash[18459]: audit 2024-02-13T00:39:19.213357+0000 mon.c (mon.2) 234 : audit [INF] from='client.? 172.21.15.80:0/3734285673' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi080-54183-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:20 smithi106 bash[18459]: audit 2024-02-13T00:39:19.214559+0000 mon.a (mon.0) 1400 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi080-54183-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:20 smithi106 bash[18459]: audit 2024-02-13T00:39:19.313971+0000 mon.a (mon.0) 1401 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:20 smithi106 bash[18459]: audit 2024-02-13T00:39:19.314885+0000 mon.a (mon.0) 1402 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pg_num","val":"11"}]: dispatch 2024-02-13T00:39:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[17386]: audit 2024-02-13T00:39:18.167813+0000 mgr.y (mgr.24461) 388 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:39:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[17386]: cluster 2024-02-13T00:39:18.172316+0000 mgr.y (mgr.24461) 389 : cluster [DBG] pgmap v372: 300 pgs: 300 active+clean; 41 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:39:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[17386]: audit 2024-02-13T00:39:19.203696+0000 mon.a (mon.0) 1394 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi080-54175-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi080-54175-28"}]': finished 2024-02-13T00:39:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[17386]: audit 2024-02-13T00:39:19.203913+0000 mon.a (mon.0) 1395 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pgp_num","val":"11"}]': finished 2024-02-13T00:39:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[17386]: audit 2024-02-13T00:39:19.204031+0000 mon.a (mon.0) 1396 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-15", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:39:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[17386]: cluster 2024-02-13T00:39:19.204173+0000 mon.a (mon.0) 1397 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2024-02-13T00:39:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[17386]: audit 2024-02-13T00:39:19.206494+0000 mon.a (mon.0) 1398 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[17386]: audit 2024-02-13T00:39:19.207126+0000 mon.a (mon.0) 1399 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-15"}]: dispatch 2024-02-13T00:39:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[17386]: audit 2024-02-13T00:39:19.213357+0000 mon.c (mon.2) 234 : audit [INF] from='client.? 172.21.15.80:0/3734285673' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi080-54183-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[17386]: audit 2024-02-13T00:39:19.214559+0000 mon.a (mon.0) 1400 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi080-54183-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[17386]: audit 2024-02-13T00:39:19.313971+0000 mon.a (mon.0) 1401 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[17386]: audit 2024-02-13T00:39:19.314885+0000 mon.a (mon.0) 1402 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pg_num","val":"11"}]: dispatch 2024-02-13T00:39:20.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[24237]: audit 2024-02-13T00:39:18.167813+0000 mgr.y (mgr.24461) 388 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:39:20.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[24237]: cluster 2024-02-13T00:39:18.172316+0000 mgr.y (mgr.24461) 389 : cluster [DBG] pgmap v372: 300 pgs: 300 active+clean; 41 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:39:20.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[24237]: audit 2024-02-13T00:39:19.203696+0000 mon.a (mon.0) 1394 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi080-54175-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi080-54175-28"}]': finished 2024-02-13T00:39:20.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[24237]: audit 2024-02-13T00:39:19.203913+0000 mon.a (mon.0) 1395 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pgp_num","val":"11"}]': finished 2024-02-13T00:39:20.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[24237]: audit 2024-02-13T00:39:19.204031+0000 mon.a (mon.0) 1396 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-15", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:39:20.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[24237]: cluster 2024-02-13T00:39:19.204173+0000 mon.a (mon.0) 1397 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2024-02-13T00:39:20.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[24237]: audit 2024-02-13T00:39:19.206494+0000 mon.a (mon.0) 1398 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:20.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[24237]: audit 2024-02-13T00:39:19.207126+0000 mon.a (mon.0) 1399 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-15"}]: dispatch 2024-02-13T00:39:20.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[24237]: audit 2024-02-13T00:39:19.213357+0000 mon.c (mon.2) 234 : audit [INF] from='client.? 172.21.15.80:0/3734285673' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi080-54183-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:20.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[24237]: audit 2024-02-13T00:39:19.214559+0000 mon.a (mon.0) 1400 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi080-54183-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:20.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[24237]: audit 2024-02-13T00:39:19.313971+0000 mon.a (mon.0) 1401 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:20.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:20 smithi080 bash[24237]: audit 2024-02-13T00:39:19.314885+0000 mon.a (mon.0) 1402 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pg_num","val":"11"}]: dispatch 2024-02-13T00:39:21.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:21 smithi106 bash[18459]: cluster 2024-02-13T00:39:20.173230+0000 mgr.y (mgr.24461) 390 : cluster [DBG] pgmap v375: 308 pgs: 40 unknown, 268 active+clean; 41 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 7.2 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-02-13T00:39:21.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:21 smithi106 bash[18459]: audit 2024-02-13T00:39:20.205993+0000 mon.a (mon.0) 1403 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-15"}]': finished 2024-02-13T00:39:21.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:21 smithi106 bash[18459]: audit 2024-02-13T00:39:20.206334+0000 mon.a (mon.0) 1404 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi080-54183-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:21.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:21 smithi106 bash[18459]: audit 2024-02-13T00:39:20.206602+0000 mon.a (mon.0) 1405 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pg_num","val":"11"}]': finished 2024-02-13T00:39:21.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:21 smithi106 bash[18459]: cluster 2024-02-13T00:39:20.206709+0000 mon.a (mon.0) 1406 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2024-02-13T00:39:21.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:21 smithi106 bash[18459]: audit 2024-02-13T00:39:20.208957+0000 mon.a (mon.0) 1407 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-15", "mode": "writeback"}]: dispatch 2024-02-13T00:39:21.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:21 smithi106 bash[18459]: audit 2024-02-13T00:39:20.209391+0000 mon.a (mon.0) 1408 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:21.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:21 smithi106 bash[18459]: audit 2024-02-13T00:39:20.209906+0000 mon.a (mon.0) 1409 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]: dispatch 2024-02-13T00:39:21.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:21 smithi106 bash[18459]: audit 2024-02-13T00:39:20.210273+0000 mon.a (mon.0) 1410 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:21.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:21 smithi106 bash[18459]: audit 2024-02-13T00:39:20.211108+0000 mon.a (mon.0) 1411 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-13T00:39:21.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:21 smithi080 bash[17386]: cluster 2024-02-13T00:39:20.173230+0000 mgr.y (mgr.24461) 390 : cluster [DBG] pgmap v375: 308 pgs: 40 unknown, 268 active+clean; 41 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 7.2 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-02-13T00:39:21.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:21 smithi080 bash[17386]: audit 2024-02-13T00:39:20.205993+0000 mon.a (mon.0) 1403 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-15"}]': finished 2024-02-13T00:39:21.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:21 smithi080 bash[17386]: audit 2024-02-13T00:39:20.206334+0000 mon.a (mon.0) 1404 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi080-54183-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:21.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:21 smithi080 bash[17386]: audit 2024-02-13T00:39:20.206602+0000 mon.a (mon.0) 1405 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pg_num","val":"11"}]': finished 2024-02-13T00:39:21.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:21 smithi080 bash[17386]: cluster 2024-02-13T00:39:20.206709+0000 mon.a (mon.0) 1406 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2024-02-13T00:39:21.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:21 smithi080 bash[17386]: audit 2024-02-13T00:39:20.208957+0000 mon.a (mon.0) 1407 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-15", "mode": "writeback"}]: dispatch 2024-02-13T00:39:21.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:21 smithi080 bash[17386]: audit 2024-02-13T00:39:20.209391+0000 mon.a (mon.0) 1408 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:21.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:21 smithi080 bash[17386]: audit 2024-02-13T00:39:20.209906+0000 mon.a (mon.0) 1409 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]: dispatch 2024-02-13T00:39:21.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:21 smithi080 bash[17386]: audit 2024-02-13T00:39:20.210273+0000 mon.a (mon.0) 1410 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:21.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:21 smithi080 bash[17386]: audit 2024-02-13T00:39:20.211108+0000 mon.a (mon.0) 1411 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-13T00:39:21.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:21 smithi080 bash[24237]: cluster 2024-02-13T00:39:20.173230+0000 mgr.y (mgr.24461) 390 : cluster [DBG] pgmap v375: 308 pgs: 40 unknown, 268 active+clean; 41 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 7.2 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-02-13T00:39:21.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:21 smithi080 bash[24237]: audit 2024-02-13T00:39:20.205993+0000 mon.a (mon.0) 1403 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-15"}]': finished 2024-02-13T00:39:21.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:21 smithi080 bash[24237]: audit 2024-02-13T00:39:20.206334+0000 mon.a (mon.0) 1404 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi080-54183-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:21.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:21 smithi080 bash[24237]: audit 2024-02-13T00:39:20.206602+0000 mon.a (mon.0) 1405 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pg_num","val":"11"}]': finished 2024-02-13T00:39:21.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:21 smithi080 bash[24237]: cluster 2024-02-13T00:39:20.206709+0000 mon.a (mon.0) 1406 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2024-02-13T00:39:21.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:21 smithi080 bash[24237]: audit 2024-02-13T00:39:20.208957+0000 mon.a (mon.0) 1407 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-15", "mode": "writeback"}]: dispatch 2024-02-13T00:39:21.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:21 smithi080 bash[24237]: audit 2024-02-13T00:39:20.209391+0000 mon.a (mon.0) 1408 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:21.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:21 smithi080 bash[24237]: audit 2024-02-13T00:39:20.209906+0000 mon.a (mon.0) 1409 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]: dispatch 2024-02-13T00:39:21.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:21 smithi080 bash[24237]: audit 2024-02-13T00:39:20.210273+0000 mon.a (mon.0) 1410 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:21.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:21 smithi080 bash[24237]: audit 2024-02-13T00:39:20.211108+0000 mon.a (mon.0) 1411 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-13T00:39:22.225 INFO:tasks.workunit.client.0.smithi080.stdout:p: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-02-13T00:39:22.225 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-02-13T00:39:22.225 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4894 ms) 2024-02-13T00:39:22.225 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-02-13T00:39:22.225 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (3582 ms) 2024-02-13T00:39:22.225 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-02-13T00:39:22.225 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (3541 ms) 2024-02-13T00:39:22.225 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (12017 ms total) 2024-02-13T00:39:22.225 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: 2024-02-13T00:39:22.226 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2024-02-13T00:39:22.226 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [==========] 20 tests from 5 test suites ran. (113196 ms total) 2024-02-13T00:39:22.226 INFO:tasks.workunit.client.0.smithi080.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2024-02-13T00:39:22.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:22 smithi106 bash[18459]: cluster 2024-02-13T00:39:21.201469+0000 mon.a (mon.0) 1412 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:39:22.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:22 smithi106 bash[18459]: audit 2024-02-13T00:39:21.209836+0000 mon.a (mon.0) 1413 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-15", "mode": "writeback"}]': finished 2024-02-13T00:39:22.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:22 smithi106 bash[18459]: audit 2024-02-13T00:39:21.209999+0000 mon.a (mon.0) 1414 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]': finished 2024-02-13T00:39:22.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:22 smithi106 bash[18459]: audit 2024-02-13T00:39:21.210157+0000 mon.a (mon.0) 1415 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pgp_num","val":"11"}]': finished 2024-02-13T00:39:22.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:22 smithi106 bash[18459]: cluster 2024-02-13T00:39:21.210394+0000 mon.a (mon.0) 1416 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2024-02-13T00:39:22.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:22 smithi106 bash[18459]: audit 2024-02-13T00:39:21.211990+0000 mon.a (mon.0) 1417 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:22.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:22 smithi106 bash[18459]: audit 2024-02-13T00:39:21.212477+0000 mon.a (mon.0) 1418 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]: dispatch 2024-02-13T00:39:22.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:22 smithi106 bash[18459]: audit 2024-02-13T00:39:21.213402+0000 mon.c (mon.2) 235 : audit [INF] from='client.? 172.21.15.80:0/1674569583' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:22.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:22 smithi106 bash[18459]: audit 2024-02-13T00:39:21.223645+0000 mon.a (mon.0) 1419 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:22.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:22 smithi106 bash[18459]: audit 2024-02-13T00:39:22.174828+0000 mon.c (mon.2) 236 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi080-54215-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-02-13T00:39:22.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:22 smithi106 bash[18459]: audit 2024-02-13T00:39:22.178611+0000 mon.a (mon.0) 1420 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi080-54215-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-02-13T00:39:22.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:22 smithi080 bash[17386]: cluster 2024-02-13T00:39:21.201469+0000 mon.a (mon.0) 1412 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:39:22.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:22 smithi080 bash[17386]: audit 2024-02-13T00:39:21.209836+0000 mon.a (mon.0) 1413 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-15", "mode": "writeback"}]': finished 2024-02-13T00:39:22.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:22 smithi080 bash[17386]: audit 2024-02-13T00:39:21.209999+0000 mon.a (mon.0) 1414 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]': finished 2024-02-13T00:39:22.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:22 smithi080 bash[17386]: audit 2024-02-13T00:39:21.210157+0000 mon.a (mon.0) 1415 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pgp_num","val":"11"}]': finished 2024-02-13T00:39:22.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:22 smithi080 bash[17386]: cluster 2024-02-13T00:39:21.210394+0000 mon.a (mon.0) 1416 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2024-02-13T00:39:22.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:22 smithi080 bash[17386]: audit 2024-02-13T00:39:21.211990+0000 mon.a (mon.0) 1417 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:22.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:22 smithi080 bash[17386]: audit 2024-02-13T00:39:21.212477+0000 mon.a (mon.0) 1418 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]: dispatch 2024-02-13T00:39:22.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:22 smithi080 bash[17386]: audit 2024-02-13T00:39:21.213402+0000 mon.c (mon.2) 235 : audit [INF] from='client.? 172.21.15.80:0/1674569583' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:22.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:22 smithi080 bash[17386]: audit 2024-02-13T00:39:21.223645+0000 mon.a (mon.0) 1419 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:22.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:22 smithi080 bash[17386]: audit 2024-02-13T00:39:22.174828+0000 mon.c (mon.2) 236 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi080-54215-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-02-13T00:39:22.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:22 smithi080 bash[17386]: audit 2024-02-13T00:39:22.178611+0000 mon.a (mon.0) 1420 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi080-54215-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-02-13T00:39:22.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:22 smithi080 bash[24237]: cluster 2024-02-13T00:39:21.201469+0000 mon.a (mon.0) 1412 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:39:22.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:22 smithi080 bash[24237]: audit 2024-02-13T00:39:21.209836+0000 mon.a (mon.0) 1413 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-15", "mode": "writeback"}]': finished 2024-02-13T00:39:22.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:22 smithi080 bash[24237]: audit 2024-02-13T00:39:21.209999+0000 mon.a (mon.0) 1414 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]': finished 2024-02-13T00:39:22.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:22 smithi080 bash[24237]: audit 2024-02-13T00:39:21.210157+0000 mon.a (mon.0) 1415 : audit [INF] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi080-54215-1","var":"pgp_num","val":"11"}]': finished 2024-02-13T00:39:22.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:22 smithi080 bash[24237]: cluster 2024-02-13T00:39:21.210394+0000 mon.a (mon.0) 1416 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2024-02-13T00:39:22.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:22 smithi080 bash[24237]: audit 2024-02-13T00:39:21.211990+0000 mon.a (mon.0) 1417 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:22.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:22 smithi080 bash[24237]: audit 2024-02-13T00:39:21.212477+0000 mon.a (mon.0) 1418 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]: dispatch 2024-02-13T00:39:22.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:22 smithi080 bash[24237]: audit 2024-02-13T00:39:21.213402+0000 mon.c (mon.2) 235 : audit [INF] from='client.? 172.21.15.80:0/1674569583' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:22.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:22 smithi080 bash[24237]: audit 2024-02-13T00:39:21.223645+0000 mon.a (mon.0) 1419 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:22.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:22 smithi080 bash[24237]: audit 2024-02-13T00:39:22.174828+0000 mon.c (mon.2) 236 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi080-54215-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-02-13T00:39:22.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:22 smithi080 bash[24237]: audit 2024-02-13T00:39:22.178611+0000 mon.a (mon.0) 1420 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi080-54215-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-02-13T00:39:23.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:23 smithi106 bash[18459]: cluster 2024-02-13T00:39:22.174278+0000 mgr.y (mgr.24461) 391 : cluster [DBG] pgmap v378: 260 pgs: 260 active+clean; 8.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:39:23.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:23 smithi106 bash[18459]: audit 2024-02-13T00:39:22.214452+0000 mon.a (mon.0) 1421 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]': finished 2024-02-13T00:39:23.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:23 smithi106 bash[18459]: audit 2024-02-13T00:39:22.214654+0000 mon.a (mon.0) 1422 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi080-54175-28"}]': finished 2024-02-13T00:39:23.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:23 smithi106 bash[18459]: audit 2024-02-13T00:39:22.214814+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi080-54215-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-02-13T00:39:23.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:23 smithi106 bash[18459]: cluster 2024-02-13T00:39:22.215152+0000 mon.a (mon.0) 1424 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2024-02-13T00:39:23.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:23 smithi106 bash[18459]: audit 2024-02-13T00:39:22.215656+0000 mon.c (mon.2) 237 : audit [INF] from='client.? 172.21.15.80:0/1674569583' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:23.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:23 smithi106 bash[18459]: audit 2024-02-13T00:39:22.215926+0000 mon.a (mon.0) 1425 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:23.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:23 smithi106 bash[18459]: audit 2024-02-13T00:39:22.219778+0000 mon.a (mon.0) 1426 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:23.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:23 smithi106 bash[18459]: audit 2024-02-13T00:39:22.220312+0000 mon.a (mon.0) 1427 : audit [INF] from='client.? 172.21.15.80:0/2673036071' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi080-54183-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:23.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:23 smithi106 bash[18459]: audit 2024-02-13T00:39:22.251675+0000 mon.a (mon.0) 1428 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:39:23.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:23 smithi106 bash[18459]: cluster 2024-02-13T00:39:23.170181+0000 mon.a (mon.0) 1429 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:39:23.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:23 smithi106 bash[18459]: audit 2024-02-13T00:39:23.220076+0000 mon.a (mon.0) 1430 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi080-54175-28"}]': finished 2024-02-13T00:39:23.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:23 smithi106 bash[18459]: audit 2024-02-13T00:39:23.220348+0000 mon.a (mon.0) 1431 : audit [INF] from='client.? 172.21.15.80:0/2673036071' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi080-54183-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:23.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:23 smithi106 bash[18459]: audit 2024-02-13T00:39:23.221544+0000 mon.a (mon.0) 1432 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:39:23.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:23 smithi106 bash[18459]: cluster 2024-02-13T00:39:23.221631+0000 mon.a (mon.0) 1433 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2024-02-13T00:39:23.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:39:23] "GET /metrics HTTP/1.1" 200 192369 "" "Prometheus/2.33.4" 2024-02-13T00:39:23.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[17386]: cluster 2024-02-13T00:39:22.174278+0000 mgr.y (mgr.24461) 391 : cluster [DBG] pgmap v378: 260 pgs: 260 active+clean; 8.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:39:23.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[17386]: audit 2024-02-13T00:39:22.214452+0000 mon.a (mon.0) 1421 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]': finished 2024-02-13T00:39:23.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[17386]: audit 2024-02-13T00:39:22.214654+0000 mon.a (mon.0) 1422 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi080-54175-28"}]': finished 2024-02-13T00:39:23.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[17386]: audit 2024-02-13T00:39:22.214814+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi080-54215-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-02-13T00:39:23.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[17386]: cluster 2024-02-13T00:39:22.215152+0000 mon.a (mon.0) 1424 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2024-02-13T00:39:23.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[17386]: audit 2024-02-13T00:39:22.215656+0000 mon.c (mon.2) 237 : audit [INF] from='client.? 172.21.15.80:0/1674569583' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:23.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[17386]: audit 2024-02-13T00:39:22.215926+0000 mon.a (mon.0) 1425 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:23.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[17386]: audit 2024-02-13T00:39:22.219778+0000 mon.a (mon.0) 1426 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:23.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[17386]: audit 2024-02-13T00:39:22.220312+0000 mon.a (mon.0) 1427 : audit [INF] from='client.? 172.21.15.80:0/2673036071' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi080-54183-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:23.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[17386]: audit 2024-02-13T00:39:22.251675+0000 mon.a (mon.0) 1428 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:39:23.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[17386]: cluster 2024-02-13T00:39:23.170181+0000 mon.a (mon.0) 1429 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:39:23.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[17386]: audit 2024-02-13T00:39:23.220076+0000 mon.a (mon.0) 1430 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi080-54175-28"}]': finished 2024-02-13T00:39:23.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[17386]: audit 2024-02-13T00:39:23.220348+0000 mon.a (mon.0) 1431 : audit [INF] from='client.? 172.21.15.80:0/2673036071' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi080-54183-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:23.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[17386]: audit 2024-02-13T00:39:23.221544+0000 mon.a (mon.0) 1432 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:39:23.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[17386]: cluster 2024-02-13T00:39:23.221631+0000 mon.a (mon.0) 1433 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2024-02-13T00:39:23.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[24237]: cluster 2024-02-13T00:39:22.174278+0000 mgr.y (mgr.24461) 391 : cluster [DBG] pgmap v378: 260 pgs: 260 active+clean; 8.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:39:23.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[24237]: audit 2024-02-13T00:39:22.214452+0000 mon.a (mon.0) 1421 : audit [INF] from='client.? 172.21.15.80:0/3465816796' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi080-54454-20"}]': finished 2024-02-13T00:39:23.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[24237]: audit 2024-02-13T00:39:22.214654+0000 mon.a (mon.0) 1422 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi080-54175-28"}]': finished 2024-02-13T00:39:23.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[24237]: audit 2024-02-13T00:39:22.214814+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi080-54215-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-02-13T00:39:23.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[24237]: cluster 2024-02-13T00:39:22.215152+0000 mon.a (mon.0) 1424 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2024-02-13T00:39:23.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[24237]: audit 2024-02-13T00:39:22.215656+0000 mon.c (mon.2) 237 : audit [INF] from='client.? 172.21.15.80:0/1674569583' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:23.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[24237]: audit 2024-02-13T00:39:22.215926+0000 mon.a (mon.0) 1425 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:23.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[24237]: audit 2024-02-13T00:39:22.219778+0000 mon.a (mon.0) 1426 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi080-54175-28"}]: dispatch 2024-02-13T00:39:23.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[24237]: audit 2024-02-13T00:39:22.220312+0000 mon.a (mon.0) 1427 : audit [INF] from='client.? 172.21.15.80:0/2673036071' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi080-54183-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:23.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[24237]: audit 2024-02-13T00:39:22.251675+0000 mon.a (mon.0) 1428 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:39:23.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[24237]: cluster 2024-02-13T00:39:23.170181+0000 mon.a (mon.0) 1429 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:39:23.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[24237]: audit 2024-02-13T00:39:23.220076+0000 mon.a (mon.0) 1430 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi080-54175-28"}]': finished 2024-02-13T00:39:23.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[24237]: audit 2024-02-13T00:39:23.220348+0000 mon.a (mon.0) 1431 : audit [INF] from='client.? 172.21.15.80:0/2673036071' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi080-54183-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:23.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[24237]: audit 2024-02-13T00:39:23.221544+0000 mon.a (mon.0) 1432 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:39:23.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:23 smithi080 bash[24237]: cluster 2024-02-13T00:39:23.221631+0000 mon.a (mon.0) 1433 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2024-02-13T00:39:24.227 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: Running main() from gmock_main.cc 2024-02-13T00:39:24.227 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [==========] Running 56 tests from 4 test suites. 2024-02-13T00:39:24.227 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [----------] Global test environment set-up. 2024-02-13T00:39:24.227 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [----------] 31 tests from LibRadosAio 2024-02-13T00:39:24.227 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2024-02-13T00:39:24.227 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (11833 ms) 2024-02-13T00:39:24.227 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2024-02-13T00:39:24.227 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (23102 ms) 2024-02-13T00:39:24.227 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2024-02-13T00:39:24.228 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (7630 ms) 2024-02-13T00:39:24.228 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2024-02-13T00:39:24.228 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (3598 ms) 2024-02-13T00:39:24.228 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2024-02-13T00:39:24.228 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (2886 ms) 2024-02-13T00:39:24.228 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2024-02-13T00:39:24.228 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (3011 ms) 2024-02-13T00:39:24.228 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2024-02-13T00:39:24.228 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (3218 ms) 2024-02-13T00:39:24.228 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-02-13T00:39:24.228 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (2551 ms) 2024-02-13T00:39:24.228 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2024-02-13T00:39:24.228 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (3022 ms) 2024-02-13T00:39:24.228 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2024-02-13T00:39:24.228 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (2996 ms) 2024-02-13T00:39:24.228 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2024-02-13T00:39:24.229 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (3000 ms) 2024-02-13T00:39:24.229 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2024-02-13T00:39:24.229 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (3026 ms) 2024-02-13T00:39:24.229 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2024-02-13T00:39:24.229 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (2998 ms) 2024-02-13T00:39:24.229 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-02-13T00:39:24.229 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3009 ms) 2024-02-13T00:39:24.229 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-02-13T00:39:24.229 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3027 ms) 2024-02-13T00:39:24.229 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-02-13T00:39:24.229 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (3446 ms) 2024-02-13T00:39:24.229 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-02-13T00:39:24.229 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (2582 ms) 2024-02-13T00:39:24.229 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2024-02-13T00:39:24.229 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (3002 ms) 2024-02-13T00:39:24.230 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2024-02-13T00:39:24.230 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3012 ms) 2024-02-13T00:39:24.230 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2024-02-13T00:39:24.230 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (2917 ms) 2024-02-13T00:39:24.230 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2024-02-13T00:39:24.230 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (3445 ms) 2024-02-13T00:39:24.230 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2024-02-13T00:39:24.230 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (2942 ms) 2024-02-13T00:39:24.230 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2024-02-13T00:39:24.230 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (3011 ms) 2024-02-13T00:39:24.230 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2024-02-13T00:39:24.230 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (3013 ms) 2024-02-13T00:39:24.230 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2024-02-13T00:39:24.230 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (3435 ms) 2024-02-13T00:39:24.230 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2024-02-13T00:39:24.230 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (2567 ms) 2024-02-13T00:39:24.230 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2024-02-13T00:39:24.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:24 smithi106 bash[18459]: audit 2024-02-13T00:39:23.225007+0000 mon.a (mon.0) 1434 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:24.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:24 smithi106 bash[18459]: audit 2024-02-13T00:39:23.227294+0000 mon.a (mon.0) 1435 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-15"}]: dispatch 2024-02-13T00:39:24.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:24 smithi106 bash[18459]: audit 2024-02-13T00:39:23.254798+0000 mon.c (mon.2) 238 : audit [INF] from='client.? 172.21.15.80:0/2543942247' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:24.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:24 smithi106 bash[18459]: audit 2024-02-13T00:39:23.255553+0000 mon.a (mon.0) 1436 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:24.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:24 smithi106 bash[18459]: audit 2024-02-13T00:39:23.256542+0000 mon.c (mon.2) 239 : audit [INF] from='client.? 172.21.15.80:0/2543942247' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:24.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:24 smithi106 bash[18459]: audit 2024-02-13T00:39:23.256877+0000 mon.a (mon.0) 1437 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:24.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:24 smithi106 bash[18459]: audit 2024-02-13T00:39:23.257531+0000 mon.c (mon.2) 240 : audit [INF] from='client.? 172.21.15.80:0/2543942247' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi080-54175-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:24.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:24 smithi106 bash[18459]: audit 2024-02-13T00:39:23.257881+0000 mon.a (mon.0) 1438 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi080-54175-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:24.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:24 smithi106 bash[18459]: cluster 2024-02-13T00:39:24.211520+0000 mon.a (mon.0) 1439 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:39:24.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:24 smithi106 bash[18459]: audit 2024-02-13T00:39:24.221228+0000 mon.a (mon.0) 1440 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-15"}]': finished 2024-02-13T00:39:24.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:24 smithi106 bash[18459]: audit 2024-02-13T00:39:24.221387+0000 mon.a (mon.0) 1441 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi080-54175-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:24.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:24 smithi106 bash[18459]: cluster 2024-02-13T00:39:24.221520+0000 mon.a (mon.0) 1442 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2024-02-13T00:39:24.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:24 smithi106 bash[18459]: audit 2024-02-13T00:39:24.229270+0000 mon.c (mon.2) 241 : audit [INF] from='client.? 172.21.15.80:0/2543942247' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi080-54175-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:24.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:24 smithi106 bash[18459]: audit 2024-02-13T00:39:24.229931+0000 mon.a (mon.0) 1443 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi080-54175-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[17386]: audit 2024-02-13T00:39:23.225007+0000 mon.a (mon.0) 1434 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[17386]: audit 2024-02-13T00:39:23.227294+0000 mon.a (mon.0) 1435 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-15"}]: dispatch 2024-02-13T00:39:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[17386]: audit 2024-02-13T00:39:23.254798+0000 mon.c (mon.2) 238 : audit [INF] from='client.? 172.21.15.80:0/2543942247' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[17386]: audit 2024-02-13T00:39:23.255553+0000 mon.a (mon.0) 1436 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[17386]: audit 2024-02-13T00:39:23.256542+0000 mon.c (mon.2) 239 : audit [INF] from='client.? 172.21.15.80:0/2543942247' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[17386]: audit 2024-02-13T00:39:23.256877+0000 mon.a (mon.0) 1437 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[17386]: audit 2024-02-13T00:39:23.257531+0000 mon.c (mon.2) 240 : audit [INF] from='client.? 172.21.15.80:0/2543942247' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi080-54175-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[17386]: audit 2024-02-13T00:39:23.257881+0000 mon.a (mon.0) 1438 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi080-54175-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[17386]: cluster 2024-02-13T00:39:24.211520+0000 mon.a (mon.0) 1439 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:39:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[17386]: audit 2024-02-13T00:39:24.221228+0000 mon.a (mon.0) 1440 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-15"}]': finished 2024-02-13T00:39:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[17386]: audit 2024-02-13T00:39:24.221387+0000 mon.a (mon.0) 1441 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi080-54175-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[17386]: cluster 2024-02-13T00:39:24.221520+0000 mon.a (mon.0) 1442 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2024-02-13T00:39:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[17386]: audit 2024-02-13T00:39:24.229270+0000 mon.c (mon.2) 241 : audit [INF] from='client.? 172.21.15.80:0/2543942247' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi080-54175-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:24.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[17386]: audit 2024-02-13T00:39:24.229931+0000 mon.a (mon.0) 1443 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi080-54175-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:24.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[24237]: audit 2024-02-13T00:39:23.225007+0000 mon.a (mon.0) 1434 : audit [DBG] from='client.? 172.21.15.80:0/4067559640' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T00:39:24.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[24237]: audit 2024-02-13T00:39:23.227294+0000 mon.a (mon.0) 1435 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-15"}]: dispatch 2024-02-13T00:39:24.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[24237]: audit 2024-02-13T00:39:23.254798+0000 mon.c (mon.2) 238 : audit [INF] from='client.? 172.21.15.80:0/2543942247' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:24.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[24237]: audit 2024-02-13T00:39:23.255553+0000 mon.a (mon.0) 1436 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:24.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[24237]: audit 2024-02-13T00:39:23.256542+0000 mon.c (mon.2) 239 : audit [INF] from='client.? 172.21.15.80:0/2543942247' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:24.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[24237]: audit 2024-02-13T00:39:23.256877+0000 mon.a (mon.0) 1437 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:24.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[24237]: audit 2024-02-13T00:39:23.257531+0000 mon.c (mon.2) 240 : audit [INF] from='client.? 172.21.15.80:0/2543942247' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi080-54175-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:24.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[24237]: audit 2024-02-13T00:39:23.257881+0000 mon.a (mon.0) 1438 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi080-54175-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:24.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[24237]: cluster 2024-02-13T00:39:24.211520+0000 mon.a (mon.0) 1439 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:39:24.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[24237]: audit 2024-02-13T00:39:24.221228+0000 mon.a (mon.0) 1440 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-15"}]': finished 2024-02-13T00:39:24.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[24237]: audit 2024-02-13T00:39:24.221387+0000 mon.a (mon.0) 1441 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi080-54175-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:24.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[24237]: cluster 2024-02-13T00:39:24.221520+0000 mon.a (mon.0) 1442 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2024-02-13T00:39:24.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[24237]: audit 2024-02-13T00:39:24.229270+0000 mon.c (mon.2) 241 : audit [INF] from='client.? 172.21.15.80:0/2543942247' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi080-54175-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:24.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:24 smithi080 bash[24237]: audit 2024-02-13T00:39:24.229931+0000 mon.a (mon.0) 1443 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi080-54175-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:26.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:26 smithi106 bash[18459]: cluster 2024-02-13T00:39:24.175367+0000 mgr.y (mgr.24461) 392 : cluster [DBG] pgmap v381: 292 pgs: 32 creating+peering, 1 peering, 259 active+clean; 8.6 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s wr, 4 op/s 2024-02-13T00:39:26.561 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:26 smithi106 bash[18459]: audit 2024-02-13T00:39:24.260293+0000 mon.a (mon.0) 1444 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi080-54215-2"}]: dispatch 2024-02-13T00:39:26.561 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:26 smithi106 bash[18459]: audit 2024-02-13T00:39:24.699388+0000 mon.a (mon.0) 1445 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi080-54215-2"}]: dispatch 2024-02-13T00:39:26.561 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:26 smithi106 bash[18459]: audit 2024-02-13T00:39:24.700495+0000 mon.a (mon.0) 1446 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi080-54215-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:26.561 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:26 smithi106 bash[18459]: audit 2024-02-13T00:39:25.667254+0000 mon.a (mon.0) 1447 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi080-54215-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:26.561 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:26 smithi106 bash[18459]: cluster 2024-02-13T00:39:25.667336+0000 mon.a (mon.0) 1448 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2024-02-13T00:39:26.562 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:26 smithi080 bash[17386]: cluster 2024-02-13T00:39:24.175367+0000 mgr.y (mgr.24461) 392 : cluster [DBG] pgmap v381: 292 pgs: 32 creating+peering, 1 peering, 259 active+clean; 8.6 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s wr, 4 op/s 2024-02-13T00:39:26.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:26 smithi080 bash[17386]: audit 2024-02-13T00:39:24.260293+0000 mon.a (mon.0) 1444 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi080-54215-2"}]: dispatch 2024-02-13T00:39:26.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:26 smithi080 bash[17386]: audit 2024-02-13T00:39:24.699388+0000 mon.a (mon.0) 1445 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi080-54215-2"}]: dispatch 2024-02-13T00:39:26.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:26 smithi080 bash[17386]: audit 2024-02-13T00:39:24.700495+0000 mon.a (mon.0) 1446 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi080-54215-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:26.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:26 smithi080 bash[17386]: audit 2024-02-13T00:39:25.667254+0000 mon.a (mon.0) 1447 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi080-54215-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:26.563 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:26 smithi080 bash[17386]: cluster 2024-02-13T00:39:25.667336+0000 mon.a (mon.0) 1448 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2024-02-13T00:39:26.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:26 smithi080 bash[24237]: cluster 2024-02-13T00:39:24.175367+0000 mgr.y (mgr.24461) 392 : cluster [DBG] pgmap v381: 292 pgs: 32 creating+peering, 1 peering, 259 active+clean; 8.6 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 0 B/s wr, 4 op/s 2024-02-13T00:39:26.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:26 smithi080 bash[24237]: audit 2024-02-13T00:39:24.260293+0000 mon.a (mon.0) 1444 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi080-54215-2"}]: dispatch 2024-02-13T00:39:26.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:26 smithi080 bash[24237]: audit 2024-02-13T00:39:24.699388+0000 mon.a (mon.0) 1445 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi080-54215-2"}]: dispatch 2024-02-13T00:39:26.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:26 smithi080 bash[24237]: audit 2024-02-13T00:39:24.700495+0000 mon.a (mon.0) 1446 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi080-54215-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:26.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:26 smithi080 bash[24237]: audit 2024-02-13T00:39:25.667254+0000 mon.a (mon.0) 1447 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi080-54215-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:26.564 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:26 smithi080 bash[24237]: cluster 2024-02-13T00:39:25.667336+0000 mon.a (mon.0) 1448 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2024-02-13T00:39:27.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:27 smithi106 bash[18459]: audit 2024-02-13T00:39:25.671500+0000 mon.c (mon.2) 242 : audit [INF] from='client.? 172.21.15.80:0/3167362265' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi080-54183-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:27.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:27 smithi106 bash[18459]: audit 2024-02-13T00:39:26.098061+0000 mon.a (mon.0) 1449 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi080-54215-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi080-54215-2"}]: dispatch 2024-02-13T00:39:27.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:27 smithi106 bash[18459]: audit 2024-02-13T00:39:26.098589+0000 mon.a (mon.0) 1450 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi080-54183-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:27.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:27 smithi106 bash[18459]: audit 2024-02-13T00:39:26.226483+0000 mon.a (mon.0) 1451 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi080-54175-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi080-54175-29"}]': finished 2024-02-13T00:39:27.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:27 smithi106 bash[18459]: audit 2024-02-13T00:39:26.669148+0000 mon.a (mon.0) 1452 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi080-54183-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:27.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:27 smithi106 bash[18459]: cluster 2024-02-13T00:39:26.669223+0000 mon.a (mon.0) 1453 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2024-02-13T00:39:27.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:27 smithi106 bash[18459]: audit 2024-02-13T00:39:26.670357+0000 mon.a (mon.0) 1454 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:27.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:27 smithi080 bash[17386]: audit 2024-02-13T00:39:25.671500+0000 mon.c (mon.2) 242 : audit [INF] from='client.? 172.21.15.80:0/3167362265' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi080-54183-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:27.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:27 smithi080 bash[17386]: audit 2024-02-13T00:39:26.098061+0000 mon.a (mon.0) 1449 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi080-54215-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi080-54215-2"}]: dispatch 2024-02-13T00:39:27.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:27 smithi080 bash[17386]: audit 2024-02-13T00:39:26.098589+0000 mon.a (mon.0) 1450 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi080-54183-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:27.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:27 smithi080 bash[17386]: audit 2024-02-13T00:39:26.226483+0000 mon.a (mon.0) 1451 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi080-54175-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi080-54175-29"}]': finished 2024-02-13T00:39:27.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:27 smithi080 bash[17386]: audit 2024-02-13T00:39:26.669148+0000 mon.a (mon.0) 1452 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi080-54183-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:27.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:27 smithi080 bash[17386]: cluster 2024-02-13T00:39:26.669223+0000 mon.a (mon.0) 1453 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2024-02-13T00:39:27.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:27 smithi080 bash[17386]: audit 2024-02-13T00:39:26.670357+0000 mon.a (mon.0) 1454 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:27.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:27 smithi080 bash[24237]: audit 2024-02-13T00:39:25.671500+0000 mon.c (mon.2) 242 : audit [INF] from='client.? 172.21.15.80:0/3167362265' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi080-54183-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:27.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:27 smithi080 bash[24237]: audit 2024-02-13T00:39:26.098061+0000 mon.a (mon.0) 1449 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi080-54215-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi080-54215-2"}]: dispatch 2024-02-13T00:39:27.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:27 smithi080 bash[24237]: audit 2024-02-13T00:39:26.098589+0000 mon.a (mon.0) 1450 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi080-54183-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:27.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:27 smithi080 bash[24237]: audit 2024-02-13T00:39:26.226483+0000 mon.a (mon.0) 1451 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi080-54175-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi080-54175-29"}]': finished 2024-02-13T00:39:27.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:27 smithi080 bash[24237]: audit 2024-02-13T00:39:26.669148+0000 mon.a (mon.0) 1452 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi080-54183-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:27.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:27 smithi080 bash[24237]: cluster 2024-02-13T00:39:26.669223+0000 mon.a (mon.0) 1453 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2024-02-13T00:39:27.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:27 smithi080 bash[24237]: audit 2024-02-13T00:39:26.670357+0000 mon.a (mon.0) 1454 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:28.282 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAiry=12 expected=12 2024-02-13T00:39:28.282 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:566253c9:::13:head 2024-02-13T00:39:28.283 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : cursor()=27:566253c9:::13:head expected=27:566253c9:::13:head 2024-02-13T00:39:28.283 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:566253c9:::13:head -> 13 2024-02-13T00:39:28.283 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : entry=13 expected=13 2024-02-13T00:39:28.283 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:d83876eb:::4:head 2024-02-13T00:39:28.283 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : cursor()=27:d83876eb:::4:head expected=27:d83876eb:::4:head 2024-02-13T00:39:28.283 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:d83876eb:::4:head -> 4 2024-02-13T00:39:28.283 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : entry=4 expected=4 2024-02-13T00:39:28.283 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:cfc208b3:::3:head 2024-02-13T00:39:28.283 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : cursor()=27:cfc208b3:::3:head expected=27:cfc208b3:::3:head 2024-02-13T00:39:28.283 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:cfc208b3:::3:head -> 3 2024-02-13T00:39:28.283 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : entry=3 expected=3 2024-02-13T00:39:28.283 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:bd63b0f1:::8:head 2024-02-13T00:39:28.283 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : cursor()=27:bd63b0f1:::8:head expected=27:bd63b0f1:::8:head 2024-02-13T00:39:28.283 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:bd63b0f1:::8:head -> 8 2024-02-13T00:39:28.284 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : entry=8 expected=8 2024-02-13T00:39:28.284 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:b29083e3:::5:head 2024-02-13T00:39:28.284 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : cursor()=27:b29083e3:::5:head expected=27:b29083e3:::5:head 2024-02-13T00:39:28.284 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:b29083e3:::5:head -> 5 2024-02-13T00:39:28.284 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : entry=5 expected=5 2024-02-13T00:39:28.284 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:89d3ae78:::11:head 2024-02-13T00:39:28.284 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : cursor()=27:89d3ae78:::11:head expected=27:89d3ae78:::11:head 2024-02-13T00:39:28.284 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:89d3ae78:::11:head -> 11 2024-02-13T00:39:28.284 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : entry=11 expected=11 2024-02-13T00:39:28.284 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:863748b0:::15:head 2024-02-13T00:39:28.284 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : cursor()=27:863748b0:::15:head expected=27:863748b0:::15:head 2024-02-13T00:39:28.284 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:863748b0:::15:head -> 15 2024-02-13T00:39:28.284 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : entry=15 expected=15 2024-02-13T00:39:28.284 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : seek to 27:6cac518f:::0:head 2024-02-13T00:39:28.284 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : cursor()=27:6cac518f:::0:head expected=27:6cac518f:::0:head 2024-02-13T00:39:28.285 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: > 27:6cac518f:::0:head -> 0 2024-02-13T00:39:28.285 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: : entry=0 expected=0 2024-02-13T00:39:28.285 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (357 ms) 2024-02-13T00:39:28.285 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2024-02-13T00:39:28.285 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (97876 ms) 2024-02-13T00:39:28.285 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2024-02-13T00:39:28.285 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: split 0/5 -> MIN 27:33333333::::head 2024-02-13T00:39:28.285 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: split 1/5 -> 27:33333333::::head 27:66666666::::head 2024-02-13T00:39:28.285 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: split 2/5 -> 27:66666666::::head 27:99999999::::head 2024-02-13T00:39:28.285 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: split 3/5 -> 27:99999999::::head 27:cccccccc::::head 2024-02-13T00:39:28.285 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: split 4/5 -> 27:cccccccc::::head MAX 2024-02-13T00:39:28.285 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (4035 ms) 2024-02-13T00:39:28.285 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [----------] 7 tests from LibRadosList (102550 ms total) 2024-02-13T00:39:28.285 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 2024-02-13T00:39:28.285 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [----------] 3 tests from LibRadosListEC 2024-02-13T00:39:28.286 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2024-02-13T00:39:28.286 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1048 ms) 2024-02-13T00:39:28.286 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2024-02-13T00:39:28.286 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: myset foo1,foo2,foo3 2024-02-13T00:39:28.286 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: foo1 2024-02-13T00:39:28.286 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: foo2 2024-02-13T00:39:28.286 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: foo3 2024-02-13T00:39:28.286 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: myset foo1,foo4,foo5 2024-02-13T00:39:28.286 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: foo4 2024-02-13T00:39:28.286 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: foo5 2024-02-13T00:39:28.286 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: foo1 2024-02-13T00:39:28.286 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: myset foo6,foo7 2024-02-13T00:39:28.286 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: foo7 2024-02-13T00:39:28.286 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: foo6 2024-02-13T00:39:28.286 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-02-13T00:39:28.286 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: ns1:foo4 2024-02-13T00:39:28.287 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: ns1:foo5 2024-02-13T00:39:28.287 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: ns2:foo7 2024-02-13T00:39:28.287 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: ns2:foo6 2024-02-13T00:39:28.287 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: ns1:foo1 2024-02-13T00:39:28.287 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: :foo1 2024-02-13T00:39:28.287 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: :foo2 2024-02-13T00:39:28.287 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: :foo3 2024-02-13T00:39:28.287 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (50 ms) 2024-02-13T00:39:28.505 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:39:28 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:39:28.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:28 smithi106 bash[18459]: cluster 2024-02-13T00:39:26.176177+0000 mgr.y (mgr.24461) 393 : cluster [DBG] pgmap v384: 228 pgs: 32 unknown, 196 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:39:28.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:28 smithi106 bash[18459]: audit 2024-02-13T00:39:27.177667+0000 mon.a (mon.0) 1455 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi080-54215-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi080-54215-2"}]': finished 2024-02-13T00:39:28.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:28 smithi106 bash[18459]: audit 2024-02-13T00:39:27.177946+0000 mon.a (mon.0) 1456 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:28.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:28 smithi106 bash[18459]: cluster 2024-02-13T00:39:27.178253+0000 mon.a (mon.0) 1457 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2024-02-13T00:39:28.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:28 smithi106 bash[18459]: audit 2024-02-13T00:39:27.220837+0000 mon.a (mon.0) 1458 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:39:28.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:28 smithi080 bash[17386]: cluster 2024-02-13T00:39:26.176177+0000 mgr.y (mgr.24461) 393 : cluster [DBG] pgmap v384: 228 pgs: 32 unknown, 196 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:39:28.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:28 smithi080 bash[17386]: audit 2024-02-13T00:39:27.177667+0000 mon.a (mon.0) 1455 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi080-54215-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi080-54215-2"}]': finished 2024-02-13T00:39:28.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:28 smithi080 bash[17386]: audit 2024-02-13T00:39:27.177946+0000 mon.a (mon.0) 1456 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:28.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:28 smithi080 bash[17386]: cluster 2024-02-13T00:39:27.178253+0000 mon.a (mon.0) 1457 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2024-02-13T00:39:28.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:28 smithi080 bash[17386]: audit 2024-02-13T00:39:27.220837+0000 mon.a (mon.0) 1458 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:39:28.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:28 smithi080 bash[24237]: cluster 2024-02-13T00:39:26.176177+0000 mgr.y (mgr.24461) 393 : cluster [DBG] pgmap v384: 228 pgs: 32 unknown, 196 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:39:28.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:28 smithi080 bash[24237]: audit 2024-02-13T00:39:27.177667+0000 mon.a (mon.0) 1455 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi080-54215-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi080-54215-2"}]': finished 2024-02-13T00:39:28.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:28 smithi080 bash[24237]: audit 2024-02-13T00:39:27.177946+0000 mon.a (mon.0) 1456 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:28.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:28 smithi080 bash[24237]: cluster 2024-02-13T00:39:27.178253+0000 mon.a (mon.0) 1457 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2024-02-13T00:39:28.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:28 smithi080 bash[24237]: audit 2024-02-13T00:39:27.220837+0000 mon.a (mon.0) 1458 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:39:29.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:29 smithi106 bash[18459]: cluster 2024-02-13T00:39:28.178395+0000 mgr.y (mgr.24461) 394 : cluster [DBG] pgmap v387: 244 pgs: 8 creating+peering, 236 active+clean; 6.9 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-13T00:39:29.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:29 smithi106 bash[18459]: audit 2024-02-13T00:39:28.179288+0000 mgr.y (mgr.24461) 395 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:39:29.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:29 smithi106 bash[18459]: audit 2024-02-13T00:39:28.200170+0000 mon.a (mon.0) 1459 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-17", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:39:29.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:29 smithi106 bash[18459]: cluster 2024-02-13T00:39:28.200424+0000 mon.a (mon.0) 1460 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2024-02-13T00:39:29.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:29 smithi106 bash[18459]: audit 2024-02-13T00:39:28.204008+0000 mon.a (mon.0) 1461 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-17"}]: dispatch 2024-02-13T00:39:29.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:29 smithi106 bash[18459]: audit 2024-02-13T00:39:28.207443+0000 mon.c (mon.2) 243 : audit [INF] from='client.? 172.21.15.80:0/24616071' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi080-54183-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:29.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:29 smithi106 bash[18459]: audit 2024-02-13T00:39:28.208348+0000 mon.a (mon.0) 1462 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi080-54183-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:29.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:29 smithi106 bash[18459]: audit 2024-02-13T00:39:28.209972+0000 mon.c (mon.2) 244 : audit [INF] from='client.? 172.21.15.80:0/2543942247' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:29.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:29 smithi106 bash[18459]: audit 2024-02-13T00:39:28.210822+0000 mon.a (mon.0) 1463 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:29.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:29 smithi106 bash[18459]: cluster 2024-02-13T00:39:29.104068+0000 mon.a (mon.0) 1464 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:39:29.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:29 smithi080 bash[17386]: cluster 2024-02-13T00:39:28.178395+0000 mgr.y (mgr.24461) 394 : cluster [DBG] pgmap v387: 244 pgs: 8 creating+peering, 236 active+clean; 6.9 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-13T00:39:29.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:29 smithi080 bash[17386]: audit 2024-02-13T00:39:28.179288+0000 mgr.y (mgr.24461) 395 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:39:29.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:29 smithi080 bash[17386]: audit 2024-02-13T00:39:28.200170+0000 mon.a (mon.0) 1459 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-17", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:39:29.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:29 smithi080 bash[17386]: cluster 2024-02-13T00:39:28.200424+0000 mon.a (mon.0) 1460 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2024-02-13T00:39:29.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:29 smithi080 bash[17386]: audit 2024-02-13T00:39:28.204008+0000 mon.a (mon.0) 1461 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-17"}]: dispatch 2024-02-13T00:39:29.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:29 smithi080 bash[17386]: audit 2024-02-13T00:39:28.207443+0000 mon.c (mon.2) 243 : audit [INF] from='client.? 172.21.15.80:0/24616071' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi080-54183-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:29.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:29 smithi080 bash[17386]: audit 2024-02-13T00:39:28.208348+0000 mon.a (mon.0) 1462 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi080-54183-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:29.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:29 smithi080 bash[17386]: audit 2024-02-13T00:39:28.209972+0000 mon.c (mon.2) 244 : audit [INF] from='client.? 172.21.15.80:0/2543942247' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:29.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:29 smithi080 bash[17386]: audit 2024-02-13T00:39:28.210822+0000 mon.a (mon.0) 1463 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:29.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:29 smithi080 bash[17386]: cluster 2024-02-13T00:39:29.104068+0000 mon.a (mon.0) 1464 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:39:29.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:29 smithi080 bash[24237]: cluster 2024-02-13T00:39:28.178395+0000 mgr.y (mgr.24461) 394 : cluster [DBG] pgmap v387: 244 pgs: 8 creating+peering, 236 active+clean; 6.9 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-13T00:39:29.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:29 smithi080 bash[24237]: audit 2024-02-13T00:39:28.179288+0000 mgr.y (mgr.24461) 395 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:39:29.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:29 smithi080 bash[24237]: audit 2024-02-13T00:39:28.200170+0000 mon.a (mon.0) 1459 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-17", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:39:29.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:29 smithi080 bash[24237]: cluster 2024-02-13T00:39:28.200424+0000 mon.a (mon.0) 1460 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2024-02-13T00:39:29.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:29 smithi080 bash[24237]: audit 2024-02-13T00:39:28.204008+0000 mon.a (mon.0) 1461 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-17"}]: dispatch 2024-02-13T00:39:29.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:29 smithi080 bash[24237]: audit 2024-02-13T00:39:28.207443+0000 mon.c (mon.2) 243 : audit [INF] from='client.? 172.21.15.80:0/24616071' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi080-54183-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:29.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:29 smithi080 bash[24237]: audit 2024-02-13T00:39:28.208348+0000 mon.a (mon.0) 1462 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi080-54183-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:29.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:29 smithi080 bash[24237]: audit 2024-02-13T00:39:28.209972+0000 mon.c (mon.2) 244 : audit [INF] from='client.? 172.21.15.80:0/2543942247' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:29.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:29 smithi080 bash[24237]: audit 2024-02-13T00:39:28.210822+0000 mon.a (mon.0) 1463 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:29.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:29 smithi080 bash[24237]: cluster 2024-02-13T00:39:29.104068+0000 mon.a (mon.0) 1464 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:39:30.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:39:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:39:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:39:30.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:30 smithi106 bash[18459]: audit 2024-02-13T00:39:29.200709+0000 mon.a (mon.0) 1465 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-17"}]': finished 2024-02-13T00:39:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:30 smithi106 bash[18459]: audit 2024-02-13T00:39:29.201050+0000 mon.a (mon.0) 1466 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi080-54183-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:30 smithi106 bash[18459]: audit 2024-02-13T00:39:29.201261+0000 mon.a (mon.0) 1467 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi080-54175-29"}]': finished 2024-02-13T00:39:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:30 smithi106 bash[18459]: cluster 2024-02-13T00:39:29.201579+0000 mon.a (mon.0) 1468 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2024-02-13T00:39:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:30 smithi106 bash[18459]: audit 2024-02-13T00:39:29.207664+0000 mon.a (mon.0) 1469 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-17", "mode": "writeback"}]: dispatch 2024-02-13T00:39:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:30 smithi106 bash[18459]: audit 2024-02-13T00:39:29.208449+0000 mon.a (mon.0) 1470 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi080-54215-2"}]: dispatch 2024-02-13T00:39:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:30 smithi106 bash[18459]: audit 2024-02-13T00:39:29.209663+0000 mon.c (mon.2) 245 : audit [INF] from='client.? 172.21.15.80:0/2543942247' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:30 smithi106 bash[18459]: audit 2024-02-13T00:39:29.222333+0000 mon.a (mon.0) 1471 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:30 smithi106 bash[18459]: cluster 2024-02-13T00:39:30.196006+0000 mon.a (mon.0) 1472 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:39:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:30 smithi106 bash[18459]: audit 2024-02-13T00:39:30.206657+0000 mon.a (mon.0) 1473 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-17", "mode": "writeback"}]': finished 2024-02-13T00:39:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:30 smithi106 bash[18459]: audit 2024-02-13T00:39:30.206763+0000 mon.a (mon.0) 1474 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi080-54215-2"}]': finished 2024-02-13T00:39:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:30 smithi106 bash[18459]: audit 2024-02-13T00:39:30.206977+0000 mon.a (mon.0) 1475 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi080-54175-29"}]': finished 2024-02-13T00:39:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:30 smithi106 bash[18459]: cluster 2024-02-13T00:39:30.207107+0000 mon.a (mon.0) 1476 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2024-02-13T00:39:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:30 smithi106 bash[18459]: audit 2024-02-13T00:39:30.207672+0000 mon.a (mon.0) 1477 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi080-54215-2"}]: dispatch 2024-02-13T00:39:30.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[17386]: audit 2024-02-13T00:39:29.200709+0000 mon.a (mon.0) 1465 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-17"}]': finished 2024-02-13T00:39:30.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[17386]: audit 2024-02-13T00:39:29.201050+0000 mon.a (mon.0) 1466 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi080-54183-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:30.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[17386]: audit 2024-02-13T00:39:29.201261+0000 mon.a (mon.0) 1467 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi080-54175-29"}]': finished 2024-02-13T00:39:30.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[17386]: cluster 2024-02-13T00:39:29.201579+0000 mon.a (mon.0) 1468 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2024-02-13T00:39:30.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[17386]: audit 2024-02-13T00:39:29.207664+0000 mon.a (mon.0) 1469 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-17", "mode": "writeback"}]: dispatch 2024-02-13T00:39:30.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[17386]: audit 2024-02-13T00:39:29.208449+0000 mon.a (mon.0) 1470 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi080-54215-2"}]: dispatch 2024-02-13T00:39:30.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[17386]: audit 2024-02-13T00:39:29.209663+0000 mon.c (mon.2) 245 : audit [INF] from='client.? 172.21.15.80:0/2543942247' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:30.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[17386]: audit 2024-02-13T00:39:29.222333+0000 mon.a (mon.0) 1471 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:30.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[17386]: cluster 2024-02-13T00:39:30.196006+0000 mon.a (mon.0) 1472 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:39:30.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[17386]: audit 2024-02-13T00:39:30.206657+0000 mon.a (mon.0) 1473 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-17", "mode": "writeback"}]': finished 2024-02-13T00:39:30.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[17386]: audit 2024-02-13T00:39:30.206763+0000 mon.a (mon.0) 1474 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi080-54215-2"}]': finished 2024-02-13T00:39:30.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[17386]: audit 2024-02-13T00:39:30.206977+0000 mon.a (mon.0) 1475 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi080-54175-29"}]': finished 2024-02-13T00:39:30.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[17386]: cluster 2024-02-13T00:39:30.207107+0000 mon.a (mon.0) 1476 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2024-02-13T00:39:30.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[17386]: audit 2024-02-13T00:39:30.207672+0000 mon.a (mon.0) 1477 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi080-54215-2"}]: dispatch 2024-02-13T00:39:30.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[24237]: audit 2024-02-13T00:39:29.200709+0000 mon.a (mon.0) 1465 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-17"}]': finished 2024-02-13T00:39:30.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[24237]: audit 2024-02-13T00:39:29.201050+0000 mon.a (mon.0) 1466 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi080-54183-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:30.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[24237]: audit 2024-02-13T00:39:29.201261+0000 mon.a (mon.0) 1467 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi080-54175-29"}]': finished 2024-02-13T00:39:30.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[24237]: cluster 2024-02-13T00:39:29.201579+0000 mon.a (mon.0) 1468 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2024-02-13T00:39:30.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[24237]: audit 2024-02-13T00:39:29.207664+0000 mon.a (mon.0) 1469 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-17", "mode": "writeback"}]: dispatch 2024-02-13T00:39:30.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[24237]: audit 2024-02-13T00:39:29.208449+0000 mon.a (mon.0) 1470 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi080-54215-2"}]: dispatch 2024-02-13T00:39:30.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[24237]: audit 2024-02-13T00:39:29.209663+0000 mon.c (mon.2) 245 : audit [INF] from='client.? 172.21.15.80:0/2543942247' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:30.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[24237]: audit 2024-02-13T00:39:29.222333+0000 mon.a (mon.0) 1471 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi080-54175-29"}]: dispatch 2024-02-13T00:39:30.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[24237]: cluster 2024-02-13T00:39:30.196006+0000 mon.a (mon.0) 1472 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:39:30.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[24237]: audit 2024-02-13T00:39:30.206657+0000 mon.a (mon.0) 1473 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-17", "mode": "writeback"}]': finished 2024-02-13T00:39:30.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[24237]: audit 2024-02-13T00:39:30.206763+0000 mon.a (mon.0) 1474 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi080-54215-2"}]': finished 2024-02-13T00:39:30.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[24237]: audit 2024-02-13T00:39:30.206977+0000 mon.a (mon.0) 1475 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi080-54175-29"}]': finished 2024-02-13T00:39:30.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[24237]: cluster 2024-02-13T00:39:30.207107+0000 mon.a (mon.0) 1476 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2024-02-13T00:39:30.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:30 smithi080 bash[24237]: audit 2024-02-13T00:39:30.207672+0000 mon.a (mon.0) 1477 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi080-54215-2"}]: dispatch 2024-02-13T00:39:31.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:31 smithi106 bash[18459]: cluster 2024-02-13T00:39:30.179209+0000 mgr.y (mgr.24461) 396 : cluster [DBG] pgmap v390: 260 pgs: 32 unknown, 228 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:39:31.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:31 smithi106 bash[18459]: audit 2024-02-13T00:39:30.235240+0000 mon.a (mon.0) 1478 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi080-54175-30"}]: dispatch 2024-02-13T00:39:31.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:31 smithi106 bash[18459]: audit 2024-02-13T00:39:30.686801+0000 mon.a (mon.0) 1479 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi080-54175-30"}]: dispatch 2024-02-13T00:39:31.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:31 smithi106 bash[18459]: audit 2024-02-13T00:39:30.687792+0000 mon.a (mon.0) 1480 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi080-54175-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:31.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:31 smithi106 bash[18459]: audit 2024-02-13T00:39:30.775741+0000 mon.a (mon.0) 1481 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:39:31.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:31 smithi106 bash[18459]: audit 2024-02-13T00:39:31.210661+0000 mon.a (mon.0) 1482 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi080-54215-2"}]': finished 2024-02-13T00:39:31.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:31 smithi106 bash[18459]: audit 2024-02-13T00:39:31.210888+0000 mon.a (mon.0) 1483 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi080-54175-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:31.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:31 smithi106 bash[18459]: audit 2024-02-13T00:39:31.211011+0000 mon.a (mon.0) 1484 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:39:31.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:31 smithi106 bash[18459]: cluster 2024-02-13T00:39:31.211079+0000 mon.a (mon.0) 1485 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2024-02-13T00:39:31.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:31 smithi106 bash[18459]: audit 2024-02-13T00:39:31.213367+0000 mon.a (mon.0) 1486 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-17"}]: dispatch 2024-02-13T00:39:31.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:31 smithi106 bash[18459]: audit 2024-02-13T00:39:31.223022+0000 mon.a (mon.0) 1487 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi080-54175-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi080-54175-30"}]: dispatch 2024-02-13T00:39:31.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:31 smithi106 bash[18459]: audit 2024-02-13T00:39:31.224333+0000 mon.c (mon.2) 246 : audit [INF] from='client.? 172.21.15.80:0/1621311781' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi080-54183-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:31.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:31 smithi106 bash[18459]: audit 2024-02-13T00:39:31.225342+0000 mon.a (mon.0) 1488 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi080-54183-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:31.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[24237]: cluster 2024-02-13T00:39:30.179209+0000 mgr.y (mgr.24461) 396 : cluster [DBG] pgmap v390: 260 pgs: 32 unknown, 228 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:39:31.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[24237]: audit 2024-02-13T00:39:30.235240+0000 mon.a (mon.0) 1478 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi080-54175-30"}]: dispatch 2024-02-13T00:39:31.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[24237]: audit 2024-02-13T00:39:30.686801+0000 mon.a (mon.0) 1479 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi080-54175-30"}]: dispatch 2024-02-13T00:39:31.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[24237]: audit 2024-02-13T00:39:30.687792+0000 mon.a (mon.0) 1480 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi080-54175-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:31.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[24237]: audit 2024-02-13T00:39:30.775741+0000 mon.a (mon.0) 1481 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:39:31.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[24237]: audit 2024-02-13T00:39:31.210661+0000 mon.a (mon.0) 1482 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi080-54215-2"}]': finished 2024-02-13T00:39:31.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[24237]: audit 2024-02-13T00:39:31.210888+0000 mon.a (mon.0) 1483 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi080-54175-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:31.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[24237]: audit 2024-02-13T00:39:31.211011+0000 mon.a (mon.0) 1484 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:39:31.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[24237]: cluster 2024-02-13T00:39:31.211079+0000 mon.a (mon.0) 1485 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2024-02-13T00:39:31.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[24237]: audit 2024-02-13T00:39:31.213367+0000 mon.a (mon.0) 1486 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-17"}]: dispatch 2024-02-13T00:39:31.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[24237]: audit 2024-02-13T00:39:31.223022+0000 mon.a (mon.0) 1487 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi080-54175-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi080-54175-30"}]: dispatch 2024-02-13T00:39:31.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[24237]: audit 2024-02-13T00:39:31.224333+0000 mon.c (mon.2) 246 : audit [INF] from='client.? 172.21.15.80:0/1621311781' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi080-54183-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:31.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[24237]: audit 2024-02-13T00:39:31.225342+0000 mon.a (mon.0) 1488 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi080-54183-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:31.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[17386]: cluster 2024-02-13T00:39:30.179209+0000 mgr.y (mgr.24461) 396 : cluster [DBG] pgmap v390: 260 pgs: 32 unknown, 228 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:39:31.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[17386]: audit 2024-02-13T00:39:30.235240+0000 mon.a (mon.0) 1478 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi080-54175-30"}]: dispatch 2024-02-13T00:39:31.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[17386]: audit 2024-02-13T00:39:30.686801+0000 mon.a (mon.0) 1479 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi080-54175-30"}]: dispatch 2024-02-13T00:39:31.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[17386]: audit 2024-02-13T00:39:30.687792+0000 mon.a (mon.0) 1480 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi080-54175-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:31.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[17386]: audit 2024-02-13T00:39:30.775741+0000 mon.a (mon.0) 1481 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:39:31.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[17386]: audit 2024-02-13T00:39:31.210661+0000 mon.a (mon.0) 1482 : audit [INF] from='client.? 172.21.15.80:0/1370400574' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi080-54215-2"}]': finished 2024-02-13T00:39:31.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[17386]: audit 2024-02-13T00:39:31.210888+0000 mon.a (mon.0) 1483 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi080-54175-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:31.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[17386]: audit 2024-02-13T00:39:31.211011+0000 mon.a (mon.0) 1484 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:39:31.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[17386]: cluster 2024-02-13T00:39:31.211079+0000 mon.a (mon.0) 1485 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2024-02-13T00:39:31.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[17386]: audit 2024-02-13T00:39:31.213367+0000 mon.a (mon.0) 1486 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-17"}]: dispatch 2024-02-13T00:39:31.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[17386]: audit 2024-02-13T00:39:31.223022+0000 mon.a (mon.0) 1487 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi080-54175-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi080-54175-30"}]: dispatch 2024-02-13T00:39:31.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[17386]: audit 2024-02-13T00:39:31.224333+0000 mon.c (mon.2) 246 : audit [INF] from='client.? 172.21.15.80:0/1621311781' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi080-54183-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:31.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:31 smithi080 bash[17386]: audit 2024-02-13T00:39:31.225342+0000 mon.a (mon.0) 1488 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi080-54183-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:33.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:32 smithi106 bash[18459]: audit 2024-02-13T00:39:31.917336+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:39:33.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:32 smithi106 bash[18459]: cluster 2024-02-13T00:39:32.205001+0000 mon.a (mon.0) 1490 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:39:33.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:32 smithi106 bash[18459]: audit 2024-02-13T00:39:32.213216+0000 mon.a (mon.0) 1491 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-17"}]': finished 2024-02-13T00:39:33.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:32 smithi106 bash[18459]: audit 2024-02-13T00:39:32.656943+0000 mon.a (mon.0) 1492 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi080-54183-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:33.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:32 smithi106 bash[18459]: cluster 2024-02-13T00:39:32.657168+0000 mon.a (mon.0) 1493 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2024-02-13T00:39:33.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:32 smithi106 bash[18459]: audit 2024-02-13T00:39:32.659586+0000 mon.c (mon.2) 247 : audit [INF] from='client.? 172.21.15.80:0/1270244047' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54215-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:33.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:32 smithi106 bash[18459]: audit 2024-02-13T00:39:32.662670+0000 mon.a (mon.0) 1494 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54215-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:33.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:32 smithi080 bash[17386]: audit 2024-02-13T00:39:31.917336+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:39:33.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:32 smithi080 bash[17386]: cluster 2024-02-13T00:39:32.205001+0000 mon.a (mon.0) 1490 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:39:33.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:32 smithi080 bash[17386]: audit 2024-02-13T00:39:32.213216+0000 mon.a (mon.0) 1491 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-17"}]': finished 2024-02-13T00:39:33.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:32 smithi080 bash[17386]: audit 2024-02-13T00:39:32.656943+0000 mon.a (mon.0) 1492 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi080-54183-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:33.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:32 smithi080 bash[17386]: cluster 2024-02-13T00:39:32.657168+0000 mon.a (mon.0) 1493 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2024-02-13T00:39:33.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:32 smithi080 bash[17386]: audit 2024-02-13T00:39:32.659586+0000 mon.c (mon.2) 247 : audit [INF] from='client.? 172.21.15.80:0/1270244047' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54215-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:33.260 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:32 smithi080 bash[17386]: audit 2024-02-13T00:39:32.662670+0000 mon.a (mon.0) 1494 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54215-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:33.261 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:39:33 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:39:33] "GET /metrics HTTP/1.1" 200 187728 "" "Prometheus/2.33.4" 2024-02-13T00:39:33.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:32 smithi080 bash[24237]: audit 2024-02-13T00:39:31.917336+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:39:33.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:32 smithi080 bash[24237]: cluster 2024-02-13T00:39:32.205001+0000 mon.a (mon.0) 1490 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:39:33.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:32 smithi080 bash[24237]: audit 2024-02-13T00:39:32.213216+0000 mon.a (mon.0) 1491 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-17"}]': finished 2024-02-13T00:39:33.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:32 smithi080 bash[24237]: audit 2024-02-13T00:39:32.656943+0000 mon.a (mon.0) 1492 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi080-54183-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:33.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:32 smithi080 bash[24237]: cluster 2024-02-13T00:39:32.657168+0000 mon.a (mon.0) 1493 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2024-02-13T00:39:33.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:32 smithi080 bash[24237]: audit 2024-02-13T00:39:32.659586+0000 mon.c (mon.2) 247 : audit [INF] from='client.? 172.21.15.80:0/1270244047' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54215-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:33.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:32 smithi080 bash[24237]: audit 2024-02-13T00:39:32.662670+0000 mon.a (mon.0) 1494 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54215-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:34.234 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2024-02-13T00:39:34.235 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 1 0 2024-02-13T00:39:34.235 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 10 0 2024-02-13T00:39:34.235 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 13 0 2024-02-13T00:39:34.235 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 7 0 2024-02-13T00:39:34.235 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 14 0 2024-02-13T00:39:34.235 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 0 0 2024-02-13T00:39:34.235 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 15 0 2024-02-13T00:39:34.235 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 11 0 2024-02-13T00:39:34.235 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 5 0 2024-02-13T00:39:34.235 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 8 0 2024-02-13T00:39:34.235 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 6 0 2024-02-13T00:39:34.235 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 3 0 2024-02-13T00:39:34.235 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 4 0 2024-02-13T00:39:34.236 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 12 0 2024-02-13T00:39:34.236 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 9 0 2024-02-13T00:39:34.236 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 2 0 2024-02-13T00:39:34.236 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-02-13T00:39:34.236 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (78 ms) 2024-02-13T00:39:34.236 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [----------] 3 tests from LibRadosListEC (1176 ms total) 2024-02-13T00:39:34.236 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 2024-02-13T00:39:34.236 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [----------] 1 test from LibRadosListNP 2024-02-13T00:39:34.236 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2024-02-13T00:39:34.236 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (3013 ms) 2024-02-13T00:39:34.236 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [----------] 1 test from LibRadosListNP (3013 ms total) 2024-02-13T00:39:34.236 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: 2024-02-13T00:39:34.236 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [----------] Global test environment tear-down 2024-02-13T00:39:34.236 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [==========] 11 tests from 3 test suites ran. (125258 ms total) 2024-02-13T00:39:34.236 INFO:tasks.workunit.client.0.smithi080.stdout: api_list: [ PASSED ] 11 tests. 2024-02-13T00:39:34.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:34 smithi106 bash[18459]: cluster 2024-02-13T00:39:32.179991+0000 mgr.y (mgr.24461) 397 : cluster [DBG] pgmap v393: 260 pgs: 32 unknown, 228 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:39:34.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:34 smithi106 bash[18459]: audit 2024-02-13T00:39:33.224084+0000 mon.a (mon.0) 1495 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi080-54175-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi080-54175-30"}]': finished 2024-02-13T00:39:34.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:34 smithi106 bash[18459]: audit 2024-02-13T00:39:33.224870+0000 mon.a (mon.0) 1496 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54215-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:34.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:34 smithi106 bash[18459]: cluster 2024-02-13T00:39:33.225603+0000 mon.a (mon.0) 1497 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2024-02-13T00:39:34.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:34 smithi106 bash[18459]: audit 2024-02-13T00:39:33.283329+0000 mon.c (mon.2) 248 : audit [INF] from='client.? 172.21.15.80:0/1270244047' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi080-54215-3","pool2":"test-rados-api-smithi080-54215-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-02-13T00:39:34.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:34 smithi080 bash[17386]: cluster 2024-02-13T00:39:32.179991+0000 mgr.y (mgr.24461) 397 : cluster [DBG] pgmap v393: 260 pgs: 32 unknown, 228 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:39:34.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:34 smithi080 bash[17386]: audit 2024-02-13T00:39:33.224084+0000 mon.a (mon.0) 1495 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi080-54175-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi080-54175-30"}]': finished 2024-02-13T00:39:34.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:34 smithi080 bash[17386]: audit 2024-02-13T00:39:33.224870+0000 mon.a (mon.0) 1496 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54215-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:34.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:34 smithi080 bash[17386]: cluster 2024-02-13T00:39:33.225603+0000 mon.a (mon.0) 1497 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2024-02-13T00:39:34.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:34 smithi080 bash[17386]: audit 2024-02-13T00:39:33.283329+0000 mon.c (mon.2) 248 : audit [INF] from='client.? 172.21.15.80:0/1270244047' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi080-54215-3","pool2":"test-rados-api-smithi080-54215-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-02-13T00:39:34.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:34 smithi080 bash[24237]: cluster 2024-02-13T00:39:32.179991+0000 mgr.y (mgr.24461) 397 : cluster [DBG] pgmap v393: 260 pgs: 32 unknown, 228 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:39:34.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:34 smithi080 bash[24237]: audit 2024-02-13T00:39:33.224084+0000 mon.a (mon.0) 1495 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi080-54175-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi080-54175-30"}]': finished 2024-02-13T00:39:34.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:34 smithi080 bash[24237]: audit 2024-02-13T00:39:33.224870+0000 mon.a (mon.0) 1496 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54215-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:34.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:34 smithi080 bash[24237]: cluster 2024-02-13T00:39:33.225603+0000 mon.a (mon.0) 1497 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2024-02-13T00:39:34.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:34 smithi080 bash[24237]: audit 2024-02-13T00:39:33.283329+0000 mon.c (mon.2) 248 : audit [INF] from='client.? 172.21.15.80:0/1270244047' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi080-54215-3","pool2":"test-rados-api-smithi080-54215-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-02-13T00:39:35.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:35 smithi106 bash[18459]: audit 2024-02-13T00:39:34.087127+0000 mon.a (mon.0) 1498 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi080-54215-3","pool2":"test-rados-api-smithi080-54215-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-02-13T00:39:35.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:35 smithi106 bash[18459]: audit 2024-02-13T00:39:34.223126+0000 mon.a (mon.0) 1499 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi080-54215-3","pool2":"test-rados-api-smithi080-54215-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-02-13T00:39:35.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:35 smithi106 bash[18459]: cluster 2024-02-13T00:39:34.223212+0000 mon.a (mon.0) 1500 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2024-02-13T00:39:35.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:35 smithi106 bash[18459]: audit 2024-02-13T00:39:34.227807+0000 mon.c (mon.2) 249 : audit [INF] from='client.? 172.21.15.80:0/194662186' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi080-54183-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:35.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:35 smithi106 bash[18459]: audit 2024-02-13T00:39:34.228993+0000 mon.a (mon.0) 1501 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:35.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:35 smithi106 bash[18459]: audit 2024-02-13T00:39:34.229415+0000 mon.a (mon.0) 1502 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi080-54183-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:35.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:35 smithi080 bash[17386]: audit 2024-02-13T00:39:34.087127+0000 mon.a (mon.0) 1498 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi080-54215-3","pool2":"test-rados-api-smithi080-54215-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-02-13T00:39:35.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:35 smithi080 bash[17386]: audit 2024-02-13T00:39:34.223126+0000 mon.a (mon.0) 1499 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi080-54215-3","pool2":"test-rados-api-smithi080-54215-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-02-13T00:39:35.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:35 smithi080 bash[17386]: cluster 2024-02-13T00:39:34.223212+0000 mon.a (mon.0) 1500 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2024-02-13T00:39:35.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:35 smithi080 bash[17386]: audit 2024-02-13T00:39:34.227807+0000 mon.c (mon.2) 249 : audit [INF] from='client.? 172.21.15.80:0/194662186' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi080-54183-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:35.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:35 smithi080 bash[17386]: audit 2024-02-13T00:39:34.228993+0000 mon.a (mon.0) 1501 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:35.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:35 smithi080 bash[17386]: audit 2024-02-13T00:39:34.229415+0000 mon.a (mon.0) 1502 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi080-54183-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:35.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:35 smithi080 bash[24237]: audit 2024-02-13T00:39:34.087127+0000 mon.a (mon.0) 1498 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi080-54215-3","pool2":"test-rados-api-smithi080-54215-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-02-13T00:39:35.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:35 smithi080 bash[24237]: audit 2024-02-13T00:39:34.223126+0000 mon.a (mon.0) 1499 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi080-54215-3","pool2":"test-rados-api-smithi080-54215-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-02-13T00:39:35.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:35 smithi080 bash[24237]: cluster 2024-02-13T00:39:34.223212+0000 mon.a (mon.0) 1500 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2024-02-13T00:39:35.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:35 smithi080 bash[24237]: audit 2024-02-13T00:39:34.227807+0000 mon.c (mon.2) 249 : audit [INF] from='client.? 172.21.15.80:0/194662186' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi080-54183-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:35.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:35 smithi080 bash[24237]: audit 2024-02-13T00:39:34.228993+0000 mon.a (mon.0) 1501 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:35.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:35 smithi080 bash[24237]: audit 2024-02-13T00:39:34.229415+0000 mon.a (mon.0) 1502 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi080-54183-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:36.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:36 smithi106 bash[18459]: cluster 2024-02-13T00:39:34.180797+0000 mgr.y (mgr.24461) 398 : cluster [DBG] pgmap v396: 236 pgs: 32 creating+peering, 8 unknown, 196 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:39:36.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:36 smithi106 bash[18459]: audit 2024-02-13T00:39:35.226297+0000 mon.a (mon.0) 1503 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:36.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:36 smithi106 bash[18459]: audit 2024-02-13T00:39:35.226484+0000 mon.a (mon.0) 1504 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi080-54183-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:36.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:36 smithi106 bash[18459]: cluster 2024-02-13T00:39:35.226734+0000 mon.a (mon.0) 1505 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2024-02-13T00:39:36.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:36 smithi106 bash[18459]: audit 2024-02-13T00:39:35.229416+0000 mon.a (mon.0) 1506 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi080-54175-30"}]: dispatch 2024-02-13T00:39:36.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:36 smithi106 bash[18459]: audit 2024-02-13T00:39:35.230268+0000 mon.a (mon.0) 1507 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:39:36.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:36 smithi080 bash[17386]: cluster 2024-02-13T00:39:34.180797+0000 mgr.y (mgr.24461) 398 : cluster [DBG] pgmap v396: 236 pgs: 32 creating+peering, 8 unknown, 196 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:39:36.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:36 smithi080 bash[17386]: audit 2024-02-13T00:39:35.226297+0000 mon.a (mon.0) 1503 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:36.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:36 smithi080 bash[17386]: audit 2024-02-13T00:39:35.226484+0000 mon.a (mon.0) 1504 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi080-54183-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:36.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:36 smithi080 bash[17386]: cluster 2024-02-13T00:39:35.226734+0000 mon.a (mon.0) 1505 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2024-02-13T00:39:36.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:36 smithi080 bash[17386]: audit 2024-02-13T00:39:35.229416+0000 mon.a (mon.0) 1506 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi080-54175-30"}]: dispatch 2024-02-13T00:39:36.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:36 smithi080 bash[17386]: audit 2024-02-13T00:39:35.230268+0000 mon.a (mon.0) 1507 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:39:36.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:36 smithi080 bash[24237]: cluster 2024-02-13T00:39:34.180797+0000 mgr.y (mgr.24461) 398 : cluster [DBG] pgmap v396: 236 pgs: 32 creating+peering, 8 unknown, 196 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:39:36.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:36 smithi080 bash[24237]: audit 2024-02-13T00:39:35.226297+0000 mon.a (mon.0) 1503 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:36.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:36 smithi080 bash[24237]: audit 2024-02-13T00:39:35.226484+0000 mon.a (mon.0) 1504 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi080-54183-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:36.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:36 smithi080 bash[24237]: cluster 2024-02-13T00:39:35.226734+0000 mon.a (mon.0) 1505 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2024-02-13T00:39:36.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:36 smithi080 bash[24237]: audit 2024-02-13T00:39:35.229416+0000 mon.a (mon.0) 1506 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi080-54175-30"}]: dispatch 2024-02-13T00:39:36.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:36 smithi080 bash[24237]: audit 2024-02-13T00:39:35.230268+0000 mon.a (mon.0) 1507 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:39:37.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:37 smithi106 bash[18459]: cluster 2024-02-13T00:39:36.181562+0000 mgr.y (mgr.24461) 399 : cluster [DBG] pgmap v399: 260 pgs: 64 unknown, 196 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:39:37.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:37 smithi106 bash[18459]: audit 2024-02-13T00:39:36.229439+0000 mon.a (mon.0) 1508 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi080-54175-30"}]': finished 2024-02-13T00:39:37.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:37 smithi106 bash[18459]: audit 2024-02-13T00:39:36.229595+0000 mon.a (mon.0) 1509 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-19", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:39:37.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:37 smithi106 bash[18459]: cluster 2024-02-13T00:39:36.229768+0000 mon.a (mon.0) 1510 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2024-02-13T00:39:37.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:37 smithi106 bash[18459]: audit 2024-02-13T00:39:36.235440+0000 mon.a (mon.0) 1511 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-19"}]: dispatch 2024-02-13T00:39:37.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:37 smithi106 bash[18459]: audit 2024-02-13T00:39:36.235754+0000 mon.a (mon.0) 1512 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi080-54175-30"}]: dispatch 2024-02-13T00:39:37.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:37 smithi106 bash[18459]: cluster 2024-02-13T00:39:37.173507+0000 mon.a (mon.0) 1513 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:39:37.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:37 smithi080 bash[17386]: cluster 2024-02-13T00:39:36.181562+0000 mgr.y (mgr.24461) 399 : cluster [DBG] pgmap v399: 260 pgs: 64 unknown, 196 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:39:37.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:37 smithi080 bash[17386]: audit 2024-02-13T00:39:36.229439+0000 mon.a (mon.0) 1508 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi080-54175-30"}]': finished 2024-02-13T00:39:37.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:37 smithi080 bash[17386]: audit 2024-02-13T00:39:36.229595+0000 mon.a (mon.0) 1509 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-19", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:39:37.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:37 smithi080 bash[17386]: cluster 2024-02-13T00:39:36.229768+0000 mon.a (mon.0) 1510 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2024-02-13T00:39:37.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:37 smithi080 bash[17386]: audit 2024-02-13T00:39:36.235440+0000 mon.a (mon.0) 1511 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-19"}]: dispatch 2024-02-13T00:39:37.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:37 smithi080 bash[17386]: audit 2024-02-13T00:39:36.235754+0000 mon.a (mon.0) 1512 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi080-54175-30"}]: dispatch 2024-02-13T00:39:37.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:37 smithi080 bash[17386]: cluster 2024-02-13T00:39:37.173507+0000 mon.a (mon.0) 1513 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:39:37.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:37 smithi080 bash[24237]: cluster 2024-02-13T00:39:36.181562+0000 mgr.y (mgr.24461) 399 : cluster [DBG] pgmap v399: 260 pgs: 64 unknown, 196 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:39:37.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:37 smithi080 bash[24237]: audit 2024-02-13T00:39:36.229439+0000 mon.a (mon.0) 1508 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi080-54175-30"}]': finished 2024-02-13T00:39:37.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:37 smithi080 bash[24237]: audit 2024-02-13T00:39:36.229595+0000 mon.a (mon.0) 1509 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-19", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:39:37.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:37 smithi080 bash[24237]: cluster 2024-02-13T00:39:36.229768+0000 mon.a (mon.0) 1510 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2024-02-13T00:39:37.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:37 smithi080 bash[24237]: audit 2024-02-13T00:39:36.235440+0000 mon.a (mon.0) 1511 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-19"}]: dispatch 2024-02-13T00:39:37.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:37 smithi080 bash[24237]: audit 2024-02-13T00:39:36.235754+0000 mon.a (mon.0) 1512 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi080-54175-30"}]: dispatch 2024-02-13T00:39:37.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:37 smithi080 bash[24237]: cluster 2024-02-13T00:39:37.173507+0000 mon.a (mon.0) 1513 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:39:38.505 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:39:38 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:39:38.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:38 smithi106 bash[18459]: audit 2024-02-13T00:39:37.230434+0000 mon.a (mon.0) 1514 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-19"}]': finished 2024-02-13T00:39:38.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:38 smithi106 bash[18459]: audit 2024-02-13T00:39:37.230547+0000 mon.a (mon.0) 1515 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi080-54175-30"}]': finished 2024-02-13T00:39:38.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:38 smithi106 bash[18459]: cluster 2024-02-13T00:39:37.230640+0000 mon.a (mon.0) 1516 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2024-02-13T00:39:38.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:38 smithi106 bash[18459]: audit 2024-02-13T00:39:37.235108+0000 mon.c (mon.2) 250 : audit [INF] from='client.? 172.21.15.80:0/4047522865' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi080-54183-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:38.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:38 smithi106 bash[18459]: audit 2024-02-13T00:39:37.252384+0000 mon.a (mon.0) 1517 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-19", "mode": "writeback"}]: dispatch 2024-02-13T00:39:38.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:38 smithi106 bash[18459]: audit 2024-02-13T00:39:37.252833+0000 mon.a (mon.0) 1518 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi080-54183-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:38.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:38 smithi106 bash[18459]: audit 2024-02-13T00:39:37.289437+0000 mon.c (mon.2) 251 : audit [INF] from='client.? 172.21.15.80:0/3806169851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:38.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:38 smithi106 bash[18459]: audit 2024-02-13T00:39:37.320669+0000 mon.a (mon.0) 1519 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:38.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:38 smithi106 bash[18459]: audit 2024-02-13T00:39:37.321209+0000 mon.c (mon.2) 252 : audit [INF] from='client.? 172.21.15.80:0/3806169851' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:38.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:38 smithi106 bash[18459]: audit 2024-02-13T00:39:37.321439+0000 mon.a (mon.0) 1520 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:38.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:38 smithi106 bash[18459]: audit 2024-02-13T00:39:37.321853+0000 mon.c (mon.2) 253 : audit [INF] from='client.? 172.21.15.80:0/3806169851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi080-54175-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:38.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:38 smithi106 bash[18459]: audit 2024-02-13T00:39:37.322091+0000 mon.a (mon.0) 1521 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi080-54175-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:38.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:38 smithi106 bash[18459]: cluster 2024-02-13T00:39:38.226784+0000 mon.a (mon.0) 1522 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:39:38.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:38 smithi106 bash[18459]: audit 2024-02-13T00:39:38.233695+0000 mon.a (mon.0) 1523 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-19", "mode": "writeback"}]': finished 2024-02-13T00:39:38.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:38 smithi106 bash[18459]: audit 2024-02-13T00:39:38.233803+0000 mon.a (mon.0) 1524 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi080-54183-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:38.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:38 smithi106 bash[18459]: audit 2024-02-13T00:39:38.234044+0000 mon.a (mon.0) 1525 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi080-54175-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:38.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:38 smithi106 bash[18459]: cluster 2024-02-13T00:39:38.234121+0000 mon.a (mon.0) 1526 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2024-02-13T00:39:38.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:38 smithi106 bash[18459]: audit 2024-02-13T00:39:38.242494+0000 mon.c (mon.2) 254 : audit [INF] from='client.? 172.21.15.80:0/3806169851' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi080-54175-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:38.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:38 smithi106 bash[18459]: audit 2024-02-13T00:39:38.243518+0000 mon.a (mon.0) 1527 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi080-54175-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:38.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:38 smithi106 bash[18459]: audit 2024-02-13T00:39:38.288720+0000 mon.a (mon.0) 1528 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:39:38.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[17386]: audit 2024-02-13T00:39:37.230434+0000 mon.a (mon.0) 1514 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-19"}]': finished 2024-02-13T00:39:38.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[17386]: audit 2024-02-13T00:39:37.230547+0000 mon.a (mon.0) 1515 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi080-54175-30"}]': finished 2024-02-13T00:39:38.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[17386]: cluster 2024-02-13T00:39:37.230640+0000 mon.a (mon.0) 1516 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2024-02-13T00:39:38.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[17386]: audit 2024-02-13T00:39:37.235108+0000 mon.c (mon.2) 250 : audit [INF] from='client.? 172.21.15.80:0/4047522865' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi080-54183-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:38.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[17386]: audit 2024-02-13T00:39:37.252384+0000 mon.a (mon.0) 1517 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-19", "mode": "writeback"}]: dispatch 2024-02-13T00:39:38.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[17386]: audit 2024-02-13T00:39:37.252833+0000 mon.a (mon.0) 1518 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi080-54183-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:38.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[17386]: audit 2024-02-13T00:39:37.289437+0000 mon.c (mon.2) 251 : audit [INF] from='client.? 172.21.15.80:0/3806169851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:38.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[17386]: audit 2024-02-13T00:39:37.320669+0000 mon.a (mon.0) 1519 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:38.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[17386]: audit 2024-02-13T00:39:37.321209+0000 mon.c (mon.2) 252 : audit [INF] from='client.? 172.21.15.80:0/3806169851' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:38.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[17386]: audit 2024-02-13T00:39:37.321439+0000 mon.a (mon.0) 1520 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:38.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[17386]: audit 2024-02-13T00:39:37.321853+0000 mon.c (mon.2) 253 : audit [INF] from='client.? 172.21.15.80:0/3806169851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi080-54175-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:38.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[17386]: audit 2024-02-13T00:39:37.322091+0000 mon.a (mon.0) 1521 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi080-54175-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:38.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[17386]: cluster 2024-02-13T00:39:38.226784+0000 mon.a (mon.0) 1522 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:39:38.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[17386]: audit 2024-02-13T00:39:38.233695+0000 mon.a (mon.0) 1523 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-19", "mode": "writeback"}]': finished 2024-02-13T00:39:38.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[24237]: audit 2024-02-13T00:39:37.230434+0000 mon.a (mon.0) 1514 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-19"}]': finished 2024-02-13T00:39:38.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[24237]: audit 2024-02-13T00:39:37.230547+0000 mon.a (mon.0) 1515 : audit [INF] from='client.? 172.21.15.80:0/967147066' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi080-54175-30"}]': finished 2024-02-13T00:39:38.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[24237]: cluster 2024-02-13T00:39:37.230640+0000 mon.a (mon.0) 1516 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2024-02-13T00:39:38.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[24237]: audit 2024-02-13T00:39:37.235108+0000 mon.c (mon.2) 250 : audit [INF] from='client.? 172.21.15.80:0/4047522865' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi080-54183-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:38.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[24237]: audit 2024-02-13T00:39:37.252384+0000 mon.a (mon.0) 1517 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-19", "mode": "writeback"}]: dispatch 2024-02-13T00:39:38.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[24237]: audit 2024-02-13T00:39:37.252833+0000 mon.a (mon.0) 1518 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi080-54183-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:38.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[24237]: audit 2024-02-13T00:39:37.289437+0000 mon.c (mon.2) 251 : audit [INF] from='client.? 172.21.15.80:0/3806169851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:38.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[24237]: audit 2024-02-13T00:39:37.320669+0000 mon.a (mon.0) 1519 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:38.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[24237]: audit 2024-02-13T00:39:37.321209+0000 mon.c (mon.2) 252 : audit [INF] from='client.? 172.21.15.80:0/3806169851' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:38.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[24237]: audit 2024-02-13T00:39:37.321439+0000 mon.a (mon.0) 1520 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:38.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[24237]: audit 2024-02-13T00:39:37.321853+0000 mon.c (mon.2) 253 : audit [INF] from='client.? 172.21.15.80:0/3806169851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi080-54175-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:38.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[24237]: audit 2024-02-13T00:39:37.322091+0000 mon.a (mon.0) 1521 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi080-54175-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:38.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[24237]: cluster 2024-02-13T00:39:38.226784+0000 mon.a (mon.0) 1522 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:39:38.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[24237]: audit 2024-02-13T00:39:38.233695+0000 mon.a (mon.0) 1523 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-19", "mode": "writeback"}]': finished 2024-02-13T00:39:38.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[24237]: audit 2024-02-13T00:39:38.233803+0000 mon.a (mon.0) 1524 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi080-54183-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:38.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[24237]: audit 2024-02-13T00:39:38.234044+0000 mon.a (mon.0) 1525 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi080-54175-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:38.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[24237]: cluster 2024-02-13T00:39:38.234121+0000 mon.a (mon.0) 1526 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2024-02-13T00:39:38.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[24237]: audit 2024-02-13T00:39:38.242494+0000 mon.c (mon.2) 254 : audit [INF] from='client.? 172.21.15.80:0/3806169851' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi080-54175-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:38.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[24237]: audit 2024-02-13T00:39:38.243518+0000 mon.a (mon.0) 1527 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi080-54175-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:38.762 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[24237]: audit 2024-02-13T00:39:38.288720+0000 mon.a (mon.0) 1528 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:39:38.763 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[17386]: audit 2024-02-13T00:39:38.233803+0000 mon.a (mon.0) 1524 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi080-54183-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:38.764 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[17386]: audit 2024-02-13T00:39:38.234044+0000 mon.a (mon.0) 1525 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi080-54175-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:38.764 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[17386]: cluster 2024-02-13T00:39:38.234121+0000 mon.a (mon.0) 1526 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2024-02-13T00:39:38.764 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[17386]: audit 2024-02-13T00:39:38.242494+0000 mon.c (mon.2) 254 : audit [INF] from='client.? 172.21.15.80:0/3806169851' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi080-54175-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:38.764 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[17386]: audit 2024-02-13T00:39:38.243518+0000 mon.a (mon.0) 1527 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi080-54175-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:38.764 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:38 smithi080 bash[17386]: audit 2024-02-13T00:39:38.288720+0000 mon.a (mon.0) 1528 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:39:40.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:39 smithi106 bash[18459]: cluster 2024-02-13T00:39:38.183791+0000 mgr.y (mgr.24461) 400 : cluster [DBG] pgmap v402: 260 pgs: 32 creating+peering, 228 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:39:40.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:39 smithi106 bash[18459]: audit 2024-02-13T00:39:38.190665+0000 mgr.y (mgr.24461) 401 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:39:40.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:39 smithi080 bash[17386]: cluster 2024-02-13T00:39:38.183791+0000 mgr.y (mgr.24461) 400 : cluster [DBG] pgmap v402: 260 pgs: 32 creating+peering, 228 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:39:40.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:39 smithi080 bash[17386]: audit 2024-02-13T00:39:38.190665+0000 mgr.y (mgr.24461) 401 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:39:40.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:39 smithi080 bash[24237]: cluster 2024-02-13T00:39:38.183791+0000 mgr.y (mgr.24461) 400 : cluster [DBG] pgmap v402: 260 pgs: 32 creating+peering, 228 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:39:40.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:39 smithi080 bash[24237]: audit 2024-02-13T00:39:38.190665+0000 mgr.y (mgr.24461) 401 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:39:40.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:39:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:39:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:39:41.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:40 smithi106 bash[18459]: audit 2024-02-13T00:39:39.676056+0000 mon.a (mon.0) 1529 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:39:41.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:40 smithi106 bash[18459]: cluster 2024-02-13T00:39:39.676184+0000 mon.a (mon.0) 1530 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2024-02-13T00:39:41.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:40 smithi106 bash[18459]: audit 2024-02-13T00:39:39.678212+0000 mon.a (mon.0) 1531 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-19"}]: dispatch 2024-02-13T00:39:41.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:40 smithi106 bash[18459]: cluster 2024-02-13T00:39:40.235839+0000 mon.a (mon.0) 1532 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:39:41.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:40 smithi106 bash[18459]: audit 2024-02-13T00:39:40.245136+0000 mon.a (mon.0) 1533 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi080-54175-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi080-54175-31"}]': finished 2024-02-13T00:39:41.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:40 smithi106 bash[18459]: audit 2024-02-13T00:39:40.245303+0000 mon.a (mon.0) 1534 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-19"}]': finished 2024-02-13T00:39:41.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:40 smithi106 bash[18459]: cluster 2024-02-13T00:39:40.245442+0000 mon.a (mon.0) 1535 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2024-02-13T00:39:41.009 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:40 smithi106 bash[18459]: audit 2024-02-13T00:39:40.250642+0000 mon.c (mon.2) 255 : audit [INF] from='client.? 172.21.15.80:0/2789066434' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:41.009 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:40 smithi106 bash[18459]: audit 2024-02-13T00:39:40.251634+0000 mon.a (mon.0) 1536 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:41.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:40 smithi080 bash[17386]: audit 2024-02-13T00:39:39.676056+0000 mon.a (mon.0) 1529 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:39:41.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:40 smithi080 bash[17386]: cluster 2024-02-13T00:39:39.676184+0000 mon.a (mon.0) 1530 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2024-02-13T00:39:41.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:40 smithi080 bash[17386]: audit 2024-02-13T00:39:39.678212+0000 mon.a (mon.0) 1531 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-19"}]: dispatch 2024-02-13T00:39:41.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:40 smithi080 bash[17386]: cluster 2024-02-13T00:39:40.235839+0000 mon.a (mon.0) 1532 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:39:41.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:40 smithi080 bash[17386]: audit 2024-02-13T00:39:40.245136+0000 mon.a (mon.0) 1533 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi080-54175-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi080-54175-31"}]': finished 2024-02-13T00:39:41.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:40 smithi080 bash[17386]: audit 2024-02-13T00:39:40.245303+0000 mon.a (mon.0) 1534 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-19"}]': finished 2024-02-13T00:39:41.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:40 smithi080 bash[17386]: cluster 2024-02-13T00:39:40.245442+0000 mon.a (mon.0) 1535 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2024-02-13T00:39:41.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:40 smithi080 bash[17386]: audit 2024-02-13T00:39:40.250642+0000 mon.c (mon.2) 255 : audit [INF] from='client.? 172.21.15.80:0/2789066434' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:41.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:40 smithi080 bash[17386]: audit 2024-02-13T00:39:40.251634+0000 mon.a (mon.0) 1536 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:41.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:40 smithi080 bash[24237]: audit 2024-02-13T00:39:39.676056+0000 mon.a (mon.0) 1529 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:39:41.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:40 smithi080 bash[24237]: cluster 2024-02-13T00:39:39.676184+0000 mon.a (mon.0) 1530 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2024-02-13T00:39:41.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:40 smithi080 bash[24237]: audit 2024-02-13T00:39:39.678212+0000 mon.a (mon.0) 1531 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-19"}]: dispatch 2024-02-13T00:39:41.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:40 smithi080 bash[24237]: cluster 2024-02-13T00:39:40.235839+0000 mon.a (mon.0) 1532 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:39:41.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:40 smithi080 bash[24237]: audit 2024-02-13T00:39:40.245136+0000 mon.a (mon.0) 1533 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi080-54175-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi080-54175-31"}]': finished 2024-02-13T00:39:41.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:40 smithi080 bash[24237]: audit 2024-02-13T00:39:40.245303+0000 mon.a (mon.0) 1534 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-19"}]': finished 2024-02-13T00:39:41.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:40 smithi080 bash[24237]: cluster 2024-02-13T00:39:40.245442+0000 mon.a (mon.0) 1535 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2024-02-13T00:39:41.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:40 smithi080 bash[24237]: audit 2024-02-13T00:39:40.250642+0000 mon.c (mon.2) 255 : audit [INF] from='client.? 172.21.15.80:0/2789066434' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:41.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:40 smithi080 bash[24237]: audit 2024-02-13T00:39:40.251634+0000 mon.a (mon.0) 1536 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:42.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:41 smithi106 bash[18459]: cluster 2024-02-13T00:39:40.184688+0000 mgr.y (mgr.24461) 402 : cluster [DBG] pgmap v405: 228 pgs: 228 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:39:42.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:41 smithi106 bash[18459]: audit 2024-02-13T00:39:41.247818+0000 mon.a (mon.0) 1537 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:42.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:41 smithi106 bash[18459]: cluster 2024-02-13T00:39:41.248062+0000 mon.a (mon.0) 1538 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2024-02-13T00:39:42.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:41 smithi080 bash[17386]: cluster 2024-02-13T00:39:40.184688+0000 mgr.y (mgr.24461) 402 : cluster [DBG] pgmap v405: 228 pgs: 228 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:39:42.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:41 smithi080 bash[17386]: audit 2024-02-13T00:39:41.247818+0000 mon.a (mon.0) 1537 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:42.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:41 smithi080 bash[17386]: cluster 2024-02-13T00:39:41.248062+0000 mon.a (mon.0) 1538 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2024-02-13T00:39:42.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:41 smithi080 bash[24237]: cluster 2024-02-13T00:39:40.184688+0000 mgr.y (mgr.24461) 402 : cluster [DBG] pgmap v405: 228 pgs: 228 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:39:42.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:41 smithi080 bash[24237]: audit 2024-02-13T00:39:41.247818+0000 mon.a (mon.0) 1537 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:42.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:41 smithi080 bash[24237]: cluster 2024-02-13T00:39:41.248062+0000 mon.a (mon.0) 1538 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2024-02-13T00:39:43.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:39:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:39:43] "GET /metrics HTTP/1.1" 200 187728 "" "Prometheus/2.33.4" 2024-02-13T00:39:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:43 smithi080 bash[17386]: cluster 2024-02-13T00:39:42.185464+0000 mgr.y (mgr.24461) 403 : cluster [DBG] pgmap v408: 236 pgs: 40 unknown, 196 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:39:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:43 smithi080 bash[17386]: cluster 2024-02-13T00:39:42.253521+0000 mon.a (mon.0) 1539 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2024-02-13T00:39:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:43 smithi080 bash[17386]: audit 2024-02-13T00:39:42.257382+0000 mon.c (mon.2) 256 : audit [INF] from='client.? 172.21.15.80:0/2775169439' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:43 smithi080 bash[17386]: audit 2024-02-13T00:39:42.257776+0000 mon.c (mon.2) 257 : audit [INF] from='client.? 172.21.15.80:0/3806169851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:43 smithi080 bash[17386]: audit 2024-02-13T00:39:42.263749+0000 mon.a (mon.0) 1540 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:43 smithi080 bash[17386]: audit 2024-02-13T00:39:42.264144+0000 mon.a (mon.0) 1541 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:43 smithi080 bash[17386]: audit 2024-02-13T00:39:42.264387+0000 mon.a (mon.0) 1542 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:43.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:43 smithi080 bash[24237]: cluster 2024-02-13T00:39:42.185464+0000 mgr.y (mgr.24461) 403 : cluster [DBG] pgmap v408: 236 pgs: 40 unknown, 196 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:39:43.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:43 smithi080 bash[24237]: cluster 2024-02-13T00:39:42.253521+0000 mon.a (mon.0) 1539 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2024-02-13T00:39:43.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:43 smithi080 bash[24237]: audit 2024-02-13T00:39:42.257382+0000 mon.c (mon.2) 256 : audit [INF] from='client.? 172.21.15.80:0/2775169439' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:43.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:43 smithi080 bash[24237]: audit 2024-02-13T00:39:42.257776+0000 mon.c (mon.2) 257 : audit [INF] from='client.? 172.21.15.80:0/3806169851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:43.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:43 smithi080 bash[24237]: audit 2024-02-13T00:39:42.263749+0000 mon.a (mon.0) 1540 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:43.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:43 smithi080 bash[24237]: audit 2024-02-13T00:39:42.264144+0000 mon.a (mon.0) 1541 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:43.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:43 smithi080 bash[24237]: audit 2024-02-13T00:39:42.264387+0000 mon.a (mon.0) 1542 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:43 smithi106 bash[18459]: cluster 2024-02-13T00:39:42.185464+0000 mgr.y (mgr.24461) 403 : cluster [DBG] pgmap v408: 236 pgs: 40 unknown, 196 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:39:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:43 smithi106 bash[18459]: cluster 2024-02-13T00:39:42.253521+0000 mon.a (mon.0) 1539 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2024-02-13T00:39:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:43 smithi106 bash[18459]: audit 2024-02-13T00:39:42.257382+0000 mon.c (mon.2) 256 : audit [INF] from='client.? 172.21.15.80:0/2775169439' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:43 smithi106 bash[18459]: audit 2024-02-13T00:39:42.257776+0000 mon.c (mon.2) 257 : audit [INF] from='client.? 172.21.15.80:0/3806169851' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:43 smithi106 bash[18459]: audit 2024-02-13T00:39:42.263749+0000 mon.a (mon.0) 1540 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:43 smithi106 bash[18459]: audit 2024-02-13T00:39:42.264144+0000 mon.a (mon.0) 1541 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:43 smithi106 bash[18459]: audit 2024-02-13T00:39:42.264387+0000 mon.a (mon.0) 1542 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:44.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:44 smithi106 bash[18459]: audit 2024-02-13T00:39:43.252845+0000 mon.a (mon.0) 1543 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:44.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:44 smithi106 bash[18459]: audit 2024-02-13T00:39:43.253021+0000 mon.a (mon.0) 1544 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi080-54175-31"}]': finished 2024-02-13T00:39:44.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:44 smithi106 bash[18459]: audit 2024-02-13T00:39:43.253118+0000 mon.a (mon.0) 1545 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:44.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:44 smithi106 bash[18459]: cluster 2024-02-13T00:39:43.253266+0000 mon.a (mon.0) 1546 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2024-02-13T00:39:44.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:44 smithi106 bash[18459]: audit 2024-02-13T00:39:43.261704+0000 mon.c (mon.2) 258 : audit [INF] from='client.? 172.21.15.80:0/3806169851' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:44.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:44 smithi106 bash[18459]: audit 2024-02-13T00:39:43.274579+0000 mon.a (mon.0) 1547 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:44.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:44 smithi106 bash[18459]: audit 2024-02-13T00:39:43.282973+0000 mon.a (mon.0) 1548 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:39:44.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:44 smithi106 bash[18459]: audit 2024-02-13T00:39:44.259215+0000 mon.a (mon.0) 1549 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi080-54175-31"}]': finished 2024-02-13T00:39:44.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:44 smithi106 bash[18459]: audit 2024-02-13T00:39:44.259382+0000 mon.a (mon.0) 1550 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-21", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:39:44.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:44 smithi106 bash[18459]: cluster 2024-02-13T00:39:44.259586+0000 mon.a (mon.0) 1551 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2024-02-13T00:39:44.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:44 smithi106 bash[18459]: audit 2024-02-13T00:39:44.260937+0000 mon.a (mon.0) 1552 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-21"}]: dispatch 2024-02-13T00:39:44.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:44 smithi106 bash[18459]: audit 2024-02-13T00:39:44.265667+0000 mon.c (mon.2) 259 : audit [INF] from='client.? 172.21.15.80:0/3828267521' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:44.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:44 smithi106 bash[18459]: audit 2024-02-13T00:39:44.266482+0000 mon.a (mon.0) 1553 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:44.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[17386]: audit 2024-02-13T00:39:43.252845+0000 mon.a (mon.0) 1543 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:44.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[17386]: audit 2024-02-13T00:39:43.253021+0000 mon.a (mon.0) 1544 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi080-54175-31"}]': finished 2024-02-13T00:39:44.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[17386]: audit 2024-02-13T00:39:43.253118+0000 mon.a (mon.0) 1545 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:44.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[17386]: cluster 2024-02-13T00:39:43.253266+0000 mon.a (mon.0) 1546 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2024-02-13T00:39:44.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[17386]: audit 2024-02-13T00:39:43.261704+0000 mon.c (mon.2) 258 : audit [INF] from='client.? 172.21.15.80:0/3806169851' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:44.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[17386]: audit 2024-02-13T00:39:43.274579+0000 mon.a (mon.0) 1547 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:44.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[17386]: audit 2024-02-13T00:39:43.282973+0000 mon.a (mon.0) 1548 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:39:44.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[17386]: audit 2024-02-13T00:39:44.259215+0000 mon.a (mon.0) 1549 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi080-54175-31"}]': finished 2024-02-13T00:39:44.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[17386]: audit 2024-02-13T00:39:44.259382+0000 mon.a (mon.0) 1550 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-21", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:39:44.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[17386]: cluster 2024-02-13T00:39:44.259586+0000 mon.a (mon.0) 1551 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2024-02-13T00:39:44.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[17386]: audit 2024-02-13T00:39:44.260937+0000 mon.a (mon.0) 1552 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-21"}]: dispatch 2024-02-13T00:39:44.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[17386]: audit 2024-02-13T00:39:44.265667+0000 mon.c (mon.2) 259 : audit [INF] from='client.? 172.21.15.80:0/3828267521' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:44.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[17386]: audit 2024-02-13T00:39:44.266482+0000 mon.a (mon.0) 1553 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:44.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[24237]: audit 2024-02-13T00:39:43.252845+0000 mon.a (mon.0) 1543 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:44.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[24237]: audit 2024-02-13T00:39:43.253021+0000 mon.a (mon.0) 1544 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi080-54175-31"}]': finished 2024-02-13T00:39:44.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[24237]: audit 2024-02-13T00:39:43.253118+0000 mon.a (mon.0) 1545 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:44.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[24237]: cluster 2024-02-13T00:39:43.253266+0000 mon.a (mon.0) 1546 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2024-02-13T00:39:44.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[24237]: audit 2024-02-13T00:39:43.261704+0000 mon.c (mon.2) 258 : audit [INF] from='client.? 172.21.15.80:0/3806169851' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:44.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[24237]: audit 2024-02-13T00:39:43.274579+0000 mon.a (mon.0) 1547 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi080-54175-31"}]: dispatch 2024-02-13T00:39:44.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[24237]: audit 2024-02-13T00:39:43.282973+0000 mon.a (mon.0) 1548 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:39:44.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[24237]: audit 2024-02-13T00:39:44.259215+0000 mon.a (mon.0) 1549 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi080-54175-31"}]': finished 2024-02-13T00:39:44.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[24237]: audit 2024-02-13T00:39:44.259382+0000 mon.a (mon.0) 1550 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-21", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:39:44.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[24237]: cluster 2024-02-13T00:39:44.259586+0000 mon.a (mon.0) 1551 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2024-02-13T00:39:44.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[24237]: audit 2024-02-13T00:39:44.260937+0000 mon.a (mon.0) 1552 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-21"}]: dispatch 2024-02-13T00:39:44.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[24237]: audit 2024-02-13T00:39:44.265667+0000 mon.c (mon.2) 259 : audit [INF] from='client.? 172.21.15.80:0/3828267521' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:44.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:44 smithi080 bash[24237]: audit 2024-02-13T00:39:44.266482+0000 mon.a (mon.0) 1553 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:45.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:45 smithi106 bash[18459]: cluster 2024-02-13T00:39:44.186312+0000 mgr.y (mgr.24461) 404 : cluster [DBG] pgmap v411: 292 pgs: 64 creating+peering, 228 active+clean; 6.9 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:39:45.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:45 smithi106 bash[18459]: audit 2024-02-13T00:39:44.287242+0000 mon.c (mon.2) 260 : audit [INF] from='client.? 172.21.15.80:0/2561771537' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:45.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:45 smithi106 bash[18459]: audit 2024-02-13T00:39:44.287610+0000 mon.a (mon.0) 1554 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:45.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:45 smithi106 bash[18459]: audit 2024-02-13T00:39:44.288519+0000 mon.c (mon.2) 261 : audit [INF] from='client.? 172.21.15.80:0/2561771537' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:45.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:45 smithi106 bash[18459]: audit 2024-02-13T00:39:44.288802+0000 mon.a (mon.0) 1555 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:45.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:45 smithi106 bash[18459]: audit 2024-02-13T00:39:44.289281+0000 mon.c (mon.2) 262 : audit [INF] from='client.? 172.21.15.80:0/2561771537' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi080-54175-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:45.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:45 smithi106 bash[18459]: audit 2024-02-13T00:39:44.289564+0000 mon.a (mon.0) 1556 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi080-54175-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:45.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:45 smithi106 bash[18459]: audit 2024-02-13T00:39:45.260853+0000 mon.a (mon.0) 1557 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-21"}]': finished 2024-02-13T00:39:45.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:45 smithi106 bash[18459]: audit 2024-02-13T00:39:45.261087+0000 mon.a (mon.0) 1558 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:45.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:45 smithi106 bash[18459]: audit 2024-02-13T00:39:45.261311+0000 mon.a (mon.0) 1559 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi080-54175-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:45.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:45 smithi106 bash[18459]: cluster 2024-02-13T00:39:45.261416+0000 mon.a (mon.0) 1560 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2024-02-13T00:39:45.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:45 smithi106 bash[18459]: audit 2024-02-13T00:39:45.264406+0000 mon.a (mon.0) 1561 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-21", "mode": "writeback"}]: dispatch 2024-02-13T00:39:45.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:45 smithi106 bash[18459]: audit 2024-02-13T00:39:45.265704+0000 mon.c (mon.2) 263 : audit [INF] from='client.? 172.21.15.80:0/2561771537' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi080-54175-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:45.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:45 smithi106 bash[18459]: audit 2024-02-13T00:39:45.267271+0000 mon.a (mon.0) 1562 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi080-54175-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:45.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[17386]: cluster 2024-02-13T00:39:44.186312+0000 mgr.y (mgr.24461) 404 : cluster [DBG] pgmap v411: 292 pgs: 64 creating+peering, 228 active+clean; 6.9 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:39:45.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[17386]: audit 2024-02-13T00:39:44.287242+0000 mon.c (mon.2) 260 : audit [INF] from='client.? 172.21.15.80:0/2561771537' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:45.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[17386]: audit 2024-02-13T00:39:44.287610+0000 mon.a (mon.0) 1554 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:45.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[17386]: audit 2024-02-13T00:39:44.288519+0000 mon.c (mon.2) 261 : audit [INF] from='client.? 172.21.15.80:0/2561771537' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:45.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[17386]: audit 2024-02-13T00:39:44.288802+0000 mon.a (mon.0) 1555 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:45.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[17386]: audit 2024-02-13T00:39:44.289281+0000 mon.c (mon.2) 262 : audit [INF] from='client.? 172.21.15.80:0/2561771537' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi080-54175-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:45.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[17386]: audit 2024-02-13T00:39:44.289564+0000 mon.a (mon.0) 1556 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi080-54175-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:45.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[17386]: audit 2024-02-13T00:39:45.260853+0000 mon.a (mon.0) 1557 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-21"}]': finished 2024-02-13T00:39:45.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[17386]: audit 2024-02-13T00:39:45.261087+0000 mon.a (mon.0) 1558 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:45.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[17386]: audit 2024-02-13T00:39:45.261311+0000 mon.a (mon.0) 1559 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi080-54175-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:45.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[17386]: cluster 2024-02-13T00:39:45.261416+0000 mon.a (mon.0) 1560 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2024-02-13T00:39:45.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[17386]: audit 2024-02-13T00:39:45.264406+0000 mon.a (mon.0) 1561 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-21", "mode": "writeback"}]: dispatch 2024-02-13T00:39:45.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[17386]: audit 2024-02-13T00:39:45.265704+0000 mon.c (mon.2) 263 : audit [INF] from='client.? 172.21.15.80:0/2561771537' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi080-54175-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:45.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[17386]: audit 2024-02-13T00:39:45.267271+0000 mon.a (mon.0) 1562 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi080-54175-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:45.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[24237]: cluster 2024-02-13T00:39:44.186312+0000 mgr.y (mgr.24461) 404 : cluster [DBG] pgmap v411: 292 pgs: 64 creating+peering, 228 active+clean; 6.9 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:39:45.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[24237]: audit 2024-02-13T00:39:44.287242+0000 mon.c (mon.2) 260 : audit [INF] from='client.? 172.21.15.80:0/2561771537' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:45.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[24237]: audit 2024-02-13T00:39:44.287610+0000 mon.a (mon.0) 1554 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:45.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[24237]: audit 2024-02-13T00:39:44.288519+0000 mon.c (mon.2) 261 : audit [INF] from='client.? 172.21.15.80:0/2561771537' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:45.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[24237]: audit 2024-02-13T00:39:44.288802+0000 mon.a (mon.0) 1555 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:45.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[24237]: audit 2024-02-13T00:39:44.289281+0000 mon.c (mon.2) 262 : audit [INF] from='client.? 172.21.15.80:0/2561771537' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi080-54175-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:45.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[24237]: audit 2024-02-13T00:39:44.289564+0000 mon.a (mon.0) 1556 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi080-54175-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:45.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[24237]: audit 2024-02-13T00:39:45.260853+0000 mon.a (mon.0) 1557 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-21"}]': finished 2024-02-13T00:39:45.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[24237]: audit 2024-02-13T00:39:45.261087+0000 mon.a (mon.0) 1558 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi080-54183-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:45.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[24237]: audit 2024-02-13T00:39:45.261311+0000 mon.a (mon.0) 1559 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi080-54175-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:45.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[24237]: cluster 2024-02-13T00:39:45.261416+0000 mon.a (mon.0) 1560 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2024-02-13T00:39:45.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[24237]: audit 2024-02-13T00:39:45.264406+0000 mon.a (mon.0) 1561 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-21", "mode": "writeback"}]: dispatch 2024-02-13T00:39:45.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[24237]: audit 2024-02-13T00:39:45.265704+0000 mon.c (mon.2) 263 : audit [INF] from='client.? 172.21.15.80:0/2561771537' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi080-54175-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:45.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:45 smithi080 bash[24237]: audit 2024-02-13T00:39:45.267271+0000 mon.a (mon.0) 1562 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi080-54175-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:47.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:46 smithi106 bash[18459]: cluster 2024-02-13T00:39:46.256514+0000 mon.a (mon.0) 1563 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:39:47.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:46 smithi106 bash[18459]: audit 2024-02-13T00:39:46.264038+0000 mon.a (mon.0) 1564 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-21", "mode": "writeback"}]': finished 2024-02-13T00:39:47.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:46 smithi080 bash[17386]: cluster 2024-02-13T00:39:46.256514+0000 mon.a (mon.0) 1563 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:39:47.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:46 smithi080 bash[17386]: audit 2024-02-13T00:39:46.264038+0000 mon.a (mon.0) 1564 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-21", "mode": "writeback"}]': finished 2024-02-13T00:39:47.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:46 smithi080 bash[24237]: cluster 2024-02-13T00:39:46.256514+0000 mon.a (mon.0) 1563 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:39:47.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:46 smithi080 bash[24237]: audit 2024-02-13T00:39:46.264038+0000 mon.a (mon.0) 1564 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-21", "mode": "writeback"}]': finished 2024-02-13T00:39:48.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:47 smithi106 bash[18459]: cluster 2024-02-13T00:39:46.187265+0000 mgr.y (mgr.24461) 405 : cluster [DBG] pgmap v414: 324 pgs: 32 unknown, 64 creating+peering, 228 active+clean; 6.9 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:39:48.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:47 smithi106 bash[18459]: cluster 2024-02-13T00:39:46.709062+0000 mon.a (mon.0) 1565 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2024-02-13T00:39:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:47 smithi106 bash[18459]: audit 2024-02-13T00:39:46.812806+0000 mon.a (mon.0) 1566 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:39:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:47 smithi106 bash[18459]: audit 2024-02-13T00:39:47.267524+0000 mon.a (mon.0) 1567 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi080-54175-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi080-54175-32"}]': finished 2024-02-13T00:39:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:47 smithi106 bash[18459]: audit 2024-02-13T00:39:47.267717+0000 mon.a (mon.0) 1568 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:39:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:47 smithi106 bash[18459]: cluster 2024-02-13T00:39:47.267781+0000 mon.a (mon.0) 1569 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2024-02-13T00:39:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:47 smithi106 bash[18459]: audit 2024-02-13T00:39:47.268931+0000 mon.a (mon.0) 1570 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-21"}]: dispatch 2024-02-13T00:39:48.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:47 smithi080 bash[17386]: cluster 2024-02-13T00:39:46.187265+0000 mgr.y (mgr.24461) 405 : cluster [DBG] pgmap v414: 324 pgs: 32 unknown, 64 creating+peering, 228 active+clean; 6.9 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:39:48.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:47 smithi080 bash[17386]: cluster 2024-02-13T00:39:46.709062+0000 mon.a (mon.0) 1565 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2024-02-13T00:39:48.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:47 smithi080 bash[17386]: audit 2024-02-13T00:39:46.812806+0000 mon.a (mon.0) 1566 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:39:48.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:47 smithi080 bash[17386]: audit 2024-02-13T00:39:47.267524+0000 mon.a (mon.0) 1567 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi080-54175-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi080-54175-32"}]': finished 2024-02-13T00:39:48.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:47 smithi080 bash[17386]: audit 2024-02-13T00:39:47.267717+0000 mon.a (mon.0) 1568 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:39:48.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:47 smithi080 bash[17386]: cluster 2024-02-13T00:39:47.267781+0000 mon.a (mon.0) 1569 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2024-02-13T00:39:48.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:47 smithi080 bash[17386]: audit 2024-02-13T00:39:47.268931+0000 mon.a (mon.0) 1570 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-21"}]: dispatch 2024-02-13T00:39:48.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:47 smithi080 bash[24237]: cluster 2024-02-13T00:39:46.187265+0000 mgr.y (mgr.24461) 405 : cluster [DBG] pgmap v414: 324 pgs: 32 unknown, 64 creating+peering, 228 active+clean; 6.9 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:39:48.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:47 smithi080 bash[24237]: cluster 2024-02-13T00:39:46.709062+0000 mon.a (mon.0) 1565 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2024-02-13T00:39:48.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:47 smithi080 bash[24237]: audit 2024-02-13T00:39:46.812806+0000 mon.a (mon.0) 1566 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:39:48.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:47 smithi080 bash[24237]: audit 2024-02-13T00:39:47.267524+0000 mon.a (mon.0) 1567 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi080-54175-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi080-54175-32"}]': finished 2024-02-13T00:39:48.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:47 smithi080 bash[24237]: audit 2024-02-13T00:39:47.267717+0000 mon.a (mon.0) 1568 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:39:48.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:47 smithi080 bash[24237]: cluster 2024-02-13T00:39:47.267781+0000 mon.a (mon.0) 1569 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2024-02-13T00:39:48.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:47 smithi080 bash[24237]: audit 2024-02-13T00:39:47.268931+0000 mon.a (mon.0) 1570 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-21"}]: dispatch 2024-02-13T00:39:48.505 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:39:48 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:39:49.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:48 smithi106 bash[18459]: cluster 2024-02-13T00:39:48.261970+0000 mon.a (mon.0) 1571 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:39:49.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:48 smithi106 bash[18459]: audit 2024-02-13T00:39:48.270836+0000 mon.a (mon.0) 1572 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-21"}]': finished 2024-02-13T00:39:49.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:48 smithi106 bash[18459]: cluster 2024-02-13T00:39:48.271401+0000 mon.a (mon.0) 1573 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2024-02-13T00:39:49.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:48 smithi080 bash[17386]: cluster 2024-02-13T00:39:48.261970+0000 mon.a (mon.0) 1571 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:39:49.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:48 smithi080 bash[17386]: audit 2024-02-13T00:39:48.270836+0000 mon.a (mon.0) 1572 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-21"}]': finished 2024-02-13T00:39:49.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:48 smithi080 bash[17386]: cluster 2024-02-13T00:39:48.271401+0000 mon.a (mon.0) 1573 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2024-02-13T00:39:49.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:48 smithi080 bash[24237]: cluster 2024-02-13T00:39:48.261970+0000 mon.a (mon.0) 1571 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:39:49.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:48 smithi080 bash[24237]: audit 2024-02-13T00:39:48.270836+0000 mon.a (mon.0) 1572 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-21"}]': finished 2024-02-13T00:39:49.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:48 smithi080 bash[24237]: cluster 2024-02-13T00:39:48.271401+0000 mon.a (mon.0) 1573 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2024-02-13T00:39:50.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:49 smithi106 bash[18459]: cluster 2024-02-13T00:39:48.189385+0000 mgr.y (mgr.24461) 406 : cluster [DBG] pgmap v417: 268 pgs: 8 creating+peering, 260 active+clean; 6.9 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-13T00:39:50.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:49 smithi106 bash[18459]: audit 2024-02-13T00:39:48.196680+0000 mgr.y (mgr.24461) 407 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:39:50.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:49 smithi106 bash[18459]: cluster 2024-02-13T00:39:49.273595+0000 mon.a (mon.0) 1574 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2024-02-13T00:39:50.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:49 smithi106 bash[18459]: audit 2024-02-13T00:39:49.279005+0000 mon.c (mon.2) 264 : audit [INF] from='client.? 172.21.15.80:0/2561771537' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:50.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:49 smithi106 bash[18459]: audit 2024-02-13T00:39:49.280019+0000 mon.a (mon.0) 1575 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:50.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:49 smithi080 bash[17386]: cluster 2024-02-13T00:39:48.189385+0000 mgr.y (mgr.24461) 406 : cluster [DBG] pgmap v417: 268 pgs: 8 creating+peering, 260 active+clean; 6.9 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-13T00:39:50.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:49 smithi080 bash[17386]: audit 2024-02-13T00:39:48.196680+0000 mgr.y (mgr.24461) 407 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:39:50.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:49 smithi080 bash[17386]: cluster 2024-02-13T00:39:49.273595+0000 mon.a (mon.0) 1574 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2024-02-13T00:39:50.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:49 smithi080 bash[17386]: audit 2024-02-13T00:39:49.279005+0000 mon.c (mon.2) 264 : audit [INF] from='client.? 172.21.15.80:0/2561771537' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:50.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:49 smithi080 bash[17386]: audit 2024-02-13T00:39:49.280019+0000 mon.a (mon.0) 1575 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:50.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:49 smithi080 bash[24237]: cluster 2024-02-13T00:39:48.189385+0000 mgr.y (mgr.24461) 406 : cluster [DBG] pgmap v417: 268 pgs: 8 creating+peering, 260 active+clean; 6.9 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-13T00:39:50.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:49 smithi080 bash[24237]: audit 2024-02-13T00:39:48.196680+0000 mgr.y (mgr.24461) 407 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:39:50.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:49 smithi080 bash[24237]: cluster 2024-02-13T00:39:49.273595+0000 mon.a (mon.0) 1574 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2024-02-13T00:39:50.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:49 smithi080 bash[24237]: audit 2024-02-13T00:39:49.279005+0000 mon.c (mon.2) 264 : audit [INF] from='client.? 172.21.15.80:0/2561771537' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:50.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:49 smithi080 bash[24237]: audit 2024-02-13T00:39:49.280019+0000 mon.a (mon.0) 1575 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:50.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:39:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:39:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:39:51.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:50 smithi106 bash[18459]: audit 2024-02-13T00:39:49.739663+0000 mon.a (mon.0) 1576 : audit [INF] from='client.? 172.21.15.80:0/1221013658' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:51.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:50 smithi106 bash[18459]: audit 2024-02-13T00:39:50.278558+0000 mon.a (mon.0) 1577 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi080-54175-32"}]': finished 2024-02-13T00:39:51.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:50 smithi106 bash[18459]: audit 2024-02-13T00:39:50.278841+0000 mon.a (mon.0) 1578 : audit [INF] from='client.? 172.21.15.80:0/1221013658' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:51.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:50 smithi106 bash[18459]: cluster 2024-02-13T00:39:50.278996+0000 mon.a (mon.0) 1579 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2024-02-13T00:39:51.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:50 smithi106 bash[18459]: audit 2024-02-13T00:39:50.284220+0000 mon.a (mon.0) 1580 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:51.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:50 smithi106 bash[18459]: audit 2024-02-13T00:39:50.286081+0000 mon.c (mon.2) 265 : audit [INF] from='client.? 172.21.15.80:0/2561771537' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:51.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:50 smithi106 bash[18459]: audit 2024-02-13T00:39:50.286654+0000 mon.a (mon.0) 1581 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:51.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:50 smithi080 bash[17386]: audit 2024-02-13T00:39:49.739663+0000 mon.a (mon.0) 1576 : audit [INF] from='client.? 172.21.15.80:0/1221013658' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:51.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:50 smithi080 bash[17386]: audit 2024-02-13T00:39:50.278558+0000 mon.a (mon.0) 1577 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi080-54175-32"}]': finished 2024-02-13T00:39:51.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:50 smithi080 bash[17386]: audit 2024-02-13T00:39:50.278841+0000 mon.a (mon.0) 1578 : audit [INF] from='client.? 172.21.15.80:0/1221013658' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:51.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:50 smithi080 bash[17386]: cluster 2024-02-13T00:39:50.278996+0000 mon.a (mon.0) 1579 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2024-02-13T00:39:51.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:50 smithi080 bash[17386]: audit 2024-02-13T00:39:50.284220+0000 mon.a (mon.0) 1580 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:51.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:50 smithi080 bash[17386]: audit 2024-02-13T00:39:50.286081+0000 mon.c (mon.2) 265 : audit [INF] from='client.? 172.21.15.80:0/2561771537' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:51.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:50 smithi080 bash[17386]: audit 2024-02-13T00:39:50.286654+0000 mon.a (mon.0) 1581 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:51.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:50 smithi080 bash[24237]: audit 2024-02-13T00:39:49.739663+0000 mon.a (mon.0) 1576 : audit [INF] from='client.? 172.21.15.80:0/1221013658' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:51.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:50 smithi080 bash[24237]: audit 2024-02-13T00:39:50.278558+0000 mon.a (mon.0) 1577 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi080-54175-32"}]': finished 2024-02-13T00:39:51.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:50 smithi080 bash[24237]: audit 2024-02-13T00:39:50.278841+0000 mon.a (mon.0) 1578 : audit [INF] from='client.? 172.21.15.80:0/1221013658' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:51.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:50 smithi080 bash[24237]: cluster 2024-02-13T00:39:50.278996+0000 mon.a (mon.0) 1579 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2024-02-13T00:39:51.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:50 smithi080 bash[24237]: audit 2024-02-13T00:39:50.284220+0000 mon.a (mon.0) 1580 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:51.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:50 smithi080 bash[24237]: audit 2024-02-13T00:39:50.286081+0000 mon.c (mon.2) 265 : audit [INF] from='client.? 172.21.15.80:0/2561771537' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:51.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:50 smithi080 bash[24237]: audit 2024-02-13T00:39:50.286654+0000 mon.a (mon.0) 1581 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi080-54175-32"}]: dispatch 2024-02-13T00:39:52.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:51 smithi106 bash[18459]: cluster 2024-02-13T00:39:50.190169+0000 mgr.y (mgr.24461) 408 : cluster [DBG] pgmap v420: 228 pgs: 32 unknown, 196 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:39:52.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:51 smithi106 bash[18459]: audit 2024-02-13T00:39:51.283687+0000 mon.a (mon.0) 1582 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:52.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:51 smithi106 bash[18459]: audit 2024-02-13T00:39:51.283864+0000 mon.a (mon.0) 1583 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi080-54175-32"}]': finished 2024-02-13T00:39:52.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:51 smithi106 bash[18459]: cluster 2024-02-13T00:39:51.284505+0000 mon.a (mon.0) 1584 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2024-02-13T00:39:52.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:51 smithi106 bash[18459]: audit 2024-02-13T00:39:51.293232+0000 mon.a (mon.0) 1585 : audit [INF] from='client.? 172.21.15.80:0/4264336835' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:52.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:51 smithi106 bash[18459]: audit 2024-02-13T00:39:51.318794+0000 mon.a (mon.0) 1586 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi080-54175-33"}]: dispatch 2024-02-13T00:39:52.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:51 smithi106 bash[18459]: audit 2024-02-13T00:39:51.319824+0000 mon.a (mon.0) 1587 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi080-54175-33"}]: dispatch 2024-02-13T00:39:52.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:51 smithi106 bash[18459]: audit 2024-02-13T00:39:51.320205+0000 mon.a (mon.0) 1588 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi080-54175-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:52.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:51 smithi080 bash[17386]: cluster 2024-02-13T00:39:50.190169+0000 mgr.y (mgr.24461) 408 : cluster [DBG] pgmap v420: 228 pgs: 32 unknown, 196 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:39:52.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:51 smithi080 bash[17386]: audit 2024-02-13T00:39:51.283687+0000 mon.a (mon.0) 1582 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:52.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:51 smithi080 bash[17386]: audit 2024-02-13T00:39:51.283864+0000 mon.a (mon.0) 1583 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi080-54175-32"}]': finished 2024-02-13T00:39:52.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:51 smithi080 bash[17386]: cluster 2024-02-13T00:39:51.284505+0000 mon.a (mon.0) 1584 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2024-02-13T00:39:52.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:51 smithi080 bash[17386]: audit 2024-02-13T00:39:51.293232+0000 mon.a (mon.0) 1585 : audit [INF] from='client.? 172.21.15.80:0/4264336835' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:52.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:51 smithi080 bash[17386]: audit 2024-02-13T00:39:51.318794+0000 mon.a (mon.0) 1586 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi080-54175-33"}]: dispatch 2024-02-13T00:39:52.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:51 smithi080 bash[17386]: audit 2024-02-13T00:39:51.319824+0000 mon.a (mon.0) 1587 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi080-54175-33"}]: dispatch 2024-02-13T00:39:52.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:51 smithi080 bash[17386]: audit 2024-02-13T00:39:51.320205+0000 mon.a (mon.0) 1588 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi080-54175-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:52.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:51 smithi080 bash[24237]: cluster 2024-02-13T00:39:50.190169+0000 mgr.y (mgr.24461) 408 : cluster [DBG] pgmap v420: 228 pgs: 32 unknown, 196 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:39:52.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:51 smithi080 bash[24237]: audit 2024-02-13T00:39:51.283687+0000 mon.a (mon.0) 1582 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:52.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:51 smithi080 bash[24237]: audit 2024-02-13T00:39:51.283864+0000 mon.a (mon.0) 1583 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi080-54175-32"}]': finished 2024-02-13T00:39:52.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:51 smithi080 bash[24237]: cluster 2024-02-13T00:39:51.284505+0000 mon.a (mon.0) 1584 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2024-02-13T00:39:52.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:51 smithi080 bash[24237]: audit 2024-02-13T00:39:51.293232+0000 mon.a (mon.0) 1585 : audit [INF] from='client.? 172.21.15.80:0/4264336835' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:52.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:51 smithi080 bash[24237]: audit 2024-02-13T00:39:51.318794+0000 mon.a (mon.0) 1586 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi080-54175-33"}]: dispatch 2024-02-13T00:39:52.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:51 smithi080 bash[24237]: audit 2024-02-13T00:39:51.319824+0000 mon.a (mon.0) 1587 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi080-54175-33"}]: dispatch 2024-02-13T00:39:52.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:51 smithi080 bash[24237]: audit 2024-02-13T00:39:51.320205+0000 mon.a (mon.0) 1588 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi080-54175-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:39:53.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:39:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:39:53] "GET /metrics HTTP/1.1" 200 190553 "" "Prometheus/2.33.4" 2024-02-13T00:39:54.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:53 smithi106 bash[18459]: cluster 2024-02-13T00:39:52.191061+0000 mgr.y (mgr.24461) 409 : cluster [DBG] pgmap v423: 292 pgs: 96 unknown, 196 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:39:54.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:53 smithi106 bash[18459]: audit 2024-02-13T00:39:52.287088+0000 mon.a (mon.0) 1589 : audit [INF] from='client.? 172.21.15.80:0/4264336835' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:54.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:53 smithi106 bash[18459]: audit 2024-02-13T00:39:52.287850+0000 mon.a (mon.0) 1590 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi080-54175-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:54.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:53 smithi106 bash[18459]: cluster 2024-02-13T00:39:52.288011+0000 mon.a (mon.0) 1591 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2024-02-13T00:39:54.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:53 smithi106 bash[18459]: audit 2024-02-13T00:39:52.292555+0000 mon.a (mon.0) 1592 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi080-54175-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi080-54175-33"}]: dispatch 2024-02-13T00:39:54.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:53 smithi106 bash[18459]: audit 2024-02-13T00:39:52.322038+0000 mon.a (mon.0) 1593 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:39:54.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:53 smithi080 bash[17386]: cluster 2024-02-13T00:39:52.191061+0000 mgr.y (mgr.24461) 409 : cluster [DBG] pgmap v423: 292 pgs: 96 unknown, 196 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:39:54.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:53 smithi080 bash[17386]: audit 2024-02-13T00:39:52.287088+0000 mon.a (mon.0) 1589 : audit [INF] from='client.? 172.21.15.80:0/4264336835' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:54.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:53 smithi080 bash[17386]: audit 2024-02-13T00:39:52.287850+0000 mon.a (mon.0) 1590 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi080-54175-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:54.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:53 smithi080 bash[17386]: cluster 2024-02-13T00:39:52.288011+0000 mon.a (mon.0) 1591 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2024-02-13T00:39:54.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:53 smithi080 bash[17386]: audit 2024-02-13T00:39:52.292555+0000 mon.a (mon.0) 1592 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi080-54175-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi080-54175-33"}]: dispatch 2024-02-13T00:39:54.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:53 smithi080 bash[17386]: audit 2024-02-13T00:39:52.322038+0000 mon.a (mon.0) 1593 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:39:54.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:53 smithi080 bash[24237]: cluster 2024-02-13T00:39:52.191061+0000 mgr.y (mgr.24461) 409 : cluster [DBG] pgmap v423: 292 pgs: 96 unknown, 196 active+clean; 6.8 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:39:54.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:53 smithi080 bash[24237]: audit 2024-02-13T00:39:52.287088+0000 mon.a (mon.0) 1589 : audit [INF] from='client.? 172.21.15.80:0/4264336835' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:54.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:53 smithi080 bash[24237]: audit 2024-02-13T00:39:52.287850+0000 mon.a (mon.0) 1590 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi080-54175-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:39:54.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:53 smithi080 bash[24237]: cluster 2024-02-13T00:39:52.288011+0000 mon.a (mon.0) 1591 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2024-02-13T00:39:54.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:53 smithi080 bash[24237]: audit 2024-02-13T00:39:52.292555+0000 mon.a (mon.0) 1592 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi080-54175-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi080-54175-33"}]: dispatch 2024-02-13T00:39:54.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:53 smithi080 bash[24237]: audit 2024-02-13T00:39:52.322038+0000 mon.a (mon.0) 1593 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:39:55.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:54 smithi106 bash[18459]: audit 2024-02-13T00:39:53.734841+0000 mon.a (mon.0) 1594 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-23", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:39:55.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:54 smithi106 bash[18459]: cluster 2024-02-13T00:39:53.734954+0000 mon.a (mon.0) 1595 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2024-02-13T00:39:55.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:54 smithi106 bash[18459]: audit 2024-02-13T00:39:53.736673+0000 mon.a (mon.0) 1596 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-23"}]: dispatch 2024-02-13T00:39:55.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:54 smithi106 bash[18459]: audit 2024-02-13T00:39:53.739893+0000 mon.c (mon.2) 266 : audit [INF] from='client.? 172.21.15.80:0/2602649298' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:55.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:54 smithi106 bash[18459]: audit 2024-02-13T00:39:53.747246+0000 mon.a (mon.0) 1597 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:55.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:54 smithi106 bash[18459]: audit 2024-02-13T00:39:54.297919+0000 mon.a (mon.0) 1598 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi080-54175-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi080-54175-33"}]': finished 2024-02-13T00:39:55.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:54 smithi106 bash[18459]: audit 2024-02-13T00:39:54.298841+0000 mon.a (mon.0) 1599 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-23"}]': finished 2024-02-13T00:39:55.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:54 smithi106 bash[18459]: audit 2024-02-13T00:39:54.299198+0000 mon.a (mon.0) 1600 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:55.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:54 smithi106 bash[18459]: cluster 2024-02-13T00:39:54.299352+0000 mon.a (mon.0) 1601 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2024-02-13T00:39:55.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:54 smithi106 bash[18459]: audit 2024-02-13T00:39:54.303519+0000 mon.a (mon.0) 1602 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-23", "mode": "writeback"}]: dispatch 2024-02-13T00:39:55.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:54 smithi080 bash[17386]: audit 2024-02-13T00:39:53.734841+0000 mon.a (mon.0) 1594 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-23", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:39:55.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:54 smithi080 bash[17386]: cluster 2024-02-13T00:39:53.734954+0000 mon.a (mon.0) 1595 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2024-02-13T00:39:55.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:54 smithi080 bash[17386]: audit 2024-02-13T00:39:53.736673+0000 mon.a (mon.0) 1596 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-23"}]: dispatch 2024-02-13T00:39:55.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:54 smithi080 bash[17386]: audit 2024-02-13T00:39:53.739893+0000 mon.c (mon.2) 266 : audit [INF] from='client.? 172.21.15.80:0/2602649298' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:55.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:54 smithi080 bash[17386]: audit 2024-02-13T00:39:53.747246+0000 mon.a (mon.0) 1597 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:55.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:54 smithi080 bash[17386]: audit 2024-02-13T00:39:54.297919+0000 mon.a (mon.0) 1598 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi080-54175-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi080-54175-33"}]': finished 2024-02-13T00:39:55.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:54 smithi080 bash[17386]: audit 2024-02-13T00:39:54.298841+0000 mon.a (mon.0) 1599 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-23"}]': finished 2024-02-13T00:39:55.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:54 smithi080 bash[17386]: audit 2024-02-13T00:39:54.299198+0000 mon.a (mon.0) 1600 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:55.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:54 smithi080 bash[17386]: cluster 2024-02-13T00:39:54.299352+0000 mon.a (mon.0) 1601 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2024-02-13T00:39:55.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:54 smithi080 bash[17386]: audit 2024-02-13T00:39:54.303519+0000 mon.a (mon.0) 1602 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-23", "mode": "writeback"}]: dispatch 2024-02-13T00:39:55.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:54 smithi080 bash[24237]: audit 2024-02-13T00:39:53.734841+0000 mon.a (mon.0) 1594 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-23", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:39:55.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:54 smithi080 bash[24237]: cluster 2024-02-13T00:39:53.734954+0000 mon.a (mon.0) 1595 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2024-02-13T00:39:55.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:54 smithi080 bash[24237]: audit 2024-02-13T00:39:53.736673+0000 mon.a (mon.0) 1596 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-23"}]: dispatch 2024-02-13T00:39:55.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:54 smithi080 bash[24237]: audit 2024-02-13T00:39:53.739893+0000 mon.c (mon.2) 266 : audit [INF] from='client.? 172.21.15.80:0/2602649298' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:55.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:54 smithi080 bash[24237]: audit 2024-02-13T00:39:53.747246+0000 mon.a (mon.0) 1597 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:55.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:54 smithi080 bash[24237]: audit 2024-02-13T00:39:54.297919+0000 mon.a (mon.0) 1598 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi080-54175-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi080-54175-33"}]': finished 2024-02-13T00:39:55.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:54 smithi080 bash[24237]: audit 2024-02-13T00:39:54.298841+0000 mon.a (mon.0) 1599 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-23"}]': finished 2024-02-13T00:39:55.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:54 smithi080 bash[24237]: audit 2024-02-13T00:39:54.299198+0000 mon.a (mon.0) 1600 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:55.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:54 smithi080 bash[24237]: cluster 2024-02-13T00:39:54.299352+0000 mon.a (mon.0) 1601 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2024-02-13T00:39:55.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:54 smithi080 bash[24237]: audit 2024-02-13T00:39:54.303519+0000 mon.a (mon.0) 1602 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-23", "mode": "writeback"}]: dispatch 2024-02-13T00:39:56.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:55 smithi106 bash[18459]: cluster 2024-02-13T00:39:54.192152+0000 mgr.y (mgr.24461) 410 : cluster [DBG] pgmap v426: 324 pgs: 32 unknown, 292 active+clean; 7.0 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-02-13T00:39:56.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:55 smithi106 bash[18459]: audit 2024-02-13T00:39:54.371247+0000 mon.c (mon.2) 267 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:39:56.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:55 smithi106 bash[18459]: audit 2024-02-13T00:39:54.664256+0000 mon.c (mon.2) 268 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:39:56.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:55 smithi106 bash[18459]: audit 2024-02-13T00:39:54.665669+0000 mon.c (mon.2) 269 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:39:56.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:55 smithi106 bash[18459]: audit 2024-02-13T00:39:54.817490+0000 mon.a (mon.0) 1603 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:39:56.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:55 smithi106 bash[18459]: cluster 2024-02-13T00:39:55.291131+0000 mon.a (mon.0) 1604 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:39:56.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:55 smithi106 bash[18459]: audit 2024-02-13T00:39:55.302026+0000 mon.a (mon.0) 1605 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-23", "mode": "writeback"}]': finished 2024-02-13T00:39:56.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:55 smithi106 bash[18459]: cluster 2024-02-13T00:39:55.302530+0000 mon.a (mon.0) 1606 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2024-02-13T00:39:56.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:55 smithi106 bash[18459]: audit 2024-02-13T00:39:55.309342+0000 mon.c (mon.2) 270 : audit [INF] from='client.? 172.21.15.80:0/854405753' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:56.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:55 smithi106 bash[18459]: audit 2024-02-13T00:39:55.311595+0000 mon.a (mon.0) 1607 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:56.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:55 smithi080 bash[17386]: cluster 2024-02-13T00:39:54.192152+0000 mgr.y (mgr.24461) 410 : cluster [DBG] pgmap v426: 324 pgs: 32 unknown, 292 active+clean; 7.0 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-02-13T00:39:56.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:55 smithi080 bash[17386]: audit 2024-02-13T00:39:54.371247+0000 mon.c (mon.2) 267 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:39:56.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:55 smithi080 bash[17386]: audit 2024-02-13T00:39:54.664256+0000 mon.c (mon.2) 268 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:39:56.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:55 smithi080 bash[17386]: audit 2024-02-13T00:39:54.665669+0000 mon.c (mon.2) 269 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:39:56.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:55 smithi080 bash[17386]: audit 2024-02-13T00:39:54.817490+0000 mon.a (mon.0) 1603 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:39:56.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:55 smithi080 bash[17386]: cluster 2024-02-13T00:39:55.291131+0000 mon.a (mon.0) 1604 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:39:56.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:55 smithi080 bash[17386]: audit 2024-02-13T00:39:55.302026+0000 mon.a (mon.0) 1605 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-23", "mode": "writeback"}]': finished 2024-02-13T00:39:56.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:55 smithi080 bash[17386]: cluster 2024-02-13T00:39:55.302530+0000 mon.a (mon.0) 1606 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2024-02-13T00:39:56.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:55 smithi080 bash[17386]: audit 2024-02-13T00:39:55.309342+0000 mon.c (mon.2) 270 : audit [INF] from='client.? 172.21.15.80:0/854405753' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:56.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:55 smithi080 bash[17386]: audit 2024-02-13T00:39:55.311595+0000 mon.a (mon.0) 1607 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:56.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:55 smithi080 bash[24237]: cluster 2024-02-13T00:39:54.192152+0000 mgr.y (mgr.24461) 410 : cluster [DBG] pgmap v426: 324 pgs: 32 unknown, 292 active+clean; 7.0 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-02-13T00:39:56.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:55 smithi080 bash[24237]: audit 2024-02-13T00:39:54.371247+0000 mon.c (mon.2) 267 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:39:56.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:55 smithi080 bash[24237]: audit 2024-02-13T00:39:54.664256+0000 mon.c (mon.2) 268 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:39:56.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:55 smithi080 bash[24237]: audit 2024-02-13T00:39:54.665669+0000 mon.c (mon.2) 269 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:39:56.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:55 smithi080 bash[24237]: audit 2024-02-13T00:39:54.817490+0000 mon.a (mon.0) 1603 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:39:56.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:55 smithi080 bash[24237]: cluster 2024-02-13T00:39:55.291131+0000 mon.a (mon.0) 1604 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:39:56.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:55 smithi080 bash[24237]: audit 2024-02-13T00:39:55.302026+0000 mon.a (mon.0) 1605 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-23", "mode": "writeback"}]': finished 2024-02-13T00:39:56.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:55 smithi080 bash[24237]: cluster 2024-02-13T00:39:55.302530+0000 mon.a (mon.0) 1606 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2024-02-13T00:39:56.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:55 smithi080 bash[24237]: audit 2024-02-13T00:39:55.309342+0000 mon.c (mon.2) 270 : audit [INF] from='client.? 172.21.15.80:0/854405753' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:56.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:55 smithi080 bash[24237]: audit 2024-02-13T00:39:55.311595+0000 mon.a (mon.0) 1607 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:57.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:57 smithi106 bash[18459]: cluster 2024-02-13T00:39:56.193073+0000 mgr.y (mgr.24461) 411 : cluster [DBG] pgmap v429: 364 pgs: 72 unknown, 292 active+clean; 7.0 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-02-13T00:39:57.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:57 smithi106 bash[18459]: audit 2024-02-13T00:39:56.303111+0000 mon.a (mon.0) 1608 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:57.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:57 smithi106 bash[18459]: cluster 2024-02-13T00:39:56.303380+0000 mon.a (mon.0) 1609 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2024-02-13T00:39:57.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:57 smithi106 bash[18459]: audit 2024-02-13T00:39:56.311143+0000 mon.a (mon.0) 1610 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi080-54175-33"}]: dispatch 2024-02-13T00:39:57.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:57 smithi106 bash[18459]: audit 2024-02-13T00:39:56.807983+0000 mon.a (mon.0) 1611 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:39:57.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:57 smithi080 bash[17386]: cluster 2024-02-13T00:39:56.193073+0000 mgr.y (mgr.24461) 411 : cluster [DBG] pgmap v429: 364 pgs: 72 unknown, 292 active+clean; 7.0 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-02-13T00:39:57.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:57 smithi080 bash[17386]: audit 2024-02-13T00:39:56.303111+0000 mon.a (mon.0) 1608 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:57.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:57 smithi080 bash[17386]: cluster 2024-02-13T00:39:56.303380+0000 mon.a (mon.0) 1609 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2024-02-13T00:39:57.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:57 smithi080 bash[17386]: audit 2024-02-13T00:39:56.311143+0000 mon.a (mon.0) 1610 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi080-54175-33"}]: dispatch 2024-02-13T00:39:57.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:57 smithi080 bash[17386]: audit 2024-02-13T00:39:56.807983+0000 mon.a (mon.0) 1611 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:39:57.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:57 smithi080 bash[24237]: cluster 2024-02-13T00:39:56.193073+0000 mgr.y (mgr.24461) 411 : cluster [DBG] pgmap v429: 364 pgs: 72 unknown, 292 active+clean; 7.0 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-02-13T00:39:57.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:57 smithi080 bash[24237]: audit 2024-02-13T00:39:56.303111+0000 mon.a (mon.0) 1608 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:39:57.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:57 smithi080 bash[24237]: cluster 2024-02-13T00:39:56.303380+0000 mon.a (mon.0) 1609 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2024-02-13T00:39:57.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:57 smithi080 bash[24237]: audit 2024-02-13T00:39:56.311143+0000 mon.a (mon.0) 1610 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi080-54175-33"}]: dispatch 2024-02-13T00:39:57.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:57 smithi080 bash[24237]: audit 2024-02-13T00:39:56.807983+0000 mon.a (mon.0) 1611 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:39:58.505 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:39:58 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:39:58.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:58 smithi106 bash[18459]: audit 2024-02-13T00:39:57.310420+0000 mon.a (mon.0) 1612 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi080-54175-33"}]': finished 2024-02-13T00:39:58.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:58 smithi106 bash[18459]: audit 2024-02-13T00:39:57.310573+0000 mon.a (mon.0) 1613 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:39:58.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:58 smithi106 bash[18459]: cluster 2024-02-13T00:39:57.310727+0000 mon.a (mon.0) 1614 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2024-02-13T00:39:58.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:58 smithi106 bash[18459]: audit 2024-02-13T00:39:57.313506+0000 mon.c (mon.2) 271 : audit [INF] from='client.? 172.21.15.80:0/1823116635' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:58.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:58 smithi106 bash[18459]: audit 2024-02-13T00:39:57.320640+0000 mon.a (mon.0) 1615 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-23"}]: dispatch 2024-02-13T00:39:58.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:58 smithi106 bash[18459]: audit 2024-02-13T00:39:57.320989+0000 mon.a (mon.0) 1616 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi080-54175-33"}]: dispatch 2024-02-13T00:39:58.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:58 smithi106 bash[18459]: audit 2024-02-13T00:39:57.321514+0000 mon.a (mon.0) 1617 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:58.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:58 smithi080 bash[17386]: audit 2024-02-13T00:39:57.310420+0000 mon.a (mon.0) 1612 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi080-54175-33"}]': finished 2024-02-13T00:39:58.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:58 smithi080 bash[17386]: audit 2024-02-13T00:39:57.310573+0000 mon.a (mon.0) 1613 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:39:58.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:58 smithi080 bash[17386]: cluster 2024-02-13T00:39:57.310727+0000 mon.a (mon.0) 1614 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2024-02-13T00:39:58.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:58 smithi080 bash[17386]: audit 2024-02-13T00:39:57.313506+0000 mon.c (mon.2) 271 : audit [INF] from='client.? 172.21.15.80:0/1823116635' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:58.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:58 smithi080 bash[17386]: audit 2024-02-13T00:39:57.320640+0000 mon.a (mon.0) 1615 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-23"}]: dispatch 2024-02-13T00:39:58.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:58 smithi080 bash[17386]: audit 2024-02-13T00:39:57.320989+0000 mon.a (mon.0) 1616 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi080-54175-33"}]: dispatch 2024-02-13T00:39:58.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:58 smithi080 bash[17386]: audit 2024-02-13T00:39:57.321514+0000 mon.a (mon.0) 1617 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:58.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:58 smithi080 bash[24237]: audit 2024-02-13T00:39:57.310420+0000 mon.a (mon.0) 1612 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi080-54175-33"}]': finished 2024-02-13T00:39:58.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:58 smithi080 bash[24237]: audit 2024-02-13T00:39:57.310573+0000 mon.a (mon.0) 1613 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:39:58.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:58 smithi080 bash[24237]: cluster 2024-02-13T00:39:57.310727+0000 mon.a (mon.0) 1614 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2024-02-13T00:39:58.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:58 smithi080 bash[24237]: audit 2024-02-13T00:39:57.313506+0000 mon.c (mon.2) 271 : audit [INF] from='client.? 172.21.15.80:0/1823116635' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:39:58.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:58 smithi080 bash[24237]: audit 2024-02-13T00:39:57.320640+0000 mon.a (mon.0) 1615 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-23"}]: dispatch 2024-02-13T00:39:58.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:58 smithi080 bash[24237]: audit 2024-02-13T00:39:57.320989+0000 mon.a (mon.0) 1616 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi080-54175-33"}]: dispatch 2024-02-13T00:39:58.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:58 smithi080 bash[24237]: audit 2024-02-13T00:39:57.321514+0000 mon.a (mon.0) 1617 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:00.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:59 smithi106 bash[18459]: cluster 2024-02-13T00:39:58.196230+0000 mgr.y (mgr.24461) 412 : cluster [DBG] pgmap v432: 388 pgs: 32 creating+peering, 356 active+clean; 6.9 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-02-13T00:40:00.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:59 smithi106 bash[18459]: audit 2024-02-13T00:39:58.208092+0000 mgr.y (mgr.24461) 413 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:40:00.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:59 smithi106 bash[18459]: cluster 2024-02-13T00:39:58.307637+0000 mon.a (mon.0) 1618 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:40:00.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:59 smithi106 bash[18459]: audit 2024-02-13T00:39:58.320885+0000 mon.a (mon.0) 1619 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-23"}]': finished 2024-02-13T00:40:00.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:59 smithi106 bash[18459]: audit 2024-02-13T00:39:58.321027+0000 mon.a (mon.0) 1620 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi080-54175-33"}]': finished 2024-02-13T00:40:00.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:59 smithi106 bash[18459]: audit 2024-02-13T00:39:58.321282+0000 mon.a (mon.0) 1621 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:00.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:59 smithi106 bash[18459]: cluster 2024-02-13T00:39:58.321551+0000 mon.a (mon.0) 1622 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2024-02-13T00:40:00.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:59 smithi106 bash[18459]: audit 2024-02-13T00:39:58.355714+0000 mon.c (mon.2) 272 : audit [INF] from='client.? 172.21.15.80:0/3180990266' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:00.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:59 smithi106 bash[18459]: audit 2024-02-13T00:39:58.356142+0000 mon.a (mon.0) 1623 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:00.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:59 smithi106 bash[18459]: audit 2024-02-13T00:39:58.357118+0000 mon.c (mon.2) 273 : audit [INF] from='client.? 172.21.15.80:0/3180990266' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:00.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:59 smithi106 bash[18459]: audit 2024-02-13T00:39:58.357601+0000 mon.a (mon.0) 1624 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:00.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:59 smithi106 bash[18459]: audit 2024-02-13T00:39:58.358150+0000 mon.c (mon.2) 274 : audit [INF] from='client.? 172.21.15.80:0/3180990266' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi080-54175-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:00.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:39:59 smithi106 bash[18459]: audit 2024-02-13T00:39:58.358577+0000 mon.a (mon.0) 1625 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi080-54175-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:00.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[17386]: cluster 2024-02-13T00:39:58.196230+0000 mgr.y (mgr.24461) 412 : cluster [DBG] pgmap v432: 388 pgs: 32 creating+peering, 356 active+clean; 6.9 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-02-13T00:40:00.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[17386]: audit 2024-02-13T00:39:58.208092+0000 mgr.y (mgr.24461) 413 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:40:00.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[17386]: cluster 2024-02-13T00:39:58.307637+0000 mon.a (mon.0) 1618 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:40:00.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[17386]: audit 2024-02-13T00:39:58.320885+0000 mon.a (mon.0) 1619 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-23"}]': finished 2024-02-13T00:40:00.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[17386]: audit 2024-02-13T00:39:58.321027+0000 mon.a (mon.0) 1620 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi080-54175-33"}]': finished 2024-02-13T00:40:00.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[17386]: audit 2024-02-13T00:39:58.321282+0000 mon.a (mon.0) 1621 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:00.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[17386]: cluster 2024-02-13T00:39:58.321551+0000 mon.a (mon.0) 1622 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2024-02-13T00:40:00.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[17386]: audit 2024-02-13T00:39:58.355714+0000 mon.c (mon.2) 272 : audit [INF] from='client.? 172.21.15.80:0/3180990266' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:00.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[17386]: audit 2024-02-13T00:39:58.356142+0000 mon.a (mon.0) 1623 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:00.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[17386]: audit 2024-02-13T00:39:58.357118+0000 mon.c (mon.2) 273 : audit [INF] from='client.? 172.21.15.80:0/3180990266' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:00.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[17386]: audit 2024-02-13T00:39:58.357601+0000 mon.a (mon.0) 1624 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:00.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[17386]: audit 2024-02-13T00:39:58.358150+0000 mon.c (mon.2) 274 : audit [INF] from='client.? 172.21.15.80:0/3180990266' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi080-54175-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:00.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[17386]: audit 2024-02-13T00:39:58.358577+0000 mon.a (mon.0) 1625 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi080-54175-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:00.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[24237]: cluster 2024-02-13T00:39:58.196230+0000 mgr.y (mgr.24461) 412 : cluster [DBG] pgmap v432: 388 pgs: 32 creating+peering, 356 active+clean; 6.9 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-02-13T00:40:00.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[24237]: audit 2024-02-13T00:39:58.208092+0000 mgr.y (mgr.24461) 413 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:40:00.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[24237]: cluster 2024-02-13T00:39:58.307637+0000 mon.a (mon.0) 1618 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:40:00.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[24237]: audit 2024-02-13T00:39:58.320885+0000 mon.a (mon.0) 1619 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-23"}]': finished 2024-02-13T00:40:00.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[24237]: audit 2024-02-13T00:39:58.321027+0000 mon.a (mon.0) 1620 : audit [INF] from='client.? 172.21.15.80:0/3795177191' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi080-54175-33"}]': finished 2024-02-13T00:40:00.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[24237]: audit 2024-02-13T00:39:58.321282+0000 mon.a (mon.0) 1621 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi080-54183-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:00.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[24237]: cluster 2024-02-13T00:39:58.321551+0000 mon.a (mon.0) 1622 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2024-02-13T00:40:00.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[24237]: audit 2024-02-13T00:39:58.355714+0000 mon.c (mon.2) 272 : audit [INF] from='client.? 172.21.15.80:0/3180990266' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:00.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[24237]: audit 2024-02-13T00:39:58.356142+0000 mon.a (mon.0) 1623 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:00.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[24237]: audit 2024-02-13T00:39:58.357118+0000 mon.c (mon.2) 273 : audit [INF] from='client.? 172.21.15.80:0/3180990266' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:00.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[24237]: audit 2024-02-13T00:39:58.357601+0000 mon.a (mon.0) 1624 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:00.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[24237]: audit 2024-02-13T00:39:58.358150+0000 mon.c (mon.2) 274 : audit [INF] from='client.? 172.21.15.80:0/3180990266' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi080-54175-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:00.261 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:39:59 smithi080 bash[24237]: audit 2024-02-13T00:39:58.358577+0000 mon.a (mon.0) 1625 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi080-54175-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:00.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:40:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:40:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:40:01.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:00 smithi106 bash[18459]: audit 2024-02-13T00:39:59.320125+0000 mon.a (mon.0) 1626 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi080-54175-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:01.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:00 smithi106 bash[18459]: cluster 2024-02-13T00:39:59.320274+0000 mon.a (mon.0) 1627 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2024-02-13T00:40:01.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:00 smithi106 bash[18459]: audit 2024-02-13T00:39:59.340686+0000 mon.c (mon.2) 275 : audit [INF] from='client.? 172.21.15.80:0/3180990266' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi080-54175-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:01.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:00 smithi106 bash[18459]: audit 2024-02-13T00:39:59.795160+0000 mon.a (mon.0) 1628 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi080-54175-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:01.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:00 smithi106 bash[18459]: cluster 2024-02-13T00:40:00.000143+0000 mon.a (mon.0) 1629 : cluster [WRN] Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2024-02-13T00:40:01.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:00 smithi106 bash[18459]: cluster 2024-02-13T00:40:00.000239+0000 mon.a (mon.0) 1630 : cluster [WRN] [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-02-13T00:40:01.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:00 smithi106 bash[18459]: cluster 2024-02-13T00:40:00.000301+0000 mon.a (mon.0) 1631 : cluster [WRN] application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-13T00:40:01.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:00 smithi106 bash[18459]: cluster 2024-02-13T00:40:00.000336+0000 mon.a (mon.0) 1632 : cluster [WRN] use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-13T00:40:01.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:00 smithi106 bash[18459]: cluster 2024-02-13T00:40:00.786732+0000 mon.a (mon.0) 1633 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2024-02-13T00:40:01.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:00 smithi080 bash[17386]: audit 2024-02-13T00:39:59.320125+0000 mon.a (mon.0) 1626 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi080-54175-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:01.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:00 smithi080 bash[17386]: cluster 2024-02-13T00:39:59.320274+0000 mon.a (mon.0) 1627 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2024-02-13T00:40:01.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:00 smithi080 bash[17386]: audit 2024-02-13T00:39:59.340686+0000 mon.c (mon.2) 275 : audit [INF] from='client.? 172.21.15.80:0/3180990266' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi080-54175-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:01.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:00 smithi080 bash[17386]: audit 2024-02-13T00:39:59.795160+0000 mon.a (mon.0) 1628 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi080-54175-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:01.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:00 smithi080 bash[17386]: cluster 2024-02-13T00:40:00.000143+0000 mon.a (mon.0) 1629 : cluster [WRN] Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2024-02-13T00:40:01.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:00 smithi080 bash[17386]: cluster 2024-02-13T00:40:00.000239+0000 mon.a (mon.0) 1630 : cluster [WRN] [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-02-13T00:40:01.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:00 smithi080 bash[17386]: cluster 2024-02-13T00:40:00.000301+0000 mon.a (mon.0) 1631 : cluster [WRN] application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-13T00:40:01.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:00 smithi080 bash[17386]: cluster 2024-02-13T00:40:00.000336+0000 mon.a (mon.0) 1632 : cluster [WRN] use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-13T00:40:01.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:00 smithi080 bash[17386]: cluster 2024-02-13T00:40:00.786732+0000 mon.a (mon.0) 1633 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2024-02-13T00:40:01.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:00 smithi080 bash[24237]: audit 2024-02-13T00:39:59.320125+0000 mon.a (mon.0) 1626 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi080-54175-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:01.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:00 smithi080 bash[24237]: cluster 2024-02-13T00:39:59.320274+0000 mon.a (mon.0) 1627 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2024-02-13T00:40:01.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:00 smithi080 bash[24237]: audit 2024-02-13T00:39:59.340686+0000 mon.c (mon.2) 275 : audit [INF] from='client.? 172.21.15.80:0/3180990266' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi080-54175-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:01.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:00 smithi080 bash[24237]: audit 2024-02-13T00:39:59.795160+0000 mon.a (mon.0) 1628 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi080-54175-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:01.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:00 smithi080 bash[24237]: cluster 2024-02-13T00:40:00.000143+0000 mon.a (mon.0) 1629 : cluster [WRN] Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2024-02-13T00:40:01.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:00 smithi080 bash[24237]: cluster 2024-02-13T00:40:00.000239+0000 mon.a (mon.0) 1630 : cluster [WRN] [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-02-13T00:40:01.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:00 smithi080 bash[24237]: cluster 2024-02-13T00:40:00.000301+0000 mon.a (mon.0) 1631 : cluster [WRN] application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-13T00:40:01.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:00 smithi080 bash[24237]: cluster 2024-02-13T00:40:00.000336+0000 mon.a (mon.0) 1632 : cluster [WRN] use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-13T00:40:01.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:00 smithi080 bash[24237]: cluster 2024-02-13T00:40:00.786732+0000 mon.a (mon.0) 1633 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2024-02-13T00:40:02.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:01 smithi080 bash[17386]: cluster 2024-02-13T00:40:00.197043+0000 mgr.y (mgr.24461) 414 : cluster [DBG] pgmap v435: 324 pgs: 324 active+clean; 6.9 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T00:40:02.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:01 smithi080 bash[17386]: audit 2024-02-13T00:40:00.788134+0000 mon.a (mon.0) 1634 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:02.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:01 smithi080 bash[17386]: audit 2024-02-13T00:40:01.327319+0000 mon.a (mon.0) 1635 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi080-54175-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi080-54175-34"}]': finished 2024-02-13T00:40:02.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:01 smithi080 bash[17386]: audit 2024-02-13T00:40:01.327675+0000 mon.a (mon.0) 1636 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:02.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:01 smithi080 bash[17386]: cluster 2024-02-13T00:40:01.328041+0000 mon.a (mon.0) 1637 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2024-02-13T00:40:02.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:01 smithi080 bash[24237]: cluster 2024-02-13T00:40:00.197043+0000 mgr.y (mgr.24461) 414 : cluster [DBG] pgmap v435: 324 pgs: 324 active+clean; 6.9 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T00:40:02.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:01 smithi080 bash[24237]: audit 2024-02-13T00:40:00.788134+0000 mon.a (mon.0) 1634 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:02.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:01 smithi080 bash[24237]: audit 2024-02-13T00:40:01.327319+0000 mon.a (mon.0) 1635 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi080-54175-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi080-54175-34"}]': finished 2024-02-13T00:40:02.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:01 smithi080 bash[24237]: audit 2024-02-13T00:40:01.327675+0000 mon.a (mon.0) 1636 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:02.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:01 smithi080 bash[24237]: cluster 2024-02-13T00:40:01.328041+0000 mon.a (mon.0) 1637 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2024-02-13T00:40:02.261 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:01 smithi106 bash[18459]: cluster 2024-02-13T00:40:00.197043+0000 mgr.y (mgr.24461) 414 : cluster [DBG] pgmap v435: 324 pgs: 324 active+clean; 6.9 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T00:40:02.261 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:01 smithi106 bash[18459]: audit 2024-02-13T00:40:00.788134+0000 mon.a (mon.0) 1634 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:02.261 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:01 smithi106 bash[18459]: audit 2024-02-13T00:40:01.327319+0000 mon.a (mon.0) 1635 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi080-54175-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi080-54175-34"}]': finished 2024-02-13T00:40:02.261 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:01 smithi106 bash[18459]: audit 2024-02-13T00:40:01.327675+0000 mon.a (mon.0) 1636 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:02.261 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:01 smithi106 bash[18459]: cluster 2024-02-13T00:40:01.328041+0000 mon.a (mon.0) 1637 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2024-02-13T00:40:03.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:02 smithi106 bash[18459]: audit 2024-02-13T00:40:01.913038+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:40:03.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:02 smithi106 bash[18459]: cluster 2024-02-13T00:40:02.194638+0000 mon.a (mon.0) 1639 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2024-02-13T00:40:03.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:02 smithi106 bash[18459]: audit 2024-02-13T00:40:02.222431+0000 mon.a (mon.0) 1640 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:40:03.258 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:40:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:40:03] "GET /metrics HTTP/1.1" 200 193428 "" "Prometheus/2.33.4" 2024-02-13T00:40:03.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:02 smithi080 bash[17386]: audit 2024-02-13T00:40:01.913038+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:40:03.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:02 smithi080 bash[17386]: cluster 2024-02-13T00:40:02.194638+0000 mon.a (mon.0) 1639 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2024-02-13T00:40:03.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:02 smithi080 bash[17386]: audit 2024-02-13T00:40:02.222431+0000 mon.a (mon.0) 1640 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:40:03.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:02 smithi080 bash[24237]: audit 2024-02-13T00:40:01.913038+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:40:03.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:02 smithi080 bash[24237]: cluster 2024-02-13T00:40:02.194638+0000 mon.a (mon.0) 1639 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2024-02-13T00:40:03.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:02 smithi080 bash[24237]: audit 2024-02-13T00:40:02.222431+0000 mon.a (mon.0) 1640 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:40:04.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:03 smithi106 bash[18459]: cluster 2024-02-13T00:40:02.198728+0000 mgr.y (mgr.24461) 415 : cluster [DBG] pgmap v439: 268 pgs: 40 unknown, 228 active+clean; 6.9 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:40:04.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:03 smithi106 bash[18459]: audit 2024-02-13T00:40:03.203851+0000 mon.a (mon.0) 1641 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-25", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:40:04.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:03 smithi106 bash[18459]: cluster 2024-02-13T00:40:03.204056+0000 mon.a (mon.0) 1642 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2024-02-13T00:40:04.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:03 smithi106 bash[18459]: audit 2024-02-13T00:40:03.207533+0000 mon.a (mon.0) 1643 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-25"}]: dispatch 2024-02-13T00:40:04.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:03 smithi106 bash[18459]: audit 2024-02-13T00:40:03.207813+0000 mon.c (mon.2) 276 : audit [INF] from='client.? 172.21.15.80:0/3180990266' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:04.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:03 smithi106 bash[18459]: audit 2024-02-13T00:40:03.208939+0000 mon.a (mon.0) 1644 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:04.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:03 smithi080 bash[17386]: cluster 2024-02-13T00:40:02.198728+0000 mgr.y (mgr.24461) 415 : cluster [DBG] pgmap v439: 268 pgs: 40 unknown, 228 active+clean; 6.9 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:40:04.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:03 smithi080 bash[17386]: audit 2024-02-13T00:40:03.203851+0000 mon.a (mon.0) 1641 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-25", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:40:04.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:03 smithi080 bash[17386]: cluster 2024-02-13T00:40:03.204056+0000 mon.a (mon.0) 1642 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2024-02-13T00:40:04.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:03 smithi080 bash[17386]: audit 2024-02-13T00:40:03.207533+0000 mon.a (mon.0) 1643 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-25"}]: dispatch 2024-02-13T00:40:04.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:03 smithi080 bash[17386]: audit 2024-02-13T00:40:03.207813+0000 mon.c (mon.2) 276 : audit [INF] from='client.? 172.21.15.80:0/3180990266' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:04.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:03 smithi080 bash[17386]: audit 2024-02-13T00:40:03.208939+0000 mon.a (mon.0) 1644 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:04.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:03 smithi080 bash[24237]: cluster 2024-02-13T00:40:02.198728+0000 mgr.y (mgr.24461) 415 : cluster [DBG] pgmap v439: 268 pgs: 40 unknown, 228 active+clean; 6.9 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:40:04.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:03 smithi080 bash[24237]: audit 2024-02-13T00:40:03.203851+0000 mon.a (mon.0) 1641 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-25", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:40:04.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:03 smithi080 bash[24237]: cluster 2024-02-13T00:40:03.204056+0000 mon.a (mon.0) 1642 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2024-02-13T00:40:04.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:03 smithi080 bash[24237]: audit 2024-02-13T00:40:03.207533+0000 mon.a (mon.0) 1643 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-25"}]: dispatch 2024-02-13T00:40:04.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:03 smithi080 bash[24237]: audit 2024-02-13T00:40:03.207813+0000 mon.c (mon.2) 276 : audit [INF] from='client.? 172.21.15.80:0/3180990266' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:04.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:03 smithi080 bash[24237]: audit 2024-02-13T00:40:03.208939+0000 mon.a (mon.0) 1644 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:05.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:05 smithi106 bash[18459]: cluster 2024-02-13T00:40:04.199573+0000 mgr.y (mgr.24461) 416 : cluster [DBG] pgmap v442: 260 pgs: 32 unknown, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 112 KiB/s rd, 0 B/s wr, 184 op/s 2024-02-13T00:40:05.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:05 smithi106 bash[18459]: audit 2024-02-13T00:40:04.202788+0000 mon.a (mon.0) 1645 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-25"}]': finished 2024-02-13T00:40:05.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:05 smithi106 bash[18459]: audit 2024-02-13T00:40:04.202917+0000 mon.a (mon.0) 1646 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi080-54175-34"}]': finished 2024-02-13T00:40:05.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:05 smithi106 bash[18459]: cluster 2024-02-13T00:40:04.203207+0000 mon.a (mon.0) 1647 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2024-02-13T00:40:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:05 smithi106 bash[18459]: audit 2024-02-13T00:40:04.204711+0000 mon.a (mon.0) 1648 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-25", "mode": "writeback"}]: dispatch 2024-02-13T00:40:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:05 smithi106 bash[18459]: audit 2024-02-13T00:40:04.207343+0000 mon.c (mon.2) 277 : audit [INF] from='client.? 172.21.15.80:0/3957541357' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi080-54183-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:05 smithi106 bash[18459]: audit 2024-02-13T00:40:04.208149+0000 mon.a (mon.0) 1649 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi080-54183-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:05 smithi106 bash[18459]: audit 2024-02-13T00:40:04.209839+0000 mon.c (mon.2) 278 : audit [INF] from='client.? 172.21.15.80:0/3180990266' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:05 smithi106 bash[18459]: audit 2024-02-13T00:40:04.210311+0000 mon.a (mon.0) 1650 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:05 smithi080 bash[17386]: cluster 2024-02-13T00:40:04.199573+0000 mgr.y (mgr.24461) 416 : cluster [DBG] pgmap v442: 260 pgs: 32 unknown, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 112 KiB/s rd, 0 B/s wr, 184 op/s 2024-02-13T00:40:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:05 smithi080 bash[17386]: audit 2024-02-13T00:40:04.202788+0000 mon.a (mon.0) 1645 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-25"}]': finished 2024-02-13T00:40:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:05 smithi080 bash[17386]: audit 2024-02-13T00:40:04.202917+0000 mon.a (mon.0) 1646 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi080-54175-34"}]': finished 2024-02-13T00:40:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:05 smithi080 bash[17386]: cluster 2024-02-13T00:40:04.203207+0000 mon.a (mon.0) 1647 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2024-02-13T00:40:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:05 smithi080 bash[17386]: audit 2024-02-13T00:40:04.204711+0000 mon.a (mon.0) 1648 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-25", "mode": "writeback"}]: dispatch 2024-02-13T00:40:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:05 smithi080 bash[17386]: audit 2024-02-13T00:40:04.207343+0000 mon.c (mon.2) 277 : audit [INF] from='client.? 172.21.15.80:0/3957541357' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi080-54183-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:05 smithi080 bash[17386]: audit 2024-02-13T00:40:04.208149+0000 mon.a (mon.0) 1649 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi080-54183-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:05 smithi080 bash[17386]: audit 2024-02-13T00:40:04.209839+0000 mon.c (mon.2) 278 : audit [INF] from='client.? 172.21.15.80:0/3180990266' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:05 smithi080 bash[17386]: audit 2024-02-13T00:40:04.210311+0000 mon.a (mon.0) 1650 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:05 smithi080 bash[24237]: cluster 2024-02-13T00:40:04.199573+0000 mgr.y (mgr.24461) 416 : cluster [DBG] pgmap v442: 260 pgs: 32 unknown, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 112 KiB/s rd, 0 B/s wr, 184 op/s 2024-02-13T00:40:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:05 smithi080 bash[24237]: audit 2024-02-13T00:40:04.202788+0000 mon.a (mon.0) 1645 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-25"}]': finished 2024-02-13T00:40:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:05 smithi080 bash[24237]: audit 2024-02-13T00:40:04.202917+0000 mon.a (mon.0) 1646 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi080-54175-34"}]': finished 2024-02-13T00:40:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:05 smithi080 bash[24237]: cluster 2024-02-13T00:40:04.203207+0000 mon.a (mon.0) 1647 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2024-02-13T00:40:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:05 smithi080 bash[24237]: audit 2024-02-13T00:40:04.204711+0000 mon.a (mon.0) 1648 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-25", "mode": "writeback"}]: dispatch 2024-02-13T00:40:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:05 smithi080 bash[24237]: audit 2024-02-13T00:40:04.207343+0000 mon.c (mon.2) 277 : audit [INF] from='client.? 172.21.15.80:0/3957541357' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi080-54183-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:05 smithi080 bash[24237]: audit 2024-02-13T00:40:04.208149+0000 mon.a (mon.0) 1649 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi080-54183-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:05 smithi080 bash[24237]: audit 2024-02-13T00:40:04.209839+0000 mon.c (mon.2) 278 : audit [INF] from='client.? 172.21.15.80:0/3180990266' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:05.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:05 smithi080 bash[24237]: audit 2024-02-13T00:40:04.210311+0000 mon.a (mon.0) 1650 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi080-54175-34"}]: dispatch 2024-02-13T00:40:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:06 smithi106 bash[18459]: cluster 2024-02-13T00:40:05.198142+0000 mon.a (mon.0) 1651 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:40:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:06 smithi106 bash[18459]: audit 2024-02-13T00:40:05.211162+0000 mon.a (mon.0) 1652 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-25", "mode": "writeback"}]': finished 2024-02-13T00:40:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:06 smithi106 bash[18459]: audit 2024-02-13T00:40:05.211326+0000 mon.a (mon.0) 1653 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi080-54183-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:06 smithi106 bash[18459]: audit 2024-02-13T00:40:05.212002+0000 mon.a (mon.0) 1654 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi080-54175-34"}]': finished 2024-02-13T00:40:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:06 smithi106 bash[18459]: cluster 2024-02-13T00:40:05.212152+0000 mon.a (mon.0) 1655 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2024-02-13T00:40:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:06 smithi106 bash[18459]: audit 2024-02-13T00:40:05.246603+0000 mon.c (mon.2) 279 : audit [INF] from='client.? 172.21.15.80:0/2311868995' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:06 smithi106 bash[18459]: audit 2024-02-13T00:40:05.247029+0000 mon.a (mon.0) 1656 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:06 smithi106 bash[18459]: audit 2024-02-13T00:40:05.248193+0000 mon.c (mon.2) 280 : audit [INF] from='client.? 172.21.15.80:0/2311868995' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:06 smithi106 bash[18459]: audit 2024-02-13T00:40:05.248527+0000 mon.a (mon.0) 1657 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:06 smithi106 bash[18459]: audit 2024-02-13T00:40:05.249167+0000 mon.c (mon.2) 281 : audit [INF] from='client.? 172.21.15.80:0/2311868995' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi080-54175-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:06 smithi106 bash[18459]: audit 2024-02-13T00:40:05.249488+0000 mon.a (mon.0) 1658 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi080-54175-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:06 smithi106 bash[18459]: audit 2024-02-13T00:40:05.255646+0000 mon.a (mon.0) 1659 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:40:06.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[17386]: cluster 2024-02-13T00:40:05.198142+0000 mon.a (mon.0) 1651 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:40:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[17386]: audit 2024-02-13T00:40:05.211162+0000 mon.a (mon.0) 1652 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-25", "mode": "writeback"}]': finished 2024-02-13T00:40:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[17386]: audit 2024-02-13T00:40:05.211326+0000 mon.a (mon.0) 1653 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi080-54183-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[17386]: audit 2024-02-13T00:40:05.212002+0000 mon.a (mon.0) 1654 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi080-54175-34"}]': finished 2024-02-13T00:40:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[17386]: cluster 2024-02-13T00:40:05.212152+0000 mon.a (mon.0) 1655 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2024-02-13T00:40:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[17386]: audit 2024-02-13T00:40:05.246603+0000 mon.c (mon.2) 279 : audit [INF] from='client.? 172.21.15.80:0/2311868995' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[17386]: audit 2024-02-13T00:40:05.247029+0000 mon.a (mon.0) 1656 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[17386]: audit 2024-02-13T00:40:05.248193+0000 mon.c (mon.2) 280 : audit [INF] from='client.? 172.21.15.80:0/2311868995' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[17386]: audit 2024-02-13T00:40:05.248527+0000 mon.a (mon.0) 1657 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[17386]: audit 2024-02-13T00:40:05.249167+0000 mon.c (mon.2) 281 : audit [INF] from='client.? 172.21.15.80:0/2311868995' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi080-54175-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[17386]: audit 2024-02-13T00:40:05.249488+0000 mon.a (mon.0) 1658 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi080-54175-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[17386]: audit 2024-02-13T00:40:05.255646+0000 mon.a (mon.0) 1659 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:40:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[24237]: cluster 2024-02-13T00:40:05.198142+0000 mon.a (mon.0) 1651 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:40:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[24237]: audit 2024-02-13T00:40:05.211162+0000 mon.a (mon.0) 1652 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-25", "mode": "writeback"}]': finished 2024-02-13T00:40:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[24237]: audit 2024-02-13T00:40:05.211326+0000 mon.a (mon.0) 1653 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi080-54183-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[24237]: audit 2024-02-13T00:40:05.212002+0000 mon.a (mon.0) 1654 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi080-54175-34"}]': finished 2024-02-13T00:40:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[24237]: cluster 2024-02-13T00:40:05.212152+0000 mon.a (mon.0) 1655 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2024-02-13T00:40:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[24237]: audit 2024-02-13T00:40:05.246603+0000 mon.c (mon.2) 279 : audit [INF] from='client.? 172.21.15.80:0/2311868995' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[24237]: audit 2024-02-13T00:40:05.247029+0000 mon.a (mon.0) 1656 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[24237]: audit 2024-02-13T00:40:05.248193+0000 mon.c (mon.2) 280 : audit [INF] from='client.? 172.21.15.80:0/2311868995' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[24237]: audit 2024-02-13T00:40:05.248527+0000 mon.a (mon.0) 1657 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[24237]: audit 2024-02-13T00:40:05.249167+0000 mon.c (mon.2) 281 : audit [INF] from='client.? 172.21.15.80:0/2311868995' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi080-54175-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[24237]: audit 2024-02-13T00:40:05.249488+0000 mon.a (mon.0) 1658 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi080-54175-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:06 smithi080 bash[24237]: audit 2024-02-13T00:40:05.255646+0000 mon.a (mon.0) 1659 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:40:08.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:07 smithi106 bash[18459]: cluster 2024-02-13T00:40:06.200439+0000 mgr.y (mgr.24461) 417 : cluster [DBG] pgmap v444: 260 pgs: 32 unknown, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 108 KiB/s rd, 0 B/s wr, 178 op/s 2024-02-13T00:40:08.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:07 smithi106 bash[18459]: audit 2024-02-13T00:40:06.215868+0000 mon.a (mon.0) 1660 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi080-54175-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:08.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:07 smithi106 bash[18459]: audit 2024-02-13T00:40:06.216149+0000 mon.a (mon.0) 1661 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:40:08.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:07 smithi106 bash[18459]: cluster 2024-02-13T00:40:06.216248+0000 mon.a (mon.0) 1662 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2024-02-13T00:40:08.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:07 smithi106 bash[18459]: audit 2024-02-13T00:40:06.217465+0000 mon.c (mon.2) 282 : audit [INF] from='client.? 172.21.15.80:0/2311868995' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi080-54175-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:08.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:07 smithi106 bash[18459]: audit 2024-02-13T00:40:06.217873+0000 mon.a (mon.0) 1663 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-25"}]: dispatch 2024-02-13T00:40:08.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:07 smithi106 bash[18459]: audit 2024-02-13T00:40:06.218655+0000 mon.a (mon.0) 1664 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi080-54175-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:08.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:07 smithi106 bash[18459]: cluster 2024-02-13T00:40:07.210881+0000 mon.a (mon.0) 1665 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:40:08.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:07 smithi080 bash[17386]: cluster 2024-02-13T00:40:06.200439+0000 mgr.y (mgr.24461) 417 : cluster [DBG] pgmap v444: 260 pgs: 32 unknown, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 108 KiB/s rd, 0 B/s wr, 178 op/s 2024-02-13T00:40:08.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:07 smithi080 bash[17386]: audit 2024-02-13T00:40:06.215868+0000 mon.a (mon.0) 1660 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi080-54175-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:08.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:07 smithi080 bash[17386]: audit 2024-02-13T00:40:06.216149+0000 mon.a (mon.0) 1661 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:40:08.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:07 smithi080 bash[17386]: cluster 2024-02-13T00:40:06.216248+0000 mon.a (mon.0) 1662 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2024-02-13T00:40:08.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:07 smithi080 bash[17386]: audit 2024-02-13T00:40:06.217465+0000 mon.c (mon.2) 282 : audit [INF] from='client.? 172.21.15.80:0/2311868995' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi080-54175-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:08.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:07 smithi080 bash[17386]: audit 2024-02-13T00:40:06.217873+0000 mon.a (mon.0) 1663 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-25"}]: dispatch 2024-02-13T00:40:08.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:07 smithi080 bash[17386]: audit 2024-02-13T00:40:06.218655+0000 mon.a (mon.0) 1664 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi080-54175-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:08.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:07 smithi080 bash[17386]: cluster 2024-02-13T00:40:07.210881+0000 mon.a (mon.0) 1665 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:40:08.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:07 smithi080 bash[24237]: cluster 2024-02-13T00:40:06.200439+0000 mgr.y (mgr.24461) 417 : cluster [DBG] pgmap v444: 260 pgs: 32 unknown, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 108 KiB/s rd, 0 B/s wr, 178 op/s 2024-02-13T00:40:08.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:07 smithi080 bash[24237]: audit 2024-02-13T00:40:06.215868+0000 mon.a (mon.0) 1660 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi080-54175-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:08.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:07 smithi080 bash[24237]: audit 2024-02-13T00:40:06.216149+0000 mon.a (mon.0) 1661 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:40:08.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:07 smithi080 bash[24237]: cluster 2024-02-13T00:40:06.216248+0000 mon.a (mon.0) 1662 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2024-02-13T00:40:08.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:07 smithi080 bash[24237]: audit 2024-02-13T00:40:06.217465+0000 mon.c (mon.2) 282 : audit [INF] from='client.? 172.21.15.80:0/2311868995' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi080-54175-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:08.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:07 smithi080 bash[24237]: audit 2024-02-13T00:40:06.217873+0000 mon.a (mon.0) 1663 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-25"}]: dispatch 2024-02-13T00:40:08.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:07 smithi080 bash[24237]: audit 2024-02-13T00:40:06.218655+0000 mon.a (mon.0) 1664 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi080-54175-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:08.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:07 smithi080 bash[24237]: cluster 2024-02-13T00:40:07.210881+0000 mon.a (mon.0) 1665 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:40:08.505 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:40:08 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:40:09.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:08 smithi106 bash[18459]: audit 2024-02-13T00:40:07.227547+0000 mon.a (mon.0) 1666 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-25"}]': finished 2024-02-13T00:40:09.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:08 smithi106 bash[18459]: cluster 2024-02-13T00:40:07.664782+0000 mon.a (mon.0) 1667 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2024-02-13T00:40:09.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:08 smithi106 bash[18459]: audit 2024-02-13T00:40:07.667047+0000 mon.c (mon.2) 283 : audit [INF] from='client.? 172.21.15.80:0/2971151092' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi080-54183-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:09.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:08 smithi106 bash[18459]: audit 2024-02-13T00:40:07.676052+0000 mon.a (mon.0) 1668 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi080-54183-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:09.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:08 smithi106 bash[18459]: audit 2024-02-13T00:40:08.234304+0000 mon.a (mon.0) 1669 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi080-54175-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi080-54175-35"}]': finished 2024-02-13T00:40:09.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:08 smithi106 bash[18459]: audit 2024-02-13T00:40:08.234642+0000 mon.a (mon.0) 1670 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi080-54183-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:09.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:08 smithi106 bash[18459]: cluster 2024-02-13T00:40:08.234877+0000 mon.a (mon.0) 1671 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2024-02-13T00:40:09.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:08 smithi080 bash[17386]: audit 2024-02-13T00:40:07.227547+0000 mon.a (mon.0) 1666 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-25"}]': finished 2024-02-13T00:40:09.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:08 smithi080 bash[17386]: cluster 2024-02-13T00:40:07.664782+0000 mon.a (mon.0) 1667 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2024-02-13T00:40:09.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:08 smithi080 bash[17386]: audit 2024-02-13T00:40:07.667047+0000 mon.c (mon.2) 283 : audit [INF] from='client.? 172.21.15.80:0/2971151092' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi080-54183-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:09.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:08 smithi080 bash[17386]: audit 2024-02-13T00:40:07.676052+0000 mon.a (mon.0) 1668 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi080-54183-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:09.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:08 smithi080 bash[17386]: audit 2024-02-13T00:40:08.234304+0000 mon.a (mon.0) 1669 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi080-54175-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi080-54175-35"}]': finished 2024-02-13T00:40:09.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:08 smithi080 bash[17386]: audit 2024-02-13T00:40:08.234642+0000 mon.a (mon.0) 1670 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi080-54183-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:09.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:08 smithi080 bash[17386]: cluster 2024-02-13T00:40:08.234877+0000 mon.a (mon.0) 1671 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2024-02-13T00:40:09.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:08 smithi080 bash[24237]: audit 2024-02-13T00:40:07.227547+0000 mon.a (mon.0) 1666 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-25"}]': finished 2024-02-13T00:40:09.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:08 smithi080 bash[24237]: cluster 2024-02-13T00:40:07.664782+0000 mon.a (mon.0) 1667 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2024-02-13T00:40:09.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:08 smithi080 bash[24237]: audit 2024-02-13T00:40:07.667047+0000 mon.c (mon.2) 283 : audit [INF] from='client.? 172.21.15.80:0/2971151092' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi080-54183-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:09.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:08 smithi080 bash[24237]: audit 2024-02-13T00:40:07.676052+0000 mon.a (mon.0) 1668 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi080-54183-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:09.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:08 smithi080 bash[24237]: audit 2024-02-13T00:40:08.234304+0000 mon.a (mon.0) 1669 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi080-54175-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi080-54175-35"}]': finished 2024-02-13T00:40:09.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:08 smithi080 bash[24237]: audit 2024-02-13T00:40:08.234642+0000 mon.a (mon.0) 1670 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi080-54183-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:09.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:08 smithi080 bash[24237]: cluster 2024-02-13T00:40:08.234877+0000 mon.a (mon.0) 1671 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2024-02-13T00:40:10.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:09 smithi106 bash[18459]: cluster 2024-02-13T00:40:08.202602+0000 mgr.y (mgr.24461) 418 : cluster [DBG] pgmap v447: 260 pgs: 32 creating+peering, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:40:10.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:09 smithi106 bash[18459]: audit 2024-02-13T00:40:08.219618+0000 mgr.y (mgr.24461) 419 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:40:10.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:09 smithi106 bash[18459]: cluster 2024-02-13T00:40:09.236149+0000 mon.a (mon.0) 1672 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2024-02-13T00:40:10.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:09 smithi106 bash[18459]: audit 2024-02-13T00:40:09.253288+0000 mon.a (mon.0) 1673 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:10.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:09 smithi106 bash[18459]: audit 2024-02-13T00:40:09.268864+0000 mon.a (mon.0) 1674 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-45"}]: dispatch 2024-02-13T00:40:10.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:09 smithi106 bash[18459]: audit 2024-02-13T00:40:09.269694+0000 mon.a (mon.0) 1675 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-45"}]: dispatch 2024-02-13T00:40:10.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:09 smithi106 bash[18459]: audit 2024-02-13T00:40:09.270071+0000 mon.a (mon.0) 1676 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi080-54183-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:10.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:09 smithi080 bash[17386]: cluster 2024-02-13T00:40:08.202602+0000 mgr.y (mgr.24461) 418 : cluster [DBG] pgmap v447: 260 pgs: 32 creating+peering, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:40:10.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:09 smithi080 bash[17386]: audit 2024-02-13T00:40:08.219618+0000 mgr.y (mgr.24461) 419 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:40:10.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:09 smithi080 bash[17386]: cluster 2024-02-13T00:40:09.236149+0000 mon.a (mon.0) 1672 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2024-02-13T00:40:10.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:09 smithi080 bash[17386]: audit 2024-02-13T00:40:09.253288+0000 mon.a (mon.0) 1673 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:10.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:09 smithi080 bash[17386]: audit 2024-02-13T00:40:09.268864+0000 mon.a (mon.0) 1674 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-45"}]: dispatch 2024-02-13T00:40:10.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:09 smithi080 bash[17386]: audit 2024-02-13T00:40:09.269694+0000 mon.a (mon.0) 1675 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-45"}]: dispatch 2024-02-13T00:40:10.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:09 smithi080 bash[17386]: audit 2024-02-13T00:40:09.270071+0000 mon.a (mon.0) 1676 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi080-54183-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:10.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:09 smithi080 bash[24237]: cluster 2024-02-13T00:40:08.202602+0000 mgr.y (mgr.24461) 418 : cluster [DBG] pgmap v447: 260 pgs: 32 creating+peering, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:40:10.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:09 smithi080 bash[24237]: audit 2024-02-13T00:40:08.219618+0000 mgr.y (mgr.24461) 419 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:40:10.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:09 smithi080 bash[24237]: cluster 2024-02-13T00:40:09.236149+0000 mon.a (mon.0) 1672 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2024-02-13T00:40:10.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:09 smithi080 bash[24237]: audit 2024-02-13T00:40:09.253288+0000 mon.a (mon.0) 1673 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:10.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:09 smithi080 bash[24237]: audit 2024-02-13T00:40:09.268864+0000 mon.a (mon.0) 1674 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-45"}]: dispatch 2024-02-13T00:40:10.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:09 smithi080 bash[24237]: audit 2024-02-13T00:40:09.269694+0000 mon.a (mon.0) 1675 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-45"}]: dispatch 2024-02-13T00:40:10.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:09 smithi080 bash[24237]: audit 2024-02-13T00:40:09.270071+0000 mon.a (mon.0) 1676 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi080-54183-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:10.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:40:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:40:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:40:12.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:11 smithi106 bash[18459]: cluster 2024-02-13T00:40:10.203414+0000 mgr.y (mgr.24461) 420 : cluster [DBG] pgmap v450: 236 pgs: 40 unknown, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:12.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:11 smithi106 bash[18459]: audit 2024-02-13T00:40:10.238303+0000 mon.a (mon.0) 1677 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:12.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:11 smithi106 bash[18459]: audit 2024-02-13T00:40:10.238582+0000 mon.a (mon.0) 1678 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi080-54183-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:12.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:11 smithi106 bash[18459]: cluster 2024-02-13T00:40:10.238681+0000 mon.a (mon.0) 1679 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2024-02-13T00:40:12.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:11 smithi106 bash[18459]: audit 2024-02-13T00:40:10.241858+0000 mon.a (mon.0) 1680 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi080-54183-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi080-54183-45"}]: dispatch 2024-02-13T00:40:12.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:11 smithi106 bash[18459]: audit 2024-02-13T00:40:10.242293+0000 mon.c (mon.2) 284 : audit [INF] from='client.? 172.21.15.80:0/2311868995' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:12.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:11 smithi106 bash[18459]: audit 2024-02-13T00:40:10.243326+0000 mon.a (mon.0) 1681 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:12.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:11 smithi080 bash[17386]: cluster 2024-02-13T00:40:10.203414+0000 mgr.y (mgr.24461) 420 : cluster [DBG] pgmap v450: 236 pgs: 40 unknown, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:12.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:11 smithi080 bash[17386]: audit 2024-02-13T00:40:10.238303+0000 mon.a (mon.0) 1677 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:12.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:11 smithi080 bash[17386]: audit 2024-02-13T00:40:10.238582+0000 mon.a (mon.0) 1678 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi080-54183-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:12.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:11 smithi080 bash[17386]: cluster 2024-02-13T00:40:10.238681+0000 mon.a (mon.0) 1679 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2024-02-13T00:40:12.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:11 smithi080 bash[17386]: audit 2024-02-13T00:40:10.241858+0000 mon.a (mon.0) 1680 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi080-54183-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi080-54183-45"}]: dispatch 2024-02-13T00:40:12.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:11 smithi080 bash[17386]: audit 2024-02-13T00:40:10.242293+0000 mon.c (mon.2) 284 : audit [INF] from='client.? 172.21.15.80:0/2311868995' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:12.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:11 smithi080 bash[17386]: audit 2024-02-13T00:40:10.243326+0000 mon.a (mon.0) 1681 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:12.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:11 smithi080 bash[24237]: cluster 2024-02-13T00:40:10.203414+0000 mgr.y (mgr.24461) 420 : cluster [DBG] pgmap v450: 236 pgs: 40 unknown, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:12.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:11 smithi080 bash[24237]: audit 2024-02-13T00:40:10.238303+0000 mon.a (mon.0) 1677 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:12.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:11 smithi080 bash[24237]: audit 2024-02-13T00:40:10.238582+0000 mon.a (mon.0) 1678 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi080-54183-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:12.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:11 smithi080 bash[24237]: cluster 2024-02-13T00:40:10.238681+0000 mon.a (mon.0) 1679 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2024-02-13T00:40:12.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:11 smithi080 bash[24237]: audit 2024-02-13T00:40:10.241858+0000 mon.a (mon.0) 1680 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi080-54183-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi080-54183-45"}]: dispatch 2024-02-13T00:40:12.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:11 smithi080 bash[24237]: audit 2024-02-13T00:40:10.242293+0000 mon.c (mon.2) 284 : audit [INF] from='client.? 172.21.15.80:0/2311868995' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:12.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:11 smithi080 bash[24237]: audit 2024-02-13T00:40:10.243326+0000 mon.a (mon.0) 1681 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:13.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:12 smithi106 bash[18459]: audit 2024-02-13T00:40:11.667731+0000 mon.a (mon.0) 1682 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi080-54175-35"}]': finished 2024-02-13T00:40:13.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:12 smithi106 bash[18459]: cluster 2024-02-13T00:40:11.667859+0000 mon.a (mon.0) 1683 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2024-02-13T00:40:13.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:12 smithi106 bash[18459]: audit 2024-02-13T00:40:11.668758+0000 mon.c (mon.2) 285 : audit [INF] from='client.? 172.21.15.80:0/2311868995' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:13.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:12 smithi106 bash[18459]: audit 2024-02-13T00:40:11.669373+0000 mon.a (mon.0) 1684 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:13.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:12 smithi106 bash[18459]: audit 2024-02-13T00:40:11.680291+0000 mon.a (mon.0) 1685 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:40:13.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:12 smithi106 bash[18459]: audit 2024-02-13T00:40:12.242939+0000 mon.a (mon.0) 1686 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi080-54183-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi080-54183-45"}]': finished 2024-02-13T00:40:13.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:12 smithi106 bash[18459]: audit 2024-02-13T00:40:12.243187+0000 mon.a (mon.0) 1687 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi080-54175-35"}]': finished 2024-02-13T00:40:13.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:12 smithi106 bash[18459]: audit 2024-02-13T00:40:12.243371+0000 mon.a (mon.0) 1688 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-27", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:40:13.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:12 smithi106 bash[18459]: cluster 2024-02-13T00:40:12.243469+0000 mon.a (mon.0) 1689 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2024-02-13T00:40:13.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:12 smithi106 bash[18459]: audit 2024-02-13T00:40:12.245668+0000 mon.a (mon.0) 1690 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-27"}]: dispatch 2024-02-13T00:40:13.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:12 smithi106 bash[18459]: audit 2024-02-13T00:40:12.268143+0000 mon.c (mon.2) 286 : audit [INF] from='client.? 172.21.15.80:0/3775173569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:13.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:12 smithi106 bash[18459]: audit 2024-02-13T00:40:12.268828+0000 mon.a (mon.0) 1691 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:13.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:12 smithi106 bash[18459]: audit 2024-02-13T00:40:12.269643+0000 mon.c (mon.2) 287 : audit [INF] from='client.? 172.21.15.80:0/3775173569' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:13.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:12 smithi106 bash[18459]: audit 2024-02-13T00:40:12.270058+0000 mon.a (mon.0) 1692 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:13.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:12 smithi106 bash[18459]: audit 2024-02-13T00:40:12.270844+0000 mon.c (mon.2) 288 : audit [INF] from='client.? 172.21.15.80:0/3775173569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:13.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:12 smithi106 bash[18459]: audit 2024-02-13T00:40:12.271299+0000 mon.a (mon.0) 1693 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:13.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[17386]: audit 2024-02-13T00:40:11.667731+0000 mon.a (mon.0) 1682 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi080-54175-35"}]': finished 2024-02-13T00:40:13.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[17386]: cluster 2024-02-13T00:40:11.667859+0000 mon.a (mon.0) 1683 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2024-02-13T00:40:13.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[17386]: audit 2024-02-13T00:40:11.668758+0000 mon.c (mon.2) 285 : audit [INF] from='client.? 172.21.15.80:0/2311868995' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:13.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[17386]: audit 2024-02-13T00:40:11.669373+0000 mon.a (mon.0) 1684 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:13.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[17386]: audit 2024-02-13T00:40:11.680291+0000 mon.a (mon.0) 1685 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:40:13.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[17386]: audit 2024-02-13T00:40:12.242939+0000 mon.a (mon.0) 1686 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi080-54183-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi080-54183-45"}]': finished 2024-02-13T00:40:13.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[17386]: audit 2024-02-13T00:40:12.243187+0000 mon.a (mon.0) 1687 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi080-54175-35"}]': finished 2024-02-13T00:40:13.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[17386]: audit 2024-02-13T00:40:12.243371+0000 mon.a (mon.0) 1688 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-27", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:40:13.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[17386]: cluster 2024-02-13T00:40:12.243469+0000 mon.a (mon.0) 1689 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2024-02-13T00:40:13.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[17386]: audit 2024-02-13T00:40:12.245668+0000 mon.a (mon.0) 1690 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-27"}]: dispatch 2024-02-13T00:40:13.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[17386]: audit 2024-02-13T00:40:12.268143+0000 mon.c (mon.2) 286 : audit [INF] from='client.? 172.21.15.80:0/3775173569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:13.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[17386]: audit 2024-02-13T00:40:12.268828+0000 mon.a (mon.0) 1691 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:13.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[17386]: audit 2024-02-13T00:40:12.269643+0000 mon.c (mon.2) 287 : audit [INF] from='client.? 172.21.15.80:0/3775173569' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:13.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[17386]: audit 2024-02-13T00:40:12.270058+0000 mon.a (mon.0) 1692 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:13.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[17386]: audit 2024-02-13T00:40:12.270844+0000 mon.c (mon.2) 288 : audit [INF] from='client.? 172.21.15.80:0/3775173569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:13.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[17386]: audit 2024-02-13T00:40:12.271299+0000 mon.a (mon.0) 1693 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:13.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[24237]: audit 2024-02-13T00:40:11.667731+0000 mon.a (mon.0) 1682 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi080-54175-35"}]': finished 2024-02-13T00:40:13.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[24237]: cluster 2024-02-13T00:40:11.667859+0000 mon.a (mon.0) 1683 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2024-02-13T00:40:13.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[24237]: audit 2024-02-13T00:40:11.668758+0000 mon.c (mon.2) 285 : audit [INF] from='client.? 172.21.15.80:0/2311868995' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:13.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[24237]: audit 2024-02-13T00:40:11.669373+0000 mon.a (mon.0) 1684 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi080-54175-35"}]: dispatch 2024-02-13T00:40:13.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[24237]: audit 2024-02-13T00:40:11.680291+0000 mon.a (mon.0) 1685 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:40:13.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[24237]: audit 2024-02-13T00:40:12.242939+0000 mon.a (mon.0) 1686 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi080-54183-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi080-54183-45"}]': finished 2024-02-13T00:40:13.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[24237]: audit 2024-02-13T00:40:12.243187+0000 mon.a (mon.0) 1687 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi080-54175-35"}]': finished 2024-02-13T00:40:13.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[24237]: audit 2024-02-13T00:40:12.243371+0000 mon.a (mon.0) 1688 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-27", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:40:13.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[24237]: cluster 2024-02-13T00:40:12.243469+0000 mon.a (mon.0) 1689 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2024-02-13T00:40:13.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[24237]: audit 2024-02-13T00:40:12.245668+0000 mon.a (mon.0) 1690 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-27"}]: dispatch 2024-02-13T00:40:13.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[24237]: audit 2024-02-13T00:40:12.268143+0000 mon.c (mon.2) 286 : audit [INF] from='client.? 172.21.15.80:0/3775173569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:13.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[24237]: audit 2024-02-13T00:40:12.268828+0000 mon.a (mon.0) 1691 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:13.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[24237]: audit 2024-02-13T00:40:12.269643+0000 mon.c (mon.2) 287 : audit [INF] from='client.? 172.21.15.80:0/3775173569' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:13.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[24237]: audit 2024-02-13T00:40:12.270058+0000 mon.a (mon.0) 1692 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:13.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[24237]: audit 2024-02-13T00:40:12.270844+0000 mon.c (mon.2) 288 : audit [INF] from='client.? 172.21.15.80:0/3775173569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:13.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:12 smithi080 bash[24237]: audit 2024-02-13T00:40:12.271299+0000 mon.a (mon.0) 1693 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:13.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:40:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:40:13] "GET /metrics HTTP/1.1" 200 193428 "" "Prometheus/2.33.4" 2024-02-13T00:40:14.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:13 smithi106 bash[18459]: cluster 2024-02-13T00:40:12.204170+0000 mgr.y (mgr.24461) 421 : cluster [DBG] pgmap v453: 228 pgs: 32 unknown, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:40:14.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:13 smithi106 bash[18459]: audit 2024-02-13T00:40:13.246145+0000 mon.a (mon.0) 1694 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-27"}]': finished 2024-02-13T00:40:14.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:13 smithi106 bash[18459]: audit 2024-02-13T00:40:13.246488+0000 mon.a (mon.0) 1695 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:14.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:13 smithi106 bash[18459]: cluster 2024-02-13T00:40:13.246681+0000 mon.a (mon.0) 1696 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2024-02-13T00:40:14.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:13 smithi106 bash[18459]: audit 2024-02-13T00:40:13.250298+0000 mon.a (mon.0) 1697 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-27", "mode": "writeback"}]: dispatch 2024-02-13T00:40:14.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:13 smithi106 bash[18459]: audit 2024-02-13T00:40:13.256918+0000 mon.c (mon.2) 289 : audit [INF] from='client.? 172.21.15.80:0/3775173569' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi080-54175-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:14.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:13 smithi106 bash[18459]: audit 2024-02-13T00:40:13.257511+0000 mon.a (mon.0) 1698 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi080-54175-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:14.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:13 smithi080 bash[17386]: cluster 2024-02-13T00:40:12.204170+0000 mgr.y (mgr.24461) 421 : cluster [DBG] pgmap v453: 228 pgs: 32 unknown, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:40:14.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:13 smithi080 bash[17386]: audit 2024-02-13T00:40:13.246145+0000 mon.a (mon.0) 1694 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-27"}]': finished 2024-02-13T00:40:14.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:13 smithi080 bash[17386]: audit 2024-02-13T00:40:13.246488+0000 mon.a (mon.0) 1695 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:14.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:13 smithi080 bash[17386]: cluster 2024-02-13T00:40:13.246681+0000 mon.a (mon.0) 1696 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2024-02-13T00:40:14.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:13 smithi080 bash[17386]: audit 2024-02-13T00:40:13.250298+0000 mon.a (mon.0) 1697 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-27", "mode": "writeback"}]: dispatch 2024-02-13T00:40:14.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:13 smithi080 bash[17386]: audit 2024-02-13T00:40:13.256918+0000 mon.c (mon.2) 289 : audit [INF] from='client.? 172.21.15.80:0/3775173569' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi080-54175-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:14.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:13 smithi080 bash[17386]: audit 2024-02-13T00:40:13.257511+0000 mon.a (mon.0) 1698 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi080-54175-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:14.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:13 smithi080 bash[24237]: cluster 2024-02-13T00:40:12.204170+0000 mgr.y (mgr.24461) 421 : cluster [DBG] pgmap v453: 228 pgs: 32 unknown, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:40:14.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:13 smithi080 bash[24237]: audit 2024-02-13T00:40:13.246145+0000 mon.a (mon.0) 1694 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-27"}]': finished 2024-02-13T00:40:14.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:13 smithi080 bash[24237]: audit 2024-02-13T00:40:13.246488+0000 mon.a (mon.0) 1695 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:14.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:13 smithi080 bash[24237]: cluster 2024-02-13T00:40:13.246681+0000 mon.a (mon.0) 1696 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2024-02-13T00:40:14.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:13 smithi080 bash[24237]: audit 2024-02-13T00:40:13.250298+0000 mon.a (mon.0) 1697 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-27", "mode": "writeback"}]: dispatch 2024-02-13T00:40:14.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:13 smithi080 bash[24237]: audit 2024-02-13T00:40:13.256918+0000 mon.c (mon.2) 289 : audit [INF] from='client.? 172.21.15.80:0/3775173569' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi080-54175-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:14.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:13 smithi080 bash[24237]: audit 2024-02-13T00:40:13.257511+0000 mon.a (mon.0) 1698 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi080-54175-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:15.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:14 smithi106 bash[18459]: cluster 2024-02-13T00:40:14.243195+0000 mon.a (mon.0) 1699 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:40:15.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:14 smithi106 bash[18459]: audit 2024-02-13T00:40:14.252671+0000 mon.a (mon.0) 1700 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-27", "mode": "writeback"}]': finished 2024-02-13T00:40:15.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:14 smithi080 bash[17386]: cluster 2024-02-13T00:40:14.243195+0000 mon.a (mon.0) 1699 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:40:15.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:14 smithi080 bash[17386]: audit 2024-02-13T00:40:14.252671+0000 mon.a (mon.0) 1700 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-27", "mode": "writeback"}]': finished 2024-02-13T00:40:15.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:14 smithi080 bash[24237]: cluster 2024-02-13T00:40:14.243195+0000 mon.a (mon.0) 1699 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:40:15.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:14 smithi080 bash[24237]: audit 2024-02-13T00:40:14.252671+0000 mon.a (mon.0) 1700 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-27", "mode": "writeback"}]': finished 2024-02-13T00:40:16.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:15 smithi106 bash[18459]: cluster 2024-02-13T00:40:14.205028+0000 mgr.y (mgr.24461) 422 : cluster [DBG] pgmap v456: 236 pgs: 8 creating+peering, 228 active+clean; 6.9 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T00:40:16.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:15 smithi106 bash[18459]: cluster 2024-02-13T00:40:14.699044+0000 mon.a (mon.0) 1701 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2024-02-13T00:40:16.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:15 smithi106 bash[18459]: audit 2024-02-13T00:40:14.700600+0000 mon.a (mon.0) 1702 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-45"}]: dispatch 2024-02-13T00:40:16.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:15 smithi106 bash[18459]: audit 2024-02-13T00:40:15.255388+0000 mon.a (mon.0) 1703 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi080-54175-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi080-54175-36"}]': finished 2024-02-13T00:40:16.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:15 smithi106 bash[18459]: audit 2024-02-13T00:40:15.255619+0000 mon.a (mon.0) 1704 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-45"}]': finished 2024-02-13T00:40:16.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:15 smithi106 bash[18459]: cluster 2024-02-13T00:40:15.256087+0000 mon.a (mon.0) 1705 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2024-02-13T00:40:16.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:15 smithi106 bash[18459]: audit 2024-02-13T00:40:15.257176+0000 mon.a (mon.0) 1706 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-45"}]: dispatch 2024-02-13T00:40:16.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:15 smithi106 bash[18459]: audit 2024-02-13T00:40:15.288663+0000 mon.a (mon.0) 1707 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:40:16.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:15 smithi080 bash[17386]: cluster 2024-02-13T00:40:14.205028+0000 mgr.y (mgr.24461) 422 : cluster [DBG] pgmap v456: 236 pgs: 8 creating+peering, 228 active+clean; 6.9 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T00:40:16.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:15 smithi080 bash[17386]: cluster 2024-02-13T00:40:14.699044+0000 mon.a (mon.0) 1701 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2024-02-13T00:40:16.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:15 smithi080 bash[17386]: audit 2024-02-13T00:40:14.700600+0000 mon.a (mon.0) 1702 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-45"}]: dispatch 2024-02-13T00:40:16.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:15 smithi080 bash[17386]: audit 2024-02-13T00:40:15.255388+0000 mon.a (mon.0) 1703 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi080-54175-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi080-54175-36"}]': finished 2024-02-13T00:40:16.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:15 smithi080 bash[17386]: audit 2024-02-13T00:40:15.255619+0000 mon.a (mon.0) 1704 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-45"}]': finished 2024-02-13T00:40:16.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:15 smithi080 bash[17386]: cluster 2024-02-13T00:40:15.256087+0000 mon.a (mon.0) 1705 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2024-02-13T00:40:16.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:15 smithi080 bash[17386]: audit 2024-02-13T00:40:15.257176+0000 mon.a (mon.0) 1706 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-45"}]: dispatch 2024-02-13T00:40:16.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:15 smithi080 bash[17386]: audit 2024-02-13T00:40:15.288663+0000 mon.a (mon.0) 1707 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:40:16.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:15 smithi080 bash[24237]: cluster 2024-02-13T00:40:14.205028+0000 mgr.y (mgr.24461) 422 : cluster [DBG] pgmap v456: 236 pgs: 8 creating+peering, 228 active+clean; 6.9 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T00:40:16.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:15 smithi080 bash[24237]: cluster 2024-02-13T00:40:14.699044+0000 mon.a (mon.0) 1701 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2024-02-13T00:40:16.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:15 smithi080 bash[24237]: audit 2024-02-13T00:40:14.700600+0000 mon.a (mon.0) 1702 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-45"}]: dispatch 2024-02-13T00:40:16.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:15 smithi080 bash[24237]: audit 2024-02-13T00:40:15.255388+0000 mon.a (mon.0) 1703 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi080-54175-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi080-54175-36"}]': finished 2024-02-13T00:40:16.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:15 smithi080 bash[24237]: audit 2024-02-13T00:40:15.255619+0000 mon.a (mon.0) 1704 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-45"}]': finished 2024-02-13T00:40:16.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:15 smithi080 bash[24237]: cluster 2024-02-13T00:40:15.256087+0000 mon.a (mon.0) 1705 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2024-02-13T00:40:16.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:15 smithi080 bash[24237]: audit 2024-02-13T00:40:15.257176+0000 mon.a (mon.0) 1706 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-45"}]: dispatch 2024-02-13T00:40:16.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:15 smithi080 bash[24237]: audit 2024-02-13T00:40:15.288663+0000 mon.a (mon.0) 1707 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:40:17.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[17386]: cluster 2024-02-13T00:40:16.205901+0000 mgr.y (mgr.24461) 423 : cluster [DBG] pgmap v459: 236 pgs: 8 unknown, 228 active+clean; 6.9 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T00:40:17.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[17386]: audit 2024-02-13T00:40:16.256890+0000 mon.a (mon.0) 1708 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-45"}]': finished 2024-02-13T00:40:17.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[17386]: audit 2024-02-13T00:40:16.257163+0000 mon.a (mon.0) 1709 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:40:17.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[17386]: cluster 2024-02-13T00:40:16.257248+0000 mon.a (mon.0) 1710 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2024-02-13T00:40:17.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[17386]: audit 2024-02-13T00:40:16.258207+0000 mon.a (mon.0) 1711 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-27"}]: dispatch 2024-02-13T00:40:17.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[17386]: audit 2024-02-13T00:40:16.283465+0000 mon.c (mon.2) 290 : audit [INF] from='client.? 172.21.15.80:0/1141487302' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:17.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[17386]: audit 2024-02-13T00:40:16.283912+0000 mon.a (mon.0) 1712 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:17.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[17386]: audit 2024-02-13T00:40:16.284654+0000 mon.c (mon.2) 291 : audit [INF] from='client.? 172.21.15.80:0/1141487302' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:17.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[17386]: audit 2024-02-13T00:40:16.285073+0000 mon.a (mon.0) 1713 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:17.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[17386]: audit 2024-02-13T00:40:16.285749+0000 mon.c (mon.2) 292 : audit [INF] from='client.? 172.21.15.80:0/1141487302' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi080-54183-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:17.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[17386]: audit 2024-02-13T00:40:16.286188+0000 mon.a (mon.0) 1714 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi080-54183-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:17.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[17386]: audit 2024-02-13T00:40:16.914351+0000 mon.a (mon.0) 1715 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:40:17.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[24237]: cluster 2024-02-13T00:40:16.205901+0000 mgr.y (mgr.24461) 423 : cluster [DBG] pgmap v459: 236 pgs: 8 unknown, 228 active+clean; 6.9 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T00:40:17.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[24237]: audit 2024-02-13T00:40:16.256890+0000 mon.a (mon.0) 1708 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-45"}]': finished 2024-02-13T00:40:17.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[24237]: audit 2024-02-13T00:40:16.257163+0000 mon.a (mon.0) 1709 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:40:17.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[24237]: cluster 2024-02-13T00:40:16.257248+0000 mon.a (mon.0) 1710 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2024-02-13T00:40:17.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[24237]: audit 2024-02-13T00:40:16.258207+0000 mon.a (mon.0) 1711 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-27"}]: dispatch 2024-02-13T00:40:17.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[24237]: audit 2024-02-13T00:40:16.283465+0000 mon.c (mon.2) 290 : audit [INF] from='client.? 172.21.15.80:0/1141487302' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:17.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[24237]: audit 2024-02-13T00:40:16.283912+0000 mon.a (mon.0) 1712 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:17.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[24237]: audit 2024-02-13T00:40:16.284654+0000 mon.c (mon.2) 291 : audit [INF] from='client.? 172.21.15.80:0/1141487302' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:17.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[24237]: audit 2024-02-13T00:40:16.285073+0000 mon.a (mon.0) 1713 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:17.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[24237]: audit 2024-02-13T00:40:16.285749+0000 mon.c (mon.2) 292 : audit [INF] from='client.? 172.21.15.80:0/1141487302' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi080-54183-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:17.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[24237]: audit 2024-02-13T00:40:16.286188+0000 mon.a (mon.0) 1714 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi080-54183-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:17.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:17 smithi080 bash[24237]: audit 2024-02-13T00:40:16.914351+0000 mon.a (mon.0) 1715 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:40:17.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:17 smithi106 bash[18459]: cluster 2024-02-13T00:40:16.205901+0000 mgr.y (mgr.24461) 423 : cluster [DBG] pgmap v459: 236 pgs: 8 unknown, 228 active+clean; 6.9 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T00:40:17.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:17 smithi106 bash[18459]: audit 2024-02-13T00:40:16.256890+0000 mon.a (mon.0) 1708 : audit [INF] from='client.? 172.21.15.80:0/3644709403' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-45"}]': finished 2024-02-13T00:40:17.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:17 smithi106 bash[18459]: audit 2024-02-13T00:40:16.257163+0000 mon.a (mon.0) 1709 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:40:17.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:17 smithi106 bash[18459]: cluster 2024-02-13T00:40:16.257248+0000 mon.a (mon.0) 1710 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2024-02-13T00:40:17.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:17 smithi106 bash[18459]: audit 2024-02-13T00:40:16.258207+0000 mon.a (mon.0) 1711 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-27"}]: dispatch 2024-02-13T00:40:17.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:17 smithi106 bash[18459]: audit 2024-02-13T00:40:16.283465+0000 mon.c (mon.2) 290 : audit [INF] from='client.? 172.21.15.80:0/1141487302' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:17 smithi106 bash[18459]: audit 2024-02-13T00:40:16.283912+0000 mon.a (mon.0) 1712 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:17 smithi106 bash[18459]: audit 2024-02-13T00:40:16.284654+0000 mon.c (mon.2) 291 : audit [INF] from='client.? 172.21.15.80:0/1141487302' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:17 smithi106 bash[18459]: audit 2024-02-13T00:40:16.285073+0000 mon.a (mon.0) 1713 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:17 smithi106 bash[18459]: audit 2024-02-13T00:40:16.285749+0000 mon.c (mon.2) 292 : audit [INF] from='client.? 172.21.15.80:0/1141487302' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi080-54183-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:17 smithi106 bash[18459]: audit 2024-02-13T00:40:16.286188+0000 mon.a (mon.0) 1714 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi080-54183-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:17 smithi106 bash[18459]: audit 2024-02-13T00:40:16.914351+0000 mon.a (mon.0) 1715 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:40:18.505 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:40:18 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:40:18.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:18 smithi106 bash[18459]: cluster 2024-02-13T00:40:17.253137+0000 mon.a (mon.0) 1716 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:40:18.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:18 smithi106 bash[18459]: audit 2024-02-13T00:40:17.266837+0000 mon.a (mon.0) 1717 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-27"}]': finished 2024-02-13T00:40:18.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:18 smithi106 bash[18459]: audit 2024-02-13T00:40:17.266944+0000 mon.a (mon.0) 1718 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi080-54183-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:18.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:18 smithi106 bash[18459]: cluster 2024-02-13T00:40:17.267078+0000 mon.a (mon.0) 1719 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2024-02-13T00:40:18.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:18 smithi106 bash[18459]: audit 2024-02-13T00:40:17.268876+0000 mon.c (mon.2) 293 : audit [INF] from='client.? 172.21.15.80:0/1141487302' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi080-54183-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:18.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:18 smithi106 bash[18459]: audit 2024-02-13T00:40:17.269182+0000 mon.c (mon.2) 294 : audit [INF] from='client.? 172.21.15.80:0/3775173569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:18.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:18 smithi106 bash[18459]: audit 2024-02-13T00:40:17.269609+0000 mon.a (mon.0) 1720 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi080-54183-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:18.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:18 smithi106 bash[18459]: audit 2024-02-13T00:40:17.270735+0000 mon.a (mon.0) 1721 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:18.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:18 smithi080 bash[17386]: cluster 2024-02-13T00:40:17.253137+0000 mon.a (mon.0) 1716 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:40:18.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:18 smithi080 bash[17386]: audit 2024-02-13T00:40:17.266837+0000 mon.a (mon.0) 1717 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-27"}]': finished 2024-02-13T00:40:18.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:18 smithi080 bash[17386]: audit 2024-02-13T00:40:17.266944+0000 mon.a (mon.0) 1718 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi080-54183-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:18.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:18 smithi080 bash[17386]: cluster 2024-02-13T00:40:17.267078+0000 mon.a (mon.0) 1719 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2024-02-13T00:40:18.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:18 smithi080 bash[17386]: audit 2024-02-13T00:40:17.268876+0000 mon.c (mon.2) 293 : audit [INF] from='client.? 172.21.15.80:0/1141487302' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi080-54183-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:18.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:18 smithi080 bash[17386]: audit 2024-02-13T00:40:17.269182+0000 mon.c (mon.2) 294 : audit [INF] from='client.? 172.21.15.80:0/3775173569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:18.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:18 smithi080 bash[17386]: audit 2024-02-13T00:40:17.269609+0000 mon.a (mon.0) 1720 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi080-54183-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:18.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:18 smithi080 bash[17386]: audit 2024-02-13T00:40:17.270735+0000 mon.a (mon.0) 1721 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:18.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:18 smithi080 bash[24237]: cluster 2024-02-13T00:40:17.253137+0000 mon.a (mon.0) 1716 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:40:18.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:18 smithi080 bash[24237]: audit 2024-02-13T00:40:17.266837+0000 mon.a (mon.0) 1717 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-27"}]': finished 2024-02-13T00:40:18.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:18 smithi080 bash[24237]: audit 2024-02-13T00:40:17.266944+0000 mon.a (mon.0) 1718 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi080-54183-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:18.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:18 smithi080 bash[24237]: cluster 2024-02-13T00:40:17.267078+0000 mon.a (mon.0) 1719 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2024-02-13T00:40:18.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:18 smithi080 bash[24237]: audit 2024-02-13T00:40:17.268876+0000 mon.c (mon.2) 293 : audit [INF] from='client.? 172.21.15.80:0/1141487302' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi080-54183-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:18.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:18 smithi080 bash[24237]: audit 2024-02-13T00:40:17.269182+0000 mon.c (mon.2) 294 : audit [INF] from='client.? 172.21.15.80:0/3775173569' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:18.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:18 smithi080 bash[24237]: audit 2024-02-13T00:40:17.269609+0000 mon.a (mon.0) 1720 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi080-54183-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:18.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:18 smithi080 bash[24237]: audit 2024-02-13T00:40:17.270735+0000 mon.a (mon.0) 1721 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:19.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:19 smithi106 bash[18459]: cluster 2024-02-13T00:40:18.208077+0000 mgr.y (mgr.24461) 424 : cluster [DBG] pgmap v462: 228 pgs: 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-13T00:40:19.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:19 smithi106 bash[18459]: audit 2024-02-13T00:40:18.231103+0000 mgr.y (mgr.24461) 425 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:40:19.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:19 smithi106 bash[18459]: audit 2024-02-13T00:40:18.697245+0000 mon.a (mon.0) 1722 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36"}]': finished 2024-02-13T00:40:19.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:19 smithi106 bash[18459]: cluster 2024-02-13T00:40:18.697387+0000 mon.a (mon.0) 1723 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2024-02-13T00:40:19.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:19 smithi106 bash[18459]: audit 2024-02-13T00:40:18.698291+0000 mon.c (mon.2) 295 : audit [INF] from='client.? 172.21.15.80:0/3775173569' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:19.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:19 smithi106 bash[18459]: audit 2024-02-13T00:40:19.143669+0000 mon.a (mon.0) 1724 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:19.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:19 smithi080 bash[17386]: cluster 2024-02-13T00:40:18.208077+0000 mgr.y (mgr.24461) 424 : cluster [DBG] pgmap v462: 228 pgs: 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-13T00:40:19.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:19 smithi080 bash[17386]: audit 2024-02-13T00:40:18.231103+0000 mgr.y (mgr.24461) 425 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:40:19.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:19 smithi080 bash[17386]: audit 2024-02-13T00:40:18.697245+0000 mon.a (mon.0) 1722 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36"}]': finished 2024-02-13T00:40:19.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:19 smithi080 bash[17386]: cluster 2024-02-13T00:40:18.697387+0000 mon.a (mon.0) 1723 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2024-02-13T00:40:19.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:19 smithi080 bash[17386]: audit 2024-02-13T00:40:18.698291+0000 mon.c (mon.2) 295 : audit [INF] from='client.? 172.21.15.80:0/3775173569' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:19.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:19 smithi080 bash[17386]: audit 2024-02-13T00:40:19.143669+0000 mon.a (mon.0) 1724 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:19.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:19 smithi080 bash[24237]: cluster 2024-02-13T00:40:18.208077+0000 mgr.y (mgr.24461) 424 : cluster [DBG] pgmap v462: 228 pgs: 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-13T00:40:19.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:19 smithi080 bash[24237]: audit 2024-02-13T00:40:18.231103+0000 mgr.y (mgr.24461) 425 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:40:19.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:19 smithi080 bash[24237]: audit 2024-02-13T00:40:18.697245+0000 mon.a (mon.0) 1722 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi080-54175-36"}]': finished 2024-02-13T00:40:19.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:19 smithi080 bash[24237]: cluster 2024-02-13T00:40:18.697387+0000 mon.a (mon.0) 1723 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2024-02-13T00:40:19.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:19 smithi080 bash[24237]: audit 2024-02-13T00:40:18.698291+0000 mon.c (mon.2) 295 : audit [INF] from='client.? 172.21.15.80:0/3775173569' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:19.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:19 smithi080 bash[24237]: audit 2024-02-13T00:40:19.143669+0000 mon.a (mon.0) 1724 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi080-54175-36"}]: dispatch 2024-02-13T00:40:20.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:40:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:40:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:40:20.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:20 smithi106 bash[18459]: audit 2024-02-13T00:40:19.279293+0000 mon.a (mon.0) 1725 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi080-54183-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi080-54183-46"}]': finished 2024-02-13T00:40:20.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:20 smithi106 bash[18459]: audit 2024-02-13T00:40:19.279460+0000 mon.a (mon.0) 1726 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi080-54175-36"}]': finished 2024-02-13T00:40:20.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:20 smithi106 bash[18459]: cluster 2024-02-13T00:40:19.279545+0000 mon.a (mon.0) 1727 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2024-02-13T00:40:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:20 smithi106 bash[18459]: audit 2024-02-13T00:40:19.281773+0000 mon.a (mon.0) 1728 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:20 smithi106 bash[18459]: audit 2024-02-13T00:40:19.308149+0000 mon.c (mon.2) 296 : audit [INF] from='client.? 172.21.15.80:0/2766050455' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:20 smithi106 bash[18459]: audit 2024-02-13T00:40:19.308529+0000 mon.a (mon.0) 1729 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:20 smithi106 bash[18459]: audit 2024-02-13T00:40:19.309213+0000 mon.c (mon.2) 297 : audit [INF] from='client.? 172.21.15.80:0/2766050455' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:20 smithi106 bash[18459]: audit 2024-02-13T00:40:19.309537+0000 mon.a (mon.0) 1730 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:20 smithi106 bash[18459]: audit 2024-02-13T00:40:19.310007+0000 mon.c (mon.2) 298 : audit [INF] from='client.? 172.21.15.80:0/2766050455' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi080-54175-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:20 smithi106 bash[18459]: audit 2024-02-13T00:40:19.310255+0000 mon.a (mon.0) 1731 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi080-54175-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:20.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:20 smithi080 bash[24237]: audit 2024-02-13T00:40:19.279293+0000 mon.a (mon.0) 1725 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi080-54183-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi080-54183-46"}]': finished 2024-02-13T00:40:20.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:20 smithi080 bash[24237]: audit 2024-02-13T00:40:19.279460+0000 mon.a (mon.0) 1726 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi080-54175-36"}]': finished 2024-02-13T00:40:20.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:20 smithi080 bash[24237]: cluster 2024-02-13T00:40:19.279545+0000 mon.a (mon.0) 1727 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2024-02-13T00:40:20.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:20 smithi080 bash[24237]: audit 2024-02-13T00:40:19.281773+0000 mon.a (mon.0) 1728 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:20.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:20 smithi080 bash[24237]: audit 2024-02-13T00:40:19.308149+0000 mon.c (mon.2) 296 : audit [INF] from='client.? 172.21.15.80:0/2766050455' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:20.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:20 smithi080 bash[24237]: audit 2024-02-13T00:40:19.308529+0000 mon.a (mon.0) 1729 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:20.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:20 smithi080 bash[24237]: audit 2024-02-13T00:40:19.309213+0000 mon.c (mon.2) 297 : audit [INF] from='client.? 172.21.15.80:0/2766050455' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:20.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:20 smithi080 bash[24237]: audit 2024-02-13T00:40:19.309537+0000 mon.a (mon.0) 1730 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:20.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:20 smithi080 bash[24237]: audit 2024-02-13T00:40:19.310007+0000 mon.c (mon.2) 298 : audit [INF] from='client.? 172.21.15.80:0/2766050455' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi080-54175-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:20.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:20 smithi080 bash[24237]: audit 2024-02-13T00:40:19.310255+0000 mon.a (mon.0) 1731 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi080-54175-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:20.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:20 smithi080 bash[17386]: audit 2024-02-13T00:40:19.279293+0000 mon.a (mon.0) 1725 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi080-54183-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi080-54183-46"}]': finished 2024-02-13T00:40:20.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:20 smithi080 bash[17386]: audit 2024-02-13T00:40:19.279460+0000 mon.a (mon.0) 1726 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi080-54175-36"}]': finished 2024-02-13T00:40:20.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:20 smithi080 bash[17386]: cluster 2024-02-13T00:40:19.279545+0000 mon.a (mon.0) 1727 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2024-02-13T00:40:20.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:20 smithi080 bash[17386]: audit 2024-02-13T00:40:19.281773+0000 mon.a (mon.0) 1728 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:20.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:20 smithi080 bash[17386]: audit 2024-02-13T00:40:19.308149+0000 mon.c (mon.2) 296 : audit [INF] from='client.? 172.21.15.80:0/2766050455' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:20.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:20 smithi080 bash[17386]: audit 2024-02-13T00:40:19.308529+0000 mon.a (mon.0) 1729 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:20.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:20 smithi080 bash[17386]: audit 2024-02-13T00:40:19.309213+0000 mon.c (mon.2) 297 : audit [INF] from='client.? 172.21.15.80:0/2766050455' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:20.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:20 smithi080 bash[17386]: audit 2024-02-13T00:40:19.309537+0000 mon.a (mon.0) 1730 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:20.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:20 smithi080 bash[17386]: audit 2024-02-13T00:40:19.310007+0000 mon.c (mon.2) 298 : audit [INF] from='client.? 172.21.15.80:0/2766050455' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi080-54175-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:20.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:20 smithi080 bash[17386]: audit 2024-02-13T00:40:19.310255+0000 mon.a (mon.0) 1731 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi080-54175-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:22.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:21 smithi106 bash[18459]: cluster 2024-02-13T00:40:20.208973+0000 mgr.y (mgr.24461) 426 : cluster [DBG] pgmap v465: 236 pgs: 40 unknown, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:22.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:21 smithi106 bash[18459]: audit 2024-02-13T00:40:20.283577+0000 mon.a (mon.0) 1732 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:22.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:21 smithi106 bash[18459]: audit 2024-02-13T00:40:20.284071+0000 mon.a (mon.0) 1733 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi080-54175-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:22.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:21 smithi106 bash[18459]: cluster 2024-02-13T00:40:20.284225+0000 mon.a (mon.0) 1734 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2024-02-13T00:40:22.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:21 smithi106 bash[18459]: audit 2024-02-13T00:40:20.293357+0000 mon.c (mon.2) 299 : audit [INF] from='client.? 172.21.15.80:0/2766050455' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi080-54175-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:22.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:21 smithi106 bash[18459]: audit 2024-02-13T00:40:20.294534+0000 mon.a (mon.0) 1735 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:40:22.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:21 smithi106 bash[18459]: audit 2024-02-13T00:40:20.315481+0000 mon.a (mon.0) 1736 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi080-54175-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:22.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:21 smithi106 bash[18459]: audit 2024-02-13T00:40:21.288194+0000 mon.a (mon.0) 1737 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-29", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:40:22.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:21 smithi080 bash[24237]: cluster 2024-02-13T00:40:20.208973+0000 mgr.y (mgr.24461) 426 : cluster [DBG] pgmap v465: 236 pgs: 40 unknown, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:22.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:21 smithi080 bash[24237]: audit 2024-02-13T00:40:20.283577+0000 mon.a (mon.0) 1732 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:22.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:21 smithi080 bash[24237]: audit 2024-02-13T00:40:20.284071+0000 mon.a (mon.0) 1733 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi080-54175-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:22.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:21 smithi080 bash[24237]: cluster 2024-02-13T00:40:20.284225+0000 mon.a (mon.0) 1734 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2024-02-13T00:40:22.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:21 smithi080 bash[24237]: audit 2024-02-13T00:40:20.293357+0000 mon.c (mon.2) 299 : audit [INF] from='client.? 172.21.15.80:0/2766050455' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi080-54175-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:22.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:21 smithi080 bash[24237]: audit 2024-02-13T00:40:20.294534+0000 mon.a (mon.0) 1735 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:40:22.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:21 smithi080 bash[24237]: audit 2024-02-13T00:40:20.315481+0000 mon.a (mon.0) 1736 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi080-54175-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:22.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:21 smithi080 bash[24237]: audit 2024-02-13T00:40:21.288194+0000 mon.a (mon.0) 1737 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-29", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:40:22.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:21 smithi080 bash[17386]: cluster 2024-02-13T00:40:20.208973+0000 mgr.y (mgr.24461) 426 : cluster [DBG] pgmap v465: 236 pgs: 40 unknown, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:22.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:21 smithi080 bash[17386]: audit 2024-02-13T00:40:20.283577+0000 mon.a (mon.0) 1732 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:22.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:21 smithi080 bash[17386]: audit 2024-02-13T00:40:20.284071+0000 mon.a (mon.0) 1733 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi080-54175-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:22.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:21 smithi080 bash[17386]: cluster 2024-02-13T00:40:20.284225+0000 mon.a (mon.0) 1734 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2024-02-13T00:40:22.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:21 smithi080 bash[17386]: audit 2024-02-13T00:40:20.293357+0000 mon.c (mon.2) 299 : audit [INF] from='client.? 172.21.15.80:0/2766050455' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi080-54175-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:22.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:21 smithi080 bash[17386]: audit 2024-02-13T00:40:20.294534+0000 mon.a (mon.0) 1735 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:40:22.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:21 smithi080 bash[17386]: audit 2024-02-13T00:40:20.315481+0000 mon.a (mon.0) 1736 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi080-54175-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:22.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:21 smithi080 bash[17386]: audit 2024-02-13T00:40:21.288194+0000 mon.a (mon.0) 1737 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-29", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:40:23.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:22 smithi106 bash[18459]: cluster 2024-02-13T00:40:21.718718+0000 mon.a (mon.0) 1738 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2024-02-13T00:40:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:22 smithi106 bash[18459]: audit 2024-02-13T00:40:21.719921+0000 mon.c (mon.2) 300 : audit [INF] from='client.? 172.21.15.80:0/1141487302' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:22 smithi106 bash[18459]: audit 2024-02-13T00:40:21.720172+0000 mon.a (mon.0) 1739 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-29"}]: dispatch 2024-02-13T00:40:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:22 smithi106 bash[18459]: audit 2024-02-13T00:40:21.720645+0000 mon.a (mon.0) 1740 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:22 smithi106 bash[18459]: audit 2024-02-13T00:40:22.216738+0000 mon.a (mon.0) 1741 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi080-54175-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi080-54175-37"}]': finished 2024-02-13T00:40:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:22 smithi106 bash[18459]: audit 2024-02-13T00:40:22.216925+0000 mon.a (mon.0) 1742 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-29"}]': finished 2024-02-13T00:40:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:22 smithi106 bash[18459]: audit 2024-02-13T00:40:22.217023+0000 mon.a (mon.0) 1743 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-46"}]': finished 2024-02-13T00:40:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:22 smithi106 bash[18459]: cluster 2024-02-13T00:40:22.217154+0000 mon.a (mon.0) 1744 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2024-02-13T00:40:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:22 smithi106 bash[18459]: audit 2024-02-13T00:40:22.221195+0000 mon.c (mon.2) 301 : audit [INF] from='client.? 172.21.15.80:0/1141487302' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:23.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:22 smithi106 bash[18459]: audit 2024-02-13T00:40:22.224128+0000 mon.a (mon.0) 1745 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-29", "mode": "writeback"}]: dispatch 2024-02-13T00:40:23.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:22 smithi106 bash[18459]: audit 2024-02-13T00:40:22.225348+0000 mon.a (mon.0) 1746 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:23.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:22 smithi080 bash[17386]: cluster 2024-02-13T00:40:21.718718+0000 mon.a (mon.0) 1738 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2024-02-13T00:40:23.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:22 smithi080 bash[17386]: audit 2024-02-13T00:40:21.719921+0000 mon.c (mon.2) 300 : audit [INF] from='client.? 172.21.15.80:0/1141487302' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:23.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:22 smithi080 bash[17386]: audit 2024-02-13T00:40:21.720172+0000 mon.a (mon.0) 1739 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-29"}]: dispatch 2024-02-13T00:40:23.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:22 smithi080 bash[17386]: audit 2024-02-13T00:40:21.720645+0000 mon.a (mon.0) 1740 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:23.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:22 smithi080 bash[17386]: audit 2024-02-13T00:40:22.216738+0000 mon.a (mon.0) 1741 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi080-54175-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi080-54175-37"}]': finished 2024-02-13T00:40:23.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:22 smithi080 bash[17386]: audit 2024-02-13T00:40:22.216925+0000 mon.a (mon.0) 1742 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-29"}]': finished 2024-02-13T00:40:23.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:22 smithi080 bash[17386]: audit 2024-02-13T00:40:22.217023+0000 mon.a (mon.0) 1743 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-46"}]': finished 2024-02-13T00:40:23.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:22 smithi080 bash[17386]: cluster 2024-02-13T00:40:22.217154+0000 mon.a (mon.0) 1744 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2024-02-13T00:40:23.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:22 smithi080 bash[17386]: audit 2024-02-13T00:40:22.221195+0000 mon.c (mon.2) 301 : audit [INF] from='client.? 172.21.15.80:0/1141487302' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:23.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:22 smithi080 bash[17386]: audit 2024-02-13T00:40:22.224128+0000 mon.a (mon.0) 1745 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-29", "mode": "writeback"}]: dispatch 2024-02-13T00:40:23.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:22 smithi080 bash[17386]: audit 2024-02-13T00:40:22.225348+0000 mon.a (mon.0) 1746 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:23.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:22 smithi080 bash[24237]: cluster 2024-02-13T00:40:21.718718+0000 mon.a (mon.0) 1738 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2024-02-13T00:40:23.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:22 smithi080 bash[24237]: audit 2024-02-13T00:40:21.719921+0000 mon.c (mon.2) 300 : audit [INF] from='client.? 172.21.15.80:0/1141487302' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:23.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:22 smithi080 bash[24237]: audit 2024-02-13T00:40:21.720172+0000 mon.a (mon.0) 1739 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-29"}]: dispatch 2024-02-13T00:40:23.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:22 smithi080 bash[24237]: audit 2024-02-13T00:40:21.720645+0000 mon.a (mon.0) 1740 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:23.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:22 smithi080 bash[24237]: audit 2024-02-13T00:40:22.216738+0000 mon.a (mon.0) 1741 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi080-54175-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi080-54175-37"}]': finished 2024-02-13T00:40:23.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:22 smithi080 bash[24237]: audit 2024-02-13T00:40:22.216925+0000 mon.a (mon.0) 1742 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-29"}]': finished 2024-02-13T00:40:23.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:22 smithi080 bash[24237]: audit 2024-02-13T00:40:22.217023+0000 mon.a (mon.0) 1743 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi080-54183-46"}]': finished 2024-02-13T00:40:23.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:22 smithi080 bash[24237]: cluster 2024-02-13T00:40:22.217154+0000 mon.a (mon.0) 1744 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2024-02-13T00:40:23.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:22 smithi080 bash[24237]: audit 2024-02-13T00:40:22.221195+0000 mon.c (mon.2) 301 : audit [INF] from='client.? 172.21.15.80:0/1141487302' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:23.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:22 smithi080 bash[24237]: audit 2024-02-13T00:40:22.224128+0000 mon.a (mon.0) 1745 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-29", "mode": "writeback"}]: dispatch 2024-02-13T00:40:23.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:22 smithi080 bash[24237]: audit 2024-02-13T00:40:22.225348+0000 mon.a (mon.0) 1746 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-46"}]: dispatch 2024-02-13T00:40:23.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:40:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:40:23] "GET /metrics HTTP/1.1" 200 188807 "" "Prometheus/2.33.4" 2024-02-13T00:40:24.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:23 smithi106 bash[18459]: cluster 2024-02-13T00:40:22.209739+0000 mgr.y (mgr.24461) 427 : cluster [DBG] pgmap v468: 228 pgs: 32 unknown, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:40:24.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:23 smithi106 bash[18459]: cluster 2024-02-13T00:40:23.209757+0000 mon.a (mon.0) 1747 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:40:24.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:23 smithi106 bash[18459]: audit 2024-02-13T00:40:23.224678+0000 mon.a (mon.0) 1748 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-29", "mode": "writeback"}]': finished 2024-02-13T00:40:24.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:23 smithi106 bash[18459]: audit 2024-02-13T00:40:23.224756+0000 mon.a (mon.0) 1749 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-46"}]': finished 2024-02-13T00:40:24.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:23 smithi106 bash[18459]: cluster 2024-02-13T00:40:23.224830+0000 mon.a (mon.0) 1750 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2024-02-13T00:40:24.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:23 smithi106 bash[18459]: audit 2024-02-13T00:40:23.254890+0000 mon.a (mon.0) 1751 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi080-54183-47"}]: dispatch 2024-02-13T00:40:24.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:23 smithi106 bash[18459]: audit 2024-02-13T00:40:23.258996+0000 mon.a (mon.0) 1752 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi080-54183-47"}]: dispatch 2024-02-13T00:40:24.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:23 smithi106 bash[18459]: audit 2024-02-13T00:40:23.259600+0000 mon.a (mon.0) 1753 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi080-54183-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:24.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:23 smithi106 bash[18459]: audit 2024-02-13T00:40:23.361622+0000 mon.a (mon.0) 1754 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:40:24.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:23 smithi080 bash[17386]: cluster 2024-02-13T00:40:22.209739+0000 mgr.y (mgr.24461) 427 : cluster [DBG] pgmap v468: 228 pgs: 32 unknown, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:40:24.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:23 smithi080 bash[17386]: cluster 2024-02-13T00:40:23.209757+0000 mon.a (mon.0) 1747 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:40:24.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:23 smithi080 bash[17386]: audit 2024-02-13T00:40:23.224678+0000 mon.a (mon.0) 1748 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-29", "mode": "writeback"}]': finished 2024-02-13T00:40:24.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:23 smithi080 bash[17386]: audit 2024-02-13T00:40:23.224756+0000 mon.a (mon.0) 1749 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-46"}]': finished 2024-02-13T00:40:24.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:23 smithi080 bash[17386]: cluster 2024-02-13T00:40:23.224830+0000 mon.a (mon.0) 1750 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2024-02-13T00:40:24.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:23 smithi080 bash[17386]: audit 2024-02-13T00:40:23.254890+0000 mon.a (mon.0) 1751 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi080-54183-47"}]: dispatch 2024-02-13T00:40:24.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:23 smithi080 bash[17386]: audit 2024-02-13T00:40:23.258996+0000 mon.a (mon.0) 1752 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi080-54183-47"}]: dispatch 2024-02-13T00:40:24.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:23 smithi080 bash[17386]: audit 2024-02-13T00:40:23.259600+0000 mon.a (mon.0) 1753 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi080-54183-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:24.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:23 smithi080 bash[17386]: audit 2024-02-13T00:40:23.361622+0000 mon.a (mon.0) 1754 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:40:24.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:23 smithi080 bash[24237]: cluster 2024-02-13T00:40:22.209739+0000 mgr.y (mgr.24461) 427 : cluster [DBG] pgmap v468: 228 pgs: 32 unknown, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:40:24.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:23 smithi080 bash[24237]: cluster 2024-02-13T00:40:23.209757+0000 mon.a (mon.0) 1747 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:40:24.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:23 smithi080 bash[24237]: audit 2024-02-13T00:40:23.224678+0000 mon.a (mon.0) 1748 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-29", "mode": "writeback"}]': finished 2024-02-13T00:40:24.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:23 smithi080 bash[24237]: audit 2024-02-13T00:40:23.224756+0000 mon.a (mon.0) 1749 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi080-54183-46"}]': finished 2024-02-13T00:40:24.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:23 smithi080 bash[24237]: cluster 2024-02-13T00:40:23.224830+0000 mon.a (mon.0) 1750 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2024-02-13T00:40:24.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:23 smithi080 bash[24237]: audit 2024-02-13T00:40:23.254890+0000 mon.a (mon.0) 1751 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi080-54183-47"}]: dispatch 2024-02-13T00:40:24.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:23 smithi080 bash[24237]: audit 2024-02-13T00:40:23.258996+0000 mon.a (mon.0) 1752 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi080-54183-47"}]: dispatch 2024-02-13T00:40:24.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:23 smithi080 bash[24237]: audit 2024-02-13T00:40:23.259600+0000 mon.a (mon.0) 1753 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi080-54183-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:24.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:23 smithi080 bash[24237]: audit 2024-02-13T00:40:23.361622+0000 mon.a (mon.0) 1754 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:40:26.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:25 smithi106 bash[18459]: cluster 2024-02-13T00:40:24.210555+0000 mgr.y (mgr.24461) 428 : cluster [DBG] pgmap v471: 236 pgs: 8 creating+peering, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:26.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:25 smithi106 bash[18459]: audit 2024-02-13T00:40:24.229092+0000 mon.a (mon.0) 1755 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi080-54183-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:26.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:25 smithi106 bash[18459]: audit 2024-02-13T00:40:24.229236+0000 mon.a (mon.0) 1756 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:40:26.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:25 smithi106 bash[18459]: cluster 2024-02-13T00:40:24.229329+0000 mon.a (mon.0) 1757 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2024-02-13T00:40:26.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:25 smithi106 bash[18459]: audit 2024-02-13T00:40:24.230807+0000 mon.c (mon.2) 302 : audit [INF] from='client.? 172.21.15.80:0/2766050455' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:26.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:25 smithi106 bash[18459]: audit 2024-02-13T00:40:24.231285+0000 mon.a (mon.0) 1758 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-29"}]: dispatch 2024-02-13T00:40:26.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:25 smithi106 bash[18459]: audit 2024-02-13T00:40:24.231653+0000 mon.a (mon.0) 1759 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi080-54183-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi080-54183-47"}]: dispatch 2024-02-13T00:40:26.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:25 smithi106 bash[18459]: audit 2024-02-13T00:40:24.232213+0000 mon.a (mon.0) 1760 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:26.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:25 smithi080 bash[24237]: cluster 2024-02-13T00:40:24.210555+0000 mgr.y (mgr.24461) 428 : cluster [DBG] pgmap v471: 236 pgs: 8 creating+peering, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:26.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:25 smithi080 bash[24237]: audit 2024-02-13T00:40:24.229092+0000 mon.a (mon.0) 1755 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi080-54183-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:26.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:25 smithi080 bash[24237]: audit 2024-02-13T00:40:24.229236+0000 mon.a (mon.0) 1756 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:40:26.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:25 smithi080 bash[24237]: cluster 2024-02-13T00:40:24.229329+0000 mon.a (mon.0) 1757 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2024-02-13T00:40:26.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:25 smithi080 bash[24237]: audit 2024-02-13T00:40:24.230807+0000 mon.c (mon.2) 302 : audit [INF] from='client.? 172.21.15.80:0/2766050455' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:26.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:25 smithi080 bash[24237]: audit 2024-02-13T00:40:24.231285+0000 mon.a (mon.0) 1758 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-29"}]: dispatch 2024-02-13T00:40:26.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:25 smithi080 bash[24237]: audit 2024-02-13T00:40:24.231653+0000 mon.a (mon.0) 1759 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi080-54183-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi080-54183-47"}]: dispatch 2024-02-13T00:40:26.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:25 smithi080 bash[24237]: audit 2024-02-13T00:40:24.232213+0000 mon.a (mon.0) 1760 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:26.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:25 smithi080 bash[17386]: cluster 2024-02-13T00:40:24.210555+0000 mgr.y (mgr.24461) 428 : cluster [DBG] pgmap v471: 236 pgs: 8 creating+peering, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:26.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:25 smithi080 bash[17386]: audit 2024-02-13T00:40:24.229092+0000 mon.a (mon.0) 1755 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi080-54183-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:26.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:25 smithi080 bash[17386]: audit 2024-02-13T00:40:24.229236+0000 mon.a (mon.0) 1756 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:40:26.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:25 smithi080 bash[17386]: cluster 2024-02-13T00:40:24.229329+0000 mon.a (mon.0) 1757 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2024-02-13T00:40:26.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:25 smithi080 bash[17386]: audit 2024-02-13T00:40:24.230807+0000 mon.c (mon.2) 302 : audit [INF] from='client.? 172.21.15.80:0/2766050455' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:26.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:25 smithi080 bash[17386]: audit 2024-02-13T00:40:24.231285+0000 mon.a (mon.0) 1758 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-29"}]: dispatch 2024-02-13T00:40:26.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:25 smithi080 bash[17386]: audit 2024-02-13T00:40:24.231653+0000 mon.a (mon.0) 1759 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi080-54183-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi080-54183-47"}]: dispatch 2024-02-13T00:40:26.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:25 smithi080 bash[17386]: audit 2024-02-13T00:40:24.232213+0000 mon.a (mon.0) 1760 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:27.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:26 smithi106 bash[18459]: cluster 2024-02-13T00:40:25.223222+0000 mon.a (mon.0) 1761 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:40:27.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:26 smithi106 bash[18459]: audit 2024-02-13T00:40:25.231163+0000 mon.a (mon.0) 1762 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-29"}]': finished 2024-02-13T00:40:27.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:26 smithi106 bash[18459]: audit 2024-02-13T00:40:25.675291+0000 mon.a (mon.0) 1763 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi080-54175-37"}]': finished 2024-02-13T00:40:27.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:26 smithi106 bash[18459]: cluster 2024-02-13T00:40:25.675546+0000 mon.a (mon.0) 1764 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2024-02-13T00:40:27.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:26 smithi106 bash[18459]: audit 2024-02-13T00:40:25.676639+0000 mon.c (mon.2) 303 : audit [INF] from='client.? 172.21.15.80:0/2766050455' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:27.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:26 smithi106 bash[18459]: audit 2024-02-13T00:40:25.677419+0000 mon.a (mon.0) 1765 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:27.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:26 smithi106 bash[18459]: audit 2024-02-13T00:40:26.234888+0000 mon.a (mon.0) 1766 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi080-54183-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi080-54183-47"}]': finished 2024-02-13T00:40:27.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:26 smithi106 bash[18459]: audit 2024-02-13T00:40:26.235364+0000 mon.a (mon.0) 1767 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi080-54175-37"}]': finished 2024-02-13T00:40:27.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:26 smithi106 bash[18459]: cluster 2024-02-13T00:40:26.235562+0000 mon.a (mon.0) 1768 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2024-02-13T00:40:27.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:26 smithi080 bash[17386]: cluster 2024-02-13T00:40:25.223222+0000 mon.a (mon.0) 1761 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:40:27.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:26 smithi080 bash[17386]: audit 2024-02-13T00:40:25.231163+0000 mon.a (mon.0) 1762 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-29"}]': finished 2024-02-13T00:40:27.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:26 smithi080 bash[17386]: audit 2024-02-13T00:40:25.675291+0000 mon.a (mon.0) 1763 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi080-54175-37"}]': finished 2024-02-13T00:40:27.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:26 smithi080 bash[17386]: cluster 2024-02-13T00:40:25.675546+0000 mon.a (mon.0) 1764 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2024-02-13T00:40:27.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:26 smithi080 bash[17386]: audit 2024-02-13T00:40:25.676639+0000 mon.c (mon.2) 303 : audit [INF] from='client.? 172.21.15.80:0/2766050455' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:27.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:26 smithi080 bash[17386]: audit 2024-02-13T00:40:25.677419+0000 mon.a (mon.0) 1765 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:27.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:26 smithi080 bash[17386]: audit 2024-02-13T00:40:26.234888+0000 mon.a (mon.0) 1766 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi080-54183-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi080-54183-47"}]': finished 2024-02-13T00:40:27.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:26 smithi080 bash[17386]: audit 2024-02-13T00:40:26.235364+0000 mon.a (mon.0) 1767 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi080-54175-37"}]': finished 2024-02-13T00:40:27.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:26 smithi080 bash[17386]: cluster 2024-02-13T00:40:26.235562+0000 mon.a (mon.0) 1768 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2024-02-13T00:40:27.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:26 smithi080 bash[24237]: cluster 2024-02-13T00:40:25.223222+0000 mon.a (mon.0) 1761 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:40:27.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:26 smithi080 bash[24237]: audit 2024-02-13T00:40:25.231163+0000 mon.a (mon.0) 1762 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-29"}]': finished 2024-02-13T00:40:27.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:26 smithi080 bash[24237]: audit 2024-02-13T00:40:25.675291+0000 mon.a (mon.0) 1763 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi080-54175-37"}]': finished 2024-02-13T00:40:27.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:26 smithi080 bash[24237]: cluster 2024-02-13T00:40:25.675546+0000 mon.a (mon.0) 1764 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2024-02-13T00:40:27.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:26 smithi080 bash[24237]: audit 2024-02-13T00:40:25.676639+0000 mon.c (mon.2) 303 : audit [INF] from='client.? 172.21.15.80:0/2766050455' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:27.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:26 smithi080 bash[24237]: audit 2024-02-13T00:40:25.677419+0000 mon.a (mon.0) 1765 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi080-54175-37"}]: dispatch 2024-02-13T00:40:27.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:26 smithi080 bash[24237]: audit 2024-02-13T00:40:26.234888+0000 mon.a (mon.0) 1766 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi080-54183-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi080-54183-47"}]': finished 2024-02-13T00:40:27.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:26 smithi080 bash[24237]: audit 2024-02-13T00:40:26.235364+0000 mon.a (mon.0) 1767 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi080-54175-37"}]': finished 2024-02-13T00:40:27.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:26 smithi080 bash[24237]: cluster 2024-02-13T00:40:26.235562+0000 mon.a (mon.0) 1768 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2024-02-13T00:40:28.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:27 smithi106 bash[18459]: cluster 2024-02-13T00:40:26.211387+0000 mgr.y (mgr.24461) 429 : cluster [DBG] pgmap v474: 228 pgs: 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:28.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:27 smithi106 bash[18459]: audit 2024-02-13T00:40:26.268312+0000 mon.c (mon.2) 304 : audit [INF] from='client.? 172.21.15.80:0/1015660509' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:28.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:27 smithi106 bash[18459]: audit 2024-02-13T00:40:26.702791+0000 mon.a (mon.0) 1769 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:28.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:27 smithi106 bash[18459]: audit 2024-02-13T00:40:26.703651+0000 mon.c (mon.2) 305 : audit [INF] from='client.? 172.21.15.80:0/1015660509' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:28.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:27 smithi106 bash[18459]: audit 2024-02-13T00:40:26.709855+0000 mon.a (mon.0) 1770 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:28.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:27 smithi106 bash[18459]: audit 2024-02-13T00:40:26.710503+0000 mon.c (mon.2) 306 : audit [INF] from='client.? 172.21.15.80:0/1015660509' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi080-54175-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:28.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:27 smithi106 bash[18459]: audit 2024-02-13T00:40:26.713787+0000 mon.a (mon.0) 1771 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi080-54175-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:28.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:27 smithi106 bash[18459]: audit 2024-02-13T00:40:27.243765+0000 mon.a (mon.0) 1772 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi080-54175-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:28.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:27 smithi106 bash[18459]: cluster 2024-02-13T00:40:27.243907+0000 mon.a (mon.0) 1773 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2024-02-13T00:40:28.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:27 smithi106 bash[18459]: audit 2024-02-13T00:40:27.247055+0000 mon.a (mon.0) 1774 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:28.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:27 smithi106 bash[18459]: audit 2024-02-13T00:40:27.248001+0000 mon.c (mon.2) 307 : audit [INF] from='client.? 172.21.15.80:0/1015660509' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi080-54175-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:28.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:27 smithi106 bash[18459]: audit 2024-02-13T00:40:27.252819+0000 mon.a (mon.0) 1775 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi080-54175-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:28.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[17386]: cluster 2024-02-13T00:40:26.211387+0000 mgr.y (mgr.24461) 429 : cluster [DBG] pgmap v474: 228 pgs: 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:28.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[17386]: audit 2024-02-13T00:40:26.268312+0000 mon.c (mon.2) 304 : audit [INF] from='client.? 172.21.15.80:0/1015660509' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:28.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[17386]: audit 2024-02-13T00:40:26.702791+0000 mon.a (mon.0) 1769 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:28.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[17386]: audit 2024-02-13T00:40:26.703651+0000 mon.c (mon.2) 305 : audit [INF] from='client.? 172.21.15.80:0/1015660509' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:28.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[17386]: audit 2024-02-13T00:40:26.709855+0000 mon.a (mon.0) 1770 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:28.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[17386]: audit 2024-02-13T00:40:26.710503+0000 mon.c (mon.2) 306 : audit [INF] from='client.? 172.21.15.80:0/1015660509' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi080-54175-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:28.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[17386]: audit 2024-02-13T00:40:26.713787+0000 mon.a (mon.0) 1771 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi080-54175-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:28.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[17386]: audit 2024-02-13T00:40:27.243765+0000 mon.a (mon.0) 1772 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi080-54175-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:28.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[17386]: cluster 2024-02-13T00:40:27.243907+0000 mon.a (mon.0) 1773 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2024-02-13T00:40:28.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[17386]: audit 2024-02-13T00:40:27.247055+0000 mon.a (mon.0) 1774 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:28.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[17386]: audit 2024-02-13T00:40:27.248001+0000 mon.c (mon.2) 307 : audit [INF] from='client.? 172.21.15.80:0/1015660509' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi080-54175-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:28.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[17386]: audit 2024-02-13T00:40:27.252819+0000 mon.a (mon.0) 1775 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi080-54175-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:28.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[24237]: cluster 2024-02-13T00:40:26.211387+0000 mgr.y (mgr.24461) 429 : cluster [DBG] pgmap v474: 228 pgs: 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:28.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[24237]: audit 2024-02-13T00:40:26.268312+0000 mon.c (mon.2) 304 : audit [INF] from='client.? 172.21.15.80:0/1015660509' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:28.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[24237]: audit 2024-02-13T00:40:26.702791+0000 mon.a (mon.0) 1769 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:28.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[24237]: audit 2024-02-13T00:40:26.703651+0000 mon.c (mon.2) 305 : audit [INF] from='client.? 172.21.15.80:0/1015660509' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:28.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[24237]: audit 2024-02-13T00:40:26.709855+0000 mon.a (mon.0) 1770 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:28.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[24237]: audit 2024-02-13T00:40:26.710503+0000 mon.c (mon.2) 306 : audit [INF] from='client.? 172.21.15.80:0/1015660509' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi080-54175-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:28.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[24237]: audit 2024-02-13T00:40:26.713787+0000 mon.a (mon.0) 1771 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi080-54175-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:28.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[24237]: audit 2024-02-13T00:40:27.243765+0000 mon.a (mon.0) 1772 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi080-54175-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:28.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[24237]: cluster 2024-02-13T00:40:27.243907+0000 mon.a (mon.0) 1773 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2024-02-13T00:40:28.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[24237]: audit 2024-02-13T00:40:27.247055+0000 mon.a (mon.0) 1774 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:28.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[24237]: audit 2024-02-13T00:40:27.248001+0000 mon.c (mon.2) 307 : audit [INF] from='client.? 172.21.15.80:0/1015660509' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi080-54175-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:28.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:27 smithi080 bash[24237]: audit 2024-02-13T00:40:27.252819+0000 mon.a (mon.0) 1775 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi080-54175-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:28.505 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:40:28 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:40:29.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:29 smithi106 bash[18459]: cluster 2024-02-13T00:40:28.213602+0000 mgr.y (mgr.24461) 430 : cluster [DBG] pgmap v477: 236 pgs: 32 creating+peering, 204 active+clean; 7.0 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:40:29.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:29 smithi106 bash[18459]: audit 2024-02-13T00:40:28.241341+0000 mgr.y (mgr.24461) 431 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:40:29.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:29 smithi106 bash[18459]: audit 2024-02-13T00:40:28.244106+0000 mon.a (mon.0) 1776 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:29.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:29 smithi106 bash[18459]: cluster 2024-02-13T00:40:28.691480+0000 mon.a (mon.0) 1777 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2024-02-13T00:40:29.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:29 smithi106 bash[18459]: audit 2024-02-13T00:40:28.694093+0000 mon.a (mon.0) 1778 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi080-54183-47"}]: dispatch 2024-02-13T00:40:29.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:29 smithi106 bash[18459]: audit 2024-02-13T00:40:28.694927+0000 mon.a (mon.0) 1779 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:40:29.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:29 smithi106 bash[18459]: cluster 2024-02-13T00:40:28.706714+0000 mon.a (mon.0) 1780 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:40:29.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:29 smithi080 bash[17386]: cluster 2024-02-13T00:40:28.213602+0000 mgr.y (mgr.24461) 430 : cluster [DBG] pgmap v477: 236 pgs: 32 creating+peering, 204 active+clean; 7.0 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:40:29.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:29 smithi080 bash[17386]: audit 2024-02-13T00:40:28.241341+0000 mgr.y (mgr.24461) 431 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:40:29.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:29 smithi080 bash[17386]: audit 2024-02-13T00:40:28.244106+0000 mon.a (mon.0) 1776 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:29.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:29 smithi080 bash[17386]: cluster 2024-02-13T00:40:28.691480+0000 mon.a (mon.0) 1777 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2024-02-13T00:40:29.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:29 smithi080 bash[17386]: audit 2024-02-13T00:40:28.694093+0000 mon.a (mon.0) 1778 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi080-54183-47"}]: dispatch 2024-02-13T00:40:29.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:29 smithi080 bash[17386]: audit 2024-02-13T00:40:28.694927+0000 mon.a (mon.0) 1779 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:40:29.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:29 smithi080 bash[17386]: cluster 2024-02-13T00:40:28.706714+0000 mon.a (mon.0) 1780 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:40:29.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:29 smithi080 bash[24237]: cluster 2024-02-13T00:40:28.213602+0000 mgr.y (mgr.24461) 430 : cluster [DBG] pgmap v477: 236 pgs: 32 creating+peering, 204 active+clean; 7.0 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:40:29.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:29 smithi080 bash[24237]: audit 2024-02-13T00:40:28.241341+0000 mgr.y (mgr.24461) 431 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:40:29.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:29 smithi080 bash[24237]: audit 2024-02-13T00:40:28.244106+0000 mon.a (mon.0) 1776 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:29.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:29 smithi080 bash[24237]: cluster 2024-02-13T00:40:28.691480+0000 mon.a (mon.0) 1777 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2024-02-13T00:40:29.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:29 smithi080 bash[24237]: audit 2024-02-13T00:40:28.694093+0000 mon.a (mon.0) 1778 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi080-54183-47"}]: dispatch 2024-02-13T00:40:29.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:29 smithi080 bash[24237]: audit 2024-02-13T00:40:28.694927+0000 mon.a (mon.0) 1779 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:40:29.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:29 smithi080 bash[24237]: cluster 2024-02-13T00:40:28.706714+0000 mon.a (mon.0) 1780 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:40:30.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:40:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:40:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:40:30.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:30 smithi106 bash[18459]: audit 2024-02-13T00:40:29.247718+0000 mon.a (mon.0) 1781 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi080-54175-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi080-54175-38"}]': finished 2024-02-13T00:40:30.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:30 smithi106 bash[18459]: audit 2024-02-13T00:40:29.247854+0000 mon.a (mon.0) 1782 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi080-54183-47"}]': finished 2024-02-13T00:40:30.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:30 smithi106 bash[18459]: audit 2024-02-13T00:40:29.247962+0000 mon.a (mon.0) 1783 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-31", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:40:30.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:30 smithi106 bash[18459]: cluster 2024-02-13T00:40:29.248026+0000 mon.a (mon.0) 1784 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2024-02-13T00:40:30.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:30 smithi106 bash[18459]: audit 2024-02-13T00:40:29.249079+0000 mon.a (mon.0) 1785 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi080-54183-47"}]: dispatch 2024-02-13T00:40:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:30 smithi106 bash[18459]: audit 2024-02-13T00:40:29.250135+0000 mon.a (mon.0) 1786 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-31"}]: dispatch 2024-02-13T00:40:30.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:30 smithi080 bash[17386]: audit 2024-02-13T00:40:29.247718+0000 mon.a (mon.0) 1781 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi080-54175-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi080-54175-38"}]': finished 2024-02-13T00:40:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:30 smithi080 bash[17386]: audit 2024-02-13T00:40:29.247854+0000 mon.a (mon.0) 1782 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi080-54183-47"}]': finished 2024-02-13T00:40:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:30 smithi080 bash[17386]: audit 2024-02-13T00:40:29.247962+0000 mon.a (mon.0) 1783 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-31", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:40:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:30 smithi080 bash[17386]: cluster 2024-02-13T00:40:29.248026+0000 mon.a (mon.0) 1784 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2024-02-13T00:40:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:30 smithi080 bash[17386]: audit 2024-02-13T00:40:29.249079+0000 mon.a (mon.0) 1785 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi080-54183-47"}]: dispatch 2024-02-13T00:40:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:30 smithi080 bash[17386]: audit 2024-02-13T00:40:29.250135+0000 mon.a (mon.0) 1786 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-31"}]: dispatch 2024-02-13T00:40:30.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:30 smithi080 bash[24237]: audit 2024-02-13T00:40:29.247718+0000 mon.a (mon.0) 1781 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi080-54175-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi080-54175-38"}]': finished 2024-02-13T00:40:30.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:30 smithi080 bash[24237]: audit 2024-02-13T00:40:29.247854+0000 mon.a (mon.0) 1782 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi080-54183-47"}]': finished 2024-02-13T00:40:30.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:30 smithi080 bash[24237]: audit 2024-02-13T00:40:29.247962+0000 mon.a (mon.0) 1783 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-31", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:40:30.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:30 smithi080 bash[24237]: cluster 2024-02-13T00:40:29.248026+0000 mon.a (mon.0) 1784 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2024-02-13T00:40:30.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:30 smithi080 bash[24237]: audit 2024-02-13T00:40:29.249079+0000 mon.a (mon.0) 1785 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi080-54183-47"}]: dispatch 2024-02-13T00:40:30.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:30 smithi080 bash[24237]: audit 2024-02-13T00:40:29.250135+0000 mon.a (mon.0) 1786 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-31"}]: dispatch 2024-02-13T00:40:31.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:31 smithi106 bash[18459]: cluster 2024-02-13T00:40:30.214422+0000 mgr.y (mgr.24461) 432 : cluster [DBG] pgmap v480: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:40:31.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:31 smithi106 bash[18459]: audit 2024-02-13T00:40:30.251073+0000 mon.a (mon.0) 1787 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi080-54183-47"}]': finished 2024-02-13T00:40:31.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:31 smithi106 bash[18459]: audit 2024-02-13T00:40:30.251389+0000 mon.a (mon.0) 1788 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-31"}]': finished 2024-02-13T00:40:31.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:31 smithi106 bash[18459]: cluster 2024-02-13T00:40:30.251665+0000 mon.a (mon.0) 1789 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2024-02-13T00:40:31.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:31 smithi106 bash[18459]: audit 2024-02-13T00:40:30.256725+0000 mon.a (mon.0) 1790 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-31", "mode": "writeback"}]: dispatch 2024-02-13T00:40:31.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:31 smithi106 bash[18459]: audit 2024-02-13T00:40:30.284067+0000 mon.a (mon.0) 1791 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi080-54183-48"}]: dispatch 2024-02-13T00:40:31.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:31 smithi106 bash[18459]: audit 2024-02-13T00:40:30.285553+0000 mon.a (mon.0) 1792 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi080-54183-48"}]: dispatch 2024-02-13T00:40:31.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:31 smithi106 bash[18459]: audit 2024-02-13T00:40:30.286108+0000 mon.a (mon.0) 1793 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi080-54183-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:31.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:31 smithi106 bash[18459]: cluster 2024-02-13T00:40:31.244632+0000 mon.a (mon.0) 1794 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:40:31.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:31 smithi080 bash[17386]: cluster 2024-02-13T00:40:30.214422+0000 mgr.y (mgr.24461) 432 : cluster [DBG] pgmap v480: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:40:31.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:31 smithi080 bash[17386]: audit 2024-02-13T00:40:30.251073+0000 mon.a (mon.0) 1787 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi080-54183-47"}]': finished 2024-02-13T00:40:31.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:31 smithi080 bash[17386]: audit 2024-02-13T00:40:30.251389+0000 mon.a (mon.0) 1788 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-31"}]': finished 2024-02-13T00:40:31.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:31 smithi080 bash[17386]: cluster 2024-02-13T00:40:30.251665+0000 mon.a (mon.0) 1789 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2024-02-13T00:40:31.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:31 smithi080 bash[17386]: audit 2024-02-13T00:40:30.256725+0000 mon.a (mon.0) 1790 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-31", "mode": "writeback"}]: dispatch 2024-02-13T00:40:31.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:31 smithi080 bash[17386]: audit 2024-02-13T00:40:30.284067+0000 mon.a (mon.0) 1791 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi080-54183-48"}]: dispatch 2024-02-13T00:40:31.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:31 smithi080 bash[17386]: audit 2024-02-13T00:40:30.285553+0000 mon.a (mon.0) 1792 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi080-54183-48"}]: dispatch 2024-02-13T00:40:31.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:31 smithi080 bash[17386]: audit 2024-02-13T00:40:30.286108+0000 mon.a (mon.0) 1793 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi080-54183-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:31.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:31 smithi080 bash[17386]: cluster 2024-02-13T00:40:31.244632+0000 mon.a (mon.0) 1794 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:40:31.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:31 smithi080 bash[24237]: cluster 2024-02-13T00:40:30.214422+0000 mgr.y (mgr.24461) 432 : cluster [DBG] pgmap v480: 236 pgs: 8 unknown, 32 creating+peering, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:40:31.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:31 smithi080 bash[24237]: audit 2024-02-13T00:40:30.251073+0000 mon.a (mon.0) 1787 : audit [INF] from='client.? 172.21.15.80:0/95385088' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi080-54183-47"}]': finished 2024-02-13T00:40:31.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:31 smithi080 bash[24237]: audit 2024-02-13T00:40:30.251389+0000 mon.a (mon.0) 1788 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-31"}]': finished 2024-02-13T00:40:31.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:31 smithi080 bash[24237]: cluster 2024-02-13T00:40:30.251665+0000 mon.a (mon.0) 1789 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2024-02-13T00:40:31.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:31 smithi080 bash[24237]: audit 2024-02-13T00:40:30.256725+0000 mon.a (mon.0) 1790 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-31", "mode": "writeback"}]: dispatch 2024-02-13T00:40:31.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:31 smithi080 bash[24237]: audit 2024-02-13T00:40:30.284067+0000 mon.a (mon.0) 1791 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi080-54183-48"}]: dispatch 2024-02-13T00:40:31.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:31 smithi080 bash[24237]: audit 2024-02-13T00:40:30.285553+0000 mon.a (mon.0) 1792 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi080-54183-48"}]: dispatch 2024-02-13T00:40:31.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:31 smithi080 bash[24237]: audit 2024-02-13T00:40:30.286108+0000 mon.a (mon.0) 1793 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi080-54183-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:31.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:31 smithi080 bash[24237]: cluster 2024-02-13T00:40:31.244632+0000 mon.a (mon.0) 1794 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:40:33.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:32 smithi106 bash[18459]: audit 2024-02-13T00:40:31.253470+0000 mon.a (mon.0) 1795 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-31", "mode": "writeback"}]': finished 2024-02-13T00:40:33.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:32 smithi106 bash[18459]: audit 2024-02-13T00:40:31.253644+0000 mon.a (mon.0) 1796 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi080-54183-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:33.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:32 smithi106 bash[18459]: cluster 2024-02-13T00:40:31.253735+0000 mon.a (mon.0) 1797 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2024-02-13T00:40:33.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:32 smithi106 bash[18459]: audit 2024-02-13T00:40:31.255681+0000 mon.c (mon.2) 308 : audit [INF] from='client.? 172.21.15.80:0/1015660509' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:33.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:32 smithi106 bash[18459]: audit 2024-02-13T00:40:31.260140+0000 mon.a (mon.0) 1798 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi080-54183-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi080-54183-48"}]: dispatch 2024-02-13T00:40:33.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:32 smithi106 bash[18459]: audit 2024-02-13T00:40:31.260781+0000 mon.a (mon.0) 1799 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:33.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:32 smithi106 bash[18459]: audit 2024-02-13T00:40:31.457992+0000 mon.a (mon.0) 1800 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:40:33.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:32 smithi080 bash[24237]: audit 2024-02-13T00:40:31.253470+0000 mon.a (mon.0) 1795 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-31", "mode": "writeback"}]': finished 2024-02-13T00:40:33.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:32 smithi080 bash[24237]: audit 2024-02-13T00:40:31.253644+0000 mon.a (mon.0) 1796 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi080-54183-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:33.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:32 smithi080 bash[24237]: cluster 2024-02-13T00:40:31.253735+0000 mon.a (mon.0) 1797 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2024-02-13T00:40:33.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:32 smithi080 bash[24237]: audit 2024-02-13T00:40:31.255681+0000 mon.c (mon.2) 308 : audit [INF] from='client.? 172.21.15.80:0/1015660509' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:33.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:32 smithi080 bash[24237]: audit 2024-02-13T00:40:31.260140+0000 mon.a (mon.0) 1798 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi080-54183-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi080-54183-48"}]: dispatch 2024-02-13T00:40:33.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:32 smithi080 bash[24237]: audit 2024-02-13T00:40:31.260781+0000 mon.a (mon.0) 1799 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:33.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:32 smithi080 bash[24237]: audit 2024-02-13T00:40:31.457992+0000 mon.a (mon.0) 1800 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:40:33.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:32 smithi080 bash[17386]: audit 2024-02-13T00:40:31.253470+0000 mon.a (mon.0) 1795 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-31", "mode": "writeback"}]': finished 2024-02-13T00:40:33.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:32 smithi080 bash[17386]: audit 2024-02-13T00:40:31.253644+0000 mon.a (mon.0) 1796 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi080-54183-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:33.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:32 smithi080 bash[17386]: cluster 2024-02-13T00:40:31.253735+0000 mon.a (mon.0) 1797 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2024-02-13T00:40:33.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:32 smithi080 bash[17386]: audit 2024-02-13T00:40:31.255681+0000 mon.c (mon.2) 308 : audit [INF] from='client.? 172.21.15.80:0/1015660509' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:33.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:32 smithi080 bash[17386]: audit 2024-02-13T00:40:31.260140+0000 mon.a (mon.0) 1798 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi080-54183-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi080-54183-48"}]: dispatch 2024-02-13T00:40:33.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:32 smithi080 bash[17386]: audit 2024-02-13T00:40:31.260781+0000 mon.a (mon.0) 1799 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:33.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:32 smithi080 bash[17386]: audit 2024-02-13T00:40:31.457992+0000 mon.a (mon.0) 1800 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:40:33.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:40:33] "GET /metrics HTTP/1.1" 200 186493 "" "Prometheus/2.33.4" 2024-02-13T00:40:34.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:33 smithi106 bash[18459]: cluster 2024-02-13T00:40:32.215231+0000 mgr.y (mgr.24461) 433 : cluster [DBG] pgmap v483: 228 pgs: 32 creating+peering, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:40:34.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:33 smithi106 bash[18459]: audit 2024-02-13T00:40:32.697489+0000 mon.a (mon.0) 1801 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi080-54175-38"}]': finished 2024-02-13T00:40:34.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:33 smithi106 bash[18459]: audit 2024-02-13T00:40:32.697583+0000 mon.a (mon.0) 1802 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:40:34.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:33 smithi106 bash[18459]: cluster 2024-02-13T00:40:32.697630+0000 mon.a (mon.0) 1803 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2024-02-13T00:40:34.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:33 smithi106 bash[18459]: audit 2024-02-13T00:40:32.698465+0000 mon.c (mon.2) 309 : audit [INF] from='client.? 172.21.15.80:0/1015660509' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:34.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:33 smithi106 bash[18459]: audit 2024-02-13T00:40:32.698629+0000 mon.a (mon.0) 1804 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-31"}]: dispatch 2024-02-13T00:40:34.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:33 smithi106 bash[18459]: audit 2024-02-13T00:40:32.698852+0000 mon.a (mon.0) 1805 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:34.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:33 smithi106 bash[18459]: cluster 2024-02-13T00:40:33.251290+0000 mon.a (mon.0) 1806 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:40:34.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:33 smithi106 bash[18459]: audit 2024-02-13T00:40:33.261566+0000 mon.a (mon.0) 1807 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi080-54183-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi080-54183-48"}]': finished 2024-02-13T00:40:34.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:33 smithi106 bash[18459]: audit 2024-02-13T00:40:33.261690+0000 mon.a (mon.0) 1808 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-31"}]': finished 2024-02-13T00:40:34.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:33 smithi106 bash[18459]: audit 2024-02-13T00:40:33.261775+0000 mon.a (mon.0) 1809 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi080-54175-38"}]': finished 2024-02-13T00:40:34.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:33 smithi106 bash[18459]: cluster 2024-02-13T00:40:33.261858+0000 mon.a (mon.0) 1810 : cluster [DBG] osdmap e236: 8 total, 8 up, 8 in 2024-02-13T00:40:34.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:33 smithi106 bash[18459]: audit 2024-02-13T00:40:33.284782+0000 mon.c (mon.2) 310 : audit [INF] from='client.? 172.21.15.80:0/799962741' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:34.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:33 smithi106 bash[18459]: audit 2024-02-13T00:40:33.285160+0000 mon.a (mon.0) 1811 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:34.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:33 smithi106 bash[18459]: audit 2024-02-13T00:40:33.286134+0000 mon.c (mon.2) 311 : audit [INF] from='client.? 172.21.15.80:0/799962741' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:34.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:33 smithi106 bash[18459]: audit 2024-02-13T00:40:33.286748+0000 mon.a (mon.0) 1812 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:34.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:33 smithi106 bash[18459]: audit 2024-02-13T00:40:33.287329+0000 mon.c (mon.2) 312 : audit [INF] from='client.? 172.21.15.80:0/799962741' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi080-54175-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:34.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:33 smithi106 bash[18459]: audit 2024-02-13T00:40:33.287737+0000 mon.a (mon.0) 1813 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi080-54175-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:34.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[24237]: cluster 2024-02-13T00:40:32.215231+0000 mgr.y (mgr.24461) 433 : cluster [DBG] pgmap v483: 228 pgs: 32 creating+peering, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:40:34.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[24237]: audit 2024-02-13T00:40:32.697489+0000 mon.a (mon.0) 1801 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi080-54175-38"}]': finished 2024-02-13T00:40:34.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[24237]: audit 2024-02-13T00:40:32.697583+0000 mon.a (mon.0) 1802 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:40:34.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[24237]: cluster 2024-02-13T00:40:32.697630+0000 mon.a (mon.0) 1803 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2024-02-13T00:40:34.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[24237]: audit 2024-02-13T00:40:32.698465+0000 mon.c (mon.2) 309 : audit [INF] from='client.? 172.21.15.80:0/1015660509' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:34.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[24237]: audit 2024-02-13T00:40:32.698629+0000 mon.a (mon.0) 1804 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-31"}]: dispatch 2024-02-13T00:40:34.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[24237]: audit 2024-02-13T00:40:32.698852+0000 mon.a (mon.0) 1805 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:34.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[24237]: cluster 2024-02-13T00:40:33.251290+0000 mon.a (mon.0) 1806 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:40:34.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[24237]: audit 2024-02-13T00:40:33.261566+0000 mon.a (mon.0) 1807 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi080-54183-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi080-54183-48"}]': finished 2024-02-13T00:40:34.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[24237]: audit 2024-02-13T00:40:33.261690+0000 mon.a (mon.0) 1808 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-31"}]': finished 2024-02-13T00:40:34.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[24237]: audit 2024-02-13T00:40:33.261775+0000 mon.a (mon.0) 1809 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi080-54175-38"}]': finished 2024-02-13T00:40:34.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[24237]: cluster 2024-02-13T00:40:33.261858+0000 mon.a (mon.0) 1810 : cluster [DBG] osdmap e236: 8 total, 8 up, 8 in 2024-02-13T00:40:34.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[24237]: audit 2024-02-13T00:40:33.284782+0000 mon.c (mon.2) 310 : audit [INF] from='client.? 172.21.15.80:0/799962741' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:34.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[24237]: audit 2024-02-13T00:40:33.285160+0000 mon.a (mon.0) 1811 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:34.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[24237]: audit 2024-02-13T00:40:33.286134+0000 mon.c (mon.2) 311 : audit [INF] from='client.? 172.21.15.80:0/799962741' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:34.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[24237]: audit 2024-02-13T00:40:33.286748+0000 mon.a (mon.0) 1812 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:34.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[24237]: audit 2024-02-13T00:40:33.287329+0000 mon.c (mon.2) 312 : audit [INF] from='client.? 172.21.15.80:0/799962741' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi080-54175-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:34.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[24237]: audit 2024-02-13T00:40:33.287737+0000 mon.a (mon.0) 1813 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi080-54175-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:34.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[17386]: cluster 2024-02-13T00:40:32.215231+0000 mgr.y (mgr.24461) 433 : cluster [DBG] pgmap v483: 228 pgs: 32 creating+peering, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:40:34.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[17386]: audit 2024-02-13T00:40:32.697489+0000 mon.a (mon.0) 1801 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi080-54175-38"}]': finished 2024-02-13T00:40:34.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[17386]: audit 2024-02-13T00:40:32.697583+0000 mon.a (mon.0) 1802 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:40:34.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[17386]: cluster 2024-02-13T00:40:32.697630+0000 mon.a (mon.0) 1803 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2024-02-13T00:40:34.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[17386]: audit 2024-02-13T00:40:32.698465+0000 mon.c (mon.2) 309 : audit [INF] from='client.? 172.21.15.80:0/1015660509' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:34.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[17386]: audit 2024-02-13T00:40:32.698629+0000 mon.a (mon.0) 1804 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-31"}]: dispatch 2024-02-13T00:40:34.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[17386]: audit 2024-02-13T00:40:32.698852+0000 mon.a (mon.0) 1805 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi080-54175-38"}]: dispatch 2024-02-13T00:40:34.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[17386]: cluster 2024-02-13T00:40:33.251290+0000 mon.a (mon.0) 1806 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:40:34.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[17386]: audit 2024-02-13T00:40:33.261566+0000 mon.a (mon.0) 1807 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi080-54183-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi080-54183-48"}]': finished 2024-02-13T00:40:34.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[17386]: audit 2024-02-13T00:40:33.261690+0000 mon.a (mon.0) 1808 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-31"}]': finished 2024-02-13T00:40:34.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[17386]: audit 2024-02-13T00:40:33.261775+0000 mon.a (mon.0) 1809 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi080-54175-38"}]': finished 2024-02-13T00:40:34.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[17386]: cluster 2024-02-13T00:40:33.261858+0000 mon.a (mon.0) 1810 : cluster [DBG] osdmap e236: 8 total, 8 up, 8 in 2024-02-13T00:40:34.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[17386]: audit 2024-02-13T00:40:33.284782+0000 mon.c (mon.2) 310 : audit [INF] from='client.? 172.21.15.80:0/799962741' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:34.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[17386]: audit 2024-02-13T00:40:33.285160+0000 mon.a (mon.0) 1811 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:34.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[17386]: audit 2024-02-13T00:40:33.286134+0000 mon.c (mon.2) 311 : audit [INF] from='client.? 172.21.15.80:0/799962741' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:34.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[17386]: audit 2024-02-13T00:40:33.286748+0000 mon.a (mon.0) 1812 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:34.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[17386]: audit 2024-02-13T00:40:33.287329+0000 mon.c (mon.2) 312 : audit [INF] from='client.? 172.21.15.80:0/799962741' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi080-54175-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:34.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:33 smithi080 bash[17386]: audit 2024-02-13T00:40:33.287737+0000 mon.a (mon.0) 1813 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi080-54175-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:35.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:35 smithi106 bash[18459]: cluster 2024-02-13T00:40:34.216055+0000 mgr.y (mgr.24461) 434 : cluster [DBG] pgmap v486: 236 pgs: 8 unknown, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-13T00:40:35.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:35 smithi106 bash[18459]: audit 2024-02-13T00:40:34.265014+0000 mon.a (mon.0) 1814 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi080-54175-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:35.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:35 smithi106 bash[18459]: cluster 2024-02-13T00:40:34.265253+0000 mon.a (mon.0) 1815 : cluster [DBG] osdmap e237: 8 total, 8 up, 8 in 2024-02-13T00:40:35.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:35 smithi106 bash[18459]: audit 2024-02-13T00:40:34.269559+0000 mon.c (mon.2) 313 : audit [INF] from='client.? 172.21.15.80:0/799962741' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi080-54175-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:35.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:35 smithi106 bash[18459]: audit 2024-02-13T00:40:34.727749+0000 mon.a (mon.0) 1816 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi080-54175-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:35.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:35 smithi080 bash[17386]: cluster 2024-02-13T00:40:34.216055+0000 mgr.y (mgr.24461) 434 : cluster [DBG] pgmap v486: 236 pgs: 8 unknown, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-13T00:40:35.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:35 smithi080 bash[17386]: audit 2024-02-13T00:40:34.265014+0000 mon.a (mon.0) 1814 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi080-54175-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:35.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:35 smithi080 bash[17386]: cluster 2024-02-13T00:40:34.265253+0000 mon.a (mon.0) 1815 : cluster [DBG] osdmap e237: 8 total, 8 up, 8 in 2024-02-13T00:40:35.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:35 smithi080 bash[17386]: audit 2024-02-13T00:40:34.269559+0000 mon.c (mon.2) 313 : audit [INF] from='client.? 172.21.15.80:0/799962741' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi080-54175-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:35.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:35 smithi080 bash[17386]: audit 2024-02-13T00:40:34.727749+0000 mon.a (mon.0) 1816 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi080-54175-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:35 smithi080 bash[24237]: cluster 2024-02-13T00:40:34.216055+0000 mgr.y (mgr.24461) 434 : cluster [DBG] pgmap v486: 236 pgs: 8 unknown, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-13T00:40:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:35 smithi080 bash[24237]: audit 2024-02-13T00:40:34.265014+0000 mon.a (mon.0) 1814 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi080-54175-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:35 smithi080 bash[24237]: cluster 2024-02-13T00:40:34.265253+0000 mon.a (mon.0) 1815 : cluster [DBG] osdmap e237: 8 total, 8 up, 8 in 2024-02-13T00:40:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:35 smithi080 bash[24237]: audit 2024-02-13T00:40:34.269559+0000 mon.c (mon.2) 313 : audit [INF] from='client.? 172.21.15.80:0/799962741' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi080-54175-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:35 smithi080 bash[24237]: audit 2024-02-13T00:40:34.727749+0000 mon.a (mon.0) 1816 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi080-54175-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:36.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:36 smithi106 bash[18459]: cluster 2024-02-13T00:40:35.714729+0000 mon.a (mon.0) 1817 : cluster [DBG] osdmap e238: 8 total, 8 up, 8 in 2024-02-13T00:40:36.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:36 smithi106 bash[18459]: audit 2024-02-13T00:40:35.716238+0000 mon.a (mon.0) 1818 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:36.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:36 smithi106 bash[18459]: audit 2024-02-13T00:40:35.716932+0000 mon.a (mon.0) 1819 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi080-54183-48"}]: dispatch 2024-02-13T00:40:36.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:36 smithi080 bash[17386]: cluster 2024-02-13T00:40:35.714729+0000 mon.a (mon.0) 1817 : cluster [DBG] osdmap e238: 8 total, 8 up, 8 in 2024-02-13T00:40:36.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:36 smithi080 bash[17386]: audit 2024-02-13T00:40:35.716238+0000 mon.a (mon.0) 1818 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:36.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:36 smithi080 bash[17386]: audit 2024-02-13T00:40:35.716932+0000 mon.a (mon.0) 1819 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi080-54183-48"}]: dispatch 2024-02-13T00:40:36.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:36 smithi080 bash[24237]: cluster 2024-02-13T00:40:35.714729+0000 mon.a (mon.0) 1817 : cluster [DBG] osdmap e238: 8 total, 8 up, 8 in 2024-02-13T00:40:36.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:36 smithi080 bash[24237]: audit 2024-02-13T00:40:35.716238+0000 mon.a (mon.0) 1818 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:36.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:36 smithi080 bash[24237]: audit 2024-02-13T00:40:35.716932+0000 mon.a (mon.0) 1819 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi080-54183-48"}]: dispatch 2024-02-13T00:40:37.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:37 smithi106 bash[18459]: cluster 2024-02-13T00:40:36.216874+0000 mgr.y (mgr.24461) 435 : cluster [DBG] pgmap v489: 228 pgs: 32 unknown, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:40:37.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:37 smithi106 bash[18459]: audit 2024-02-13T00:40:36.291384+0000 mon.a (mon.0) 1820 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi080-54175-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi080-54175-39"}]': finished 2024-02-13T00:40:37.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:37 smithi106 bash[18459]: audit 2024-02-13T00:40:36.291592+0000 mon.a (mon.0) 1821 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:37.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:37 smithi106 bash[18459]: audit 2024-02-13T00:40:36.291665+0000 mon.a (mon.0) 1822 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi080-54183-48"}]': finished 2024-02-13T00:40:37.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:37 smithi106 bash[18459]: cluster 2024-02-13T00:40:36.291796+0000 mon.a (mon.0) 1823 : cluster [DBG] osdmap e239: 8 total, 8 up, 8 in 2024-02-13T00:40:37.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:37 smithi106 bash[18459]: audit 2024-02-13T00:40:36.296649+0000 mon.a (mon.0) 1824 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi080-54183-48"}]: dispatch 2024-02-13T00:40:37.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:37 smithi106 bash[18459]: audit 2024-02-13T00:40:36.312957+0000 mon.a (mon.0) 1825 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:40:37.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:37 smithi106 bash[18459]: cluster 2024-02-13T00:40:37.210691+0000 mon.a (mon.0) 1826 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:40:37.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:37 smithi080 bash[24237]: cluster 2024-02-13T00:40:36.216874+0000 mgr.y (mgr.24461) 435 : cluster [DBG] pgmap v489: 228 pgs: 32 unknown, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:40:37.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:37 smithi080 bash[24237]: audit 2024-02-13T00:40:36.291384+0000 mon.a (mon.0) 1820 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi080-54175-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi080-54175-39"}]': finished 2024-02-13T00:40:37.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:37 smithi080 bash[24237]: audit 2024-02-13T00:40:36.291592+0000 mon.a (mon.0) 1821 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:37.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:37 smithi080 bash[24237]: audit 2024-02-13T00:40:36.291665+0000 mon.a (mon.0) 1822 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi080-54183-48"}]': finished 2024-02-13T00:40:37.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:37 smithi080 bash[24237]: cluster 2024-02-13T00:40:36.291796+0000 mon.a (mon.0) 1823 : cluster [DBG] osdmap e239: 8 total, 8 up, 8 in 2024-02-13T00:40:37.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:37 smithi080 bash[24237]: audit 2024-02-13T00:40:36.296649+0000 mon.a (mon.0) 1824 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi080-54183-48"}]: dispatch 2024-02-13T00:40:37.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:37 smithi080 bash[24237]: audit 2024-02-13T00:40:36.312957+0000 mon.a (mon.0) 1825 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:40:37.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:37 smithi080 bash[24237]: cluster 2024-02-13T00:40:37.210691+0000 mon.a (mon.0) 1826 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:40:37.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:37 smithi080 bash[17386]: cluster 2024-02-13T00:40:36.216874+0000 mgr.y (mgr.24461) 435 : cluster [DBG] pgmap v489: 228 pgs: 32 unknown, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:40:37.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:37 smithi080 bash[17386]: audit 2024-02-13T00:40:36.291384+0000 mon.a (mon.0) 1820 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi080-54175-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi080-54175-39"}]': finished 2024-02-13T00:40:37.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:37 smithi080 bash[17386]: audit 2024-02-13T00:40:36.291592+0000 mon.a (mon.0) 1821 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:37.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:37 smithi080 bash[17386]: audit 2024-02-13T00:40:36.291665+0000 mon.a (mon.0) 1822 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi080-54183-48"}]': finished 2024-02-13T00:40:37.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:37 smithi080 bash[17386]: cluster 2024-02-13T00:40:36.291796+0000 mon.a (mon.0) 1823 : cluster [DBG] osdmap e239: 8 total, 8 up, 8 in 2024-02-13T00:40:37.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:37 smithi080 bash[17386]: audit 2024-02-13T00:40:36.296649+0000 mon.a (mon.0) 1824 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi080-54183-48"}]: dispatch 2024-02-13T00:40:37.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:37 smithi080 bash[17386]: audit 2024-02-13T00:40:36.312957+0000 mon.a (mon.0) 1825 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:40:37.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:37 smithi080 bash[17386]: cluster 2024-02-13T00:40:37.210691+0000 mon.a (mon.0) 1826 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:40:38.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:40:38 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:40:38.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:38 smithi106 bash[18459]: audit 2024-02-13T00:40:37.292676+0000 mon.a (mon.0) 1827 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi080-54183-48"}]': finished 2024-02-13T00:40:38.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:38 smithi106 bash[18459]: audit 2024-02-13T00:40:37.292913+0000 mon.a (mon.0) 1828 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-33", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:40:38.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:38 smithi106 bash[18459]: cluster 2024-02-13T00:40:37.292986+0000 mon.a (mon.0) 1829 : cluster [DBG] osdmap e240: 8 total, 8 up, 8 in 2024-02-13T00:40:38.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:38 smithi106 bash[18459]: audit 2024-02-13T00:40:37.297285+0000 mon.a (mon.0) 1830 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-33"}]: dispatch 2024-02-13T00:40:38.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:38 smithi106 bash[18459]: audit 2024-02-13T00:40:37.320952+0000 mon.a (mon.0) 1831 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi080-54183-49"}]: dispatch 2024-02-13T00:40:38.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:38 smithi106 bash[18459]: audit 2024-02-13T00:40:37.322072+0000 mon.a (mon.0) 1832 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi080-54183-49"}]: dispatch 2024-02-13T00:40:38.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:38 smithi106 bash[18459]: audit 2024-02-13T00:40:37.322562+0000 mon.a (mon.0) 1833 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi080-54183-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:38.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:38 smithi106 bash[18459]: audit 2024-02-13T00:40:38.293945+0000 mon.a (mon.0) 1834 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-33"}]': finished 2024-02-13T00:40:38.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:38 smithi106 bash[18459]: audit 2024-02-13T00:40:38.294118+0000 mon.a (mon.0) 1835 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi080-54183-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:38.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:38 smithi106 bash[18459]: cluster 2024-02-13T00:40:38.294227+0000 mon.a (mon.0) 1836 : cluster [DBG] osdmap e241: 8 total, 8 up, 8 in 2024-02-13T00:40:38.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:38 smithi106 bash[18459]: audit 2024-02-13T00:40:38.295168+0000 mon.a (mon.0) 1837 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-33", "mode": "writeback"}]: dispatch 2024-02-13T00:40:38.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:38 smithi106 bash[18459]: audit 2024-02-13T00:40:38.296358+0000 mon.a (mon.0) 1838 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi080-54183-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi080-54183-49"}]: dispatch 2024-02-13T00:40:38.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[24237]: audit 2024-02-13T00:40:37.292676+0000 mon.a (mon.0) 1827 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi080-54183-48"}]': finished 2024-02-13T00:40:38.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[24237]: audit 2024-02-13T00:40:37.292913+0000 mon.a (mon.0) 1828 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-33", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:40:38.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[24237]: cluster 2024-02-13T00:40:37.292986+0000 mon.a (mon.0) 1829 : cluster [DBG] osdmap e240: 8 total, 8 up, 8 in 2024-02-13T00:40:38.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[24237]: audit 2024-02-13T00:40:37.297285+0000 mon.a (mon.0) 1830 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-33"}]: dispatch 2024-02-13T00:40:38.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[24237]: audit 2024-02-13T00:40:37.320952+0000 mon.a (mon.0) 1831 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi080-54183-49"}]: dispatch 2024-02-13T00:40:38.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[24237]: audit 2024-02-13T00:40:37.322072+0000 mon.a (mon.0) 1832 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi080-54183-49"}]: dispatch 2024-02-13T00:40:38.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[24237]: audit 2024-02-13T00:40:37.322562+0000 mon.a (mon.0) 1833 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi080-54183-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:38.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[24237]: audit 2024-02-13T00:40:38.293945+0000 mon.a (mon.0) 1834 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-33"}]': finished 2024-02-13T00:40:38.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[24237]: audit 2024-02-13T00:40:38.294118+0000 mon.a (mon.0) 1835 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi080-54183-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:38.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[24237]: cluster 2024-02-13T00:40:38.294227+0000 mon.a (mon.0) 1836 : cluster [DBG] osdmap e241: 8 total, 8 up, 8 in 2024-02-13T00:40:38.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[24237]: audit 2024-02-13T00:40:38.295168+0000 mon.a (mon.0) 1837 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-33", "mode": "writeback"}]: dispatch 2024-02-13T00:40:38.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[24237]: audit 2024-02-13T00:40:38.296358+0000 mon.a (mon.0) 1838 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi080-54183-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi080-54183-49"}]: dispatch 2024-02-13T00:40:38.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[17386]: audit 2024-02-13T00:40:37.292676+0000 mon.a (mon.0) 1827 : audit [INF] from='client.? 172.21.15.80:0/143283192' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi080-54183-48"}]': finished 2024-02-13T00:40:38.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[17386]: audit 2024-02-13T00:40:37.292913+0000 mon.a (mon.0) 1828 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-33", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:40:38.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[17386]: cluster 2024-02-13T00:40:37.292986+0000 mon.a (mon.0) 1829 : cluster [DBG] osdmap e240: 8 total, 8 up, 8 in 2024-02-13T00:40:38.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[17386]: audit 2024-02-13T00:40:37.297285+0000 mon.a (mon.0) 1830 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-33"}]: dispatch 2024-02-13T00:40:38.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[17386]: audit 2024-02-13T00:40:37.320952+0000 mon.a (mon.0) 1831 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi080-54183-49"}]: dispatch 2024-02-13T00:40:38.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[17386]: audit 2024-02-13T00:40:37.322072+0000 mon.a (mon.0) 1832 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi080-54183-49"}]: dispatch 2024-02-13T00:40:38.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[17386]: audit 2024-02-13T00:40:37.322562+0000 mon.a (mon.0) 1833 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi080-54183-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:38.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[17386]: audit 2024-02-13T00:40:38.293945+0000 mon.a (mon.0) 1834 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-33"}]': finished 2024-02-13T00:40:38.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[17386]: audit 2024-02-13T00:40:38.294118+0000 mon.a (mon.0) 1835 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi080-54183-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:38.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[17386]: cluster 2024-02-13T00:40:38.294227+0000 mon.a (mon.0) 1836 : cluster [DBG] osdmap e241: 8 total, 8 up, 8 in 2024-02-13T00:40:38.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[17386]: audit 2024-02-13T00:40:38.295168+0000 mon.a (mon.0) 1837 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-33", "mode": "writeback"}]: dispatch 2024-02-13T00:40:38.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:38 smithi080 bash[17386]: audit 2024-02-13T00:40:38.296358+0000 mon.a (mon.0) 1838 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi080-54183-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi080-54183-49"}]: dispatch 2024-02-13T00:40:40.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:39 smithi106 bash[18459]: cluster 2024-02-13T00:40:38.218907+0000 mgr.y (mgr.24461) 436 : cluster [DBG] pgmap v492: 236 pgs: 236 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:40:40.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:39 smithi106 bash[18459]: audit 2024-02-13T00:40:38.252785+0000 mgr.y (mgr.24461) 437 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:40:40.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:39 smithi106 bash[18459]: audit 2024-02-13T00:40:38.300195+0000 mon.c (mon.2) 314 : audit [INF] from='client.? 172.21.15.80:0/799962741' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:40.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:39 smithi106 bash[18459]: audit 2024-02-13T00:40:38.304965+0000 mon.a (mon.0) 1839 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:40.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:39 smithi106 bash[18459]: cluster 2024-02-13T00:40:39.290489+0000 mon.a (mon.0) 1840 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:40:40.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:39 smithi106 bash[18459]: audit 2024-02-13T00:40:39.299718+0000 mon.a (mon.0) 1841 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-33", "mode": "writeback"}]': finished 2024-02-13T00:40:40.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:39 smithi080 bash[17386]: cluster 2024-02-13T00:40:38.218907+0000 mgr.y (mgr.24461) 436 : cluster [DBG] pgmap v492: 236 pgs: 236 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:40:40.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:39 smithi080 bash[17386]: audit 2024-02-13T00:40:38.252785+0000 mgr.y (mgr.24461) 437 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:40:40.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:39 smithi080 bash[17386]: audit 2024-02-13T00:40:38.300195+0000 mon.c (mon.2) 314 : audit [INF] from='client.? 172.21.15.80:0/799962741' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:40.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:39 smithi080 bash[17386]: audit 2024-02-13T00:40:38.304965+0000 mon.a (mon.0) 1839 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:40.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:39 smithi080 bash[17386]: cluster 2024-02-13T00:40:39.290489+0000 mon.a (mon.0) 1840 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:40:40.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:39 smithi080 bash[17386]: audit 2024-02-13T00:40:39.299718+0000 mon.a (mon.0) 1841 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-33", "mode": "writeback"}]': finished 2024-02-13T00:40:40.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:39 smithi080 bash[24237]: cluster 2024-02-13T00:40:38.218907+0000 mgr.y (mgr.24461) 436 : cluster [DBG] pgmap v492: 236 pgs: 236 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:40:40.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:39 smithi080 bash[24237]: audit 2024-02-13T00:40:38.252785+0000 mgr.y (mgr.24461) 437 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:40:40.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:39 smithi080 bash[24237]: audit 2024-02-13T00:40:38.300195+0000 mon.c (mon.2) 314 : audit [INF] from='client.? 172.21.15.80:0/799962741' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:40.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:39 smithi080 bash[24237]: audit 2024-02-13T00:40:38.304965+0000 mon.a (mon.0) 1839 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:40.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:39 smithi080 bash[24237]: cluster 2024-02-13T00:40:39.290489+0000 mon.a (mon.0) 1840 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:40:40.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:39 smithi080 bash[24237]: audit 2024-02-13T00:40:39.299718+0000 mon.a (mon.0) 1841 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-33", "mode": "writeback"}]': finished 2024-02-13T00:40:40.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:40:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:40:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:40:41.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:40 smithi106 bash[18459]: audit 2024-02-13T00:40:39.719705+0000 mon.a (mon.0) 1842 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi080-54175-39"}]': finished 2024-02-13T00:40:41.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:40 smithi106 bash[18459]: cluster 2024-02-13T00:40:39.719960+0000 mon.a (mon.0) 1843 : cluster [DBG] osdmap e242: 8 total, 8 up, 8 in 2024-02-13T00:40:41.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:40 smithi106 bash[18459]: audit 2024-02-13T00:40:39.720995+0000 mon.c (mon.2) 315 : audit [INF] from='client.? 172.21.15.80:0/799962741' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:41.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:40 smithi106 bash[18459]: audit 2024-02-13T00:40:39.722310+0000 mon.a (mon.0) 1844 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:41.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:40 smithi106 bash[18459]: audit 2024-02-13T00:40:40.302169+0000 mon.a (mon.0) 1845 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi080-54183-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi080-54183-49"}]': finished 2024-02-13T00:40:41.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:40 smithi106 bash[18459]: audit 2024-02-13T00:40:40.302466+0000 mon.a (mon.0) 1846 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi080-54175-39"}]': finished 2024-02-13T00:40:41.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:40 smithi106 bash[18459]: cluster 2024-02-13T00:40:40.302587+0000 mon.a (mon.0) 1847 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2024-02-13T00:40:41.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:40 smithi106 bash[18459]: audit 2024-02-13T00:40:40.327867+0000 mon.a (mon.0) 1848 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi080-54175-40"}]: dispatch 2024-02-13T00:40:41.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:40 smithi106 bash[18459]: audit 2024-02-13T00:40:40.328966+0000 mon.a (mon.0) 1849 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi080-54175-40"}]: dispatch 2024-02-13T00:40:41.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:40 smithi106 bash[18459]: audit 2024-02-13T00:40:40.329472+0000 mon.a (mon.0) 1850 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi080-54175-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:41.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:40 smithi080 bash[17386]: audit 2024-02-13T00:40:39.719705+0000 mon.a (mon.0) 1842 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi080-54175-39"}]': finished 2024-02-13T00:40:41.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:40 smithi080 bash[17386]: cluster 2024-02-13T00:40:39.719960+0000 mon.a (mon.0) 1843 : cluster [DBG] osdmap e242: 8 total, 8 up, 8 in 2024-02-13T00:40:41.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:40 smithi080 bash[17386]: audit 2024-02-13T00:40:39.720995+0000 mon.c (mon.2) 315 : audit [INF] from='client.? 172.21.15.80:0/799962741' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:41.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:40 smithi080 bash[17386]: audit 2024-02-13T00:40:39.722310+0000 mon.a (mon.0) 1844 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:41.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:40 smithi080 bash[17386]: audit 2024-02-13T00:40:40.302169+0000 mon.a (mon.0) 1845 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi080-54183-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi080-54183-49"}]': finished 2024-02-13T00:40:41.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:40 smithi080 bash[17386]: audit 2024-02-13T00:40:40.302466+0000 mon.a (mon.0) 1846 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi080-54175-39"}]': finished 2024-02-13T00:40:41.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:40 smithi080 bash[17386]: cluster 2024-02-13T00:40:40.302587+0000 mon.a (mon.0) 1847 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2024-02-13T00:40:41.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:40 smithi080 bash[17386]: audit 2024-02-13T00:40:40.327867+0000 mon.a (mon.0) 1848 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi080-54175-40"}]: dispatch 2024-02-13T00:40:41.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:40 smithi080 bash[17386]: audit 2024-02-13T00:40:40.328966+0000 mon.a (mon.0) 1849 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi080-54175-40"}]: dispatch 2024-02-13T00:40:41.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:40 smithi080 bash[17386]: audit 2024-02-13T00:40:40.329472+0000 mon.a (mon.0) 1850 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi080-54175-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:41.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:40 smithi080 bash[24237]: audit 2024-02-13T00:40:39.719705+0000 mon.a (mon.0) 1842 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi080-54175-39"}]': finished 2024-02-13T00:40:41.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:40 smithi080 bash[24237]: cluster 2024-02-13T00:40:39.719960+0000 mon.a (mon.0) 1843 : cluster [DBG] osdmap e242: 8 total, 8 up, 8 in 2024-02-13T00:40:41.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:40 smithi080 bash[24237]: audit 2024-02-13T00:40:39.720995+0000 mon.c (mon.2) 315 : audit [INF] from='client.? 172.21.15.80:0/799962741' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:41.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:40 smithi080 bash[24237]: audit 2024-02-13T00:40:39.722310+0000 mon.a (mon.0) 1844 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi080-54175-39"}]: dispatch 2024-02-13T00:40:41.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:40 smithi080 bash[24237]: audit 2024-02-13T00:40:40.302169+0000 mon.a (mon.0) 1845 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi080-54183-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi080-54183-49"}]': finished 2024-02-13T00:40:41.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:40 smithi080 bash[24237]: audit 2024-02-13T00:40:40.302466+0000 mon.a (mon.0) 1846 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi080-54175-39"}]': finished 2024-02-13T00:40:41.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:40 smithi080 bash[24237]: cluster 2024-02-13T00:40:40.302587+0000 mon.a (mon.0) 1847 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2024-02-13T00:40:41.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:40 smithi080 bash[24237]: audit 2024-02-13T00:40:40.327867+0000 mon.a (mon.0) 1848 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi080-54175-40"}]: dispatch 2024-02-13T00:40:41.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:40 smithi080 bash[24237]: audit 2024-02-13T00:40:40.328966+0000 mon.a (mon.0) 1849 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi080-54175-40"}]: dispatch 2024-02-13T00:40:41.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:40 smithi080 bash[24237]: audit 2024-02-13T00:40:40.329472+0000 mon.a (mon.0) 1850 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi080-54175-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:42.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:41 smithi106 bash[18459]: cluster 2024-02-13T00:40:40.219752+0000 mgr.y (mgr.24461) 438 : cluster [DBG] pgmap v495: 228 pgs: 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:42.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:41 smithi106 bash[18459]: audit 2024-02-13T00:40:41.305198+0000 mon.a (mon.0) 1851 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi080-54175-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:42.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:41 smithi106 bash[18459]: cluster 2024-02-13T00:40:41.305327+0000 mon.a (mon.0) 1852 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2024-02-13T00:40:42.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:41 smithi106 bash[18459]: audit 2024-02-13T00:40:41.306953+0000 mon.a (mon.0) 1853 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi080-54175-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi080-54175-40"}]: dispatch 2024-02-13T00:40:42.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:41 smithi106 bash[18459]: audit 2024-02-13T00:40:41.374358+0000 mon.a (mon.0) 1854 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:40:42.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:41 smithi080 bash[17386]: cluster 2024-02-13T00:40:40.219752+0000 mgr.y (mgr.24461) 438 : cluster [DBG] pgmap v495: 228 pgs: 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:42.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:41 smithi080 bash[17386]: audit 2024-02-13T00:40:41.305198+0000 mon.a (mon.0) 1851 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi080-54175-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:42.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:41 smithi080 bash[17386]: cluster 2024-02-13T00:40:41.305327+0000 mon.a (mon.0) 1852 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2024-02-13T00:40:42.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:41 smithi080 bash[17386]: audit 2024-02-13T00:40:41.306953+0000 mon.a (mon.0) 1853 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi080-54175-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi080-54175-40"}]: dispatch 2024-02-13T00:40:42.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:41 smithi080 bash[17386]: audit 2024-02-13T00:40:41.374358+0000 mon.a (mon.0) 1854 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:40:42.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:41 smithi080 bash[24237]: cluster 2024-02-13T00:40:40.219752+0000 mgr.y (mgr.24461) 438 : cluster [DBG] pgmap v495: 228 pgs: 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:42.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:41 smithi080 bash[24237]: audit 2024-02-13T00:40:41.305198+0000 mon.a (mon.0) 1851 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi080-54175-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:42.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:41 smithi080 bash[24237]: cluster 2024-02-13T00:40:41.305327+0000 mon.a (mon.0) 1852 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2024-02-13T00:40:42.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:41 smithi080 bash[24237]: audit 2024-02-13T00:40:41.306953+0000 mon.a (mon.0) 1853 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi080-54175-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi080-54175-40"}]: dispatch 2024-02-13T00:40:42.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:41 smithi080 bash[24237]: audit 2024-02-13T00:40:41.374358+0000 mon.a (mon.0) 1854 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:40:43.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:40:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:40:43] "GET /metrics HTTP/1.1" 200 186493 "" "Prometheus/2.33.4" 2024-02-13T00:40:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:43 smithi080 bash[17386]: cluster 2024-02-13T00:40:42.220519+0000 mgr.y (mgr.24461) 439 : cluster [DBG] pgmap v498: 236 pgs: 8 unknown, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:40:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:43 smithi080 bash[17386]: audit 2024-02-13T00:40:42.750937+0000 mon.a (mon.0) 1855 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:40:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:43 smithi080 bash[17386]: cluster 2024-02-13T00:40:42.751142+0000 mon.a (mon.0) 1856 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2024-02-13T00:40:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:43 smithi080 bash[17386]: audit 2024-02-13T00:40:42.752345+0000 mon.a (mon.0) 1857 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi080-54183-49"}]: dispatch 2024-02-13T00:40:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:43 smithi080 bash[17386]: audit 2024-02-13T00:40:42.756219+0000 mon.a (mon.0) 1858 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-33"}]: dispatch 2024-02-13T00:40:43.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:43 smithi080 bash[24237]: cluster 2024-02-13T00:40:42.220519+0000 mgr.y (mgr.24461) 439 : cluster [DBG] pgmap v498: 236 pgs: 8 unknown, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:40:43.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:43 smithi080 bash[24237]: audit 2024-02-13T00:40:42.750937+0000 mon.a (mon.0) 1855 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:40:43.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:43 smithi080 bash[24237]: cluster 2024-02-13T00:40:42.751142+0000 mon.a (mon.0) 1856 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2024-02-13T00:40:43.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:43 smithi080 bash[24237]: audit 2024-02-13T00:40:42.752345+0000 mon.a (mon.0) 1857 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi080-54183-49"}]: dispatch 2024-02-13T00:40:43.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:43 smithi080 bash[24237]: audit 2024-02-13T00:40:42.756219+0000 mon.a (mon.0) 1858 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-33"}]: dispatch 2024-02-13T00:40:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:43 smithi106 bash[18459]: cluster 2024-02-13T00:40:42.220519+0000 mgr.y (mgr.24461) 439 : cluster [DBG] pgmap v498: 236 pgs: 8 unknown, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:40:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:43 smithi106 bash[18459]: audit 2024-02-13T00:40:42.750937+0000 mon.a (mon.0) 1855 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:40:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:43 smithi106 bash[18459]: cluster 2024-02-13T00:40:42.751142+0000 mon.a (mon.0) 1856 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2024-02-13T00:40:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:43 smithi106 bash[18459]: audit 2024-02-13T00:40:42.752345+0000 mon.a (mon.0) 1857 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi080-54183-49"}]: dispatch 2024-02-13T00:40:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:43 smithi106 bash[18459]: audit 2024-02-13T00:40:42.756219+0000 mon.a (mon.0) 1858 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-33"}]: dispatch 2024-02-13T00:40:44.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:44 smithi106 bash[18459]: audit 2024-02-13T00:40:43.321513+0000 mon.a (mon.0) 1859 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi080-54175-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi080-54175-40"}]': finished 2024-02-13T00:40:44.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:44 smithi106 bash[18459]: audit 2024-02-13T00:40:43.321594+0000 mon.a (mon.0) 1860 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi080-54183-49"}]': finished 2024-02-13T00:40:44.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:44 smithi106 bash[18459]: audit 2024-02-13T00:40:43.321642+0000 mon.a (mon.0) 1861 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-33"}]': finished 2024-02-13T00:40:44.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:44 smithi106 bash[18459]: cluster 2024-02-13T00:40:43.321681+0000 mon.a (mon.0) 1862 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2024-02-13T00:40:44.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:44 smithi106 bash[18459]: audit 2024-02-13T00:40:43.323035+0000 mon.a (mon.0) 1863 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi080-54183-49"}]: dispatch 2024-02-13T00:40:44.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:44 smithi080 bash[17386]: audit 2024-02-13T00:40:43.321513+0000 mon.a (mon.0) 1859 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi080-54175-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi080-54175-40"}]': finished 2024-02-13T00:40:44.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:44 smithi080 bash[17386]: audit 2024-02-13T00:40:43.321594+0000 mon.a (mon.0) 1860 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi080-54183-49"}]': finished 2024-02-13T00:40:44.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:44 smithi080 bash[17386]: audit 2024-02-13T00:40:43.321642+0000 mon.a (mon.0) 1861 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-33"}]': finished 2024-02-13T00:40:44.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:44 smithi080 bash[17386]: cluster 2024-02-13T00:40:43.321681+0000 mon.a (mon.0) 1862 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2024-02-13T00:40:44.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:44 smithi080 bash[17386]: audit 2024-02-13T00:40:43.323035+0000 mon.a (mon.0) 1863 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi080-54183-49"}]: dispatch 2024-02-13T00:40:44.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:44 smithi080 bash[24237]: audit 2024-02-13T00:40:43.321513+0000 mon.a (mon.0) 1859 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi080-54175-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi080-54175-40"}]': finished 2024-02-13T00:40:44.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:44 smithi080 bash[24237]: audit 2024-02-13T00:40:43.321594+0000 mon.a (mon.0) 1860 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi080-54183-49"}]': finished 2024-02-13T00:40:44.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:44 smithi080 bash[24237]: audit 2024-02-13T00:40:43.321642+0000 mon.a (mon.0) 1861 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-33"}]': finished 2024-02-13T00:40:44.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:44 smithi080 bash[24237]: cluster 2024-02-13T00:40:43.321681+0000 mon.a (mon.0) 1862 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2024-02-13T00:40:44.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:44 smithi080 bash[24237]: audit 2024-02-13T00:40:43.323035+0000 mon.a (mon.0) 1863 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi080-54183-49"}]: dispatch 2024-02-13T00:40:45.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:45 smithi106 bash[18459]: cluster 2024-02-13T00:40:44.221263+0000 mgr.y (mgr.24461) 440 : cluster [DBG] pgmap v501: 236 pgs: 8 unknown, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-13T00:40:45.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:45 smithi106 bash[18459]: audit 2024-02-13T00:40:44.327953+0000 mon.a (mon.0) 1864 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi080-54183-49"}]': finished 2024-02-13T00:40:45.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:45 smithi106 bash[18459]: cluster 2024-02-13T00:40:44.328176+0000 mon.a (mon.0) 1865 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2024-02-13T00:40:45.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:45 smithi106 bash[18459]: audit 2024-02-13T00:40:44.820718+0000 mon.a (mon.0) 1866 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:40:45.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:45 smithi080 bash[17386]: cluster 2024-02-13T00:40:44.221263+0000 mgr.y (mgr.24461) 440 : cluster [DBG] pgmap v501: 236 pgs: 8 unknown, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-13T00:40:45.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:45 smithi080 bash[17386]: audit 2024-02-13T00:40:44.327953+0000 mon.a (mon.0) 1864 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi080-54183-49"}]': finished 2024-02-13T00:40:45.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:45 smithi080 bash[17386]: cluster 2024-02-13T00:40:44.328176+0000 mon.a (mon.0) 1865 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2024-02-13T00:40:45.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:45 smithi080 bash[17386]: audit 2024-02-13T00:40:44.820718+0000 mon.a (mon.0) 1866 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:40:45.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:45 smithi080 bash[24237]: cluster 2024-02-13T00:40:44.221263+0000 mgr.y (mgr.24461) 440 : cluster [DBG] pgmap v501: 236 pgs: 8 unknown, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-13T00:40:45.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:45 smithi080 bash[24237]: audit 2024-02-13T00:40:44.327953+0000 mon.a (mon.0) 1864 : audit [INF] from='client.? 172.21.15.80:0/2500055096' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi080-54183-49"}]': finished 2024-02-13T00:40:45.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:45 smithi080 bash[24237]: cluster 2024-02-13T00:40:44.328176+0000 mon.a (mon.0) 1865 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2024-02-13T00:40:45.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:45 smithi080 bash[24237]: audit 2024-02-13T00:40:44.820718+0000 mon.a (mon.0) 1866 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:40:46.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:46 smithi106 bash[18459]: audit 2024-02-13T00:40:45.353510+0000 mon.a (mon.0) 1867 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:40:46.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:46 smithi106 bash[18459]: cluster 2024-02-13T00:40:45.353591+0000 mon.a (mon.0) 1868 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2024-02-13T00:40:46.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:46 smithi106 bash[18459]: audit 2024-02-13T00:40:45.354999+0000 mon.a (mon.0) 1869 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-33"}]: dispatch 2024-02-13T00:40:46.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:46 smithi106 bash[18459]: audit 2024-02-13T00:40:45.355599+0000 mon.a (mon.0) 1870 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi080-54175-40"}]: dispatch 2024-02-13T00:40:46.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:46 smithi106 bash[18459]: audit 2024-02-13T00:40:45.363349+0000 mon.c (mon.2) 316 : audit [INF] from='client.? 172.21.15.80:0/198016947' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi080-54183-50","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:46.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:46 smithi106 bash[18459]: audit 2024-02-13T00:40:45.367365+0000 mon.a (mon.0) 1871 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi080-54183-50","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:46.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:46 smithi080 bash[17386]: audit 2024-02-13T00:40:45.353510+0000 mon.a (mon.0) 1867 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:40:46.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:46 smithi080 bash[17386]: cluster 2024-02-13T00:40:45.353591+0000 mon.a (mon.0) 1868 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2024-02-13T00:40:46.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:46 smithi080 bash[17386]: audit 2024-02-13T00:40:45.354999+0000 mon.a (mon.0) 1869 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-33"}]: dispatch 2024-02-13T00:40:46.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:46 smithi080 bash[17386]: audit 2024-02-13T00:40:45.355599+0000 mon.a (mon.0) 1870 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi080-54175-40"}]: dispatch 2024-02-13T00:40:46.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:46 smithi080 bash[17386]: audit 2024-02-13T00:40:45.363349+0000 mon.c (mon.2) 316 : audit [INF] from='client.? 172.21.15.80:0/198016947' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi080-54183-50","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:46.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:46 smithi080 bash[17386]: audit 2024-02-13T00:40:45.367365+0000 mon.a (mon.0) 1871 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi080-54183-50","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:46.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:46 smithi080 bash[24237]: audit 2024-02-13T00:40:45.353510+0000 mon.a (mon.0) 1867 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:40:46.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:46 smithi080 bash[24237]: cluster 2024-02-13T00:40:45.353591+0000 mon.a (mon.0) 1868 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2024-02-13T00:40:46.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:46 smithi080 bash[24237]: audit 2024-02-13T00:40:45.354999+0000 mon.a (mon.0) 1869 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-33"}]: dispatch 2024-02-13T00:40:46.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:46 smithi080 bash[24237]: audit 2024-02-13T00:40:45.355599+0000 mon.a (mon.0) 1870 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi080-54175-40"}]: dispatch 2024-02-13T00:40:46.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:46 smithi080 bash[24237]: audit 2024-02-13T00:40:45.363349+0000 mon.c (mon.2) 316 : audit [INF] from='client.? 172.21.15.80:0/198016947' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi080-54183-50","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:46.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:46 smithi080 bash[24237]: audit 2024-02-13T00:40:45.367365+0000 mon.a (mon.0) 1871 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi080-54183-50","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:47.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:47 smithi106 bash[18459]: cluster 2024-02-13T00:40:46.222040+0000 mgr.y (mgr.24461) 441 : cluster [DBG] pgmap v504: 260 pgs: 32 unknown, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-13T00:40:47.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:47 smithi106 bash[18459]: cluster 2024-02-13T00:40:46.349889+0000 mon.a (mon.0) 1872 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:40:47.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:47 smithi106 bash[18459]: audit 2024-02-13T00:40:46.361840+0000 mon.a (mon.0) 1873 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-33"}]': finished 2024-02-13T00:40:47.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:47 smithi106 bash[18459]: audit 2024-02-13T00:40:46.361945+0000 mon.a (mon.0) 1874 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi080-54175-40"}]': finished 2024-02-13T00:40:47.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:47 smithi106 bash[18459]: audit 2024-02-13T00:40:46.362142+0000 mon.a (mon.0) 1875 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi080-54183-50","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:47.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:47 smithi106 bash[18459]: cluster 2024-02-13T00:40:46.362264+0000 mon.a (mon.0) 1876 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2024-02-13T00:40:47.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:47 smithi106 bash[18459]: audit 2024-02-13T00:40:46.364737+0000 mon.a (mon.0) 1877 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi080-54175-40"}]: dispatch 2024-02-13T00:40:47.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:47 smithi106 bash[18459]: audit 2024-02-13T00:40:46.917260+0000 mon.a (mon.0) 1878 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:40:47.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:47 smithi080 bash[17386]: cluster 2024-02-13T00:40:46.222040+0000 mgr.y (mgr.24461) 441 : cluster [DBG] pgmap v504: 260 pgs: 32 unknown, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-13T00:40:47.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:47 smithi080 bash[17386]: cluster 2024-02-13T00:40:46.349889+0000 mon.a (mon.0) 1872 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:40:47.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:47 smithi080 bash[17386]: audit 2024-02-13T00:40:46.361840+0000 mon.a (mon.0) 1873 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-33"}]': finished 2024-02-13T00:40:47.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:47 smithi080 bash[17386]: audit 2024-02-13T00:40:46.361945+0000 mon.a (mon.0) 1874 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi080-54175-40"}]': finished 2024-02-13T00:40:47.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:47 smithi080 bash[17386]: audit 2024-02-13T00:40:46.362142+0000 mon.a (mon.0) 1875 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi080-54183-50","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:47.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:47 smithi080 bash[17386]: cluster 2024-02-13T00:40:46.362264+0000 mon.a (mon.0) 1876 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2024-02-13T00:40:47.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:47 smithi080 bash[17386]: audit 2024-02-13T00:40:46.364737+0000 mon.a (mon.0) 1877 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi080-54175-40"}]: dispatch 2024-02-13T00:40:47.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:47 smithi080 bash[17386]: audit 2024-02-13T00:40:46.917260+0000 mon.a (mon.0) 1878 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:40:47.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:47 smithi080 bash[24237]: cluster 2024-02-13T00:40:46.222040+0000 mgr.y (mgr.24461) 441 : cluster [DBG] pgmap v504: 260 pgs: 32 unknown, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-13T00:40:47.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:47 smithi080 bash[24237]: cluster 2024-02-13T00:40:46.349889+0000 mon.a (mon.0) 1872 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:40:47.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:47 smithi080 bash[24237]: audit 2024-02-13T00:40:46.361840+0000 mon.a (mon.0) 1873 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-33"}]': finished 2024-02-13T00:40:47.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:47 smithi080 bash[24237]: audit 2024-02-13T00:40:46.361945+0000 mon.a (mon.0) 1874 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi080-54175-40"}]': finished 2024-02-13T00:40:47.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:47 smithi080 bash[24237]: audit 2024-02-13T00:40:46.362142+0000 mon.a (mon.0) 1875 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi080-54183-50","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:47.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:47 smithi080 bash[24237]: cluster 2024-02-13T00:40:46.362264+0000 mon.a (mon.0) 1876 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2024-02-13T00:40:47.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:47 smithi080 bash[24237]: audit 2024-02-13T00:40:46.364737+0000 mon.a (mon.0) 1877 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi080-54175-40"}]: dispatch 2024-02-13T00:40:47.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:47 smithi080 bash[24237]: audit 2024-02-13T00:40:46.917260+0000 mon.a (mon.0) 1878 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:40:48.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:40:48 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:40:48.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:48 smithi106 bash[18459]: audit 2024-02-13T00:40:47.365786+0000 mon.a (mon.0) 1879 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi080-54175-40"}]': finished 2024-02-13T00:40:48.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:48 smithi106 bash[18459]: cluster 2024-02-13T00:40:47.365971+0000 mon.a (mon.0) 1880 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2024-02-13T00:40:48.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:48 smithi106 bash[18459]: audit 2024-02-13T00:40:47.403120+0000 mon.c (mon.2) 317 : audit [INF] from='client.? 172.21.15.80:0/96657013' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:48.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:48 smithi106 bash[18459]: audit 2024-02-13T00:40:47.405507+0000 mon.b (mon.1) 72 : audit [INF] from='client.? 172.21.15.80:0/1339299481' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:48.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:48 smithi106 bash[18459]: audit 2024-02-13T00:40:47.830144+0000 mon.a (mon.0) 1881 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:48.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:48 smithi106 bash[18459]: audit 2024-02-13T00:40:47.830818+0000 mon.a (mon.0) 1882 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:48.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:48 smithi106 bash[18459]: audit 2024-02-13T00:40:47.831499+0000 mon.c (mon.2) 318 : audit [INF] from='client.? 172.21.15.80:0/96657013' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:48.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:48 smithi106 bash[18459]: audit 2024-02-13T00:40:47.832068+0000 mon.a (mon.0) 1883 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:48.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:48 smithi106 bash[18459]: audit 2024-02-13T00:40:47.832854+0000 mon.b (mon.1) 73 : audit [INF] from='client.? 172.21.15.80:0/1339299481' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:48.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:48 smithi106 bash[18459]: audit 2024-02-13T00:40:47.833160+0000 mon.a (mon.0) 1884 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:48.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:48 smithi106 bash[18459]: audit 2024-02-13T00:40:47.833195+0000 mon.c (mon.2) 319 : audit [INF] from='client.? 172.21.15.80:0/96657013' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi080-54175-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:48.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:48 smithi106 bash[18459]: audit 2024-02-13T00:40:47.834237+0000 mon.a (mon.0) 1885 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi080-54175-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:48.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:48 smithi106 bash[18459]: audit 2024-02-13T00:40:47.834990+0000 mon.b (mon.1) 74 : audit [INF] from='client.? 172.21.15.80:0/1339299481' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:48.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:48 smithi106 bash[18459]: audit 2024-02-13T00:40:47.835281+0000 mon.a (mon.0) 1886 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:48.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[17386]: audit 2024-02-13T00:40:47.365786+0000 mon.a (mon.0) 1879 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi080-54175-40"}]': finished 2024-02-13T00:40:48.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[17386]: cluster 2024-02-13T00:40:47.365971+0000 mon.a (mon.0) 1880 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2024-02-13T00:40:48.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[17386]: audit 2024-02-13T00:40:47.403120+0000 mon.c (mon.2) 317 : audit [INF] from='client.? 172.21.15.80:0/96657013' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:48.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[17386]: audit 2024-02-13T00:40:47.405507+0000 mon.b (mon.1) 72 : audit [INF] from='client.? 172.21.15.80:0/1339299481' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:48.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[17386]: audit 2024-02-13T00:40:47.830144+0000 mon.a (mon.0) 1881 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:48.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[17386]: audit 2024-02-13T00:40:47.830818+0000 mon.a (mon.0) 1882 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:48.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[17386]: audit 2024-02-13T00:40:47.831499+0000 mon.c (mon.2) 318 : audit [INF] from='client.? 172.21.15.80:0/96657013' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:48.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[17386]: audit 2024-02-13T00:40:47.832068+0000 mon.a (mon.0) 1883 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:48.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[17386]: audit 2024-02-13T00:40:47.832854+0000 mon.b (mon.1) 73 : audit [INF] from='client.? 172.21.15.80:0/1339299481' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:48.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[17386]: audit 2024-02-13T00:40:47.833160+0000 mon.a (mon.0) 1884 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:48.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[17386]: audit 2024-02-13T00:40:47.833195+0000 mon.c (mon.2) 319 : audit [INF] from='client.? 172.21.15.80:0/96657013' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi080-54175-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:48.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[17386]: audit 2024-02-13T00:40:47.834237+0000 mon.a (mon.0) 1885 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi080-54175-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:48.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[17386]: audit 2024-02-13T00:40:47.834990+0000 mon.b (mon.1) 74 : audit [INF] from='client.? 172.21.15.80:0/1339299481' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:48.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[17386]: audit 2024-02-13T00:40:47.835281+0000 mon.a (mon.0) 1886 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:48.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[24237]: audit 2024-02-13T00:40:47.365786+0000 mon.a (mon.0) 1879 : audit [INF] from='client.? 172.21.15.80:0/1914516479' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi080-54175-40"}]': finished 2024-02-13T00:40:48.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[24237]: cluster 2024-02-13T00:40:47.365971+0000 mon.a (mon.0) 1880 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2024-02-13T00:40:48.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[24237]: audit 2024-02-13T00:40:47.403120+0000 mon.c (mon.2) 317 : audit [INF] from='client.? 172.21.15.80:0/96657013' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:48.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[24237]: audit 2024-02-13T00:40:47.405507+0000 mon.b (mon.1) 72 : audit [INF] from='client.? 172.21.15.80:0/1339299481' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:48.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[24237]: audit 2024-02-13T00:40:47.830144+0000 mon.a (mon.0) 1881 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:48.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[24237]: audit 2024-02-13T00:40:47.830818+0000 mon.a (mon.0) 1882 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:48.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[24237]: audit 2024-02-13T00:40:47.831499+0000 mon.c (mon.2) 318 : audit [INF] from='client.? 172.21.15.80:0/96657013' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:48.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[24237]: audit 2024-02-13T00:40:47.832068+0000 mon.a (mon.0) 1883 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:48.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[24237]: audit 2024-02-13T00:40:47.832854+0000 mon.b (mon.1) 73 : audit [INF] from='client.? 172.21.15.80:0/1339299481' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:48.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[24237]: audit 2024-02-13T00:40:47.833160+0000 mon.a (mon.0) 1884 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:48.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[24237]: audit 2024-02-13T00:40:47.833195+0000 mon.c (mon.2) 319 : audit [INF] from='client.? 172.21.15.80:0/96657013' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi080-54175-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:48.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[24237]: audit 2024-02-13T00:40:47.834237+0000 mon.a (mon.0) 1885 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi080-54175-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:48.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[24237]: audit 2024-02-13T00:40:47.834990+0000 mon.b (mon.1) 74 : audit [INF] from='client.? 172.21.15.80:0/1339299481' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:48.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:48 smithi080 bash[24237]: audit 2024-02-13T00:40:47.835281+0000 mon.a (mon.0) 1886 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:50.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:40:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:40:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:40:50.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:50 smithi106 bash[18459]: cluster 2024-02-13T00:40:48.223962+0000 mgr.y (mgr.24461) 442 : cluster [DBG] pgmap v507: 196 pgs: 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:50.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:50 smithi106 bash[18459]: audit 2024-02-13T00:40:48.256540+0000 mgr.y (mgr.24461) 443 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:40:50.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:50 smithi106 bash[18459]: audit 2024-02-13T00:40:48.380340+0000 mon.a (mon.0) 1887 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi080-54175-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:50 smithi106 bash[18459]: audit 2024-02-13T00:40:48.380455+0000 mon.a (mon.0) 1888 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:50 smithi106 bash[18459]: cluster 2024-02-13T00:40:48.380558+0000 mon.a (mon.0) 1889 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2024-02-13T00:40:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:50 smithi106 bash[18459]: audit 2024-02-13T00:40:48.382496+0000 mon.c (mon.2) 320 : audit [INF] from='client.? 172.21.15.80:0/96657013' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi080-54175-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:50 smithi106 bash[18459]: audit 2024-02-13T00:40:48.382886+0000 mon.b (mon.1) 75 : audit [INF] from='client.? 172.21.15.80:0/1339299481' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi080-54183-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:50 smithi106 bash[18459]: audit 2024-02-13T00:40:48.389938+0000 mon.a (mon.0) 1890 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi080-54183-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:50 smithi106 bash[18459]: audit 2024-02-13T00:40:48.390700+0000 mon.a (mon.0) 1891 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi080-54175-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:50 smithi106 bash[18459]: audit 2024-02-13T00:40:48.391448+0000 mon.a (mon.0) 1892 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:50.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:50 smithi080 bash[24237]: cluster 2024-02-13T00:40:48.223962+0000 mgr.y (mgr.24461) 442 : cluster [DBG] pgmap v507: 196 pgs: 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:50.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:50 smithi080 bash[24237]: audit 2024-02-13T00:40:48.256540+0000 mgr.y (mgr.24461) 443 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:40:50.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:50 smithi080 bash[24237]: audit 2024-02-13T00:40:48.380340+0000 mon.a (mon.0) 1887 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi080-54175-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:50.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:50 smithi080 bash[24237]: audit 2024-02-13T00:40:48.380455+0000 mon.a (mon.0) 1888 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:50.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:50 smithi080 bash[24237]: cluster 2024-02-13T00:40:48.380558+0000 mon.a (mon.0) 1889 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2024-02-13T00:40:50.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:50 smithi080 bash[24237]: audit 2024-02-13T00:40:48.382496+0000 mon.c (mon.2) 320 : audit [INF] from='client.? 172.21.15.80:0/96657013' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi080-54175-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:50.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:50 smithi080 bash[24237]: audit 2024-02-13T00:40:48.382886+0000 mon.b (mon.1) 75 : audit [INF] from='client.? 172.21.15.80:0/1339299481' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi080-54183-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:50.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:50 smithi080 bash[24237]: audit 2024-02-13T00:40:48.389938+0000 mon.a (mon.0) 1890 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi080-54183-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:50.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:50 smithi080 bash[24237]: audit 2024-02-13T00:40:48.390700+0000 mon.a (mon.0) 1891 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi080-54175-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:50.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:50 smithi080 bash[24237]: audit 2024-02-13T00:40:48.391448+0000 mon.a (mon.0) 1892 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:50.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:50 smithi080 bash[17386]: cluster 2024-02-13T00:40:48.223962+0000 mgr.y (mgr.24461) 442 : cluster [DBG] pgmap v507: 196 pgs: 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:50.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:50 smithi080 bash[17386]: audit 2024-02-13T00:40:48.256540+0000 mgr.y (mgr.24461) 443 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:40:50.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:50 smithi080 bash[17386]: audit 2024-02-13T00:40:48.380340+0000 mon.a (mon.0) 1887 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi080-54175-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:50.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:50 smithi080 bash[17386]: audit 2024-02-13T00:40:48.380455+0000 mon.a (mon.0) 1888 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:50.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:50 smithi080 bash[17386]: cluster 2024-02-13T00:40:48.380558+0000 mon.a (mon.0) 1889 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2024-02-13T00:40:50.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:50 smithi080 bash[17386]: audit 2024-02-13T00:40:48.382496+0000 mon.c (mon.2) 320 : audit [INF] from='client.? 172.21.15.80:0/96657013' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi080-54175-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:50.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:50 smithi080 bash[17386]: audit 2024-02-13T00:40:48.382886+0000 mon.b (mon.1) 75 : audit [INF] from='client.? 172.21.15.80:0/1339299481' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi080-54183-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:50.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:50 smithi080 bash[17386]: audit 2024-02-13T00:40:48.389938+0000 mon.a (mon.0) 1890 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi080-54183-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:50.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:50 smithi080 bash[17386]: audit 2024-02-13T00:40:48.390700+0000 mon.a (mon.0) 1891 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi080-54175-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:50.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:50 smithi080 bash[17386]: audit 2024-02-13T00:40:48.391448+0000 mon.a (mon.0) 1892 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:51.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:51 smithi106 bash[18459]: cluster 2024-02-13T00:40:50.224748+0000 mgr.y (mgr.24461) 444 : cluster [DBG] pgmap v510: 228 pgs: 32 unknown, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:51.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:51 smithi106 bash[18459]: audit 2024-02-13T00:40:50.224907+0000 mon.a (mon.0) 1893 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:51.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:51 smithi106 bash[18459]: cluster 2024-02-13T00:40:50.225227+0000 mon.a (mon.0) 1894 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2024-02-13T00:40:51.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:51 smithi106 bash[18459]: audit 2024-02-13T00:40:50.228876+0000 mon.a (mon.0) 1895 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:40:51.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:51 smithi106 bash[18459]: audit 2024-02-13T00:40:50.391326+0000 mon.a (mon.0) 1896 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi080-54183-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]': finished 2024-02-13T00:40:51.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:51 smithi106 bash[18459]: audit 2024-02-13T00:40:50.391451+0000 mon.a (mon.0) 1897 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi080-54175-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi080-54175-41"}]': finished 2024-02-13T00:40:51.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:51 smithi106 bash[18459]: audit 2024-02-13T00:40:50.391568+0000 mon.a (mon.0) 1898 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-35", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:40:51.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:51 smithi106 bash[18459]: cluster 2024-02-13T00:40:50.391641+0000 mon.a (mon.0) 1899 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2024-02-13T00:40:51.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:51 smithi106 bash[18459]: audit 2024-02-13T00:40:50.393733+0000 mon.a (mon.0) 1900 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-35"}]: dispatch 2024-02-13T00:40:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:51 smithi080 bash[17386]: cluster 2024-02-13T00:40:50.224748+0000 mgr.y (mgr.24461) 444 : cluster [DBG] pgmap v510: 228 pgs: 32 unknown, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:51 smithi080 bash[17386]: audit 2024-02-13T00:40:50.224907+0000 mon.a (mon.0) 1893 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:51 smithi080 bash[17386]: cluster 2024-02-13T00:40:50.225227+0000 mon.a (mon.0) 1894 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2024-02-13T00:40:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:51 smithi080 bash[17386]: audit 2024-02-13T00:40:50.228876+0000 mon.a (mon.0) 1895 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:40:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:51 smithi080 bash[17386]: audit 2024-02-13T00:40:50.391326+0000 mon.a (mon.0) 1896 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi080-54183-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]': finished 2024-02-13T00:40:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:51 smithi080 bash[17386]: audit 2024-02-13T00:40:50.391451+0000 mon.a (mon.0) 1897 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi080-54175-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi080-54175-41"}]': finished 2024-02-13T00:40:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:51 smithi080 bash[17386]: audit 2024-02-13T00:40:50.391568+0000 mon.a (mon.0) 1898 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-35", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:40:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:51 smithi080 bash[17386]: cluster 2024-02-13T00:40:50.391641+0000 mon.a (mon.0) 1899 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2024-02-13T00:40:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:51 smithi080 bash[17386]: audit 2024-02-13T00:40:50.393733+0000 mon.a (mon.0) 1900 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-35"}]: dispatch 2024-02-13T00:40:51.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:51 smithi080 bash[24237]: cluster 2024-02-13T00:40:50.224748+0000 mgr.y (mgr.24461) 444 : cluster [DBG] pgmap v510: 228 pgs: 32 unknown, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:51.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:51 smithi080 bash[24237]: audit 2024-02-13T00:40:50.224907+0000 mon.a (mon.0) 1893 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:51.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:51 smithi080 bash[24237]: cluster 2024-02-13T00:40:50.225227+0000 mon.a (mon.0) 1894 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2024-02-13T00:40:51.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:51 smithi080 bash[24237]: audit 2024-02-13T00:40:50.228876+0000 mon.a (mon.0) 1895 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:40:51.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:51 smithi080 bash[24237]: audit 2024-02-13T00:40:50.391326+0000 mon.a (mon.0) 1896 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi080-54183-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]': finished 2024-02-13T00:40:51.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:51 smithi080 bash[24237]: audit 2024-02-13T00:40:50.391451+0000 mon.a (mon.0) 1897 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi080-54175-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi080-54175-41"}]': finished 2024-02-13T00:40:51.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:51 smithi080 bash[24237]: audit 2024-02-13T00:40:50.391568+0000 mon.a (mon.0) 1898 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-35", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:40:51.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:51 smithi080 bash[24237]: cluster 2024-02-13T00:40:50.391641+0000 mon.a (mon.0) 1899 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2024-02-13T00:40:51.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:51 smithi080 bash[24237]: audit 2024-02-13T00:40:50.393733+0000 mon.a (mon.0) 1900 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-35"}]: dispatch 2024-02-13T00:40:52.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:52 smithi106 bash[18459]: audit 2024-02-13T00:40:51.397581+0000 mon.a (mon.0) 1901 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-35"}]': finished 2024-02-13T00:40:52.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:52 smithi106 bash[18459]: cluster 2024-02-13T00:40:51.397758+0000 mon.a (mon.0) 1902 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2024-02-13T00:40:52.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:52 smithi106 bash[18459]: audit 2024-02-13T00:40:51.398747+0000 mon.a (mon.0) 1903 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-35", "mode": "writeback"}]: dispatch 2024-02-13T00:40:52.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:52 smithi106 bash[18459]: cluster 2024-02-13T00:40:52.217075+0000 mon.a (mon.0) 1904 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:40:52.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:52 smithi106 bash[18459]: audit 2024-02-13T00:40:52.225597+0000 mon.a (mon.0) 1905 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-35", "mode": "writeback"}]': finished 2024-02-13T00:40:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:52 smithi106 bash[18459]: cluster 2024-02-13T00:40:52.225824+0000 mon.a (mon.0) 1906 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2024-02-13T00:40:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:52 smithi106 bash[18459]: audit 2024-02-13T00:40:52.228255+0000 mon.b (mon.1) 76 : audit [INF] from='client.? 172.21.15.80:0/1339299481' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:52 smithi106 bash[18459]: audit 2024-02-13T00:40:52.232444+0000 mon.a (mon.0) 1907 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:52 smithi106 bash[18459]: audit 2024-02-13T00:40:52.234615+0000 mon.c (mon.2) 321 : audit [INF] from='client.? 172.21.15.80:0/96657013' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:52 smithi106 bash[18459]: audit 2024-02-13T00:40:52.239500+0000 mon.a (mon.0) 1908 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:52 smithi106 bash[18459]: audit 2024-02-13T00:40:52.305967+0000 mon.a (mon.0) 1909 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:40:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:52 smithi080 bash[17386]: audit 2024-02-13T00:40:51.397581+0000 mon.a (mon.0) 1901 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-35"}]': finished 2024-02-13T00:40:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:52 smithi080 bash[17386]: cluster 2024-02-13T00:40:51.397758+0000 mon.a (mon.0) 1902 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2024-02-13T00:40:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:52 smithi080 bash[17386]: audit 2024-02-13T00:40:51.398747+0000 mon.a (mon.0) 1903 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-35", "mode": "writeback"}]: dispatch 2024-02-13T00:40:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:52 smithi080 bash[17386]: cluster 2024-02-13T00:40:52.217075+0000 mon.a (mon.0) 1904 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:40:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:52 smithi080 bash[17386]: audit 2024-02-13T00:40:52.225597+0000 mon.a (mon.0) 1905 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-35", "mode": "writeback"}]': finished 2024-02-13T00:40:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:52 smithi080 bash[17386]: cluster 2024-02-13T00:40:52.225824+0000 mon.a (mon.0) 1906 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2024-02-13T00:40:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:52 smithi080 bash[17386]: audit 2024-02-13T00:40:52.228255+0000 mon.b (mon.1) 76 : audit [INF] from='client.? 172.21.15.80:0/1339299481' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:52 smithi080 bash[17386]: audit 2024-02-13T00:40:52.232444+0000 mon.a (mon.0) 1907 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:52 smithi080 bash[17386]: audit 2024-02-13T00:40:52.234615+0000 mon.c (mon.2) 321 : audit [INF] from='client.? 172.21.15.80:0/96657013' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:52 smithi080 bash[17386]: audit 2024-02-13T00:40:52.239500+0000 mon.a (mon.0) 1908 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:52 smithi080 bash[17386]: audit 2024-02-13T00:40:52.305967+0000 mon.a (mon.0) 1909 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:40:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:52 smithi080 bash[24237]: audit 2024-02-13T00:40:51.397581+0000 mon.a (mon.0) 1901 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-35"}]': finished 2024-02-13T00:40:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:52 smithi080 bash[24237]: cluster 2024-02-13T00:40:51.397758+0000 mon.a (mon.0) 1902 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2024-02-13T00:40:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:52 smithi080 bash[24237]: audit 2024-02-13T00:40:51.398747+0000 mon.a (mon.0) 1903 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-35", "mode": "writeback"}]: dispatch 2024-02-13T00:40:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:52 smithi080 bash[24237]: cluster 2024-02-13T00:40:52.217075+0000 mon.a (mon.0) 1904 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:40:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:52 smithi080 bash[24237]: audit 2024-02-13T00:40:52.225597+0000 mon.a (mon.0) 1905 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-35", "mode": "writeback"}]': finished 2024-02-13T00:40:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:52 smithi080 bash[24237]: cluster 2024-02-13T00:40:52.225824+0000 mon.a (mon.0) 1906 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2024-02-13T00:40:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:52 smithi080 bash[24237]: audit 2024-02-13T00:40:52.228255+0000 mon.b (mon.1) 76 : audit [INF] from='client.? 172.21.15.80:0/1339299481' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:52 smithi080 bash[24237]: audit 2024-02-13T00:40:52.232444+0000 mon.a (mon.0) 1907 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:52 smithi080 bash[24237]: audit 2024-02-13T00:40:52.234615+0000 mon.c (mon.2) 321 : audit [INF] from='client.? 172.21.15.80:0/96657013' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:52 smithi080 bash[24237]: audit 2024-02-13T00:40:52.239500+0000 mon.a (mon.0) 1908 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:52 smithi080 bash[24237]: audit 2024-02-13T00:40:52.305967+0000 mon.a (mon.0) 1909 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:40:53.399 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:40:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:40:53] "GET /metrics HTTP/1.1" 200 189205 "" "Prometheus/2.33.4" 2024-02-13T00:40:53.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:53 smithi106 bash[18459]: cluster 2024-02-13T00:40:52.225522+0000 mgr.y (mgr.24461) 445 : cluster [DBG] pgmap v514: 228 pgs: 32 unknown, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:40:53.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:53 smithi106 bash[18459]: audit 2024-02-13T00:40:53.232701+0000 mon.a (mon.0) 1910 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]': finished 2024-02-13T00:40:53.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:53 smithi106 bash[18459]: audit 2024-02-13T00:40:53.232825+0000 mon.a (mon.0) 1911 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi080-54175-41"}]': finished 2024-02-13T00:40:53.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:53 smithi106 bash[18459]: audit 2024-02-13T00:40:53.232934+0000 mon.a (mon.0) 1912 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:40:53.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:53 smithi106 bash[18459]: cluster 2024-02-13T00:40:53.233034+0000 mon.a (mon.0) 1913 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2024-02-13T00:40:53.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:53 smithi106 bash[18459]: audit 2024-02-13T00:40:53.233853+0000 mon.a (mon.0) 1914 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-35"}]: dispatch 2024-02-13T00:40:53.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:53 smithi106 bash[18459]: audit 2024-02-13T00:40:53.234489+0000 mon.c (mon.2) 322 : audit [INF] from='client.? 172.21.15.80:0/96657013' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:53.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:53 smithi106 bash[18459]: audit 2024-02-13T00:40:53.234719+0000 mon.b (mon.1) 77 : audit [INF] from='client.? 172.21.15.80:0/1339299481' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:53.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:53 smithi106 bash[18459]: audit 2024-02-13T00:40:53.235044+0000 mon.a (mon.0) 1915 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:53.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:53 smithi106 bash[18459]: audit 2024-02-13T00:40:53.235680+0000 mon.a (mon.0) 1916 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:53.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:53 smithi080 bash[17386]: cluster 2024-02-13T00:40:52.225522+0000 mgr.y (mgr.24461) 445 : cluster [DBG] pgmap v514: 228 pgs: 32 unknown, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:40:53.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:53 smithi080 bash[17386]: audit 2024-02-13T00:40:53.232701+0000 mon.a (mon.0) 1910 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]': finished 2024-02-13T00:40:53.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:53 smithi080 bash[17386]: audit 2024-02-13T00:40:53.232825+0000 mon.a (mon.0) 1911 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi080-54175-41"}]': finished 2024-02-13T00:40:53.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:53 smithi080 bash[17386]: audit 2024-02-13T00:40:53.232934+0000 mon.a (mon.0) 1912 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:40:53.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:53 smithi080 bash[17386]: cluster 2024-02-13T00:40:53.233034+0000 mon.a (mon.0) 1913 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2024-02-13T00:40:53.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:53 smithi080 bash[17386]: audit 2024-02-13T00:40:53.233853+0000 mon.a (mon.0) 1914 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-35"}]: dispatch 2024-02-13T00:40:53.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:53 smithi080 bash[17386]: audit 2024-02-13T00:40:53.234489+0000 mon.c (mon.2) 322 : audit [INF] from='client.? 172.21.15.80:0/96657013' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:53.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:53 smithi080 bash[17386]: audit 2024-02-13T00:40:53.234719+0000 mon.b (mon.1) 77 : audit [INF] from='client.? 172.21.15.80:0/1339299481' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:53.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:53 smithi080 bash[17386]: audit 2024-02-13T00:40:53.235044+0000 mon.a (mon.0) 1915 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:53.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:53 smithi080 bash[17386]: audit 2024-02-13T00:40:53.235680+0000 mon.a (mon.0) 1916 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:53.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:53 smithi080 bash[24237]: cluster 2024-02-13T00:40:52.225522+0000 mgr.y (mgr.24461) 445 : cluster [DBG] pgmap v514: 228 pgs: 32 unknown, 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:40:53.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:53 smithi080 bash[24237]: audit 2024-02-13T00:40:53.232701+0000 mon.a (mon.0) 1910 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi080-54183-51"}]': finished 2024-02-13T00:40:53.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:53 smithi080 bash[24237]: audit 2024-02-13T00:40:53.232825+0000 mon.a (mon.0) 1911 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi080-54175-41"}]': finished 2024-02-13T00:40:53.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:53 smithi080 bash[24237]: audit 2024-02-13T00:40:53.232934+0000 mon.a (mon.0) 1912 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:40:53.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:53 smithi080 bash[24237]: cluster 2024-02-13T00:40:53.233034+0000 mon.a (mon.0) 1913 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2024-02-13T00:40:53.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:53 smithi080 bash[24237]: audit 2024-02-13T00:40:53.233853+0000 mon.a (mon.0) 1914 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-35"}]: dispatch 2024-02-13T00:40:53.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:53 smithi080 bash[24237]: audit 2024-02-13T00:40:53.234489+0000 mon.c (mon.2) 322 : audit [INF] from='client.? 172.21.15.80:0/96657013' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:53.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:53 smithi080 bash[24237]: audit 2024-02-13T00:40:53.234719+0000 mon.b (mon.1) 77 : audit [INF] from='client.? 172.21.15.80:0/1339299481' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:53.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:53 smithi080 bash[24237]: audit 2024-02-13T00:40:53.235044+0000 mon.a (mon.0) 1915 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi080-54183-51"}]: dispatch 2024-02-13T00:40:53.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:53 smithi080 bash[24237]: audit 2024-02-13T00:40:53.235680+0000 mon.a (mon.0) 1916 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi080-54175-41"}]: dispatch 2024-02-13T00:40:54.247 INFO:tasks.workunit.client.0.smithi080.stdout:ete 2024-02-13T00:40:54.247 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (7019 ms) 2024-02-13T00:40:54.247 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2024-02-13T00:40:54.248 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (7008 ms) 2024-02-13T00:40:54.248 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2024-02-13T00:40:54.248 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (6987 ms) 2024-02-13T00:40:54.248 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2024-02-13T00:40:54.248 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (7043 ms) 2024-02-13T00:40:54.248 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2024-02-13T00:40:54.248 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (7011 ms) 2024-02-13T00:40:54.248 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2024-02-13T00:40:54.248 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (7024 ms) 2024-02-13T00:40:54.248 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2024-02-13T00:40:54.248 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (7037 ms) 2024-02-13T00:40:54.248 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2024-02-13T00:40:54.248 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (6894 ms) 2024-02-13T00:40:54.248 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2024-02-13T00:40:54.249 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (7029 ms) 2024-02-13T00:40:54.249 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-02-13T00:40:54.249 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (7038 ms) 2024-02-13T00:40:54.249 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2024-02-13T00:40:54.249 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (6957 ms) 2024-02-13T00:40:54.249 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2024-02-13T00:40:54.249 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (7021 ms) 2024-02-13T00:40:54.249 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2024-02-13T00:40:54.249 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (7044 ms) 2024-02-13T00:40:54.249 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2024-02-13T00:40:54.249 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7063 ms) 2024-02-13T00:40:54.249 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2024-02-13T00:40:54.249 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (6871 ms) 2024-02-13T00:40:54.250 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (112460 ms total) 2024-02-13T00:40:54.250 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: 2024-02-13T00:40:54.250 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [----------] Global test environment tear-down 2024-02-13T00:40:54.250 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [==========] 41 tests from 2 test suites ran. (205305 ms total) 2024-02-13T00:40:54.250 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio: [ PASSED ] 41 tests. 2024-02-13T00:40:54.251 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:40:54.251 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54226 2024-02-13T00:40:54.251 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54226 2024-02-13T00:40:54.251 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:40:54.251 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54632 2024-02-13T00:40:54.251 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54632 2024-02-13T00:40:54.251 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:40:54.252 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54524 2024-02-13T00:40:54.252 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54524 2024-02-13T00:40:54.252 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:40:54.252 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54186 2024-02-13T00:40:54.252 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54186 2024-02-13T00:40:54.252 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:40:54.252 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54258 2024-02-13T00:40:54.252 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54258 2024-02-13T00:40:54.252 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:40:54.252 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54481 2024-02-13T00:40:54.252 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54481 2024-02-13T00:40:54.252 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:40:54.252 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54250 2024-02-13T00:40:54.252 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54250 2024-02-13T00:40:54.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:54 smithi106 bash[18459]: cluster 2024-02-13T00:40:54.230218+0000 mon.a (mon.0) 1917 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:40:54.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:54 smithi106 bash[18459]: audit 2024-02-13T00:40:54.237465+0000 mon.a (mon.0) 1918 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-35"}]': finished 2024-02-13T00:40:54.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:54 smithi106 bash[18459]: audit 2024-02-13T00:40:54.237562+0000 mon.a (mon.0) 1919 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi080-54183-51"}]': finished 2024-02-13T00:40:54.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:54 smithi106 bash[18459]: audit 2024-02-13T00:40:54.237621+0000 mon.a (mon.0) 1920 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi080-54175-41"}]': finished 2024-02-13T00:40:54.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:54 smithi106 bash[18459]: cluster 2024-02-13T00:40:54.237691+0000 mon.a (mon.0) 1921 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2024-02-13T00:40:54.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:54 smithi106 bash[18459]: audit 2024-02-13T00:40:54.263264+0000 mon.a (mon.0) 1922 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:54.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:54 smithi106 bash[18459]: audit 2024-02-13T00:40:54.263315+0000 mon.b (mon.1) 78 : audit [INF] from='client.? 172.21.15.80:0/1168156144' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:54 smithi106 bash[18459]: audit 2024-02-13T00:40:54.265275+0000 mon.b (mon.1) 79 : audit [INF] from='client.? 172.21.15.80:0/1168156144' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:54 smithi106 bash[18459]: audit 2024-02-13T00:40:54.265281+0000 mon.a (mon.0) 1923 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:54 smithi106 bash[18459]: audit 2024-02-13T00:40:54.266586+0000 mon.a (mon.0) 1924 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:54 smithi106 bash[18459]: audit 2024-02-13T00:40:54.266647+0000 mon.b (mon.1) 80 : audit [INF] from='client.? 172.21.15.80:0/1168156144' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:54 smithi080 bash[17386]: cluster 2024-02-13T00:40:54.230218+0000 mon.a (mon.0) 1917 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:40:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:54 smithi080 bash[17386]: audit 2024-02-13T00:40:54.237465+0000 mon.a (mon.0) 1918 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-35"}]': finished 2024-02-13T00:40:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:54 smithi080 bash[17386]: audit 2024-02-13T00:40:54.237562+0000 mon.a (mon.0) 1919 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi080-54183-51"}]': finished 2024-02-13T00:40:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:54 smithi080 bash[17386]: audit 2024-02-13T00:40:54.237621+0000 mon.a (mon.0) 1920 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi080-54175-41"}]': finished 2024-02-13T00:40:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:54 smithi080 bash[17386]: cluster 2024-02-13T00:40:54.237691+0000 mon.a (mon.0) 1921 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2024-02-13T00:40:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:54 smithi080 bash[17386]: audit 2024-02-13T00:40:54.263264+0000 mon.a (mon.0) 1922 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:54 smithi080 bash[17386]: audit 2024-02-13T00:40:54.263315+0000 mon.b (mon.1) 78 : audit [INF] from='client.? 172.21.15.80:0/1168156144' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:54 smithi080 bash[17386]: audit 2024-02-13T00:40:54.265275+0000 mon.b (mon.1) 79 : audit [INF] from='client.? 172.21.15.80:0/1168156144' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:54 smithi080 bash[17386]: audit 2024-02-13T00:40:54.265281+0000 mon.a (mon.0) 1923 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:54 smithi080 bash[17386]: audit 2024-02-13T00:40:54.266586+0000 mon.a (mon.0) 1924 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:54 smithi080 bash[17386]: audit 2024-02-13T00:40:54.266647+0000 mon.b (mon.1) 80 : audit [INF] from='client.? 172.21.15.80:0/1168156144' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:54 smithi080 bash[24237]: cluster 2024-02-13T00:40:54.230218+0000 mon.a (mon.0) 1917 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:40:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:54 smithi080 bash[24237]: audit 2024-02-13T00:40:54.237465+0000 mon.a (mon.0) 1918 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-35"}]': finished 2024-02-13T00:40:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:54 smithi080 bash[24237]: audit 2024-02-13T00:40:54.237562+0000 mon.a (mon.0) 1919 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi080-54183-51"}]': finished 2024-02-13T00:40:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:54 smithi080 bash[24237]: audit 2024-02-13T00:40:54.237621+0000 mon.a (mon.0) 1920 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi080-54175-41"}]': finished 2024-02-13T00:40:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:54 smithi080 bash[24237]: cluster 2024-02-13T00:40:54.237691+0000 mon.a (mon.0) 1921 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2024-02-13T00:40:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:54 smithi080 bash[24237]: audit 2024-02-13T00:40:54.263264+0000 mon.a (mon.0) 1922 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:54 smithi080 bash[24237]: audit 2024-02-13T00:40:54.263315+0000 mon.b (mon.1) 78 : audit [INF] from='client.? 172.21.15.80:0/1168156144' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:54 smithi080 bash[24237]: audit 2024-02-13T00:40:54.265275+0000 mon.b (mon.1) 79 : audit [INF] from='client.? 172.21.15.80:0/1168156144' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:54 smithi080 bash[24237]: audit 2024-02-13T00:40:54.265281+0000 mon.a (mon.0) 1923 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:54 smithi080 bash[24237]: audit 2024-02-13T00:40:54.266586+0000 mon.a (mon.0) 1924 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:54 smithi080 bash[24237]: audit 2024-02-13T00:40:54.266647+0000 mon.b (mon.1) 80 : audit [INF] from='client.? 172.21.15.80:0/1168156144' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:40:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: cluster 2024-02-13T00:40:54.226354+0000 mgr.y (mgr.24461) 446 : cluster [DBG] pgmap v516: 228 pgs: 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-02-13T00:40:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:54.825564+0000 mon.c (mon.2) 323 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:40:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.096410+0000 mon.c (mon.2) 324 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.097207+0000 mon.a (mon.0) 1925 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.098971+0000 mon.c (mon.2) 325 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.099542+0000 mon.a (mon.0) 1926 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.101169+0000 mon.c (mon.2) 326 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.101700+0000 mon.a (mon.0) 1927 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.103144+0000 mon.c (mon.2) 327 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.103598+0000 mon.a (mon.0) 1928 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: cephadm 2024-02-13T00:40:55.104883+0000 mgr.y (mgr.24461) 447 : cephadm [INF] Adjusting osd_memory_target on smithi106 to 3292M 2024-02-13T00:40:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.110943+0000 mon.a (mon.0) 1929 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:40:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.127304+0000 mon.c (mon.2) 328 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.128035+0000 mon.a (mon.0) 1930 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.129755+0000 mon.c (mon.2) 329 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.130241+0000 mon.a (mon.0) 1931 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.131534+0000 mon.c (mon.2) 330 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.132073+0000 mon.a (mon.0) 1932 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.133412+0000 mon.c (mon.2) 331 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.133938+0000 mon.a (mon.0) 1933 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: cephadm 2024-02-13T00:40:55.134988+0000 mgr.y (mgr.24461) 448 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 3292M 2024-02-13T00:40:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.143328+0000 mon.a (mon.0) 1934 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:40:56.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.147750+0000 mon.c (mon.2) 332 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:40:56.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.149001+0000 mon.c (mon.2) 333 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:40:56.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.158813+0000 mon.a (mon.0) 1935 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:40:56.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.246511+0000 mon.a (mon.0) 1936 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:56.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: cluster 2024-02-13T00:40:55.246637+0000 mon.a (mon.0) 1937 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2024-02-13T00:40:56.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.248508+0000 mon.b (mon.1) 81 : audit [INF] from='client.? 172.21.15.80:0/1168156144' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi080-54183-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:56.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:55 smithi106 bash[18459]: audit 2024-02-13T00:40:55.249190+0000 mon.a (mon.0) 1938 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi080-54183-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: cluster 2024-02-13T00:40:54.226354+0000 mgr.y (mgr.24461) 446 : cluster [DBG] pgmap v516: 228 pgs: 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-02-13T00:40:56.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:54.825564+0000 mon.c (mon.2) 323 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:40:56.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.096410+0000 mon.c (mon.2) 324 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.097207+0000 mon.a (mon.0) 1925 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.098971+0000 mon.c (mon.2) 325 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.099542+0000 mon.a (mon.0) 1926 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.101169+0000 mon.c (mon.2) 326 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.101700+0000 mon.a (mon.0) 1927 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.103144+0000 mon.c (mon.2) 327 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.103598+0000 mon.a (mon.0) 1928 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: cephadm 2024-02-13T00:40:55.104883+0000 mgr.y (mgr.24461) 447 : cephadm [INF] Adjusting osd_memory_target on smithi106 to 3292M 2024-02-13T00:40:56.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.110943+0000 mon.a (mon.0) 1929 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:40:56.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.127304+0000 mon.c (mon.2) 328 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.128035+0000 mon.a (mon.0) 1930 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.129755+0000 mon.c (mon.2) 329 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.130241+0000 mon.a (mon.0) 1931 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.131534+0000 mon.c (mon.2) 330 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: cluster 2024-02-13T00:40:54.226354+0000 mgr.y (mgr.24461) 446 : cluster [DBG] pgmap v516: 228 pgs: 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-02-13T00:40:56.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:54.825564+0000 mon.c (mon.2) 323 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:40:56.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.096410+0000 mon.c (mon.2) 324 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.097207+0000 mon.a (mon.0) 1925 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.098971+0000 mon.c (mon.2) 325 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.099542+0000 mon.a (mon.0) 1926 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.010 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.101169+0000 mon.c (mon.2) 326 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.101700+0000 mon.a (mon.0) 1927 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.103144+0000 mon.c (mon.2) 327 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.103598+0000 mon.a (mon.0) 1928 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: cephadm 2024-02-13T00:40:55.104883+0000 mgr.y (mgr.24461) 447 : cephadm [INF] Adjusting osd_memory_target on smithi106 to 3292M 2024-02-13T00:40:56.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.110943+0000 mon.a (mon.0) 1929 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:40:56.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.127304+0000 mon.c (mon.2) 328 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.128035+0000 mon.a (mon.0) 1930 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.129755+0000 mon.c (mon.2) 329 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.130241+0000 mon.a (mon.0) 1931 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.011 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.131534+0000 mon.c (mon.2) 330 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.132073+0000 mon.a (mon.0) 1932 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.133412+0000 mon.c (mon.2) 331 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.133938+0000 mon.a (mon.0) 1933 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: cephadm 2024-02-13T00:40:55.134988+0000 mgr.y (mgr.24461) 448 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 3292M 2024-02-13T00:40:56.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.143328+0000 mon.a (mon.0) 1934 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:40:56.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.147750+0000 mon.c (mon.2) 332 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:40:56.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.149001+0000 mon.c (mon.2) 333 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:40:56.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.158813+0000 mon.a (mon.0) 1935 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:40:56.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.246511+0000 mon.a (mon.0) 1936 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:56.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: cluster 2024-02-13T00:40:55.246637+0000 mon.a (mon.0) 1937 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2024-02-13T00:40:56.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.248508+0000 mon.b (mon.1) 81 : audit [INF] from='client.? 172.21.15.80:0/1168156144' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi080-54183-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:56.012 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[17386]: audit 2024-02-13T00:40:55.249190+0000 mon.a (mon.0) 1938 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi080-54183-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:56.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.132073+0000 mon.a (mon.0) 1932 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.012 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.133412+0000 mon.c (mon.2) 331 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.133938+0000 mon.a (mon.0) 1933 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T00:40:56.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: cephadm 2024-02-13T00:40:55.134988+0000 mgr.y (mgr.24461) 448 : cephadm [INF] Adjusting osd_memory_target on smithi080 to 3292M 2024-02-13T00:40:56.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.143328+0000 mon.a (mon.0) 1934 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:40:56.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.147750+0000 mon.c (mon.2) 332 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:40:56.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.149001+0000 mon.c (mon.2) 333 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:40:56.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.158813+0000 mon.a (mon.0) 1935 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:40:56.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.246511+0000 mon.a (mon.0) 1936 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:40:56.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: cluster 2024-02-13T00:40:55.246637+0000 mon.a (mon.0) 1937 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2024-02-13T00:40:56.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.248508+0000 mon.b (mon.1) 81 : audit [INF] from='client.? 172.21.15.80:0/1168156144' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi080-54183-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:56.013 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:55 smithi080 bash[24237]: audit 2024-02-13T00:40:55.249190+0000 mon.a (mon.0) 1938 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi080-54183-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:57.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:57 smithi106 bash[18459]: cluster 2024-02-13T00:40:56.227119+0000 mgr.y (mgr.24461) 449 : cluster [DBG] pgmap v519: 196 pgs: 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T00:40:57.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:57 smithi106 bash[18459]: cluster 2024-02-13T00:40:56.687467+0000 mon.a (mon.0) 1939 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2024-02-13T00:40:57.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:57 smithi106 bash[18459]: audit 2024-02-13T00:40:56.688931+0000 mon.a (mon.0) 1940 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:57.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:57 smithi080 bash[17386]: cluster 2024-02-13T00:40:56.227119+0000 mgr.y (mgr.24461) 449 : cluster [DBG] pgmap v519: 196 pgs: 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T00:40:57.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:57 smithi080 bash[17386]: cluster 2024-02-13T00:40:56.687467+0000 mon.a (mon.0) 1939 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2024-02-13T00:40:57.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:57 smithi080 bash[17386]: audit 2024-02-13T00:40:56.688931+0000 mon.a (mon.0) 1940 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:57.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:57 smithi080 bash[24237]: cluster 2024-02-13T00:40:56.227119+0000 mgr.y (mgr.24461) 449 : cluster [DBG] pgmap v519: 196 pgs: 196 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T00:40:57.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:57 smithi080 bash[24237]: cluster 2024-02-13T00:40:56.687467+0000 mon.a (mon.0) 1939 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2024-02-13T00:40:57.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:57 smithi080 bash[24237]: audit 2024-02-13T00:40:56.688931+0000 mon.a (mon.0) 1940 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:40:58.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:40:58 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:40:58.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:58 smithi106 bash[18459]: audit 2024-02-13T00:40:57.261342+0000 mon.a (mon.0) 1941 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi080-54183-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi080-54183-52"}]': finished 2024-02-13T00:40:58.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:58 smithi106 bash[18459]: audit 2024-02-13T00:40:57.261622+0000 mon.a (mon.0) 1942 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:58.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:58 smithi106 bash[18459]: cluster 2024-02-13T00:40:57.262087+0000 mon.a (mon.0) 1943 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2024-02-13T00:40:58.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:58 smithi106 bash[18459]: audit 2024-02-13T00:40:57.273487+0000 mon.a (mon.0) 1944 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:40:58.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:58 smithi080 bash[17386]: audit 2024-02-13T00:40:57.261342+0000 mon.a (mon.0) 1941 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi080-54183-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi080-54183-52"}]': finished 2024-02-13T00:40:58.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:58 smithi080 bash[17386]: audit 2024-02-13T00:40:57.261622+0000 mon.a (mon.0) 1942 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:58.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:58 smithi080 bash[17386]: cluster 2024-02-13T00:40:57.262087+0000 mon.a (mon.0) 1943 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2024-02-13T00:40:58.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:58 smithi080 bash[17386]: audit 2024-02-13T00:40:57.273487+0000 mon.a (mon.0) 1944 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:40:58.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:58 smithi080 bash[24237]: audit 2024-02-13T00:40:57.261342+0000 mon.a (mon.0) 1941 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi080-54183-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi080-54183-52"}]': finished 2024-02-13T00:40:58.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:58 smithi080 bash[24237]: audit 2024-02-13T00:40:57.261622+0000 mon.a (mon.0) 1942 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:40:58.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:58 smithi080 bash[24237]: cluster 2024-02-13T00:40:57.262087+0000 mon.a (mon.0) 1943 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2024-02-13T00:40:58.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:58 smithi080 bash[24237]: audit 2024-02-13T00:40:57.273487+0000 mon.a (mon.0) 1944 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:40:59.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:59 smithi106 bash[18459]: cluster 2024-02-13T00:40:58.229161+0000 mgr.y (mgr.24461) 450 : cluster [DBG] pgmap v522: 236 pgs: 8 creating+peering, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:59.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:59 smithi106 bash[18459]: audit 2024-02-13T00:40:58.264108+0000 mon.a (mon.0) 1945 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-37", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:40:59.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:59 smithi106 bash[18459]: cluster 2024-02-13T00:40:58.264289+0000 mon.a (mon.0) 1946 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2024-02-13T00:40:59.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:59 smithi106 bash[18459]: audit 2024-02-13T00:40:58.265546+0000 mgr.y (mgr.24461) 451 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:40:59.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:59 smithi106 bash[18459]: audit 2024-02-13T00:40:58.267381+0000 mon.a (mon.0) 1947 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-37"}]: dispatch 2024-02-13T00:40:59.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:59 smithi106 bash[18459]: audit 2024-02-13T00:40:59.267822+0000 mon.a (mon.0) 1948 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-37"}]': finished 2024-02-13T00:40:59.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:59 smithi106 bash[18459]: cluster 2024-02-13T00:40:59.268038+0000 mon.a (mon.0) 1949 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2024-02-13T00:40:59.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:59 smithi106 bash[18459]: audit 2024-02-13T00:40:59.269766+0000 mon.a (mon.0) 1950 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-37", "mode": "writeback"}]: dispatch 2024-02-13T00:40:59.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:59 smithi106 bash[18459]: audit 2024-02-13T00:40:59.269984+0000 mon.b (mon.1) 82 : audit [INF] from='client.? 172.21.15.80:0/1168156144' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:59.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:40:59 smithi106 bash[18459]: audit 2024-02-13T00:40:59.270311+0000 mon.a (mon.0) 1951 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:59.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:59 smithi080 bash[24237]: cluster 2024-02-13T00:40:58.229161+0000 mgr.y (mgr.24461) 450 : cluster [DBG] pgmap v522: 236 pgs: 8 creating+peering, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:59.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:59 smithi080 bash[24237]: audit 2024-02-13T00:40:58.264108+0000 mon.a (mon.0) 1945 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-37", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:40:59.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:59 smithi080 bash[24237]: cluster 2024-02-13T00:40:58.264289+0000 mon.a (mon.0) 1946 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2024-02-13T00:40:59.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:59 smithi080 bash[24237]: audit 2024-02-13T00:40:58.265546+0000 mgr.y (mgr.24461) 451 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:40:59.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:59 smithi080 bash[24237]: audit 2024-02-13T00:40:58.267381+0000 mon.a (mon.0) 1947 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-37"}]: dispatch 2024-02-13T00:40:59.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:59 smithi080 bash[24237]: audit 2024-02-13T00:40:59.267822+0000 mon.a (mon.0) 1948 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-37"}]': finished 2024-02-13T00:40:59.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:59 smithi080 bash[24237]: cluster 2024-02-13T00:40:59.268038+0000 mon.a (mon.0) 1949 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2024-02-13T00:40:59.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:59 smithi080 bash[24237]: audit 2024-02-13T00:40:59.269766+0000 mon.a (mon.0) 1950 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-37", "mode": "writeback"}]: dispatch 2024-02-13T00:40:59.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:59 smithi080 bash[24237]: audit 2024-02-13T00:40:59.269984+0000 mon.b (mon.1) 82 : audit [INF] from='client.? 172.21.15.80:0/1168156144' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:59.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:40:59 smithi080 bash[24237]: audit 2024-02-13T00:40:59.270311+0000 mon.a (mon.0) 1951 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:59.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:59 smithi080 bash[17386]: cluster 2024-02-13T00:40:58.229161+0000 mgr.y (mgr.24461) 450 : cluster [DBG] pgmap v522: 236 pgs: 8 creating+peering, 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:40:59.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:59 smithi080 bash[17386]: audit 2024-02-13T00:40:58.264108+0000 mon.a (mon.0) 1945 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-37", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:40:59.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:59 smithi080 bash[17386]: cluster 2024-02-13T00:40:58.264289+0000 mon.a (mon.0) 1946 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2024-02-13T00:40:59.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:59 smithi080 bash[17386]: audit 2024-02-13T00:40:58.265546+0000 mgr.y (mgr.24461) 451 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:40:59.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:59 smithi080 bash[17386]: audit 2024-02-13T00:40:58.267381+0000 mon.a (mon.0) 1947 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-37"}]: dispatch 2024-02-13T00:40:59.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:59 smithi080 bash[17386]: audit 2024-02-13T00:40:59.267822+0000 mon.a (mon.0) 1948 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-37"}]': finished 2024-02-13T00:40:59.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:59 smithi080 bash[17386]: cluster 2024-02-13T00:40:59.268038+0000 mon.a (mon.0) 1949 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2024-02-13T00:40:59.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:59 smithi080 bash[17386]: audit 2024-02-13T00:40:59.269766+0000 mon.a (mon.0) 1950 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-37", "mode": "writeback"}]: dispatch 2024-02-13T00:40:59.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:59 smithi080 bash[17386]: audit 2024-02-13T00:40:59.269984+0000 mon.b (mon.1) 82 : audit [INF] from='client.? 172.21.15.80:0/1168156144' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:40:59.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:40:59 smithi080 bash[17386]: audit 2024-02-13T00:40:59.270311+0000 mon.a (mon.0) 1951 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:41:00.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:41:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:41:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:41:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:00 smithi106 bash[18459]: cluster 2024-02-13T00:41:00.260932+0000 mon.a (mon.0) 1952 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:41:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:00 smithi106 bash[18459]: audit 2024-02-13T00:41:00.268612+0000 mon.a (mon.0) 1953 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-37", "mode": "writeback"}]': finished 2024-02-13T00:41:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:00 smithi106 bash[18459]: audit 2024-02-13T00:41:00.268810+0000 mon.a (mon.0) 1954 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52"}]': finished 2024-02-13T00:41:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:00 smithi106 bash[18459]: cluster 2024-02-13T00:41:00.268884+0000 mon.a (mon.0) 1955 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2024-02-13T00:41:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:00 smithi106 bash[18459]: audit 2024-02-13T00:41:00.271122+0000 mon.b (mon.1) 83 : audit [INF] from='client.? 172.21.15.80:0/1168156144' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:41:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:00 smithi106 bash[18459]: audit 2024-02-13T00:41:00.271756+0000 mon.a (mon.0) 1956 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:41:00.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:00 smithi080 bash[17386]: cluster 2024-02-13T00:41:00.260932+0000 mon.a (mon.0) 1952 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:41:00.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:00 smithi080 bash[17386]: audit 2024-02-13T00:41:00.268612+0000 mon.a (mon.0) 1953 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-37", "mode": "writeback"}]': finished 2024-02-13T00:41:00.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:00 smithi080 bash[17386]: audit 2024-02-13T00:41:00.268810+0000 mon.a (mon.0) 1954 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52"}]': finished 2024-02-13T00:41:00.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:00 smithi080 bash[17386]: cluster 2024-02-13T00:41:00.268884+0000 mon.a (mon.0) 1955 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2024-02-13T00:41:00.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:00 smithi080 bash[17386]: audit 2024-02-13T00:41:00.271122+0000 mon.b (mon.1) 83 : audit [INF] from='client.? 172.21.15.80:0/1168156144' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:41:00.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:00 smithi080 bash[17386]: audit 2024-02-13T00:41:00.271756+0000 mon.a (mon.0) 1956 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:41:00.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:00 smithi080 bash[24237]: cluster 2024-02-13T00:41:00.260932+0000 mon.a (mon.0) 1952 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:41:00.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:00 smithi080 bash[24237]: audit 2024-02-13T00:41:00.268612+0000 mon.a (mon.0) 1953 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-37", "mode": "writeback"}]': finished 2024-02-13T00:41:00.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:00 smithi080 bash[24237]: audit 2024-02-13T00:41:00.268810+0000 mon.a (mon.0) 1954 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi080-54183-52"}]': finished 2024-02-13T00:41:00.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:00 smithi080 bash[24237]: cluster 2024-02-13T00:41:00.268884+0000 mon.a (mon.0) 1955 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2024-02-13T00:41:00.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:00 smithi080 bash[24237]: audit 2024-02-13T00:41:00.271122+0000 mon.b (mon.1) 83 : audit [INF] from='client.? 172.21.15.80:0/1168156144' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:41:00.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:00 smithi080 bash[24237]: audit 2024-02-13T00:41:00.271756+0000 mon.a (mon.0) 1956 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi080-54183-52"}]: dispatch 2024-02-13T00:41:01.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:01 smithi106 bash[18459]: cluster 2024-02-13T00:41:00.229940+0000 mgr.y (mgr.24461) 452 : cluster [DBG] pgmap v525: 228 pgs: 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:01.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:01 smithi106 bash[18459]: audit 2024-02-13T00:41:00.401954+0000 mon.a (mon.0) 1957 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:41:01.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:01 smithi106 bash[18459]: audit 2024-02-13T00:41:01.272083+0000 mon.a (mon.0) 1958 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi080-54183-52"}]': finished 2024-02-13T00:41:01.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:01 smithi106 bash[18459]: audit 2024-02-13T00:41:01.272234+0000 mon.a (mon.0) 1959 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:41:01.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:01 smithi106 bash[18459]: cluster 2024-02-13T00:41:01.272394+0000 mon.a (mon.0) 1960 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2024-02-13T00:41:01.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:01 smithi106 bash[18459]: audit 2024-02-13T00:41:01.273111+0000 mon.a (mon.0) 1961 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-37"}]: dispatch 2024-02-13T00:41:01.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:01 smithi080 bash[17386]: cluster 2024-02-13T00:41:00.229940+0000 mgr.y (mgr.24461) 452 : cluster [DBG] pgmap v525: 228 pgs: 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:01.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:01 smithi080 bash[17386]: audit 2024-02-13T00:41:00.401954+0000 mon.a (mon.0) 1957 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:41:01.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:01 smithi080 bash[17386]: audit 2024-02-13T00:41:01.272083+0000 mon.a (mon.0) 1958 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi080-54183-52"}]': finished 2024-02-13T00:41:01.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:01 smithi080 bash[17386]: audit 2024-02-13T00:41:01.272234+0000 mon.a (mon.0) 1959 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:41:01.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:01 smithi080 bash[17386]: cluster 2024-02-13T00:41:01.272394+0000 mon.a (mon.0) 1960 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2024-02-13T00:41:01.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:01 smithi080 bash[17386]: audit 2024-02-13T00:41:01.273111+0000 mon.a (mon.0) 1961 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-37"}]: dispatch 2024-02-13T00:41:01.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:01 smithi080 bash[24237]: cluster 2024-02-13T00:41:00.229940+0000 mgr.y (mgr.24461) 452 : cluster [DBG] pgmap v525: 228 pgs: 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:01.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:01 smithi080 bash[24237]: audit 2024-02-13T00:41:00.401954+0000 mon.a (mon.0) 1957 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:41:01.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:01 smithi080 bash[24237]: audit 2024-02-13T00:41:01.272083+0000 mon.a (mon.0) 1958 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi080-54183-52"}]': finished 2024-02-13T00:41:01.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:01 smithi080 bash[24237]: audit 2024-02-13T00:41:01.272234+0000 mon.a (mon.0) 1959 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:41:01.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:01 smithi080 bash[24237]: cluster 2024-02-13T00:41:01.272394+0000 mon.a (mon.0) 1960 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2024-02-13T00:41:01.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:01 smithi080 bash[24237]: audit 2024-02-13T00:41:01.273111+0000 mon.a (mon.0) 1961 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-37"}]: dispatch 2024-02-13T00:41:02.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:02 smithi106 bash[18459]: audit 2024-02-13T00:41:01.293797+0000 mon.c (mon.2) 334 : audit [INF] from='client.? 172.21.15.80:0/434853005' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:02.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:02 smithi106 bash[18459]: audit 2024-02-13T00:41:01.294342+0000 mon.a (mon.0) 1962 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:02.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:02 smithi106 bash[18459]: audit 2024-02-13T00:41:01.294961+0000 mon.c (mon.2) 335 : audit [INF] from='client.? 172.21.15.80:0/434853005' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:02.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:02 smithi106 bash[18459]: audit 2024-02-13T00:41:01.295413+0000 mon.a (mon.0) 1963 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:02.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:02 smithi106 bash[18459]: audit 2024-02-13T00:41:01.295984+0000 mon.c (mon.2) 336 : audit [INF] from='client.? 172.21.15.80:0/434853005' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi080-54183-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:02.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:02 smithi106 bash[18459]: audit 2024-02-13T00:41:01.296454+0000 mon.a (mon.0) 1964 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi080-54183-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:02.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:02 smithi106 bash[18459]: audit 2024-02-13T00:41:01.915380+0000 mon.a (mon.0) 1965 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:41:02.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:02 smithi106 bash[18459]: cluster 2024-02-13T00:41:02.266337+0000 mon.a (mon.0) 1966 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:41:02.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:02 smithi106 bash[18459]: audit 2024-02-13T00:41:02.274284+0000 mon.a (mon.0) 1967 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-37"}]': finished 2024-02-13T00:41:02.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:02 smithi106 bash[18459]: audit 2024-02-13T00:41:02.274465+0000 mon.a (mon.0) 1968 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi080-54183-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:02.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:02 smithi106 bash[18459]: cluster 2024-02-13T00:41:02.274650+0000 mon.a (mon.0) 1969 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2024-02-13T00:41:02.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:02 smithi106 bash[18459]: audit 2024-02-13T00:41:02.276409+0000 mon.c (mon.2) 337 : audit [INF] from='client.? 172.21.15.80:0/434853005' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi080-54183-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:02.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:02 smithi106 bash[18459]: audit 2024-02-13T00:41:02.277536+0000 mon.a (mon.0) 1970 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi080-54183-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:02.757 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[24237]: audit 2024-02-13T00:41:01.293797+0000 mon.c (mon.2) 334 : audit [INF] from='client.? 172.21.15.80:0/434853005' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:02.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[24237]: audit 2024-02-13T00:41:01.294342+0000 mon.a (mon.0) 1962 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:02.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[24237]: audit 2024-02-13T00:41:01.294961+0000 mon.c (mon.2) 335 : audit [INF] from='client.? 172.21.15.80:0/434853005' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:02.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[24237]: audit 2024-02-13T00:41:01.295413+0000 mon.a (mon.0) 1963 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:02.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[24237]: audit 2024-02-13T00:41:01.295984+0000 mon.c (mon.2) 336 : audit [INF] from='client.? 172.21.15.80:0/434853005' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi080-54183-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:02.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[24237]: audit 2024-02-13T00:41:01.296454+0000 mon.a (mon.0) 1964 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi080-54183-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:02.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[24237]: audit 2024-02-13T00:41:01.915380+0000 mon.a (mon.0) 1965 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:41:02.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[24237]: cluster 2024-02-13T00:41:02.266337+0000 mon.a (mon.0) 1966 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:41:02.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[24237]: audit 2024-02-13T00:41:02.274284+0000 mon.a (mon.0) 1967 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-37"}]': finished 2024-02-13T00:41:02.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[24237]: audit 2024-02-13T00:41:02.274465+0000 mon.a (mon.0) 1968 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi080-54183-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:02.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[24237]: cluster 2024-02-13T00:41:02.274650+0000 mon.a (mon.0) 1969 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2024-02-13T00:41:02.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[24237]: audit 2024-02-13T00:41:02.276409+0000 mon.c (mon.2) 337 : audit [INF] from='client.? 172.21.15.80:0/434853005' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi080-54183-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:02.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[24237]: audit 2024-02-13T00:41:02.277536+0000 mon.a (mon.0) 1970 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi080-54183-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:02.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[17386]: audit 2024-02-13T00:41:01.293797+0000 mon.c (mon.2) 334 : audit [INF] from='client.? 172.21.15.80:0/434853005' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:02.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[17386]: audit 2024-02-13T00:41:01.294342+0000 mon.a (mon.0) 1962 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:02.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[17386]: audit 2024-02-13T00:41:01.294961+0000 mon.c (mon.2) 335 : audit [INF] from='client.? 172.21.15.80:0/434853005' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:02.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[17386]: audit 2024-02-13T00:41:01.295413+0000 mon.a (mon.0) 1963 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:02.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[17386]: audit 2024-02-13T00:41:01.295984+0000 mon.c (mon.2) 336 : audit [INF] from='client.? 172.21.15.80:0/434853005' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi080-54183-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:02.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[17386]: audit 2024-02-13T00:41:01.296454+0000 mon.a (mon.0) 1964 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi080-54183-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:02.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[17386]: audit 2024-02-13T00:41:01.915380+0000 mon.a (mon.0) 1965 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:41:02.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[17386]: cluster 2024-02-13T00:41:02.266337+0000 mon.a (mon.0) 1966 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:41:02.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[17386]: audit 2024-02-13T00:41:02.274284+0000 mon.a (mon.0) 1967 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-37"}]': finished 2024-02-13T00:41:02.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[17386]: audit 2024-02-13T00:41:02.274465+0000 mon.a (mon.0) 1968 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi080-54183-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:02.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[17386]: cluster 2024-02-13T00:41:02.274650+0000 mon.a (mon.0) 1969 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2024-02-13T00:41:02.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[17386]: audit 2024-02-13T00:41:02.276409+0000 mon.c (mon.2) 337 : audit [INF] from='client.? 172.21.15.80:0/434853005' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi080-54183-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:02.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:02 smithi080 bash[17386]: audit 2024-02-13T00:41:02.277536+0000 mon.a (mon.0) 1970 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi080-54183-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:03.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:41:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:41:03] "GET /metrics HTTP/1.1" 200 186860 "" "Prometheus/2.33.4" 2024-02-13T00:41:04.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:04 smithi106 bash[18459]: cluster 2024-02-13T00:41:02.230644+0000 mgr.y (mgr.24461) 453 : cluster [DBG] pgmap v528: 228 pgs: 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:41:04.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:04 smithi080 bash[17386]: cluster 2024-02-13T00:41:02.230644+0000 mgr.y (mgr.24461) 453 : cluster [DBG] pgmap v528: 228 pgs: 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:41:04.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:04 smithi080 bash[24237]: cluster 2024-02-13T00:41:02.230644+0000 mgr.y (mgr.24461) 453 : cluster [DBG] pgmap v528: 228 pgs: 228 active+clean; 6.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:41:05.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:05 smithi106 bash[18459]: cluster 2024-02-13T00:41:03.706508+0000 mon.a (mon.0) 1971 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2024-02-13T00:41:05.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:05 smithi106 bash[18459]: audit 2024-02-13T00:41:04.280791+0000 mon.a (mon.0) 1972 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi080-54183-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi080-54183-53"}]': finished 2024-02-13T00:41:05.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:05 smithi106 bash[18459]: cluster 2024-02-13T00:41:04.281034+0000 mon.a (mon.0) 1973 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2024-02-13T00:41:05.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:05 smithi106 bash[18459]: audit 2024-02-13T00:41:04.283950+0000 mon.a (mon.0) 1974 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:41:05.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:05 smithi080 bash[17386]: cluster 2024-02-13T00:41:03.706508+0000 mon.a (mon.0) 1971 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2024-02-13T00:41:05.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:05 smithi080 bash[17386]: audit 2024-02-13T00:41:04.280791+0000 mon.a (mon.0) 1972 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi080-54183-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi080-54183-53"}]': finished 2024-02-13T00:41:05.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:05 smithi080 bash[17386]: cluster 2024-02-13T00:41:04.281034+0000 mon.a (mon.0) 1973 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2024-02-13T00:41:05.510 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:05 smithi080 bash[17386]: audit 2024-02-13T00:41:04.283950+0000 mon.a (mon.0) 1974 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:41:05.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:05 smithi080 bash[24237]: cluster 2024-02-13T00:41:03.706508+0000 mon.a (mon.0) 1971 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2024-02-13T00:41:05.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:05 smithi080 bash[24237]: audit 2024-02-13T00:41:04.280791+0000 mon.a (mon.0) 1972 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi080-54183-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi080-54183-53"}]': finished 2024-02-13T00:41:05.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:05 smithi080 bash[24237]: cluster 2024-02-13T00:41:04.281034+0000 mon.a (mon.0) 1973 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2024-02-13T00:41:05.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:05 smithi080 bash[24237]: audit 2024-02-13T00:41:04.283950+0000 mon.a (mon.0) 1974 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:41:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:06 smithi106 bash[18459]: cluster 2024-02-13T00:41:04.231377+0000 mgr.y (mgr.24461) 454 : cluster [DBG] pgmap v531: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-13T00:41:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:06 smithi106 bash[18459]: audit 2024-02-13T00:41:05.282088+0000 mon.a (mon.0) 1975 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:41:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:06 smithi106 bash[18459]: cluster 2024-02-13T00:41:05.282442+0000 mon.a (mon.0) 1976 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2024-02-13T00:41:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:06 smithi106 bash[18459]: audit 2024-02-13T00:41:05.301535+0000 mon.a (mon.0) 1977 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:41:06.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:06 smithi080 bash[17386]: cluster 2024-02-13T00:41:04.231377+0000 mgr.y (mgr.24461) 454 : cluster [DBG] pgmap v531: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-13T00:41:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:06 smithi080 bash[17386]: audit 2024-02-13T00:41:05.282088+0000 mon.a (mon.0) 1975 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:41:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:06 smithi080 bash[17386]: cluster 2024-02-13T00:41:05.282442+0000 mon.a (mon.0) 1976 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2024-02-13T00:41:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:06 smithi080 bash[17386]: audit 2024-02-13T00:41:05.301535+0000 mon.a (mon.0) 1977 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:41:06.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:06 smithi080 bash[24237]: cluster 2024-02-13T00:41:04.231377+0000 mgr.y (mgr.24461) 454 : cluster [DBG] pgmap v531: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-13T00:41:06.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:06 smithi080 bash[24237]: audit 2024-02-13T00:41:05.282088+0000 mon.a (mon.0) 1975 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:41:06.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:06 smithi080 bash[24237]: cluster 2024-02-13T00:41:05.282442+0000 mon.a (mon.0) 1976 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2024-02-13T00:41:06.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:06 smithi080 bash[24237]: audit 2024-02-13T00:41:05.301535+0000 mon.a (mon.0) 1977 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:41:07.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:07 smithi106 bash[18459]: cluster 2024-02-13T00:41:06.232196+0000 mgr.y (mgr.24461) 455 : cluster [DBG] pgmap v534: 236 pgs: 40 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-13T00:41:07.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:07 smithi106 bash[18459]: audit 2024-02-13T00:41:06.290194+0000 mon.a (mon.0) 1978 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-39", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:41:07.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:07 smithi106 bash[18459]: cluster 2024-02-13T00:41:06.290342+0000 mon.a (mon.0) 1979 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2024-02-13T00:41:07.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:07 smithi106 bash[18459]: audit 2024-02-13T00:41:06.291849+0000 mon.a (mon.0) 1980 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-39","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:41:07.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:07 smithi106 bash[18459]: audit 2024-02-13T00:41:06.292398+0000 mon.c (mon.2) 338 : audit [INF] from='client.? 172.21.15.80:0/434853005' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:07.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:07 smithi106 bash[18459]: audit 2024-02-13T00:41:06.293528+0000 mon.a (mon.0) 1981 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:07.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:07 smithi080 bash[17386]: cluster 2024-02-13T00:41:06.232196+0000 mgr.y (mgr.24461) 455 : cluster [DBG] pgmap v534: 236 pgs: 40 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-13T00:41:07.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:07 smithi080 bash[17386]: audit 2024-02-13T00:41:06.290194+0000 mon.a (mon.0) 1978 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-39", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:41:07.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:07 smithi080 bash[17386]: cluster 2024-02-13T00:41:06.290342+0000 mon.a (mon.0) 1979 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2024-02-13T00:41:07.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:07 smithi080 bash[17386]: audit 2024-02-13T00:41:06.291849+0000 mon.a (mon.0) 1980 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-39","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:41:07.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:07 smithi080 bash[17386]: audit 2024-02-13T00:41:06.292398+0000 mon.c (mon.2) 338 : audit [INF] from='client.? 172.21.15.80:0/434853005' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:07.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:07 smithi080 bash[17386]: audit 2024-02-13T00:41:06.293528+0000 mon.a (mon.0) 1981 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:07.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:07 smithi080 bash[24237]: cluster 2024-02-13T00:41:06.232196+0000 mgr.y (mgr.24461) 455 : cluster [DBG] pgmap v534: 236 pgs: 40 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-13T00:41:07.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:07 smithi080 bash[24237]: audit 2024-02-13T00:41:06.290194+0000 mon.a (mon.0) 1978 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-39", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:41:07.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:07 smithi080 bash[24237]: cluster 2024-02-13T00:41:06.290342+0000 mon.a (mon.0) 1979 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2024-02-13T00:41:07.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:07 smithi080 bash[24237]: audit 2024-02-13T00:41:06.291849+0000 mon.a (mon.0) 1980 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-39","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:41:07.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:07 smithi080 bash[24237]: audit 2024-02-13T00:41:06.292398+0000 mon.c (mon.2) 338 : audit [INF] from='client.? 172.21.15.80:0/434853005' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:07.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:07 smithi080 bash[24237]: audit 2024-02-13T00:41:06.293528+0000 mon.a (mon.0) 1981 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:08.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:41:08 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:41:08.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:08 smithi106 bash[18459]: audit 2024-02-13T00:41:07.287278+0000 mon.a (mon.0) 1982 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-39","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:41:08.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:08 smithi106 bash[18459]: audit 2024-02-13T00:41:07.287439+0000 mon.a (mon.0) 1983 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi080-54183-53"}]': finished 2024-02-13T00:41:08.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:08 smithi106 bash[18459]: cluster 2024-02-13T00:41:07.287616+0000 mon.a (mon.0) 1984 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2024-02-13T00:41:08.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:08 smithi106 bash[18459]: audit 2024-02-13T00:41:07.289580+0000 mon.c (mon.2) 339 : audit [INF] from='client.? 172.21.15.80:0/434853005' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:08.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:08 smithi106 bash[18459]: audit 2024-02-13T00:41:07.290173+0000 mon.a (mon.0) 1985 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-39","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:41:08.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:08 smithi106 bash[18459]: audit 2024-02-13T00:41:07.294493+0000 mon.a (mon.0) 1986 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:08.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:08 smithi106 bash[18459]: audit 2024-02-13T00:41:08.291914+0000 mon.a (mon.0) 1987 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-39","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:41:08.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:08 smithi106 bash[18459]: audit 2024-02-13T00:41:08.292094+0000 mon.a (mon.0) 1988 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi080-54183-53"}]': finished 2024-02-13T00:41:08.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:08 smithi106 bash[18459]: cluster 2024-02-13T00:41:08.292178+0000 mon.a (mon.0) 1989 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2024-02-13T00:41:08.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:08 smithi106 bash[18459]: audit 2024-02-13T00:41:08.293267+0000 mon.a (mon.0) 1990 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-39","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T00:41:08.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:08 smithi080 bash[17386]: audit 2024-02-13T00:41:07.287278+0000 mon.a (mon.0) 1982 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-39","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:41:08.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:08 smithi080 bash[17386]: audit 2024-02-13T00:41:07.287439+0000 mon.a (mon.0) 1983 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi080-54183-53"}]': finished 2024-02-13T00:41:08.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:08 smithi080 bash[17386]: cluster 2024-02-13T00:41:07.287616+0000 mon.a (mon.0) 1984 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2024-02-13T00:41:08.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:08 smithi080 bash[17386]: audit 2024-02-13T00:41:07.289580+0000 mon.c (mon.2) 339 : audit [INF] from='client.? 172.21.15.80:0/434853005' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:08.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:08 smithi080 bash[17386]: audit 2024-02-13T00:41:07.290173+0000 mon.a (mon.0) 1985 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-39","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:41:08.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:08 smithi080 bash[17386]: audit 2024-02-13T00:41:07.294493+0000 mon.a (mon.0) 1986 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:08.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:08 smithi080 bash[17386]: audit 2024-02-13T00:41:08.291914+0000 mon.a (mon.0) 1987 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-39","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:41:08.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:08 smithi080 bash[17386]: audit 2024-02-13T00:41:08.292094+0000 mon.a (mon.0) 1988 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi080-54183-53"}]': finished 2024-02-13T00:41:08.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:08 smithi080 bash[17386]: cluster 2024-02-13T00:41:08.292178+0000 mon.a (mon.0) 1989 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2024-02-13T00:41:08.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:08 smithi080 bash[17386]: audit 2024-02-13T00:41:08.293267+0000 mon.a (mon.0) 1990 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-39","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T00:41:08.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:08 smithi080 bash[24237]: audit 2024-02-13T00:41:07.287278+0000 mon.a (mon.0) 1982 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-39","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:41:08.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:08 smithi080 bash[24237]: audit 2024-02-13T00:41:07.287439+0000 mon.a (mon.0) 1983 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi080-54183-53"}]': finished 2024-02-13T00:41:08.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:08 smithi080 bash[24237]: cluster 2024-02-13T00:41:07.287616+0000 mon.a (mon.0) 1984 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2024-02-13T00:41:08.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:08 smithi080 bash[24237]: audit 2024-02-13T00:41:07.289580+0000 mon.c (mon.2) 339 : audit [INF] from='client.? 172.21.15.80:0/434853005' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:08.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:08 smithi080 bash[24237]: audit 2024-02-13T00:41:07.290173+0000 mon.a (mon.0) 1985 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-39","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:41:08.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:08 smithi080 bash[24237]: audit 2024-02-13T00:41:07.294493+0000 mon.a (mon.0) 1986 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi080-54183-53"}]: dispatch 2024-02-13T00:41:08.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:08 smithi080 bash[24237]: audit 2024-02-13T00:41:08.291914+0000 mon.a (mon.0) 1987 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-39","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:41:08.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:08 smithi080 bash[24237]: audit 2024-02-13T00:41:08.292094+0000 mon.a (mon.0) 1988 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi080-54183-53"}]': finished 2024-02-13T00:41:08.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:08 smithi080 bash[24237]: cluster 2024-02-13T00:41:08.292178+0000 mon.a (mon.0) 1989 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2024-02-13T00:41:08.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:08 smithi080 bash[24237]: audit 2024-02-13T00:41:08.293267+0000 mon.a (mon.0) 1990 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-39","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T00:41:09.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:09 smithi106 bash[18459]: cluster 2024-02-13T00:41:08.234234+0000 mgr.y (mgr.24461) 456 : cluster [DBG] pgmap v537: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:41:09.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:09 smithi106 bash[18459]: audit 2024-02-13T00:41:08.277554+0000 mgr.y (mgr.24461) 457 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:41:09.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:09 smithi106 bash[18459]: audit 2024-02-13T00:41:08.313621+0000 mon.a (mon.0) 1991 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi080-54183-54"}]: dispatch 2024-02-13T00:41:09.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:09 smithi106 bash[18459]: audit 2024-02-13T00:41:08.315057+0000 mon.a (mon.0) 1992 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi080-54183-54"}]: dispatch 2024-02-13T00:41:09.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:09 smithi106 bash[18459]: audit 2024-02-13T00:41:08.315569+0000 mon.a (mon.0) 1993 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi080-54183-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:09.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:09 smithi106 bash[18459]: audit 2024-02-13T00:41:09.294491+0000 mon.a (mon.0) 1994 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-39","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T00:41:09.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:09 smithi106 bash[18459]: audit 2024-02-13T00:41:09.294713+0000 mon.a (mon.0) 1995 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi080-54183-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:09.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:09 smithi106 bash[18459]: cluster 2024-02-13T00:41:09.294866+0000 mon.a (mon.0) 1996 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2024-02-13T00:41:09.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:09 smithi106 bash[18459]: audit 2024-02-13T00:41:09.295897+0000 mon.a (mon.0) 1997 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi080-54183-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi080-54183-54"}]: dispatch 2024-02-13T00:41:09.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:09 smithi080 bash[17386]: cluster 2024-02-13T00:41:08.234234+0000 mgr.y (mgr.24461) 456 : cluster [DBG] pgmap v537: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:41:09.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:09 smithi080 bash[17386]: audit 2024-02-13T00:41:08.277554+0000 mgr.y (mgr.24461) 457 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:41:09.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:09 smithi080 bash[17386]: audit 2024-02-13T00:41:08.313621+0000 mon.a (mon.0) 1991 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi080-54183-54"}]: dispatch 2024-02-13T00:41:09.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:09 smithi080 bash[17386]: audit 2024-02-13T00:41:08.315057+0000 mon.a (mon.0) 1992 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi080-54183-54"}]: dispatch 2024-02-13T00:41:09.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:09 smithi080 bash[17386]: audit 2024-02-13T00:41:08.315569+0000 mon.a (mon.0) 1993 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi080-54183-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:09.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:09 smithi080 bash[17386]: audit 2024-02-13T00:41:09.294491+0000 mon.a (mon.0) 1994 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-39","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T00:41:09.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:09 smithi080 bash[17386]: audit 2024-02-13T00:41:09.294713+0000 mon.a (mon.0) 1995 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi080-54183-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:09.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:09 smithi080 bash[17386]: cluster 2024-02-13T00:41:09.294866+0000 mon.a (mon.0) 1996 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2024-02-13T00:41:09.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:09 smithi080 bash[17386]: audit 2024-02-13T00:41:09.295897+0000 mon.a (mon.0) 1997 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi080-54183-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi080-54183-54"}]: dispatch 2024-02-13T00:41:09.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:09 smithi080 bash[24237]: cluster 2024-02-13T00:41:08.234234+0000 mgr.y (mgr.24461) 456 : cluster [DBG] pgmap v537: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:41:09.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:09 smithi080 bash[24237]: audit 2024-02-13T00:41:08.277554+0000 mgr.y (mgr.24461) 457 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:41:09.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:09 smithi080 bash[24237]: audit 2024-02-13T00:41:08.313621+0000 mon.a (mon.0) 1991 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi080-54183-54"}]: dispatch 2024-02-13T00:41:09.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:09 smithi080 bash[24237]: audit 2024-02-13T00:41:08.315057+0000 mon.a (mon.0) 1992 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi080-54183-54"}]: dispatch 2024-02-13T00:41:09.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:09 smithi080 bash[24237]: audit 2024-02-13T00:41:08.315569+0000 mon.a (mon.0) 1993 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi080-54183-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:09.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:09 smithi080 bash[24237]: audit 2024-02-13T00:41:09.294491+0000 mon.a (mon.0) 1994 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-39","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T00:41:09.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:09 smithi080 bash[24237]: audit 2024-02-13T00:41:09.294713+0000 mon.a (mon.0) 1995 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi080-54183-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:09.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:09 smithi080 bash[24237]: cluster 2024-02-13T00:41:09.294866+0000 mon.a (mon.0) 1996 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2024-02-13T00:41:09.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:09 smithi080 bash[24237]: audit 2024-02-13T00:41:09.295897+0000 mon.a (mon.0) 1997 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi080-54183-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi080-54183-54"}]: dispatch 2024-02-13T00:41:10.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:41:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:41:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:41:11.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:11 smithi106 bash[18459]: cluster 2024-02-13T00:41:10.235043+0000 mgr.y (mgr.24461) 458 : cluster [DBG] pgmap v540: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:41:11.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:11 smithi106 bash[18459]: cluster 2024-02-13T00:41:10.723898+0000 mon.a (mon.0) 1998 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2024-02-13T00:41:11.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:11 smithi106 bash[18459]: audit 2024-02-13T00:41:10.756084+0000 mon.a (mon.0) 1999 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:41:11.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:11 smithi106 bash[18459]: audit 2024-02-13T00:41:10.756617+0000 mon.a (mon.0) 2000 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-39"}]: dispatch 2024-02-13T00:41:11.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:11 smithi080 bash[17386]: cluster 2024-02-13T00:41:10.235043+0000 mgr.y (mgr.24461) 458 : cluster [DBG] pgmap v540: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:41:11.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:11 smithi080 bash[17386]: cluster 2024-02-13T00:41:10.723898+0000 mon.a (mon.0) 1998 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2024-02-13T00:41:11.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:11 smithi080 bash[17386]: audit 2024-02-13T00:41:10.756084+0000 mon.a (mon.0) 1999 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:41:11.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:11 smithi080 bash[17386]: audit 2024-02-13T00:41:10.756617+0000 mon.a (mon.0) 2000 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-39"}]: dispatch 2024-02-13T00:41:11.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:11 smithi080 bash[24237]: cluster 2024-02-13T00:41:10.235043+0000 mgr.y (mgr.24461) 458 : cluster [DBG] pgmap v540: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:41:11.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:11 smithi080 bash[24237]: cluster 2024-02-13T00:41:10.723898+0000 mon.a (mon.0) 1998 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2024-02-13T00:41:11.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:11 smithi080 bash[24237]: audit 2024-02-13T00:41:10.756084+0000 mon.a (mon.0) 1999 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:41:11.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:11 smithi080 bash[24237]: audit 2024-02-13T00:41:10.756617+0000 mon.a (mon.0) 2000 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-39"}]: dispatch 2024-02-13T00:41:12.316 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [==========] Running 72 tests from 4 test suites. 2024-02-13T00:41:12.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [----------] Global test environment set-up. 2024-02-13T00:41:12.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2024-02-13T00:41:12.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: seed 54255 2024-02-13T00:41:12.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2024-02-13T00:41:12.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (224 ms) 2024-02-13T00:41:12.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2024-02-13T00:41:12.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (16895 ms) 2024-02-13T00:41:12.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2024-02-13T00:41:12.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (10 ms) 2024-02-13T00:41:12.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (17129 ms total) 2024-02-13T00:41:12.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: 2024-02-13T00:41:12.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [----------] 43 tests from LibRadosTwoPoolsPP 2024-02-13T00:41:12.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2024-02-13T00:41:12.317 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (8339 ms) 2024-02-13T00:41:12.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2024-02-13T00:41:12.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (7205 ms) 2024-02-13T00:41:12.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-02-13T00:41:12.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (9694 ms) 2024-02-13T00:41:12.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-02-13T00:41:12.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: my_snaps [4] 2024-02-13T00:41:12.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: my_snaps [5,4] 2024-02-13T00:41:12.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: my_snaps [6,5,4] 2024-02-13T00:41:12.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: my_snaps [7,6,5,4] 2024-02-13T00:41:12.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: promoting some heads 2024-02-13T00:41:12.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: promoting from clones for snap 7 2024-02-13T00:41:12.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: promoting from clones for snap 6 2024-02-13T00:41:12.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: promoting from clones for snap 5 2024-02-13T00:41:12.318 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: promoting from clones for snap 4 2024-02-13T00:41:12.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: waiting for scrubs... 2024-02-13T00:41:12.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: done waiting 2024-02-13T00:41:12.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (49414 ms) 2024-02-13T00:41:12.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-02-13T00:41:12.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (10462 ms) 2024-02-13T00:41:12.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-02-13T00:41:12.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (7559 ms) 2024-02-13T00:41:12.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-02-13T00:41:12.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (8021 ms) 2024-02-13T00:41:12.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2024-02-13T00:41:12.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (8036 ms) 2024-02-13T00:41:12.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-02-13T00:41:12.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (10036 ms) 2024-02-13T00:41:12.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-02-13T00:41:12.319 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (8917 ms) 2024-02-13T00:41:12.320 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-02-13T00:41:12.320 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (10460 ms) 2024-02-13T00:41:12.320 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-02-13T00:41:12.320 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (7542 ms) 2024-02-13T00:41:12.320 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2024-02-13T00:41:12.320 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (8029 ms) 2024-02-13T00:41:12.320 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-02-13T00:41:12.320 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (13101 ms) 2024-02-13T00:41:12.320 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-02-13T00:41:12.320 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (7880 ms) 2024-02-13T00:41:12.321 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-02-13T00:41:12.321 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (8457 ms) 2024-02-13T00:41:12.321 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-02-13T00:41:12.321 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: hmm, no HitSet yet 2024-02-13T00:41:12.321 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: ok, hit_set contains 189:602f83fe:::foo:head 2024-02-13T00:41:13.116 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:12 smithi080 bash[17386]: audit 2024-02-13T00:41:11.306322+0000 mon.a (mon.0) 2001 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi080-54183-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi080-54183-54"}]': finished 2024-02-13T00:41:13.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:12 smithi080 bash[17386]: audit 2024-02-13T00:41:11.306450+0000 mon.a (mon.0) 2002 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-39"}]': finished 2024-02-13T00:41:13.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:12 smithi080 bash[17386]: cluster 2024-02-13T00:41:11.306529+0000 mon.a (mon.0) 2003 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2024-02-13T00:41:13.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:12 smithi080 bash[24237]: audit 2024-02-13T00:41:11.306322+0000 mon.a (mon.0) 2001 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi080-54183-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi080-54183-54"}]': finished 2024-02-13T00:41:13.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:12 smithi080 bash[24237]: audit 2024-02-13T00:41:11.306450+0000 mon.a (mon.0) 2002 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-39"}]': finished 2024-02-13T00:41:13.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:12 smithi080 bash[24237]: cluster 2024-02-13T00:41:11.306529+0000 mon.a (mon.0) 2003 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2024-02-13T00:41:13.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:12 smithi106 bash[18459]: audit 2024-02-13T00:41:11.306322+0000 mon.a (mon.0) 2001 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi080-54183-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi080-54183-54"}]': finished 2024-02-13T00:41:13.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:12 smithi106 bash[18459]: audit 2024-02-13T00:41:11.306450+0000 mon.a (mon.0) 2002 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-39"}]': finished 2024-02-13T00:41:13.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:12 smithi106 bash[18459]: cluster 2024-02-13T00:41:11.306529+0000 mon.a (mon.0) 2003 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2024-02-13T00:41:13.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:41:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:41:13] "GET /metrics HTTP/1.1" 200 186860 "" "Prometheus/2.33.4" 2024-02-13T00:41:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:13 smithi106 bash[18459]: cluster 2024-02-13T00:41:12.235674+0000 mgr.y (mgr.24461) 459 : cluster [DBG] pgmap v543: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:41:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:13 smithi106 bash[18459]: cluster 2024-02-13T00:41:12.310342+0000 mon.a (mon.0) 2004 : cluster [DBG] osdmap e275: 8 total, 8 up, 8 in 2024-02-13T00:41:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:13 smithi106 bash[18459]: cluster 2024-02-13T00:41:13.313914+0000 mon.a (mon.0) 2005 : cluster [DBG] osdmap e276: 8 total, 8 up, 8 in 2024-02-13T00:41:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:13 smithi106 bash[18459]: audit 2024-02-13T00:41:13.317861+0000 mon.a (mon.0) 2006 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi080-54183-54"}]: dispatch 2024-02-13T00:41:14.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:13 smithi106 bash[18459]: audit 2024-02-13T00:41:13.318844+0000 mon.a (mon.0) 2007 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:41:14.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:13 smithi080 bash[17386]: cluster 2024-02-13T00:41:12.235674+0000 mgr.y (mgr.24461) 459 : cluster [DBG] pgmap v543: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:41:14.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:13 smithi080 bash[17386]: cluster 2024-02-13T00:41:12.310342+0000 mon.a (mon.0) 2004 : cluster [DBG] osdmap e275: 8 total, 8 up, 8 in 2024-02-13T00:41:14.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:13 smithi080 bash[17386]: cluster 2024-02-13T00:41:13.313914+0000 mon.a (mon.0) 2005 : cluster [DBG] osdmap e276: 8 total, 8 up, 8 in 2024-02-13T00:41:14.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:13 smithi080 bash[17386]: audit 2024-02-13T00:41:13.317861+0000 mon.a (mon.0) 2006 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi080-54183-54"}]: dispatch 2024-02-13T00:41:14.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:13 smithi080 bash[17386]: audit 2024-02-13T00:41:13.318844+0000 mon.a (mon.0) 2007 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:41:14.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:13 smithi080 bash[24237]: cluster 2024-02-13T00:41:12.235674+0000 mgr.y (mgr.24461) 459 : cluster [DBG] pgmap v543: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:41:14.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:13 smithi080 bash[24237]: cluster 2024-02-13T00:41:12.310342+0000 mon.a (mon.0) 2004 : cluster [DBG] osdmap e275: 8 total, 8 up, 8 in 2024-02-13T00:41:14.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:13 smithi080 bash[24237]: cluster 2024-02-13T00:41:13.313914+0000 mon.a (mon.0) 2005 : cluster [DBG] osdmap e276: 8 total, 8 up, 8 in 2024-02-13T00:41:14.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:13 smithi080 bash[24237]: audit 2024-02-13T00:41:13.317861+0000 mon.a (mon.0) 2006 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi080-54183-54"}]: dispatch 2024-02-13T00:41:14.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:13 smithi080 bash[24237]: audit 2024-02-13T00:41:13.318844+0000 mon.a (mon.0) 2007 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:41:15.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:15 smithi106 bash[18459]: cluster 2024-02-13T00:41:14.236644+0000 mgr.y (mgr.24461) 460 : cluster [DBG] pgmap v546: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:15.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:15 smithi106 bash[18459]: audit 2024-02-13T00:41:14.319355+0000 mon.a (mon.0) 2008 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi080-54183-54"}]': finished 2024-02-13T00:41:15.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:15 smithi106 bash[18459]: audit 2024-02-13T00:41:14.319474+0000 mon.a (mon.0) 2009 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:41:15.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:15 smithi106 bash[18459]: cluster 2024-02-13T00:41:14.319683+0000 mon.a (mon.0) 2010 : cluster [DBG] osdmap e277: 8 total, 8 up, 8 in 2024-02-13T00:41:15.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:15 smithi106 bash[18459]: audit 2024-02-13T00:41:14.324516+0000 mon.a (mon.0) 2011 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi080-54183-54"}]: dispatch 2024-02-13T00:41:15.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:15 smithi106 bash[18459]: audit 2024-02-13T00:41:14.325808+0000 mon.a (mon.0) 2012 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi080-54255-6","var": "pg_num","format": "json"}]: dispatch 2024-02-13T00:41:15.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:15 smithi106 bash[18459]: audit 2024-02-13T00:41:14.326671+0000 mon.a (mon.0) 2013 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:41:15.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:15 smithi080 bash[17386]: cluster 2024-02-13T00:41:14.236644+0000 mgr.y (mgr.24461) 460 : cluster [DBG] pgmap v546: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:15 smithi080 bash[17386]: audit 2024-02-13T00:41:14.319355+0000 mon.a (mon.0) 2008 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi080-54183-54"}]': finished 2024-02-13T00:41:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:15 smithi080 bash[17386]: audit 2024-02-13T00:41:14.319474+0000 mon.a (mon.0) 2009 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:41:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:15 smithi080 bash[17386]: cluster 2024-02-13T00:41:14.319683+0000 mon.a (mon.0) 2010 : cluster [DBG] osdmap e277: 8 total, 8 up, 8 in 2024-02-13T00:41:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:15 smithi080 bash[17386]: audit 2024-02-13T00:41:14.324516+0000 mon.a (mon.0) 2011 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi080-54183-54"}]: dispatch 2024-02-13T00:41:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:15 smithi080 bash[17386]: audit 2024-02-13T00:41:14.325808+0000 mon.a (mon.0) 2012 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi080-54255-6","var": "pg_num","format": "json"}]: dispatch 2024-02-13T00:41:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:15 smithi080 bash[17386]: audit 2024-02-13T00:41:14.326671+0000 mon.a (mon.0) 2013 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:41:15.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:15 smithi080 bash[24237]: cluster 2024-02-13T00:41:14.236644+0000 mgr.y (mgr.24461) 460 : cluster [DBG] pgmap v546: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:15.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:15 smithi080 bash[24237]: audit 2024-02-13T00:41:14.319355+0000 mon.a (mon.0) 2008 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi080-54183-54"}]': finished 2024-02-13T00:41:15.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:15 smithi080 bash[24237]: audit 2024-02-13T00:41:14.319474+0000 mon.a (mon.0) 2009 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:41:15.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:15 smithi080 bash[24237]: cluster 2024-02-13T00:41:14.319683+0000 mon.a (mon.0) 2010 : cluster [DBG] osdmap e277: 8 total, 8 up, 8 in 2024-02-13T00:41:15.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:15 smithi080 bash[24237]: audit 2024-02-13T00:41:14.324516+0000 mon.a (mon.0) 2011 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi080-54183-54"}]: dispatch 2024-02-13T00:41:15.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:15 smithi080 bash[24237]: audit 2024-02-13T00:41:14.325808+0000 mon.a (mon.0) 2012 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi080-54255-6","var": "pg_num","format": "json"}]: dispatch 2024-02-13T00:41:15.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:15 smithi080 bash[24237]: audit 2024-02-13T00:41:14.326671+0000 mon.a (mon.0) 2013 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:41:16.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:16 smithi106 bash[18459]: audit 2024-02-13T00:41:15.320426+0000 mon.a (mon.0) 2014 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi080-54183-54"}]': finished 2024-02-13T00:41:16.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:16 smithi106 bash[18459]: audit 2024-02-13T00:41:15.320761+0000 mon.a (mon.0) 2015 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-41", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:41:16.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:16 smithi106 bash[18459]: cluster 2024-02-13T00:41:15.320857+0000 mon.a (mon.0) 2016 : cluster [DBG] osdmap e278: 8 total, 8 up, 8 in 2024-02-13T00:41:16.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:16 smithi106 bash[18459]: audit 2024-02-13T00:41:15.323154+0000 mon.a (mon.0) 2017 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-41","var": "hit_set_count","val": "8"}]: dispatch 2024-02-13T00:41:16.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:16 smithi106 bash[18459]: audit 2024-02-13T00:41:15.346370+0000 mon.a (mon.0) 2018 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi080-54183-55"}]: dispatch 2024-02-13T00:41:16.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:16 smithi106 bash[18459]: audit 2024-02-13T00:41:15.347751+0000 mon.a (mon.0) 2019 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi080-54183-55"}]: dispatch 2024-02-13T00:41:16.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:16 smithi106 bash[18459]: audit 2024-02-13T00:41:15.348362+0000 mon.a (mon.0) 2020 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi080-54183-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:16.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:16 smithi080 bash[17386]: audit 2024-02-13T00:41:15.320426+0000 mon.a (mon.0) 2014 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi080-54183-54"}]': finished 2024-02-13T00:41:16.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:16 smithi080 bash[17386]: audit 2024-02-13T00:41:15.320761+0000 mon.a (mon.0) 2015 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-41", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:41:16.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:16 smithi080 bash[17386]: cluster 2024-02-13T00:41:15.320857+0000 mon.a (mon.0) 2016 : cluster [DBG] osdmap e278: 8 total, 8 up, 8 in 2024-02-13T00:41:16.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:16 smithi080 bash[17386]: audit 2024-02-13T00:41:15.323154+0000 mon.a (mon.0) 2017 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-41","var": "hit_set_count","val": "8"}]: dispatch 2024-02-13T00:41:16.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:16 smithi080 bash[17386]: audit 2024-02-13T00:41:15.346370+0000 mon.a (mon.0) 2018 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi080-54183-55"}]: dispatch 2024-02-13T00:41:16.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:16 smithi080 bash[17386]: audit 2024-02-13T00:41:15.347751+0000 mon.a (mon.0) 2019 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi080-54183-55"}]: dispatch 2024-02-13T00:41:16.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:16 smithi080 bash[17386]: audit 2024-02-13T00:41:15.348362+0000 mon.a (mon.0) 2020 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi080-54183-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:16.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:16 smithi080 bash[24237]: audit 2024-02-13T00:41:15.320426+0000 mon.a (mon.0) 2014 : audit [INF] from='client.? 172.21.15.80:0/3148899633' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi080-54183-54"}]': finished 2024-02-13T00:41:16.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:16 smithi080 bash[24237]: audit 2024-02-13T00:41:15.320761+0000 mon.a (mon.0) 2015 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-41", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:41:16.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:16 smithi080 bash[24237]: cluster 2024-02-13T00:41:15.320857+0000 mon.a (mon.0) 2016 : cluster [DBG] osdmap e278: 8 total, 8 up, 8 in 2024-02-13T00:41:16.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:16 smithi080 bash[24237]: audit 2024-02-13T00:41:15.323154+0000 mon.a (mon.0) 2017 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-41","var": "hit_set_count","val": "8"}]: dispatch 2024-02-13T00:41:16.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:16 smithi080 bash[24237]: audit 2024-02-13T00:41:15.346370+0000 mon.a (mon.0) 2018 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi080-54183-55"}]: dispatch 2024-02-13T00:41:16.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:16 smithi080 bash[24237]: audit 2024-02-13T00:41:15.347751+0000 mon.a (mon.0) 2019 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi080-54183-55"}]: dispatch 2024-02-13T00:41:16.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:16 smithi080 bash[24237]: audit 2024-02-13T00:41:15.348362+0000 mon.a (mon.0) 2020 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi080-54183-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:18.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:17 smithi106 bash[18459]: cluster 2024-02-13T00:41:16.237510+0000 mgr.y (mgr.24461) 461 : cluster [DBG] pgmap v549: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:18.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:17 smithi106 bash[18459]: audit 2024-02-13T00:41:16.324071+0000 mon.a (mon.0) 2021 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-41","var": "hit_set_count","val": "8"}]': finished 2024-02-13T00:41:18.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:17 smithi106 bash[18459]: audit 2024-02-13T00:41:16.324416+0000 mon.a (mon.0) 2022 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi080-54183-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:18.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:17 smithi106 bash[18459]: cluster 2024-02-13T00:41:16.324524+0000 mon.a (mon.0) 2023 : cluster [DBG] osdmap e279: 8 total, 8 up, 8 in 2024-02-13T00:41:18.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:17 smithi106 bash[18459]: audit 2024-02-13T00:41:16.326087+0000 mon.a (mon.0) 2024 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-41","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:41:18.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:17 smithi106 bash[18459]: audit 2024-02-13T00:41:16.326464+0000 mon.a (mon.0) 2025 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi080-54183-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi080-54183-55"}]: dispatch 2024-02-13T00:41:18.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:17 smithi106 bash[18459]: audit 2024-02-13T00:41:16.917978+0000 mon.a (mon.0) 2026 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:41:18.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:17 smithi106 bash[18459]: audit 2024-02-13T00:41:17.326274+0000 mon.a (mon.0) 2027 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-41","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:41:18.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:17 smithi080 bash[17386]: cluster 2024-02-13T00:41:16.237510+0000 mgr.y (mgr.24461) 461 : cluster [DBG] pgmap v549: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:18.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:17 smithi080 bash[17386]: audit 2024-02-13T00:41:16.324071+0000 mon.a (mon.0) 2021 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-41","var": "hit_set_count","val": "8"}]': finished 2024-02-13T00:41:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:17 smithi080 bash[17386]: audit 2024-02-13T00:41:16.324416+0000 mon.a (mon.0) 2022 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi080-54183-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:17 smithi080 bash[17386]: cluster 2024-02-13T00:41:16.324524+0000 mon.a (mon.0) 2023 : cluster [DBG] osdmap e279: 8 total, 8 up, 8 in 2024-02-13T00:41:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:17 smithi080 bash[17386]: audit 2024-02-13T00:41:16.326087+0000 mon.a (mon.0) 2024 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-41","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:41:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:17 smithi080 bash[17386]: audit 2024-02-13T00:41:16.326464+0000 mon.a (mon.0) 2025 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi080-54183-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi080-54183-55"}]: dispatch 2024-02-13T00:41:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:17 smithi080 bash[17386]: audit 2024-02-13T00:41:16.917978+0000 mon.a (mon.0) 2026 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:41:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:17 smithi080 bash[17386]: audit 2024-02-13T00:41:17.326274+0000 mon.a (mon.0) 2027 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-41","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:41:18.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:17 smithi080 bash[24237]: cluster 2024-02-13T00:41:16.237510+0000 mgr.y (mgr.24461) 461 : cluster [DBG] pgmap v549: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:18.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:17 smithi080 bash[24237]: audit 2024-02-13T00:41:16.324071+0000 mon.a (mon.0) 2021 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-41","var": "hit_set_count","val": "8"}]': finished 2024-02-13T00:41:18.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:17 smithi080 bash[24237]: audit 2024-02-13T00:41:16.324416+0000 mon.a (mon.0) 2022 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi080-54183-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:18.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:17 smithi080 bash[24237]: cluster 2024-02-13T00:41:16.324524+0000 mon.a (mon.0) 2023 : cluster [DBG] osdmap e279: 8 total, 8 up, 8 in 2024-02-13T00:41:18.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:17 smithi080 bash[24237]: audit 2024-02-13T00:41:16.326087+0000 mon.a (mon.0) 2024 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-41","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:41:18.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:17 smithi080 bash[24237]: audit 2024-02-13T00:41:16.326464+0000 mon.a (mon.0) 2025 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi080-54183-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi080-54183-55"}]: dispatch 2024-02-13T00:41:18.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:17 smithi080 bash[24237]: audit 2024-02-13T00:41:16.917978+0000 mon.a (mon.0) 2026 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:41:18.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:17 smithi080 bash[24237]: audit 2024-02-13T00:41:17.326274+0000 mon.a (mon.0) 2027 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-41","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:41:18.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:41:18 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:41:18.757 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (8607 ms) 2024-02-13T00:41:18.758 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-02-13T00:41:18.758 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg_num = 32 2024-02-13T00:41:18.758 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 0 ls 1707784879,0 2024-02-13T00:41:18.758 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 1 ls 1707784879,0 2024-02-13T00:41:18.758 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 2 ls 1707784879,0 2024-02-13T00:41:18.758 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 3 ls 1707784879,0 2024-02-13T00:41:18.758 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 4 ls 1707784879,0 2024-02-13T00:41:18.758 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 5 ls 1707784879,0 2024-02-13T00:41:18.758 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 6 ls 1707784879,0 2024-02-13T00:41:18.758 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 7 ls 1707784879,0 2024-02-13T00:41:18.758 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 8 ls 1707784879,0 2024-02-13T00:41:18.758 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 9 ls 1707784879,0 2024-02-13T00:41:18.758 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 10 ls 1707784879,0 2024-02-13T00:41:18.758 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 11 ls 1707784879,0 2024-02-13T00:41:18.759 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 12 ls 1707784879,0 2024-02-13T00:41:18.759 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 13 ls 1707784879,0 2024-02-13T00:41:18.759 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 14 ls 1707784879,0 2024-02-13T00:41:18.759 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 15 ls 1707784879,0 2024-02-13T00:41:18.759 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 16 ls 1707784879,0 2024-02-13T00:41:18.759 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 17 ls 1707784879,0 2024-02-13T00:41:18.759 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 18 ls 1707784879,0 2024-02-13T00:41:18.759 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 19 ls 1707784879,0 2024-02-13T00:41:18.759 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 20 ls 1707784879,0 2024-02-13T00:41:18.759 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 21 ls 1707784879,0 2024-02-13T00:41:18.759 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 22 ls 1707784879,0 2024-02-13T00:41:18.759 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 23 ls 1707784879,0 2024-02-13T00:41:18.759 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 24 ls 1707784879,0 2024-02-13T00:41:18.759 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 25 ls 1707784879,0 2024-02-13T00:41:18.759 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 26 ls 1707784879,0 2024-02-13T00:41:18.759 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 27 ls 1707784879,0 2024-02-13T00:41:18.760 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 28 ls 1707784879,0 2024-02-13T00:41:18.760 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 29 ls 1707784879,0 2024-02-13T00:41:18.760 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 30 ls 1707784879,0 2024-02-13T00:41:18.760 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg 31 ls 1707784879,0 2024-02-13T00:41:18.760 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: pg_num = 32 2024-02-13T00:41:18.760 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:6cac518f:::0:head 2024-02-13T00:41:18.760 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:02547ec2:::1:head 2024-02-13T00:41:18.760 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:f905c69b:::2:head 2024-02-13T00:41:18.760 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:cfc208b3:::3:head 2024-02-13T00:41:18.760 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:d83876eb:::4:head 2024-02-13T00:41:18.760 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:b29083e3:::5:head 2024-02-13T00:41:18.760 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:c4fdafeb:::6:head 2024-02-13T00:41:18.760 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:5c6b0b28:::7:head 2024-02-13T00:41:18.760 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:bd63b0f1:::8:head 2024-02-13T00:41:18.761 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:e960b815:::9:head 2024-02-13T00:41:18.761 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:52ea6a34:::10:head 2024-02-13T00:41:18.761 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:89d3ae78:::11:head 2024-02-13T00:41:18.761 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:de5d7c5f:::12:head 2024-02-13T00:41:18.761 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:566253c9:::13:head 2024-02-13T00:41:18.761 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:62a1935d:::14:head 2024-02-13T00:41:18.761 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:863748b0:::15:head 2024-02-13T00:41:18.761 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:3958e169:::16:head 2024-02-13T00:41:18.761 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:4d4dabf9:::17:head 2024-02-13T00:41:18.761 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:8391935d:::18:head 2024-02-13T00:41:18.761 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:28883081:::19:head 2024-02-13T00:41:18.761 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:69259c59:::20:head 2024-02-13T00:41:18.761 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:4bdb80b7:::21:head 2024-02-13T00:41:18.761 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:a11c5d71:::22:head 2024-02-13T00:41:18.762 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:271af37b:::23:head 2024-02-13T00:41:18.762 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:95b121be:::24:head 2024-02-13T00:41:18.762 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:58d1031b:::25:head 2024-02-13T00:41:18.762 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:0a050783:::26:head 2024-02-13T00:41:18.762 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:c709704c:::27:head 2024-02-13T00:41:18.762 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:cbe56eaf:::28:head 2024-02-13T00:41:18.762 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:86b4b162:::29:head 2024-02-13T00:41:18.762 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:70d89383:::30:head 2024-02-13T00:41:18.762 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:dd450c7c:::31:head 2024-02-13T00:41:18.762 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:6d5729b1:::32:head 2024-02-13T00:41:18.762 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:c388f3fb:::33:head 2024-02-13T00:41:18.762 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:56cfea31:::34:head 2024-02-13T00:41:18.762 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:9dbc1bf7:::35:head 2024-02-13T00:41:18.763 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:40b74ccd:::36:head 2024-02-13T00:41:18.763 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:4d5aaf42:::37:head 2024-02-13T00:41:18.763 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:920f362c:::38:head 2024-02-13T00:41:18.763 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:6cc53222:::39:head 2024-02-13T00:41:18.763 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:9cad833f:::40:head 2024-02-13T00:41:18.763 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:1ea84d41:::41:head 2024-02-13T00:41:18.763 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:c4480ef6:::42:head 2024-02-13T00:41:18.763 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:a694361e:::43:head 2024-02-13T00:41:18.763 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:d1bd33e9:::44:head 2024-02-13T00:41:18.763 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:ddc2cd5d:::45:head 2024-02-13T00:41:18.763 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:2b782207:::46:head 2024-02-13T00:41:18.763 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:7b187fca:::47:head 2024-02-13T00:41:18.763 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:90ecdf6f:::48:head 2024-02-13T00:41:18.763 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:a5ed95fe:::49:head 2024-02-13T00:41:18.764 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:ea0eaa55:::50:head 2024-02-13T00:41:18.764 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:f33ef17b:::51:head 2024-02-13T00:41:18.764 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:a0d1b2f6:::52:head 2024-02-13T00:41:18.764 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:60c5229e:::53:head 2024-02-13T00:41:18.764 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:edcbc575:::54:head 2024-02-13T00:41:18.764 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:102cf253:::55:head 2024-02-13T00:41:18.764 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:efb7fb0b:::56:head 2024-02-13T00:41:18.764 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:50d0a326:::57:head 2024-02-13T00:41:18.764 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:d4dc5daf:::58:head 2024-02-13T00:41:18.764 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:3a130462:::59:head 2024-02-13T00:41:18.764 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:ec87ed71:::60:head 2024-02-13T00:41:18.764 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:d5bc9454:::61:head 2024-02-13T00:41:18.764 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:3ddfe313:::62:head 2024-02-13T00:41:18.764 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:7c2816b9:::63:head 2024-02-13T00:41:18.764 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:47e00e4d:::64:head 2024-02-13T00:41:18.765 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:c6410c18:::65:head 2024-02-13T00:41:18.765 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:b48ed237:::66:head 2024-02-13T00:41:18.765 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:cd63ad31:::67:head 2024-02-13T00:41:18.765 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:b179e92b:::68:head 2024-02-13T00:41:18.765 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:0d9f741a:::69:head 2024-02-13T00:41:18.765 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:6d3352ae:::70:head 2024-02-13T00:41:18.765 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:c6d5c19e:::71:head 2024-02-13T00:41:18.765 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:bc4729c3:::72:head 2024-02-13T00:41:18.765 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:77e930b9:::73:head 2024-02-13T00:41:18.765 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:0abeecfd:::74:head 2024-02-13T00:41:18.765 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:b7c37e15:::75:head 2024-02-13T00:41:18.765 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:b6378398:::76:head 2024-02-13T00:41:18.765 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:02bd68de:::77:head 2024-02-13T00:41:18.765 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:cc795d2d:::78:head 2024-02-13T00:41:18.765 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:630d4fea:::79:head 2024-02-13T00:41:18.766 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:e0d29ef5:::80:head 2024-02-13T00:41:18.766 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:fd6f13d2:::81:head 2024-02-13T00:41:18.766 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:606461d5:::82:head 2024-02-13T00:41:18.766 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:eadbdc43:::83:head 2024-02-13T00:41:18.766 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:8761d0bb:::84:head 2024-02-13T00:41:18.766 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:9ef0186f:::85:head 2024-02-13T00:41:18.766 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:e0d41294:::86:head 2024-02-13T00:41:18.766 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:961de695:::87:head 2024-02-13T00:41:18.766 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:1423148f:::88:head 2024-02-13T00:41:18.766 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:633a8fa2:::89:head 2024-02-13T00:41:18.766 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:a8653809:::90:head 2024-02-13T00:41:18.766 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:3dac8b33:::91:head 2024-02-13T00:41:18.766 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:35aad435:::92:head 2024-02-13T00:41:18.766 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:f6dcc343:::93:head 2024-02-13T00:41:18.766 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:dbbdad87:::94:head 2024-02-13T00:41:18.766 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:1cb48ce0:::95:head 2024-02-13T00:41:18.767 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:03cd461c:::96:head 2024-02-13T00:41:18.767 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:17a4ea99:::97:head 2024-02-13T00:41:18.767 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:9993c9a7:::98:head 2024-02-13T00:41:18.767 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:6394211c:::99:head 2024-02-13T00:41:18.767 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:94c7ae57:::100:head 2024-02-13T00:41:18.767 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:6fdee5bb:::101:head 2024-02-13T00:41:18.767 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:9a477fd1:::102:head 2024-02-13T00:41:18.767 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:eb850916:::103:head 2024-02-13T00:41:18.767 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:affc56b9:::104:head 2024-02-13T00:41:18.767 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:b42dc814:::105:head 2024-02-13T00:41:18.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:f319f8f0:::106:head 2024-02-13T00:41:18.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:9a40b9de:::107:head 2024-02-13T00:41:18.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:8b524f28:::108:head 2024-02-13T00:41:18.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:e3de589f:::109:head 2024-02-13T00:41:18.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:90f90a5b:::110:head 2024-02-13T00:41:18.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:a7b4f1d7:::111:head 2024-02-13T00:41:18.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:af51766e:::112:head 2024-02-13T00:41:18.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:b6f90bd1:::113:head 2024-02-13T00:41:18.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:e0261208:::114:head 2024-02-13T00:41:18.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:c9569ef7:::115:head 2024-02-13T00:41:18.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:61bebe50:::116:head 2024-02-13T00:41:18.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:fe93412b:::117:head 2024-02-13T00:41:18.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:d3d38bee:::118:head 2024-02-13T00:41:18.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:3100ba0c:::119:head 2024-02-13T00:41:18.768 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:d0560ada:::120:head 2024-02-13T00:41:18.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:f0ea8b35:::121:head 2024-02-13T00:41:18.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:766f231a:::122:head 2024-02-13T00:41:18.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:a07a2582:::123:head 2024-02-13T00:41:18.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:bd7c6b3a:::124:head 2024-02-13T00:41:18.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:fb2ddaff:::125:head 2024-02-13T00:41:18.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:4408e1fe:::126:head 2024-02-13T00:41:18.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:ee1df7a7:::127:head 2024-02-13T00:41:18.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:c3002909:::128:head 2024-02-13T00:41:18.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:4f48ffa9:::129:head 2024-02-13T00:41:18.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:edf38733:::130:head 2024-02-13T00:41:18.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:c08425c0:::131:head 2024-02-13T00:41:18.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:5f902d98:::132:head 2024-02-13T00:41:18.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:41ea2c93:::133:head 2024-02-13T00:41:18.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:813cee13:::134:head 2024-02-13T00:41:18.769 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:0131818d:::135:head 2024-02-13T00:41:18.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:26ba5a85:::136:head 2024-02-13T00:41:18.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:381b8a5a:::137:head 2024-02-13T00:41:18.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:28797e47:::138:head 2024-02-13T00:41:18.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:bfca7f22:::139:head 2024-02-13T00:41:18.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:36807075:::140:head 2024-02-13T00:41:18.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:80b03975:::141:head 2024-02-13T00:41:18.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:5c15709b:::142:head 2024-02-13T00:41:18.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:f39ea15e:::143:head 2024-02-13T00:41:18.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:ea992956:::144:head 2024-02-13T00:41:18.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:48887b1c:::145:head 2024-02-13T00:41:18.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:9f24a9dd:::146:head 2024-02-13T00:41:18.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:987f100b:::147:head 2024-02-13T00:41:18.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:d2dd3581:::148:head 2024-02-13T00:41:18.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:7fed1808:::149:head 2024-02-13T00:41:18.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:c80b70e9:::150:head 2024-02-13T00:41:18.770 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:85ed90f9:::151:head 2024-02-13T00:41:18.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:36428b24:::152:head 2024-02-13T00:41:18.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:d044c34a:::153:head 2024-02-13T00:41:18.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:7c18bf58:::154:head 2024-02-13T00:41:18.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:d1c21232:::155:head 2024-02-13T00:41:18.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:a7a3c575:::156:head 2024-02-13T00:41:18.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:87da0633:::157:head 2024-02-13T00:41:18.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:d5ac3822:::158:head 2024-02-13T00:41:18.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:3f20522d:::159:head 2024-02-13T00:41:18.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:6ca26563:::160:head 2024-02-13T00:41:18.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:532ce135:::161:head 2024-02-13T00:41:18.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:c78863e6:::162:head 2024-02-13T00:41:18.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:7462ddf6:::163:head 2024-02-13T00:41:18.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:5d165639:::164:head 2024-02-13T00:41:18.771 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:f43765fc:::165:head 2024-02-13T00:41:19.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:18 smithi106 bash[18459]: cluster 2024-02-13T00:41:17.765500+0000 mon.a (mon.0) 2028 : cluster [DBG] osdmap e280: 8 total, 8 up, 8 in 2024-02-13T00:41:19.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:18 smithi106 bash[18459]: audit 2024-02-13T00:41:17.767328+0000 mon.a (mon.0) 2029 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-41","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-02-13T00:41:19.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:18 smithi106 bash[18459]: audit 2024-02-13T00:41:18.328682+0000 mon.a (mon.0) 2030 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi080-54183-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi080-54183-55"}]': finished 2024-02-13T00:41:19.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:18 smithi106 bash[18459]: audit 2024-02-13T00:41:18.329187+0000 mon.a (mon.0) 2031 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-41","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-02-13T00:41:19.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:18 smithi106 bash[18459]: cluster 2024-02-13T00:41:18.329323+0000 mon.a (mon.0) 2032 : cluster [DBG] osdmap e281: 8 total, 8 up, 8 in 2024-02-13T00:41:19.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:18 smithi106 bash[18459]: audit 2024-02-13T00:41:18.755168+0000 mon.a (mon.0) 2033 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi080-54255-41","var": "pg_num","format": "json"}]: dispatch 2024-02-13T00:41:19.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:18 smithi080 bash[24237]: cluster 2024-02-13T00:41:17.765500+0000 mon.a (mon.0) 2028 : cluster [DBG] osdmap e280: 8 total, 8 up, 8 in 2024-02-13T00:41:19.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:18 smithi080 bash[24237]: audit 2024-02-13T00:41:17.767328+0000 mon.a (mon.0) 2029 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-41","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-02-13T00:41:19.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:18 smithi080 bash[24237]: audit 2024-02-13T00:41:18.328682+0000 mon.a (mon.0) 2030 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi080-54183-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi080-54183-55"}]': finished 2024-02-13T00:41:19.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:18 smithi080 bash[24237]: audit 2024-02-13T00:41:18.329187+0000 mon.a (mon.0) 2031 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-41","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-02-13T00:41:19.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:18 smithi080 bash[24237]: cluster 2024-02-13T00:41:18.329323+0000 mon.a (mon.0) 2032 : cluster [DBG] osdmap e281: 8 total, 8 up, 8 in 2024-02-13T00:41:19.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:18 smithi080 bash[24237]: audit 2024-02-13T00:41:18.755168+0000 mon.a (mon.0) 2033 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi080-54255-41","var": "pg_num","format": "json"}]: dispatch 2024-02-13T00:41:19.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:18 smithi080 bash[17386]: cluster 2024-02-13T00:41:17.765500+0000 mon.a (mon.0) 2028 : cluster [DBG] osdmap e280: 8 total, 8 up, 8 in 2024-02-13T00:41:19.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:18 smithi080 bash[17386]: audit 2024-02-13T00:41:17.767328+0000 mon.a (mon.0) 2029 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-41","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-02-13T00:41:19.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:18 smithi080 bash[17386]: audit 2024-02-13T00:41:18.328682+0000 mon.a (mon.0) 2030 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi080-54183-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi080-54183-55"}]': finished 2024-02-13T00:41:19.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:18 smithi080 bash[17386]: audit 2024-02-13T00:41:18.329187+0000 mon.a (mon.0) 2031 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-41","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-02-13T00:41:19.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:18 smithi080 bash[17386]: cluster 2024-02-13T00:41:18.329323+0000 mon.a (mon.0) 2032 : cluster [DBG] osdmap e281: 8 total, 8 up, 8 in 2024-02-13T00:41:19.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:18 smithi080 bash[17386]: audit 2024-02-13T00:41:18.755168+0000 mon.a (mon.0) 2033 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi080-54255-41","var": "pg_num","format": "json"}]: dispatch 2024-02-13T00:41:20.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:19 smithi106 bash[18459]: cluster 2024-02-13T00:41:18.239626+0000 mgr.y (mgr.24461) 462 : cluster [DBG] pgmap v552: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:20.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:19 smithi106 bash[18459]: audit 2024-02-13T00:41:18.289050+0000 mgr.y (mgr.24461) 463 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:41:20.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:19 smithi106 bash[18459]: audit 2024-02-13T00:41:19.002658+0000 mon.a (mon.0) 2034 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:41:20.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:19 smithi106 bash[18459]: audit 2024-02-13T00:41:19.003447+0000 mon.a (mon.0) 2035 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-41"}]: dispatch 2024-02-13T00:41:20.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:19 smithi106 bash[18459]: audit 2024-02-13T00:41:19.332790+0000 mon.a (mon.0) 2036 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-41"}]': finished 2024-02-13T00:41:20.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:19 smithi106 bash[18459]: cluster 2024-02-13T00:41:19.332940+0000 mon.a (mon.0) 2037 : cluster [DBG] osdmap e282: 8 total, 8 up, 8 in 2024-02-13T00:41:20.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:19 smithi080 bash[17386]: cluster 2024-02-13T00:41:18.239626+0000 mgr.y (mgr.24461) 462 : cluster [DBG] pgmap v552: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:20.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:19 smithi080 bash[17386]: audit 2024-02-13T00:41:18.289050+0000 mgr.y (mgr.24461) 463 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:41:20.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:19 smithi080 bash[17386]: audit 2024-02-13T00:41:19.002658+0000 mon.a (mon.0) 2034 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:41:20.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:19 smithi080 bash[17386]: audit 2024-02-13T00:41:19.003447+0000 mon.a (mon.0) 2035 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-41"}]: dispatch 2024-02-13T00:41:20.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:19 smithi080 bash[17386]: audit 2024-02-13T00:41:19.332790+0000 mon.a (mon.0) 2036 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-41"}]': finished 2024-02-13T00:41:20.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:19 smithi080 bash[17386]: cluster 2024-02-13T00:41:19.332940+0000 mon.a (mon.0) 2037 : cluster [DBG] osdmap e282: 8 total, 8 up, 8 in 2024-02-13T00:41:20.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:19 smithi080 bash[24237]: cluster 2024-02-13T00:41:18.239626+0000 mgr.y (mgr.24461) 462 : cluster [DBG] pgmap v552: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:20.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:19 smithi080 bash[24237]: audit 2024-02-13T00:41:18.289050+0000 mgr.y (mgr.24461) 463 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:41:20.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:19 smithi080 bash[24237]: audit 2024-02-13T00:41:19.002658+0000 mon.a (mon.0) 2034 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:41:20.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:19 smithi080 bash[24237]: audit 2024-02-13T00:41:19.003447+0000 mon.a (mon.0) 2035 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-41"}]: dispatch 2024-02-13T00:41:20.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:19 smithi080 bash[24237]: audit 2024-02-13T00:41:19.332790+0000 mon.a (mon.0) 2036 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-41"}]': finished 2024-02-13T00:41:20.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:19 smithi080 bash[24237]: cluster 2024-02-13T00:41:19.332940+0000 mon.a (mon.0) 2037 : cluster [DBG] osdmap e282: 8 total, 8 up, 8 in 2024-02-13T00:41:20.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:41:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:41:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:41:21.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:21 smithi106 bash[18459]: cluster 2024-02-13T00:41:20.240486+0000 mgr.y (mgr.24461) 464 : cluster [DBG] pgmap v555: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:21.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:21 smithi106 bash[18459]: cluster 2024-02-13T00:41:20.339439+0000 mon.a (mon.0) 2038 : cluster [DBG] osdmap e283: 8 total, 8 up, 8 in 2024-02-13T00:41:21.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:21 smithi106 bash[18459]: audit 2024-02-13T00:41:20.342019+0000 mon.a (mon.0) 2039 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi080-54183-55"}]: dispatch 2024-02-13T00:41:21.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:21 smithi080 bash[17386]: cluster 2024-02-13T00:41:20.240486+0000 mgr.y (mgr.24461) 464 : cluster [DBG] pgmap v555: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:21.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:21 smithi080 bash[17386]: cluster 2024-02-13T00:41:20.339439+0000 mon.a (mon.0) 2038 : cluster [DBG] osdmap e283: 8 total, 8 up, 8 in 2024-02-13T00:41:21.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:21 smithi080 bash[17386]: audit 2024-02-13T00:41:20.342019+0000 mon.a (mon.0) 2039 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi080-54183-55"}]: dispatch 2024-02-13T00:41:21.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:21 smithi080 bash[24237]: cluster 2024-02-13T00:41:20.240486+0000 mgr.y (mgr.24461) 464 : cluster [DBG] pgmap v555: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:21.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:21 smithi080 bash[24237]: cluster 2024-02-13T00:41:20.339439+0000 mon.a (mon.0) 2038 : cluster [DBG] osdmap e283: 8 total, 8 up, 8 in 2024-02-13T00:41:21.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:21 smithi080 bash[24237]: audit 2024-02-13T00:41:20.342019+0000 mon.a (mon.0) 2039 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi080-54183-55"}]: dispatch 2024-02-13T00:41:22.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:22 smithi106 bash[18459]: audit 2024-02-13T00:41:21.338474+0000 mon.a (mon.0) 2040 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi080-54183-55"}]': finished 2024-02-13T00:41:22.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:22 smithi106 bash[18459]: cluster 2024-02-13T00:41:21.338721+0000 mon.a (mon.0) 2041 : cluster [DBG] osdmap e284: 8 total, 8 up, 8 in 2024-02-13T00:41:22.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:22 smithi106 bash[18459]: audit 2024-02-13T00:41:21.340207+0000 mon.a (mon.0) 2042 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi080-54183-55"}]: dispatch 2024-02-13T00:41:22.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:22 smithi106 bash[18459]: audit 2024-02-13T00:41:21.341856+0000 mon.a (mon.0) 2043 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:41:22.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:22 smithi080 bash[17386]: audit 2024-02-13T00:41:21.338474+0000 mon.a (mon.0) 2040 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi080-54183-55"}]': finished 2024-02-13T00:41:22.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:22 smithi080 bash[17386]: cluster 2024-02-13T00:41:21.338721+0000 mon.a (mon.0) 2041 : cluster [DBG] osdmap e284: 8 total, 8 up, 8 in 2024-02-13T00:41:22.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:22 smithi080 bash[17386]: audit 2024-02-13T00:41:21.340207+0000 mon.a (mon.0) 2042 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi080-54183-55"}]: dispatch 2024-02-13T00:41:22.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:22 smithi080 bash[17386]: audit 2024-02-13T00:41:21.341856+0000 mon.a (mon.0) 2043 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:41:22.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:22 smithi080 bash[24237]: audit 2024-02-13T00:41:21.338474+0000 mon.a (mon.0) 2040 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi080-54183-55"}]': finished 2024-02-13T00:41:22.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:22 smithi080 bash[24237]: cluster 2024-02-13T00:41:21.338721+0000 mon.a (mon.0) 2041 : cluster [DBG] osdmap e284: 8 total, 8 up, 8 in 2024-02-13T00:41:22.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:22 smithi080 bash[24237]: audit 2024-02-13T00:41:21.340207+0000 mon.a (mon.0) 2042 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi080-54183-55"}]: dispatch 2024-02-13T00:41:22.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:22 smithi080 bash[24237]: audit 2024-02-13T00:41:21.341856+0000 mon.a (mon.0) 2043 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:41:23.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:41:23] "GET /metrics HTTP/1.1" 200 186987 "" "Prometheus/2.33.4" 2024-02-13T00:41:23.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[17386]: cluster 2024-02-13T00:41:22.241131+0000 mgr.y (mgr.24461) 465 : cluster [DBG] pgmap v558: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:41:23.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[17386]: audit 2024-02-13T00:41:22.346037+0000 mon.a (mon.0) 2044 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi080-54183-55"}]': finished 2024-02-13T00:41:23.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[17386]: audit 2024-02-13T00:41:22.346351+0000 mon.a (mon.0) 2045 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:41:23.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[17386]: cluster 2024-02-13T00:41:22.346593+0000 mon.a (mon.0) 2046 : cluster [DBG] osdmap e285: 8 total, 8 up, 8 in 2024-02-13T00:41:23.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[17386]: audit 2024-02-13T00:41:22.355332+0000 mon.a (mon.0) 2047 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:41:23.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[17386]: audit 2024-02-13T00:41:22.382245+0000 mon.a (mon.0) 2048 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi080-54183-56"}]: dispatch 2024-02-13T00:41:23.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[17386]: audit 2024-02-13T00:41:22.383323+0000 mon.a (mon.0) 2049 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi080-54183-56"}]: dispatch 2024-02-13T00:41:23.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[17386]: audit 2024-02-13T00:41:22.383719+0000 mon.a (mon.0) 2050 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi080-54183-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:23.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[17386]: audit 2024-02-13T00:41:23.347113+0000 mon.a (mon.0) 2051 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-43", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:41:23.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[17386]: audit 2024-02-13T00:41:23.347405+0000 mon.a (mon.0) 2052 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi080-54183-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:23.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[17386]: cluster 2024-02-13T00:41:23.347555+0000 mon.a (mon.0) 2053 : cluster [DBG] osdmap e286: 8 total, 8 up, 8 in 2024-02-13T00:41:23.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[17386]: audit 2024-02-13T00:41:23.349850+0000 mon.a (mon.0) 2054 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_count","val": "3"}]: dispatch 2024-02-13T00:41:23.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[17386]: audit 2024-02-13T00:41:23.350094+0000 mon.a (mon.0) 2055 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi080-54183-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi080-54183-56"}]: dispatch 2024-02-13T00:41:23.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[24237]: cluster 2024-02-13T00:41:22.241131+0000 mgr.y (mgr.24461) 465 : cluster [DBG] pgmap v558: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:41:23.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[24237]: audit 2024-02-13T00:41:22.346037+0000 mon.a (mon.0) 2044 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi080-54183-55"}]': finished 2024-02-13T00:41:23.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[24237]: audit 2024-02-13T00:41:22.346351+0000 mon.a (mon.0) 2045 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:41:23.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[24237]: cluster 2024-02-13T00:41:22.346593+0000 mon.a (mon.0) 2046 : cluster [DBG] osdmap e285: 8 total, 8 up, 8 in 2024-02-13T00:41:23.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[24237]: audit 2024-02-13T00:41:22.355332+0000 mon.a (mon.0) 2047 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:41:23.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[24237]: audit 2024-02-13T00:41:22.382245+0000 mon.a (mon.0) 2048 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi080-54183-56"}]: dispatch 2024-02-13T00:41:23.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[24237]: audit 2024-02-13T00:41:22.383323+0000 mon.a (mon.0) 2049 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi080-54183-56"}]: dispatch 2024-02-13T00:41:23.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[24237]: audit 2024-02-13T00:41:22.383719+0000 mon.a (mon.0) 2050 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi080-54183-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:23.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[24237]: audit 2024-02-13T00:41:23.347113+0000 mon.a (mon.0) 2051 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-43", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:41:23.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[24237]: audit 2024-02-13T00:41:23.347405+0000 mon.a (mon.0) 2052 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi080-54183-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:23.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[24237]: cluster 2024-02-13T00:41:23.347555+0000 mon.a (mon.0) 2053 : cluster [DBG] osdmap e286: 8 total, 8 up, 8 in 2024-02-13T00:41:23.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[24237]: audit 2024-02-13T00:41:23.349850+0000 mon.a (mon.0) 2054 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_count","val": "3"}]: dispatch 2024-02-13T00:41:23.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:23 smithi080 bash[24237]: audit 2024-02-13T00:41:23.350094+0000 mon.a (mon.0) 2055 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi080-54183-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi080-54183-56"}]: dispatch 2024-02-13T00:41:23.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:23 smithi106 bash[18459]: cluster 2024-02-13T00:41:22.241131+0000 mgr.y (mgr.24461) 465 : cluster [DBG] pgmap v558: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:41:23.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:23 smithi106 bash[18459]: audit 2024-02-13T00:41:22.346037+0000 mon.a (mon.0) 2044 : audit [INF] from='client.? 172.21.15.80:0/2789994475' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi080-54183-55"}]': finished 2024-02-13T00:41:23.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:23 smithi106 bash[18459]: audit 2024-02-13T00:41:22.346351+0000 mon.a (mon.0) 2045 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:41:23.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:23 smithi106 bash[18459]: cluster 2024-02-13T00:41:22.346593+0000 mon.a (mon.0) 2046 : cluster [DBG] osdmap e285: 8 total, 8 up, 8 in 2024-02-13T00:41:23.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:23 smithi106 bash[18459]: audit 2024-02-13T00:41:22.355332+0000 mon.a (mon.0) 2047 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:41:23.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:23 smithi106 bash[18459]: audit 2024-02-13T00:41:22.382245+0000 mon.a (mon.0) 2048 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi080-54183-56"}]: dispatch 2024-02-13T00:41:23.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:23 smithi106 bash[18459]: audit 2024-02-13T00:41:22.383323+0000 mon.a (mon.0) 2049 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi080-54183-56"}]: dispatch 2024-02-13T00:41:23.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:23 smithi106 bash[18459]: audit 2024-02-13T00:41:22.383719+0000 mon.a (mon.0) 2050 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi080-54183-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:23.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:23 smithi106 bash[18459]: audit 2024-02-13T00:41:23.347113+0000 mon.a (mon.0) 2051 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-43", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:41:23.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:23 smithi106 bash[18459]: audit 2024-02-13T00:41:23.347405+0000 mon.a (mon.0) 2052 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi080-54183-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:23.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:23 smithi106 bash[18459]: cluster 2024-02-13T00:41:23.347555+0000 mon.a (mon.0) 2053 : cluster [DBG] osdmap e286: 8 total, 8 up, 8 in 2024-02-13T00:41:23.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:23 smithi106 bash[18459]: audit 2024-02-13T00:41:23.349850+0000 mon.a (mon.0) 2054 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_count","val": "3"}]: dispatch 2024-02-13T00:41:23.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:23 smithi106 bash[18459]: audit 2024-02-13T00:41:23.350094+0000 mon.a (mon.0) 2055 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi080-54183-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi080-54183-56"}]: dispatch 2024-02-13T00:41:25.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:25 smithi106 bash[18459]: cluster 2024-02-13T00:41:24.241911+0000 mgr.y (mgr.24461) 466 : cluster [DBG] pgmap v561: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:25.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:25 smithi106 bash[18459]: audit 2024-02-13T00:41:24.348822+0000 mon.a (mon.0) 2056 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_count","val": "3"}]': finished 2024-02-13T00:41:25.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:25 smithi106 bash[18459]: cluster 2024-02-13T00:41:24.778114+0000 mon.a (mon.0) 2057 : cluster [DBG] osdmap e287: 8 total, 8 up, 8 in 2024-02-13T00:41:25.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:25 smithi106 bash[18459]: audit 2024-02-13T00:41:24.779154+0000 mon.a (mon.0) 2058 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_period","val": "3"}]: dispatch 2024-02-13T00:41:25.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:25 smithi080 bash[17386]: cluster 2024-02-13T00:41:24.241911+0000 mgr.y (mgr.24461) 466 : cluster [DBG] pgmap v561: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:25.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:25 smithi080 bash[17386]: audit 2024-02-13T00:41:24.348822+0000 mon.a (mon.0) 2056 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_count","val": "3"}]': finished 2024-02-13T00:41:25.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:25 smithi080 bash[17386]: cluster 2024-02-13T00:41:24.778114+0000 mon.a (mon.0) 2057 : cluster [DBG] osdmap e287: 8 total, 8 up, 8 in 2024-02-13T00:41:25.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:25 smithi080 bash[17386]: audit 2024-02-13T00:41:24.779154+0000 mon.a (mon.0) 2058 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_period","val": "3"}]: dispatch 2024-02-13T00:41:25.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:25 smithi080 bash[24237]: cluster 2024-02-13T00:41:24.241911+0000 mgr.y (mgr.24461) 466 : cluster [DBG] pgmap v561: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:25.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:25 smithi080 bash[24237]: audit 2024-02-13T00:41:24.348822+0000 mon.a (mon.0) 2056 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_count","val": "3"}]': finished 2024-02-13T00:41:25.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:25 smithi080 bash[24237]: cluster 2024-02-13T00:41:24.778114+0000 mon.a (mon.0) 2057 : cluster [DBG] osdmap e287: 8 total, 8 up, 8 in 2024-02-13T00:41:25.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:25 smithi080 bash[24237]: audit 2024-02-13T00:41:24.779154+0000 mon.a (mon.0) 2058 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_period","val": "3"}]: dispatch 2024-02-13T00:41:26.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:26 smithi106 bash[18459]: audit 2024-02-13T00:41:25.358058+0000 mon.a (mon.0) 2059 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi080-54183-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi080-54183-56"}]': finished 2024-02-13T00:41:26.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:26 smithi106 bash[18459]: audit 2024-02-13T00:41:25.358173+0000 mon.a (mon.0) 2060 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_period","val": "3"}]': finished 2024-02-13T00:41:26.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:26 smithi106 bash[18459]: cluster 2024-02-13T00:41:25.358241+0000 mon.a (mon.0) 2061 : cluster [DBG] osdmap e288: 8 total, 8 up, 8 in 2024-02-13T00:41:26.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:26 smithi106 bash[18459]: audit 2024-02-13T00:41:25.359417+0000 mon.a (mon.0) 2062 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:41:26.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:26 smithi080 bash[17386]: audit 2024-02-13T00:41:25.358058+0000 mon.a (mon.0) 2059 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi080-54183-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi080-54183-56"}]': finished 2024-02-13T00:41:26.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:26 smithi080 bash[17386]: audit 2024-02-13T00:41:25.358173+0000 mon.a (mon.0) 2060 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_period","val": "3"}]': finished 2024-02-13T00:41:26.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:26 smithi080 bash[17386]: cluster 2024-02-13T00:41:25.358241+0000 mon.a (mon.0) 2061 : cluster [DBG] osdmap e288: 8 total, 8 up, 8 in 2024-02-13T00:41:26.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:26 smithi080 bash[17386]: audit 2024-02-13T00:41:25.359417+0000 mon.a (mon.0) 2062 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:41:26.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:26 smithi080 bash[24237]: audit 2024-02-13T00:41:25.358058+0000 mon.a (mon.0) 2059 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi080-54183-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi080-54183-56"}]': finished 2024-02-13T00:41:26.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:26 smithi080 bash[24237]: audit 2024-02-13T00:41:25.358173+0000 mon.a (mon.0) 2060 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_period","val": "3"}]': finished 2024-02-13T00:41:26.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:26 smithi080 bash[24237]: cluster 2024-02-13T00:41:25.358241+0000 mon.a (mon.0) 2061 : cluster [DBG] osdmap e288: 8 total, 8 up, 8 in 2024-02-13T00:41:26.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:26 smithi080 bash[24237]: audit 2024-02-13T00:41:25.359417+0000 mon.a (mon.0) 2062 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:41:27.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:27 smithi106 bash[18459]: cluster 2024-02-13T00:41:26.242775+0000 mgr.y (mgr.24461) 467 : cluster [DBG] pgmap v564: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:27.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:27 smithi106 bash[18459]: audit 2024-02-13T00:41:26.362201+0000 mon.a (mon.0) 2063 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T00:41:27.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:27 smithi106 bash[18459]: cluster 2024-02-13T00:41:26.362770+0000 mon.a (mon.0) 2064 : cluster [DBG] osdmap e289: 8 total, 8 up, 8 in 2024-02-13T00:41:27.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:27 smithi106 bash[18459]: audit 2024-02-13T00:41:26.365160+0000 mon.a (mon.0) 2065 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-13T00:41:27.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:27 smithi106 bash[18459]: audit 2024-02-13T00:41:27.364187+0000 mon.a (mon.0) 2066 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_fpp","val": ".01"}]': finished 2024-02-13T00:41:27.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:27 smithi106 bash[18459]: cluster 2024-02-13T00:41:27.364435+0000 mon.a (mon.0) 2067 : cluster [DBG] osdmap e290: 8 total, 8 up, 8 in 2024-02-13T00:41:27.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:27 smithi106 bash[18459]: audit 2024-02-13T00:41:27.367457+0000 mon.a (mon.0) 2068 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi080-54183-56"}]: dispatch 2024-02-13T00:41:27.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:27 smithi080 bash[17386]: cluster 2024-02-13T00:41:26.242775+0000 mgr.y (mgr.24461) 467 : cluster [DBG] pgmap v564: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:27.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:27 smithi080 bash[17386]: audit 2024-02-13T00:41:26.362201+0000 mon.a (mon.0) 2063 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T00:41:27.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:27 smithi080 bash[17386]: cluster 2024-02-13T00:41:26.362770+0000 mon.a (mon.0) 2064 : cluster [DBG] osdmap e289: 8 total, 8 up, 8 in 2024-02-13T00:41:27.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:27 smithi080 bash[17386]: audit 2024-02-13T00:41:26.365160+0000 mon.a (mon.0) 2065 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-13T00:41:27.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:27 smithi080 bash[17386]: audit 2024-02-13T00:41:27.364187+0000 mon.a (mon.0) 2066 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_fpp","val": ".01"}]': finished 2024-02-13T00:41:27.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:27 smithi080 bash[17386]: cluster 2024-02-13T00:41:27.364435+0000 mon.a (mon.0) 2067 : cluster [DBG] osdmap e290: 8 total, 8 up, 8 in 2024-02-13T00:41:27.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:27 smithi080 bash[17386]: audit 2024-02-13T00:41:27.367457+0000 mon.a (mon.0) 2068 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi080-54183-56"}]: dispatch 2024-02-13T00:41:27.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:27 smithi080 bash[24237]: cluster 2024-02-13T00:41:26.242775+0000 mgr.y (mgr.24461) 467 : cluster [DBG] pgmap v564: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:27.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:27 smithi080 bash[24237]: audit 2024-02-13T00:41:26.362201+0000 mon.a (mon.0) 2063 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T00:41:27.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:27 smithi080 bash[24237]: cluster 2024-02-13T00:41:26.362770+0000 mon.a (mon.0) 2064 : cluster [DBG] osdmap e289: 8 total, 8 up, 8 in 2024-02-13T00:41:27.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:27 smithi080 bash[24237]: audit 2024-02-13T00:41:26.365160+0000 mon.a (mon.0) 2065 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-13T00:41:27.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:27 smithi080 bash[24237]: audit 2024-02-13T00:41:27.364187+0000 mon.a (mon.0) 2066 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-43","var": "hit_set_fpp","val": ".01"}]': finished 2024-02-13T00:41:27.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:27 smithi080 bash[24237]: cluster 2024-02-13T00:41:27.364435+0000 mon.a (mon.0) 2067 : cluster [DBG] osdmap e290: 8 total, 8 up, 8 in 2024-02-13T00:41:27.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:27 smithi080 bash[24237]: audit 2024-02-13T00:41:27.367457+0000 mon.a (mon.0) 2068 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi080-54183-56"}]: dispatch 2024-02-13T00:41:28.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:41:28 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:41:29.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:29 smithi106 bash[18459]: cluster 2024-02-13T00:41:28.244947+0000 mgr.y (mgr.24461) 468 : cluster [DBG] pgmap v567: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:41:29.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:29 smithi106 bash[18459]: audit 2024-02-13T00:41:28.297758+0000 mgr.y (mgr.24461) 469 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:41:29.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:29 smithi106 bash[18459]: audit 2024-02-13T00:41:28.369946+0000 mon.a (mon.0) 2069 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi080-54183-56"}]': finished 2024-02-13T00:41:29.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:29 smithi106 bash[18459]: cluster 2024-02-13T00:41:28.370040+0000 mon.a (mon.0) 2070 : cluster [DBG] osdmap e291: 8 total, 8 up, 8 in 2024-02-13T00:41:29.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:29 smithi106 bash[18459]: audit 2024-02-13T00:41:28.370931+0000 mon.a (mon.0) 2071 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi080-54183-56"}]: dispatch 2024-02-13T00:41:29.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:29 smithi080 bash[17386]: cluster 2024-02-13T00:41:28.244947+0000 mgr.y (mgr.24461) 468 : cluster [DBG] pgmap v567: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:41:29.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:29 smithi080 bash[17386]: audit 2024-02-13T00:41:28.297758+0000 mgr.y (mgr.24461) 469 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:41:29.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:29 smithi080 bash[17386]: audit 2024-02-13T00:41:28.369946+0000 mon.a (mon.0) 2069 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi080-54183-56"}]': finished 2024-02-13T00:41:29.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:29 smithi080 bash[17386]: cluster 2024-02-13T00:41:28.370040+0000 mon.a (mon.0) 2070 : cluster [DBG] osdmap e291: 8 total, 8 up, 8 in 2024-02-13T00:41:29.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:29 smithi080 bash[17386]: audit 2024-02-13T00:41:28.370931+0000 mon.a (mon.0) 2071 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi080-54183-56"}]: dispatch 2024-02-13T00:41:29.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:29 smithi080 bash[24237]: cluster 2024-02-13T00:41:28.244947+0000 mgr.y (mgr.24461) 468 : cluster [DBG] pgmap v567: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:41:29.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:29 smithi080 bash[24237]: audit 2024-02-13T00:41:28.297758+0000 mgr.y (mgr.24461) 469 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:41:29.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:29 smithi080 bash[24237]: audit 2024-02-13T00:41:28.369946+0000 mon.a (mon.0) 2069 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi080-54183-56"}]': finished 2024-02-13T00:41:29.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:29 smithi080 bash[24237]: cluster 2024-02-13T00:41:28.370040+0000 mon.a (mon.0) 2070 : cluster [DBG] osdmap e291: 8 total, 8 up, 8 in 2024-02-13T00:41:29.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:29 smithi080 bash[24237]: audit 2024-02-13T00:41:28.370931+0000 mon.a (mon.0) 2071 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi080-54183-56"}]: dispatch 2024-02-13T00:41:30.394 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:41:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:41:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:41:30.395 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:30 smithi106 bash[18459]: audit 2024-02-13T00:41:29.374136+0000 mon.a (mon.0) 2072 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi080-54183-56"}]': finished 2024-02-13T00:41:30.395 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:30 smithi106 bash[18459]: cluster 2024-02-13T00:41:29.374250+0000 mon.a (mon.0) 2073 : cluster [DBG] osdmap e292: 8 total, 8 up, 8 in 2024-02-13T00:41:30.395 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:30 smithi106 bash[18459]: audit 2024-02-13T00:41:29.400063+0000 mon.b (mon.1) 84 : audit [INF] from='client.? 172.21.15.80:0/2695746574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:30.395 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:30 smithi106 bash[18459]: audit 2024-02-13T00:41:29.400069+0000 mon.a (mon.0) 2074 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:30.395 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:30 smithi106 bash[18459]: audit 2024-02-13T00:41:29.401874+0000 mon.b (mon.1) 85 : audit [INF] from='client.? 172.21.15.80:0/2695746574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:30.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:30 smithi106 bash[18459]: audit 2024-02-13T00:41:29.401877+0000 mon.a (mon.0) 2075 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:30.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:30 smithi106 bash[18459]: audit 2024-02-13T00:41:29.403102+0000 mon.b (mon.1) 86 : audit [INF] from='client.? 172.21.15.80:0/2695746574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi080-54183-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:30.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:30 smithi106 bash[18459]: audit 2024-02-13T00:41:29.403148+0000 mon.a (mon.0) 2076 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi080-54183-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:30 smithi080 bash[17386]: audit 2024-02-13T00:41:29.374136+0000 mon.a (mon.0) 2072 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi080-54183-56"}]': finished 2024-02-13T00:41:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:30 smithi080 bash[17386]: cluster 2024-02-13T00:41:29.374250+0000 mon.a (mon.0) 2073 : cluster [DBG] osdmap e292: 8 total, 8 up, 8 in 2024-02-13T00:41:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:30 smithi080 bash[17386]: audit 2024-02-13T00:41:29.400063+0000 mon.b (mon.1) 84 : audit [INF] from='client.? 172.21.15.80:0/2695746574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:30 smithi080 bash[17386]: audit 2024-02-13T00:41:29.400069+0000 mon.a (mon.0) 2074 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:30 smithi080 bash[17386]: audit 2024-02-13T00:41:29.401874+0000 mon.b (mon.1) 85 : audit [INF] from='client.? 172.21.15.80:0/2695746574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:30 smithi080 bash[17386]: audit 2024-02-13T00:41:29.401877+0000 mon.a (mon.0) 2075 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:30 smithi080 bash[17386]: audit 2024-02-13T00:41:29.403102+0000 mon.b (mon.1) 86 : audit [INF] from='client.? 172.21.15.80:0/2695746574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi080-54183-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:30 smithi080 bash[17386]: audit 2024-02-13T00:41:29.403148+0000 mon.a (mon.0) 2076 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi080-54183-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:30.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:30 smithi080 bash[24237]: audit 2024-02-13T00:41:29.374136+0000 mon.a (mon.0) 2072 : audit [INF] from='client.? 172.21.15.80:0/3581893722' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi080-54183-56"}]': finished 2024-02-13T00:41:30.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:30 smithi080 bash[24237]: cluster 2024-02-13T00:41:29.374250+0000 mon.a (mon.0) 2073 : cluster [DBG] osdmap e292: 8 total, 8 up, 8 in 2024-02-13T00:41:30.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:30 smithi080 bash[24237]: audit 2024-02-13T00:41:29.400063+0000 mon.b (mon.1) 84 : audit [INF] from='client.? 172.21.15.80:0/2695746574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:30.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:30 smithi080 bash[24237]: audit 2024-02-13T00:41:29.400069+0000 mon.a (mon.0) 2074 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:30.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:30 smithi080 bash[24237]: audit 2024-02-13T00:41:29.401874+0000 mon.b (mon.1) 85 : audit [INF] from='client.? 172.21.15.80:0/2695746574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:30.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:30 smithi080 bash[24237]: audit 2024-02-13T00:41:29.401877+0000 mon.a (mon.0) 2075 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:30.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:30 smithi080 bash[24237]: audit 2024-02-13T00:41:29.403102+0000 mon.b (mon.1) 86 : audit [INF] from='client.? 172.21.15.80:0/2695746574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi080-54183-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:30.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:30 smithi080 bash[24237]: audit 2024-02-13T00:41:29.403148+0000 mon.a (mon.0) 2076 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi080-54183-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:32.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:31 smithi106 bash[18459]: cluster 2024-02-13T00:41:30.245887+0000 mgr.y (mgr.24461) 470 : cluster [DBG] pgmap v570: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:41:32.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:31 smithi106 bash[18459]: audit 2024-02-13T00:41:30.387332+0000 mon.a (mon.0) 2077 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi080-54183-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:32.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:31 smithi106 bash[18459]: cluster 2024-02-13T00:41:30.387446+0000 mon.a (mon.0) 2078 : cluster [DBG] osdmap e293: 8 total, 8 up, 8 in 2024-02-13T00:41:32.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:31 smithi106 bash[18459]: audit 2024-02-13T00:41:30.389204+0000 mon.b (mon.1) 87 : audit [INF] from='client.? 172.21.15.80:0/2695746574' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi080-54183-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:32.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:31 smithi106 bash[18459]: audit 2024-02-13T00:41:30.389886+0000 mon.a (mon.0) 2079 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi080-54183-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:32.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:31 smithi080 bash[17386]: cluster 2024-02-13T00:41:30.245887+0000 mgr.y (mgr.24461) 470 : cluster [DBG] pgmap v570: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:41:32.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:31 smithi080 bash[17386]: audit 2024-02-13T00:41:30.387332+0000 mon.a (mon.0) 2077 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi080-54183-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:32.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:31 smithi080 bash[17386]: cluster 2024-02-13T00:41:30.387446+0000 mon.a (mon.0) 2078 : cluster [DBG] osdmap e293: 8 total, 8 up, 8 in 2024-02-13T00:41:32.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:31 smithi080 bash[17386]: audit 2024-02-13T00:41:30.389204+0000 mon.b (mon.1) 87 : audit [INF] from='client.? 172.21.15.80:0/2695746574' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi080-54183-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:32.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:31 smithi080 bash[17386]: audit 2024-02-13T00:41:30.389886+0000 mon.a (mon.0) 2079 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi080-54183-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:32.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:31 smithi080 bash[24237]: cluster 2024-02-13T00:41:30.245887+0000 mgr.y (mgr.24461) 470 : cluster [DBG] pgmap v570: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:41:32.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:31 smithi080 bash[24237]: audit 2024-02-13T00:41:30.387332+0000 mon.a (mon.0) 2077 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi080-54183-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:32.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:31 smithi080 bash[24237]: cluster 2024-02-13T00:41:30.387446+0000 mon.a (mon.0) 2078 : cluster [DBG] osdmap e293: 8 total, 8 up, 8 in 2024-02-13T00:41:32.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:31 smithi080 bash[24237]: audit 2024-02-13T00:41:30.389204+0000 mon.b (mon.1) 87 : audit [INF] from='client.? 172.21.15.80:0/2695746574' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi080-54183-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:32.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:31 smithi080 bash[24237]: audit 2024-02-13T00:41:30.389886+0000 mon.a (mon.0) 2079 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi080-54183-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:33.116 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:32 smithi080 bash[17386]: cluster 2024-02-13T00:41:31.831540+0000 mon.a (mon.0) 2080 : cluster [DBG] osdmap e294: 8 total, 8 up, 8 in 2024-02-13T00:41:33.116 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:32 smithi080 bash[17386]: audit 2024-02-13T00:41:32.390996+0000 mon.a (mon.0) 2081 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi080-54183-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi080-54183-57"}]': finished 2024-02-13T00:41:33.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:32 smithi080 bash[17386]: cluster 2024-02-13T00:41:32.391221+0000 mon.a (mon.0) 2082 : cluster [DBG] osdmap e295: 8 total, 8 up, 8 in 2024-02-13T00:41:33.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:32 smithi080 bash[24237]: cluster 2024-02-13T00:41:31.831540+0000 mon.a (mon.0) 2080 : cluster [DBG] osdmap e294: 8 total, 8 up, 8 in 2024-02-13T00:41:33.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:32 smithi080 bash[24237]: audit 2024-02-13T00:41:32.390996+0000 mon.a (mon.0) 2081 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi080-54183-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi080-54183-57"}]': finished 2024-02-13T00:41:33.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:32 smithi080 bash[24237]: cluster 2024-02-13T00:41:32.391221+0000 mon.a (mon.0) 2082 : cluster [DBG] osdmap e295: 8 total, 8 up, 8 in 2024-02-13T00:41:33.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:32 smithi106 bash[18459]: cluster 2024-02-13T00:41:31.831540+0000 mon.a (mon.0) 2080 : cluster [DBG] osdmap e294: 8 total, 8 up, 8 in 2024-02-13T00:41:33.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:32 smithi106 bash[18459]: audit 2024-02-13T00:41:32.390996+0000 mon.a (mon.0) 2081 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi080-54183-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi080-54183-57"}]': finished 2024-02-13T00:41:33.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:32 smithi106 bash[18459]: cluster 2024-02-13T00:41:32.391221+0000 mon.a (mon.0) 2082 : cluster [DBG] osdmap e295: 8 total, 8 up, 8 in 2024-02-13T00:41:33.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:41:33 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:41:33] "GET /metrics HTTP/1.1" 200 187133 "" "Prometheus/2.33.4" 2024-02-13T00:41:34.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:33 smithi106 bash[18459]: cluster 2024-02-13T00:41:32.246678+0000 mgr.y (mgr.24461) 471 : cluster [DBG] pgmap v573: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:41:34.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:33 smithi106 bash[18459]: cluster 2024-02-13T00:41:33.396631+0000 mon.a (mon.0) 2083 : cluster [DBG] osdmap e296: 8 total, 8 up, 8 in 2024-02-13T00:41:34.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:33 smithi080 bash[17386]: cluster 2024-02-13T00:41:32.246678+0000 mgr.y (mgr.24461) 471 : cluster [DBG] pgmap v573: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:41:34.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:33 smithi080 bash[17386]: cluster 2024-02-13T00:41:33.396631+0000 mon.a (mon.0) 2083 : cluster [DBG] osdmap e296: 8 total, 8 up, 8 in 2024-02-13T00:41:34.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:33 smithi080 bash[24237]: cluster 2024-02-13T00:41:32.246678+0000 mgr.y (mgr.24461) 471 : cluster [DBG] pgmap v573: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:41:34.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:33 smithi080 bash[24237]: cluster 2024-02-13T00:41:33.396631+0000 mon.a (mon.0) 2083 : cluster [DBG] osdmap e296: 8 total, 8 up, 8 in 2024-02-13T00:41:35.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:35 smithi106 bash[18459]: cluster 2024-02-13T00:41:34.247509+0000 mgr.y (mgr.24461) 472 : cluster [DBG] pgmap v576: 236 pgs: 8 creating+peering, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-13T00:41:35.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:35 smithi106 bash[18459]: cluster 2024-02-13T00:41:34.400435+0000 mon.a (mon.0) 2084 : cluster [DBG] osdmap e297: 8 total, 8 up, 8 in 2024-02-13T00:41:35.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:35 smithi106 bash[18459]: audit 2024-02-13T00:41:34.402574+0000 mon.b (mon.1) 88 : audit [INF] from='client.? 172.21.15.80:0/2695746574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:35.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:35 smithi106 bash[18459]: audit 2024-02-13T00:41:34.403153+0000 mon.a (mon.0) 2085 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:35.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:35 smithi080 bash[17386]: cluster 2024-02-13T00:41:34.247509+0000 mgr.y (mgr.24461) 472 : cluster [DBG] pgmap v576: 236 pgs: 8 creating+peering, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-13T00:41:35.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:35 smithi080 bash[17386]: cluster 2024-02-13T00:41:34.400435+0000 mon.a (mon.0) 2084 : cluster [DBG] osdmap e297: 8 total, 8 up, 8 in 2024-02-13T00:41:35.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:35 smithi080 bash[17386]: audit 2024-02-13T00:41:34.402574+0000 mon.b (mon.1) 88 : audit [INF] from='client.? 172.21.15.80:0/2695746574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:35.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:35 smithi080 bash[17386]: audit 2024-02-13T00:41:34.403153+0000 mon.a (mon.0) 2085 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:35 smithi080 bash[24237]: cluster 2024-02-13T00:41:34.247509+0000 mgr.y (mgr.24461) 472 : cluster [DBG] pgmap v576: 236 pgs: 8 creating+peering, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-13T00:41:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:35 smithi080 bash[24237]: cluster 2024-02-13T00:41:34.400435+0000 mon.a (mon.0) 2084 : cluster [DBG] osdmap e297: 8 total, 8 up, 8 in 2024-02-13T00:41:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:35 smithi080 bash[24237]: audit 2024-02-13T00:41:34.402574+0000 mon.b (mon.1) 88 : audit [INF] from='client.? 172.21.15.80:0/2695746574' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:35 smithi080 bash[24237]: audit 2024-02-13T00:41:34.403153+0000 mon.a (mon.0) 2085 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:36.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:36 smithi106 bash[18459]: audit 2024-02-13T00:41:35.404493+0000 mon.a (mon.0) 2086 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi080-54183-57"}]': finished 2024-02-13T00:41:36.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:36 smithi106 bash[18459]: cluster 2024-02-13T00:41:35.404861+0000 mon.a (mon.0) 2087 : cluster [DBG] osdmap e298: 8 total, 8 up, 8 in 2024-02-13T00:41:36.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:36 smithi106 bash[18459]: audit 2024-02-13T00:41:35.406291+0000 mon.b (mon.1) 89 : audit [INF] from='client.? 172.21.15.80:0/2695746574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:36.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:36 smithi106 bash[18459]: audit 2024-02-13T00:41:35.406511+0000 mon.a (mon.0) 2088 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:36.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:36 smithi106 bash[18459]: audit 2024-02-13T00:41:36.406145+0000 mon.a (mon.0) 2089 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi080-54183-57"}]': finished 2024-02-13T00:41:36.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:36 smithi106 bash[18459]: cluster 2024-02-13T00:41:36.406321+0000 mon.a (mon.0) 2090 : cluster [DBG] osdmap e299: 8 total, 8 up, 8 in 2024-02-13T00:41:36.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:36 smithi080 bash[17386]: audit 2024-02-13T00:41:35.404493+0000 mon.a (mon.0) 2086 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi080-54183-57"}]': finished 2024-02-13T00:41:36.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:36 smithi080 bash[17386]: cluster 2024-02-13T00:41:35.404861+0000 mon.a (mon.0) 2087 : cluster [DBG] osdmap e298: 8 total, 8 up, 8 in 2024-02-13T00:41:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:36 smithi080 bash[17386]: audit 2024-02-13T00:41:35.406291+0000 mon.b (mon.1) 89 : audit [INF] from='client.? 172.21.15.80:0/2695746574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:36 smithi080 bash[17386]: audit 2024-02-13T00:41:35.406511+0000 mon.a (mon.0) 2088 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:36 smithi080 bash[17386]: audit 2024-02-13T00:41:36.406145+0000 mon.a (mon.0) 2089 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi080-54183-57"}]': finished 2024-02-13T00:41:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:36 smithi080 bash[17386]: cluster 2024-02-13T00:41:36.406321+0000 mon.a (mon.0) 2090 : cluster [DBG] osdmap e299: 8 total, 8 up, 8 in 2024-02-13T00:41:36.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:36 smithi080 bash[24237]: audit 2024-02-13T00:41:35.404493+0000 mon.a (mon.0) 2086 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi080-54183-57"}]': finished 2024-02-13T00:41:36.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:36 smithi080 bash[24237]: cluster 2024-02-13T00:41:35.404861+0000 mon.a (mon.0) 2087 : cluster [DBG] osdmap e298: 8 total, 8 up, 8 in 2024-02-13T00:41:36.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:36 smithi080 bash[24237]: audit 2024-02-13T00:41:35.406291+0000 mon.b (mon.1) 89 : audit [INF] from='client.? 172.21.15.80:0/2695746574' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:36.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:36 smithi080 bash[24237]: audit 2024-02-13T00:41:35.406511+0000 mon.a (mon.0) 2088 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi080-54183-57"}]: dispatch 2024-02-13T00:41:36.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:36 smithi080 bash[24237]: audit 2024-02-13T00:41:36.406145+0000 mon.a (mon.0) 2089 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi080-54183-57"}]': finished 2024-02-13T00:41:36.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:36 smithi080 bash[24237]: cluster 2024-02-13T00:41:36.406321+0000 mon.a (mon.0) 2090 : cluster [DBG] osdmap e299: 8 total, 8 up, 8 in 2024-02-13T00:41:37.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:37 smithi106 bash[18459]: cluster 2024-02-13T00:41:36.248376+0000 mgr.y (mgr.24461) 473 : cluster [DBG] pgmap v579: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-13T00:41:37.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:37 smithi106 bash[18459]: audit 2024-02-13T00:41:36.428658+0000 mon.a (mon.0) 2091 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi080-54183-58"}]: dispatch 2024-02-13T00:41:37.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:37 smithi106 bash[18459]: audit 2024-02-13T00:41:36.430174+0000 mon.a (mon.0) 2092 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi080-54183-58"}]: dispatch 2024-02-13T00:41:37.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:37 smithi106 bash[18459]: audit 2024-02-13T00:41:36.430669+0000 mon.a (mon.0) 2093 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi080-54183-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:37.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:37 smithi080 bash[17386]: cluster 2024-02-13T00:41:36.248376+0000 mgr.y (mgr.24461) 473 : cluster [DBG] pgmap v579: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-13T00:41:37.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:37 smithi080 bash[17386]: audit 2024-02-13T00:41:36.428658+0000 mon.a (mon.0) 2091 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi080-54183-58"}]: dispatch 2024-02-13T00:41:37.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:37 smithi080 bash[17386]: audit 2024-02-13T00:41:36.430174+0000 mon.a (mon.0) 2092 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi080-54183-58"}]: dispatch 2024-02-13T00:41:37.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:37 smithi080 bash[17386]: audit 2024-02-13T00:41:36.430669+0000 mon.a (mon.0) 2093 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi080-54183-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:37.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:37 smithi080 bash[24237]: cluster 2024-02-13T00:41:36.248376+0000 mgr.y (mgr.24461) 473 : cluster [DBG] pgmap v579: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-13T00:41:37.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:37 smithi080 bash[24237]: audit 2024-02-13T00:41:36.428658+0000 mon.a (mon.0) 2091 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi080-54183-58"}]: dispatch 2024-02-13T00:41:37.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:37 smithi080 bash[24237]: audit 2024-02-13T00:41:36.430174+0000 mon.a (mon.0) 2092 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi080-54183-58"}]: dispatch 2024-02-13T00:41:37.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:37 smithi080 bash[24237]: audit 2024-02-13T00:41:36.430669+0000 mon.a (mon.0) 2093 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi080-54183-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:38.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:41:38 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:41:39.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:38 smithi106 bash[18459]: audit 2024-02-13T00:41:37.426299+0000 mon.a (mon.0) 2094 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi080-54183-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:39.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:38 smithi106 bash[18459]: cluster 2024-02-13T00:41:37.426978+0000 mon.a (mon.0) 2095 : cluster [DBG] osdmap e300: 8 total, 8 up, 8 in 2024-02-13T00:41:39.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:38 smithi106 bash[18459]: audit 2024-02-13T00:41:37.428328+0000 mon.a (mon.0) 2096 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi080-54183-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi080-54183-58"}]: dispatch 2024-02-13T00:41:39.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:38 smithi080 bash[24237]: audit 2024-02-13T00:41:37.426299+0000 mon.a (mon.0) 2094 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi080-54183-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:39.257 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:38 smithi080 bash[24237]: cluster 2024-02-13T00:41:37.426978+0000 mon.a (mon.0) 2095 : cluster [DBG] osdmap e300: 8 total, 8 up, 8 in 2024-02-13T00:41:39.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:38 smithi080 bash[24237]: audit 2024-02-13T00:41:37.428328+0000 mon.a (mon.0) 2096 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi080-54183-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi080-54183-58"}]: dispatch 2024-02-13T00:41:39.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:38 smithi080 bash[17386]: audit 2024-02-13T00:41:37.426299+0000 mon.a (mon.0) 2094 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi080-54183-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:39.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:38 smithi080 bash[17386]: cluster 2024-02-13T00:41:37.426978+0000 mon.a (mon.0) 2095 : cluster [DBG] osdmap e300: 8 total, 8 up, 8 in 2024-02-13T00:41:39.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:38 smithi080 bash[17386]: audit 2024-02-13T00:41:37.428328+0000 mon.a (mon.0) 2096 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi080-54183-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi080-54183-58"}]: dispatch 2024-02-13T00:41:40.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:39 smithi106 bash[18459]: cluster 2024-02-13T00:41:38.250552+0000 mgr.y (mgr.24461) 474 : cluster [DBG] pgmap v582: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-13T00:41:40.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:39 smithi106 bash[18459]: audit 2024-02-13T00:41:38.309271+0000 mgr.y (mgr.24461) 475 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:41:40.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:39 smithi106 bash[18459]: cluster 2024-02-13T00:41:38.869247+0000 mon.a (mon.0) 2097 : cluster [DBG] osdmap e301: 8 total, 8 up, 8 in 2024-02-13T00:41:40.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:39 smithi106 bash[18459]: audit 2024-02-13T00:41:39.433008+0000 mon.a (mon.0) 2098 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi080-54183-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi080-54183-58"}]': finished 2024-02-13T00:41:40.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:39 smithi106 bash[18459]: cluster 2024-02-13T00:41:39.433130+0000 mon.a (mon.0) 2099 : cluster [DBG] osdmap e302: 8 total, 8 up, 8 in 2024-02-13T00:41:40.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:39 smithi106 bash[18459]: audit 2024-02-13T00:41:39.454406+0000 mon.a (mon.0) 2100 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:41:40.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:39 smithi106 bash[18459]: audit 2024-02-13T00:41:39.455020+0000 mon.a (mon.0) 2101 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-43"}]: dispatch 2024-02-13T00:41:40.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:39 smithi080 bash[17386]: cluster 2024-02-13T00:41:38.250552+0000 mgr.y (mgr.24461) 474 : cluster [DBG] pgmap v582: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-13T00:41:40.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:39 smithi080 bash[17386]: audit 2024-02-13T00:41:38.309271+0000 mgr.y (mgr.24461) 475 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:41:40.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:39 smithi080 bash[17386]: cluster 2024-02-13T00:41:38.869247+0000 mon.a (mon.0) 2097 : cluster [DBG] osdmap e301: 8 total, 8 up, 8 in 2024-02-13T00:41:40.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:39 smithi080 bash[17386]: audit 2024-02-13T00:41:39.433008+0000 mon.a (mon.0) 2098 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi080-54183-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi080-54183-58"}]': finished 2024-02-13T00:41:40.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:39 smithi080 bash[17386]: cluster 2024-02-13T00:41:39.433130+0000 mon.a (mon.0) 2099 : cluster [DBG] osdmap e302: 8 total, 8 up, 8 in 2024-02-13T00:41:40.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:39 smithi080 bash[17386]: audit 2024-02-13T00:41:39.454406+0000 mon.a (mon.0) 2100 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:41:40.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:39 smithi080 bash[17386]: audit 2024-02-13T00:41:39.455020+0000 mon.a (mon.0) 2101 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-43"}]: dispatch 2024-02-13T00:41:40.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:39 smithi080 bash[24237]: cluster 2024-02-13T00:41:38.250552+0000 mgr.y (mgr.24461) 474 : cluster [DBG] pgmap v582: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-13T00:41:40.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:39 smithi080 bash[24237]: audit 2024-02-13T00:41:38.309271+0000 mgr.y (mgr.24461) 475 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:41:40.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:39 smithi080 bash[24237]: cluster 2024-02-13T00:41:38.869247+0000 mon.a (mon.0) 2097 : cluster [DBG] osdmap e301: 8 total, 8 up, 8 in 2024-02-13T00:41:40.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:39 smithi080 bash[24237]: audit 2024-02-13T00:41:39.433008+0000 mon.a (mon.0) 2098 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi080-54183-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi080-54183-58"}]': finished 2024-02-13T00:41:40.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:39 smithi080 bash[24237]: cluster 2024-02-13T00:41:39.433130+0000 mon.a (mon.0) 2099 : cluster [DBG] osdmap e302: 8 total, 8 up, 8 in 2024-02-13T00:41:40.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:39 smithi080 bash[24237]: audit 2024-02-13T00:41:39.454406+0000 mon.a (mon.0) 2100 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:41:40.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:39 smithi080 bash[24237]: audit 2024-02-13T00:41:39.455020+0000 mon.a (mon.0) 2101 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-43"}]: dispatch 2024-02-13T00:41:40.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:41:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:41:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:41:42.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:41 smithi106 bash[18459]: cluster 2024-02-13T00:41:40.251389+0000 mgr.y (mgr.24461) 476 : cluster [DBG] pgmap v585: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-13T00:41:42.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:41 smithi106 bash[18459]: audit 2024-02-13T00:41:40.433712+0000 mon.a (mon.0) 2102 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-43"}]': finished 2024-02-13T00:41:42.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:41 smithi106 bash[18459]: cluster 2024-02-13T00:41:40.433851+0000 mon.a (mon.0) 2103 : cluster [DBG] osdmap e303: 8 total, 8 up, 8 in 2024-02-13T00:41:42.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:41 smithi080 bash[17386]: cluster 2024-02-13T00:41:40.251389+0000 mgr.y (mgr.24461) 476 : cluster [DBG] pgmap v585: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-13T00:41:42.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:41 smithi080 bash[17386]: audit 2024-02-13T00:41:40.433712+0000 mon.a (mon.0) 2102 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-43"}]': finished 2024-02-13T00:41:42.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:41 smithi080 bash[17386]: cluster 2024-02-13T00:41:40.433851+0000 mon.a (mon.0) 2103 : cluster [DBG] osdmap e303: 8 total, 8 up, 8 in 2024-02-13T00:41:42.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:41 smithi080 bash[24237]: cluster 2024-02-13T00:41:40.251389+0000 mgr.y (mgr.24461) 476 : cluster [DBG] pgmap v585: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-13T00:41:42.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:41 smithi080 bash[24237]: audit 2024-02-13T00:41:40.433712+0000 mon.a (mon.0) 2102 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-43"}]': finished 2024-02-13T00:41:42.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:41 smithi080 bash[24237]: cluster 2024-02-13T00:41:40.433851+0000 mon.a (mon.0) 2103 : cluster [DBG] osdmap e303: 8 total, 8 up, 8 in 2024-02-13T00:41:43.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:42 smithi106 bash[18459]: cluster 2024-02-13T00:41:41.436651+0000 mon.a (mon.0) 2104 : cluster [DBG] osdmap e304: 8 total, 8 up, 8 in 2024-02-13T00:41:43.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:42 smithi106 bash[18459]: audit 2024-02-13T00:41:41.440757+0000 mon.a (mon.0) 2105 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi080-54183-58"}]: dispatch 2024-02-13T00:41:43.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:42 smithi106 bash[18459]: audit 2024-02-13T00:41:42.441278+0000 mon.a (mon.0) 2106 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi080-54183-58"}]': finished 2024-02-13T00:41:43.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:42 smithi106 bash[18459]: cluster 2024-02-13T00:41:42.441454+0000 mon.a (mon.0) 2107 : cluster [DBG] osdmap e305: 8 total, 8 up, 8 in 2024-02-13T00:41:43.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:42 smithi106 bash[18459]: audit 2024-02-13T00:41:42.444066+0000 mon.a (mon.0) 2108 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi080-54183-58"}]: dispatch 2024-02-13T00:41:43.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:42 smithi106 bash[18459]: audit 2024-02-13T00:41:42.446228+0000 mon.a (mon.0) 2109 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:41:43.257 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:41:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:41:43] "GET /metrics HTTP/1.1" 200 187133 "" "Prometheus/2.33.4" 2024-02-13T00:41:43.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:42 smithi080 bash[17386]: cluster 2024-02-13T00:41:41.436651+0000 mon.a (mon.0) 2104 : cluster [DBG] osdmap e304: 8 total, 8 up, 8 in 2024-02-13T00:41:43.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:42 smithi080 bash[17386]: audit 2024-02-13T00:41:41.440757+0000 mon.a (mon.0) 2105 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi080-54183-58"}]: dispatch 2024-02-13T00:41:43.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:42 smithi080 bash[17386]: audit 2024-02-13T00:41:42.441278+0000 mon.a (mon.0) 2106 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi080-54183-58"}]': finished 2024-02-13T00:41:43.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:42 smithi080 bash[17386]: cluster 2024-02-13T00:41:42.441454+0000 mon.a (mon.0) 2107 : cluster [DBG] osdmap e305: 8 total, 8 up, 8 in 2024-02-13T00:41:43.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:42 smithi080 bash[17386]: audit 2024-02-13T00:41:42.444066+0000 mon.a (mon.0) 2108 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi080-54183-58"}]: dispatch 2024-02-13T00:41:43.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:42 smithi080 bash[17386]: audit 2024-02-13T00:41:42.446228+0000 mon.a (mon.0) 2109 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:41:43.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:42 smithi080 bash[24237]: cluster 2024-02-13T00:41:41.436651+0000 mon.a (mon.0) 2104 : cluster [DBG] osdmap e304: 8 total, 8 up, 8 in 2024-02-13T00:41:43.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:42 smithi080 bash[24237]: audit 2024-02-13T00:41:41.440757+0000 mon.a (mon.0) 2105 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi080-54183-58"}]: dispatch 2024-02-13T00:41:43.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:42 smithi080 bash[24237]: audit 2024-02-13T00:41:42.441278+0000 mon.a (mon.0) 2106 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi080-54183-58"}]': finished 2024-02-13T00:41:43.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:42 smithi080 bash[24237]: cluster 2024-02-13T00:41:42.441454+0000 mon.a (mon.0) 2107 : cluster [DBG] osdmap e305: 8 total, 8 up, 8 in 2024-02-13T00:41:43.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:42 smithi080 bash[24237]: audit 2024-02-13T00:41:42.444066+0000 mon.a (mon.0) 2108 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi080-54183-58"}]: dispatch 2024-02-13T00:41:43.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:42 smithi080 bash[24237]: audit 2024-02-13T00:41:42.446228+0000 mon.a (mon.0) 2109 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:41:44.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:43 smithi106 bash[18459]: cluster 2024-02-13T00:41:42.252151+0000 mgr.y (mgr.24461) 477 : cluster [DBG] pgmap v588: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:41:44.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:43 smithi106 bash[18459]: audit 2024-02-13T00:41:43.445189+0000 mon.a (mon.0) 2110 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi080-54183-58"}]': finished 2024-02-13T00:41:44.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:43 smithi106 bash[18459]: audit 2024-02-13T00:41:43.445456+0000 mon.a (mon.0) 2111 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:41:44.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:43 smithi106 bash[18459]: cluster 2024-02-13T00:41:43.445661+0000 mon.a (mon.0) 2112 : cluster [DBG] osdmap e306: 8 total, 8 up, 8 in 2024-02-13T00:41:44.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:43 smithi080 bash[17386]: cluster 2024-02-13T00:41:42.252151+0000 mgr.y (mgr.24461) 477 : cluster [DBG] pgmap v588: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:41:44.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:43 smithi080 bash[17386]: audit 2024-02-13T00:41:43.445189+0000 mon.a (mon.0) 2110 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi080-54183-58"}]': finished 2024-02-13T00:41:44.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:43 smithi080 bash[17386]: audit 2024-02-13T00:41:43.445456+0000 mon.a (mon.0) 2111 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:41:44.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:43 smithi080 bash[17386]: cluster 2024-02-13T00:41:43.445661+0000 mon.a (mon.0) 2112 : cluster [DBG] osdmap e306: 8 total, 8 up, 8 in 2024-02-13T00:41:44.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:43 smithi080 bash[24237]: cluster 2024-02-13T00:41:42.252151+0000 mgr.y (mgr.24461) 477 : cluster [DBG] pgmap v588: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:41:44.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:43 smithi080 bash[24237]: audit 2024-02-13T00:41:43.445189+0000 mon.a (mon.0) 2110 : audit [INF] from='client.? 172.21.15.80:0/4254650755' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi080-54183-58"}]': finished 2024-02-13T00:41:44.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:43 smithi080 bash[24237]: audit 2024-02-13T00:41:43.445456+0000 mon.a (mon.0) 2111 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:41:44.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:43 smithi080 bash[24237]: cluster 2024-02-13T00:41:43.445661+0000 mon.a (mon.0) 2112 : cluster [DBG] osdmap e306: 8 total, 8 up, 8 in 2024-02-13T00:41:45.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:44 smithi106 bash[18459]: audit 2024-02-13T00:41:43.911152+0000 mon.a (mon.0) 2113 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:41:45.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:44 smithi106 bash[18459]: audit 2024-02-13T00:41:44.449463+0000 mon.a (mon.0) 2114 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-45", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:41:45.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:44 smithi106 bash[18459]: cluster 2024-02-13T00:41:44.449601+0000 mon.a (mon.0) 2115 : cluster [DBG] osdmap e307: 8 total, 8 up, 8 in 2024-02-13T00:41:45.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:44 smithi106 bash[18459]: audit 2024-02-13T00:41:44.451619+0000 mon.a (mon.0) 2116 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-45"}]: dispatch 2024-02-13T00:41:45.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:44 smithi106 bash[18459]: audit 2024-02-13T00:41:44.452905+0000 mon.a (mon.0) 2117 : audit [INF] from='client.? 172.21.15.80:0/1296435870' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi080-54183-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:41:45.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:44 smithi080 bash[17386]: audit 2024-02-13T00:41:43.911152+0000 mon.a (mon.0) 2113 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:41:45.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:44 smithi080 bash[17386]: audit 2024-02-13T00:41:44.449463+0000 mon.a (mon.0) 2114 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-45", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:41:45.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:44 smithi080 bash[17386]: cluster 2024-02-13T00:41:44.449601+0000 mon.a (mon.0) 2115 : cluster [DBG] osdmap e307: 8 total, 8 up, 8 in 2024-02-13T00:41:45.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:44 smithi080 bash[17386]: audit 2024-02-13T00:41:44.451619+0000 mon.a (mon.0) 2116 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-45"}]: dispatch 2024-02-13T00:41:45.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:44 smithi080 bash[17386]: audit 2024-02-13T00:41:44.452905+0000 mon.a (mon.0) 2117 : audit [INF] from='client.? 172.21.15.80:0/1296435870' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi080-54183-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:41:45.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:44 smithi080 bash[24237]: audit 2024-02-13T00:41:43.911152+0000 mon.a (mon.0) 2113 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:41:45.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:44 smithi080 bash[24237]: audit 2024-02-13T00:41:44.449463+0000 mon.a (mon.0) 2114 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-45", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:41:45.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:44 smithi080 bash[24237]: cluster 2024-02-13T00:41:44.449601+0000 mon.a (mon.0) 2115 : cluster [DBG] osdmap e307: 8 total, 8 up, 8 in 2024-02-13T00:41:45.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:44 smithi080 bash[24237]: audit 2024-02-13T00:41:44.451619+0000 mon.a (mon.0) 2116 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-45"}]: dispatch 2024-02-13T00:41:45.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:44 smithi080 bash[24237]: audit 2024-02-13T00:41:44.452905+0000 mon.a (mon.0) 2117 : audit [INF] from='client.? 172.21.15.80:0/1296435870' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi080-54183-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:41:46.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:45 smithi106 bash[18459]: cluster 2024-02-13T00:41:44.252958+0000 mgr.y (mgr.24461) 478 : cluster [DBG] pgmap v591: 228 pgs: 32 creating+peering, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:46.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:45 smithi106 bash[18459]: audit 2024-02-13T00:41:45.451927+0000 mon.a (mon.0) 2118 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-45"}]': finished 2024-02-13T00:41:46.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:45 smithi106 bash[18459]: audit 2024-02-13T00:41:45.452298+0000 mon.a (mon.0) 2119 : audit [INF] from='client.? 172.21.15.80:0/1296435870' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi080-54183-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:41:46.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:45 smithi106 bash[18459]: cluster 2024-02-13T00:41:45.452646+0000 mon.a (mon.0) 2120 : cluster [DBG] osdmap e308: 8 total, 8 up, 8 in 2024-02-13T00:41:46.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:45 smithi106 bash[18459]: audit 2024-02-13T00:41:45.453837+0000 mon.a (mon.0) 2121 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-45", "mode": "writeback"}]: dispatch 2024-02-13T00:41:46.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:45 smithi080 bash[17386]: cluster 2024-02-13T00:41:44.252958+0000 mgr.y (mgr.24461) 478 : cluster [DBG] pgmap v591: 228 pgs: 32 creating+peering, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:46.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:45 smithi080 bash[17386]: audit 2024-02-13T00:41:45.451927+0000 mon.a (mon.0) 2118 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-45"}]': finished 2024-02-13T00:41:46.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:45 smithi080 bash[17386]: audit 2024-02-13T00:41:45.452298+0000 mon.a (mon.0) 2119 : audit [INF] from='client.? 172.21.15.80:0/1296435870' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi080-54183-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:41:46.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:45 smithi080 bash[17386]: cluster 2024-02-13T00:41:45.452646+0000 mon.a (mon.0) 2120 : cluster [DBG] osdmap e308: 8 total, 8 up, 8 in 2024-02-13T00:41:46.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:45 smithi080 bash[17386]: audit 2024-02-13T00:41:45.453837+0000 mon.a (mon.0) 2121 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-45", "mode": "writeback"}]: dispatch 2024-02-13T00:41:46.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:45 smithi080 bash[24237]: cluster 2024-02-13T00:41:44.252958+0000 mgr.y (mgr.24461) 478 : cluster [DBG] pgmap v591: 228 pgs: 32 creating+peering, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:46.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:45 smithi080 bash[24237]: audit 2024-02-13T00:41:45.451927+0000 mon.a (mon.0) 2118 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-45"}]': finished 2024-02-13T00:41:46.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:45 smithi080 bash[24237]: audit 2024-02-13T00:41:45.452298+0000 mon.a (mon.0) 2119 : audit [INF] from='client.? 172.21.15.80:0/1296435870' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi080-54183-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:41:46.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:45 smithi080 bash[24237]: cluster 2024-02-13T00:41:45.452646+0000 mon.a (mon.0) 2120 : cluster [DBG] osdmap e308: 8 total, 8 up, 8 in 2024-02-13T00:41:46.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:45 smithi080 bash[24237]: audit 2024-02-13T00:41:45.453837+0000 mon.a (mon.0) 2121 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-45", "mode": "writeback"}]: dispatch 2024-02-13T00:41:47.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:46 smithi106 bash[18459]: cluster 2024-02-13T00:41:46.445502+0000 mon.a (mon.0) 2122 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:41:47.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:46 smithi106 bash[18459]: audit 2024-02-13T00:41:46.454361+0000 mon.a (mon.0) 2123 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-45", "mode": "writeback"}]': finished 2024-02-13T00:41:47.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:46 smithi106 bash[18459]: cluster 2024-02-13T00:41:46.454592+0000 mon.a (mon.0) 2124 : cluster [DBG] osdmap e309: 8 total, 8 up, 8 in 2024-02-13T00:41:47.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:46 smithi106 bash[18459]: audit 2024-02-13T00:41:46.455441+0000 mon.a (mon.0) 2125 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:41:47.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:46 smithi106 bash[18459]: audit 2024-02-13T00:41:46.478803+0000 mon.c (mon.2) 340 : audit [INF] from='client.? 172.21.15.80:0/1949903987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:47.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:46 smithi106 bash[18459]: audit 2024-02-13T00:41:46.479239+0000 mon.a (mon.0) 2126 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:47.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:46 smithi106 bash[18459]: audit 2024-02-13T00:41:46.480289+0000 mon.c (mon.2) 341 : audit [INF] from='client.? 172.21.15.80:0/1949903987' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:47.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:46 smithi106 bash[18459]: audit 2024-02-13T00:41:46.480739+0000 mon.a (mon.0) 2127 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:47.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:46 smithi106 bash[18459]: audit 2024-02-13T00:41:46.481450+0000 mon.c (mon.2) 342 : audit [INF] from='client.? 172.21.15.80:0/1949903987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi080-54183-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:47.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:46 smithi106 bash[18459]: audit 2024-02-13T00:41:46.481873+0000 mon.a (mon.0) 2128 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi080-54183-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:47.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:46 smithi106 bash[18459]: audit 2024-02-13T00:41:46.917469+0000 mon.a (mon.0) 2129 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:41:47.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:46 smithi080 bash[17386]: cluster 2024-02-13T00:41:46.445502+0000 mon.a (mon.0) 2122 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:41:47.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:46 smithi080 bash[17386]: audit 2024-02-13T00:41:46.454361+0000 mon.a (mon.0) 2123 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-45", "mode": "writeback"}]': finished 2024-02-13T00:41:47.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:46 smithi080 bash[17386]: cluster 2024-02-13T00:41:46.454592+0000 mon.a (mon.0) 2124 : cluster [DBG] osdmap e309: 8 total, 8 up, 8 in 2024-02-13T00:41:47.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:46 smithi080 bash[17386]: audit 2024-02-13T00:41:46.455441+0000 mon.a (mon.0) 2125 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:41:47.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:46 smithi080 bash[17386]: audit 2024-02-13T00:41:46.478803+0000 mon.c (mon.2) 340 : audit [INF] from='client.? 172.21.15.80:0/1949903987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:47.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:46 smithi080 bash[17386]: audit 2024-02-13T00:41:46.479239+0000 mon.a (mon.0) 2126 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:47.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:46 smithi080 bash[17386]: audit 2024-02-13T00:41:46.480289+0000 mon.c (mon.2) 341 : audit [INF] from='client.? 172.21.15.80:0/1949903987' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:47.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:46 smithi080 bash[17386]: audit 2024-02-13T00:41:46.480739+0000 mon.a (mon.0) 2127 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:47.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:46 smithi080 bash[17386]: audit 2024-02-13T00:41:46.481450+0000 mon.c (mon.2) 342 : audit [INF] from='client.? 172.21.15.80:0/1949903987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi080-54183-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:47.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:46 smithi080 bash[17386]: audit 2024-02-13T00:41:46.481873+0000 mon.a (mon.0) 2128 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi080-54183-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:47.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:46 smithi080 bash[17386]: audit 2024-02-13T00:41:46.917469+0000 mon.a (mon.0) 2129 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:41:47.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:46 smithi080 bash[24237]: cluster 2024-02-13T00:41:46.445502+0000 mon.a (mon.0) 2122 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:41:47.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:46 smithi080 bash[24237]: audit 2024-02-13T00:41:46.454361+0000 mon.a (mon.0) 2123 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-45", "mode": "writeback"}]': finished 2024-02-13T00:41:47.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:46 smithi080 bash[24237]: cluster 2024-02-13T00:41:46.454592+0000 mon.a (mon.0) 2124 : cluster [DBG] osdmap e309: 8 total, 8 up, 8 in 2024-02-13T00:41:47.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:46 smithi080 bash[24237]: audit 2024-02-13T00:41:46.455441+0000 mon.a (mon.0) 2125 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:41:47.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:46 smithi080 bash[24237]: audit 2024-02-13T00:41:46.478803+0000 mon.c (mon.2) 340 : audit [INF] from='client.? 172.21.15.80:0/1949903987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:47.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:46 smithi080 bash[24237]: audit 2024-02-13T00:41:46.479239+0000 mon.a (mon.0) 2126 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:47.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:46 smithi080 bash[24237]: audit 2024-02-13T00:41:46.480289+0000 mon.c (mon.2) 341 : audit [INF] from='client.? 172.21.15.80:0/1949903987' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:47.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:46 smithi080 bash[24237]: audit 2024-02-13T00:41:46.480739+0000 mon.a (mon.0) 2127 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:47.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:46 smithi080 bash[24237]: audit 2024-02-13T00:41:46.481450+0000 mon.c (mon.2) 342 : audit [INF] from='client.? 172.21.15.80:0/1949903987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi080-54183-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:47.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:46 smithi080 bash[24237]: audit 2024-02-13T00:41:46.481873+0000 mon.a (mon.0) 2128 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi080-54183-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:47.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:46 smithi080 bash[24237]: audit 2024-02-13T00:41:46.917469+0000 mon.a (mon.0) 2129 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:41:48.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:47 smithi106 bash[18459]: cluster 2024-02-13T00:41:46.253816+0000 mgr.y (mgr.24461) 479 : cluster [DBG] pgmap v594: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:48.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:47 smithi106 bash[18459]: audit 2024-02-13T00:41:47.456919+0000 mon.a (mon.0) 2130 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:41:48.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:47 smithi106 bash[18459]: audit 2024-02-13T00:41:47.457056+0000 mon.a (mon.0) 2131 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi080-54183-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:48.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:47 smithi106 bash[18459]: cluster 2024-02-13T00:41:47.457214+0000 mon.a (mon.0) 2132 : cluster [DBG] osdmap e310: 8 total, 8 up, 8 in 2024-02-13T00:41:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:47 smithi106 bash[18459]: audit 2024-02-13T00:41:47.458280+0000 mon.a (mon.0) 2133 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:41:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:47 smithi106 bash[18459]: audit 2024-02-13T00:41:47.459008+0000 mon.c (mon.2) 343 : audit [INF] from='client.? 172.21.15.80:0/1949903987' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi080-54183-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:47 smithi106 bash[18459]: audit 2024-02-13T00:41:47.459681+0000 mon.a (mon.0) 2134 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi080-54183-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:48.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:47 smithi080 bash[24237]: cluster 2024-02-13T00:41:46.253816+0000 mgr.y (mgr.24461) 479 : cluster [DBG] pgmap v594: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:48.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:47 smithi080 bash[24237]: audit 2024-02-13T00:41:47.456919+0000 mon.a (mon.0) 2130 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:41:48.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:47 smithi080 bash[24237]: audit 2024-02-13T00:41:47.457056+0000 mon.a (mon.0) 2131 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi080-54183-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:48.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:47 smithi080 bash[24237]: cluster 2024-02-13T00:41:47.457214+0000 mon.a (mon.0) 2132 : cluster [DBG] osdmap e310: 8 total, 8 up, 8 in 2024-02-13T00:41:48.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:47 smithi080 bash[24237]: audit 2024-02-13T00:41:47.458280+0000 mon.a (mon.0) 2133 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:41:48.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:47 smithi080 bash[24237]: audit 2024-02-13T00:41:47.459008+0000 mon.c (mon.2) 343 : audit [INF] from='client.? 172.21.15.80:0/1949903987' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi080-54183-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:48.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:47 smithi080 bash[24237]: audit 2024-02-13T00:41:47.459681+0000 mon.a (mon.0) 2134 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi080-54183-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:48.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:47 smithi080 bash[17386]: cluster 2024-02-13T00:41:46.253816+0000 mgr.y (mgr.24461) 479 : cluster [DBG] pgmap v594: 260 pgs: 32 unknown, 32 creating+peering, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:41:48.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:47 smithi080 bash[17386]: audit 2024-02-13T00:41:47.456919+0000 mon.a (mon.0) 2130 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:41:48.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:47 smithi080 bash[17386]: audit 2024-02-13T00:41:47.457056+0000 mon.a (mon.0) 2131 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi080-54183-60", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:48.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:47 smithi080 bash[17386]: cluster 2024-02-13T00:41:47.457214+0000 mon.a (mon.0) 2132 : cluster [DBG] osdmap e310: 8 total, 8 up, 8 in 2024-02-13T00:41:48.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:47 smithi080 bash[17386]: audit 2024-02-13T00:41:47.458280+0000 mon.a (mon.0) 2133 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:41:48.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:47 smithi080 bash[17386]: audit 2024-02-13T00:41:47.459008+0000 mon.c (mon.2) 343 : audit [INF] from='client.? 172.21.15.80:0/1949903987' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi080-54183-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:48.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:47 smithi080 bash[17386]: audit 2024-02-13T00:41:47.459681+0000 mon.a (mon.0) 2134 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi080-54183-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:48.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:41:48 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:41:49.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:49 smithi106 bash[18459]: cluster 2024-02-13T00:41:48.256230+0000 mgr.y (mgr.24461) 480 : cluster [DBG] pgmap v597: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-13T00:41:49.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:49 smithi106 bash[18459]: audit 2024-02-13T00:41:48.317589+0000 mgr.y (mgr.24461) 481 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:41:49.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:49 smithi106 bash[18459]: audit 2024-02-13T00:41:48.460507+0000 mon.a (mon.0) 2135 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:41:49.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:49 smithi106 bash[18459]: cluster 2024-02-13T00:41:48.891092+0000 mon.a (mon.0) 2136 : cluster [DBG] osdmap e311: 8 total, 8 up, 8 in 2024-02-13T00:41:49.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:49 smithi106 bash[18459]: audit 2024-02-13T00:41:48.892427+0000 mon.a (mon.0) 2137 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:41:49.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:49 smithi080 bash[17386]: cluster 2024-02-13T00:41:48.256230+0000 mgr.y (mgr.24461) 480 : cluster [DBG] pgmap v597: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-13T00:41:49.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:49 smithi080 bash[17386]: audit 2024-02-13T00:41:48.317589+0000 mgr.y (mgr.24461) 481 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:41:49.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:49 smithi080 bash[17386]: audit 2024-02-13T00:41:48.460507+0000 mon.a (mon.0) 2135 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:41:49.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:49 smithi080 bash[17386]: cluster 2024-02-13T00:41:48.891092+0000 mon.a (mon.0) 2136 : cluster [DBG] osdmap e311: 8 total, 8 up, 8 in 2024-02-13T00:41:49.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:49 smithi080 bash[17386]: audit 2024-02-13T00:41:48.892427+0000 mon.a (mon.0) 2137 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:41:49.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:49 smithi080 bash[24237]: cluster 2024-02-13T00:41:48.256230+0000 mgr.y (mgr.24461) 480 : cluster [DBG] pgmap v597: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-13T00:41:49.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:49 smithi080 bash[24237]: audit 2024-02-13T00:41:48.317589+0000 mgr.y (mgr.24461) 481 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:41:49.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:49 smithi080 bash[24237]: audit 2024-02-13T00:41:48.460507+0000 mon.a (mon.0) 2135 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:41:49.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:49 smithi080 bash[24237]: cluster 2024-02-13T00:41:48.891092+0000 mon.a (mon.0) 2136 : cluster [DBG] osdmap e311: 8 total, 8 up, 8 in 2024-02-13T00:41:49.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:49 smithi080 bash[24237]: audit 2024-02-13T00:41:48.892427+0000 mon.a (mon.0) 2137 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:41:50.478 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:41:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:41:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:41:50.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:50 smithi106 bash[18459]: cluster 2024-02-13T00:41:49.454382+0000 mon.a (mon.0) 2138 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:41:50.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:50 smithi106 bash[18459]: audit 2024-02-13T00:41:49.463325+0000 mon.a (mon.0) 2139 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi080-54183-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi080-54183-60"}]': finished 2024-02-13T00:41:50.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:50 smithi106 bash[18459]: audit 2024-02-13T00:41:49.463533+0000 mon.a (mon.0) 2140 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T00:41:50.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:50 smithi106 bash[18459]: cluster 2024-02-13T00:41:49.463676+0000 mon.a (mon.0) 2141 : cluster [DBG] osdmap e312: 8 total, 8 up, 8 in 2024-02-13T00:41:50.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:50 smithi106 bash[18459]: audit 2024-02-13T00:41:49.467428+0000 mon.a (mon.0) 2142 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T00:41:50.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:50 smithi106 bash[18459]: audit 2024-02-13T00:41:50.465530+0000 mon.a (mon.0) 2143 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T00:41:50.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:50 smithi106 bash[18459]: cluster 2024-02-13T00:41:50.466076+0000 mon.a (mon.0) 2144 : cluster [DBG] osdmap e313: 8 total, 8 up, 8 in 2024-02-13T00:41:50.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:50 smithi106 bash[18459]: audit 2024-02-13T00:41:50.467530+0000 mon.a (mon.0) 2145 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-13T00:41:50.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:50 smithi080 bash[17386]: cluster 2024-02-13T00:41:49.454382+0000 mon.a (mon.0) 2138 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:41:50.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:50 smithi080 bash[17386]: audit 2024-02-13T00:41:49.463325+0000 mon.a (mon.0) 2139 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi080-54183-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi080-54183-60"}]': finished 2024-02-13T00:41:50.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:50 smithi080 bash[17386]: audit 2024-02-13T00:41:49.463533+0000 mon.a (mon.0) 2140 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T00:41:50.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:50 smithi080 bash[17386]: cluster 2024-02-13T00:41:49.463676+0000 mon.a (mon.0) 2141 : cluster [DBG] osdmap e312: 8 total, 8 up, 8 in 2024-02-13T00:41:50.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:50 smithi080 bash[17386]: audit 2024-02-13T00:41:49.467428+0000 mon.a (mon.0) 2142 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T00:41:50.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:50 smithi080 bash[17386]: audit 2024-02-13T00:41:50.465530+0000 mon.a (mon.0) 2143 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T00:41:50.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:50 smithi080 bash[17386]: cluster 2024-02-13T00:41:50.466076+0000 mon.a (mon.0) 2144 : cluster [DBG] osdmap e313: 8 total, 8 up, 8 in 2024-02-13T00:41:50.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:50 smithi080 bash[17386]: audit 2024-02-13T00:41:50.467530+0000 mon.a (mon.0) 2145 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-13T00:41:50.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:50 smithi080 bash[24237]: cluster 2024-02-13T00:41:49.454382+0000 mon.a (mon.0) 2138 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:41:50.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:50 smithi080 bash[24237]: audit 2024-02-13T00:41:49.463325+0000 mon.a (mon.0) 2139 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi080-54183-60", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi080-54183-60"}]': finished 2024-02-13T00:41:50.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:50 smithi080 bash[24237]: audit 2024-02-13T00:41:49.463533+0000 mon.a (mon.0) 2140 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T00:41:50.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:50 smithi080 bash[24237]: cluster 2024-02-13T00:41:49.463676+0000 mon.a (mon.0) 2141 : cluster [DBG] osdmap e312: 8 total, 8 up, 8 in 2024-02-13T00:41:50.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:50 smithi080 bash[24237]: audit 2024-02-13T00:41:49.467428+0000 mon.a (mon.0) 2142 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T00:41:50.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:50 smithi080 bash[24237]: audit 2024-02-13T00:41:50.465530+0000 mon.a (mon.0) 2143 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T00:41:50.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:50 smithi080 bash[24237]: cluster 2024-02-13T00:41:50.466076+0000 mon.a (mon.0) 2144 : cluster [DBG] osdmap e313: 8 total, 8 up, 8 in 2024-02-13T00:41:50.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:50 smithi080 bash[24237]: audit 2024-02-13T00:41:50.467530+0000 mon.a (mon.0) 2145 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-13T00:41:51.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:51 smithi106 bash[18459]: cluster 2024-02-13T00:41:50.257044+0000 mgr.y (mgr.24461) 482 : cluster [DBG] pgmap v600: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-13T00:41:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:51 smithi106 bash[18459]: audit 2024-02-13T00:41:51.467799+0000 mon.a (mon.0) 2146 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-02-13T00:41:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:51 smithi106 bash[18459]: cluster 2024-02-13T00:41:51.468032+0000 mon.a (mon.0) 2147 : cluster [DBG] osdmap e314: 8 total, 8 up, 8 in 2024-02-13T00:41:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:51 smithi106 bash[18459]: audit 2024-02-13T00:41:51.470898+0000 mon.a (mon.0) 2148 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-13T00:41:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:51 smithi106 bash[18459]: audit 2024-02-13T00:41:51.471624+0000 mon.c (mon.2) 344 : audit [INF] from='client.? 172.21.15.80:0/1949903987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:51 smithi106 bash[18459]: audit 2024-02-13T00:41:51.472195+0000 mon.a (mon.0) 2149 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:51.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:51 smithi080 bash[24237]: cluster 2024-02-13T00:41:50.257044+0000 mgr.y (mgr.24461) 482 : cluster [DBG] pgmap v600: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-13T00:41:51.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:51 smithi080 bash[24237]: audit 2024-02-13T00:41:51.467799+0000 mon.a (mon.0) 2146 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-02-13T00:41:51.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:51 smithi080 bash[24237]: cluster 2024-02-13T00:41:51.468032+0000 mon.a (mon.0) 2147 : cluster [DBG] osdmap e314: 8 total, 8 up, 8 in 2024-02-13T00:41:51.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:51 smithi080 bash[24237]: audit 2024-02-13T00:41:51.470898+0000 mon.a (mon.0) 2148 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-13T00:41:51.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:51 smithi080 bash[24237]: audit 2024-02-13T00:41:51.471624+0000 mon.c (mon.2) 344 : audit [INF] from='client.? 172.21.15.80:0/1949903987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:51.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:51 smithi080 bash[24237]: audit 2024-02-13T00:41:51.472195+0000 mon.a (mon.0) 2149 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:51.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:51 smithi080 bash[17386]: cluster 2024-02-13T00:41:50.257044+0000 mgr.y (mgr.24461) 482 : cluster [DBG] pgmap v600: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-13T00:41:51.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:51 smithi080 bash[17386]: audit 2024-02-13T00:41:51.467799+0000 mon.a (mon.0) 2146 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-02-13T00:41:51.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:51 smithi080 bash[17386]: cluster 2024-02-13T00:41:51.468032+0000 mon.a (mon.0) 2147 : cluster [DBG] osdmap e314: 8 total, 8 up, 8 in 2024-02-13T00:41:51.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:51 smithi080 bash[17386]: audit 2024-02-13T00:41:51.470898+0000 mon.a (mon.0) 2148 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-13T00:41:51.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:51 smithi080 bash[17386]: audit 2024-02-13T00:41:51.471624+0000 mon.c (mon.2) 344 : audit [INF] from='client.? 172.21.15.80:0/1949903987' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:51.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:51 smithi080 bash[17386]: audit 2024-02-13T00:41:51.472195+0000 mon.a (mon.0) 2149 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:53.480 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:41:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:41:53] "GET /metrics HTTP/1.1" 200 187227 "" "Prometheus/2.33.4" 2024-02-13T00:41:53.486 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:o.RoundTripAppendPP (3010 ms) 2024-02-13T00:41:53.486 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2024-02-13T00:41:53.486 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (2957 ms) 2024-02-13T00:41:53.486 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-02-13T00:41:53.486 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3029 ms) 2024-02-13T00:41:53.486 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-02-13T00:41:53.486 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3018 ms) 2024-02-13T00:41:53.486 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2024-02-13T00:41:53.487 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (3006 ms) 2024-02-13T00:41:53.487 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [----------] 31 tests from LibRadosAio (127299 ms total) 2024-02-13T00:41:53.487 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: 2024-02-13T00:41:53.487 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2024-02-13T00:41:53.487 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-02-13T00:41:53.487 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (3444 ms) 2024-02-13T00:41:53.487 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-02-13T00:41:53.487 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (8596 ms) 2024-02-13T00:41:53.487 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2024-02-13T00:41:53.487 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (14933 ms) 2024-02-13T00:41:53.487 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2024-02-13T00:41:53.487 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3011 ms) 2024-02-13T00:41:53.487 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (29984 ms total) 2024-02-13T00:41:53.487 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: 2024-02-13T00:41:53.488 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2024-02-13T00:41:53.488 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-02-13T00:41:53.488 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (3021 ms) 2024-02-13T00:41:53.488 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (3021 ms total) 2024-02-13T00:41:53.488 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: 2024-02-13T00:41:53.488 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2024-02-13T00:41:53.488 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2024-02-13T00:41:53.488 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (13992 ms) 2024-02-13T00:41:53.488 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2024-02-13T00:41:53.488 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (7033 ms) 2024-02-13T00:41:53.488 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2024-02-13T00:41:53.488 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (7032 ms) 2024-02-13T00:41:53.488 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2024-02-13T00:41:53.488 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (7037 ms) 2024-02-13T00:41:53.488 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2024-02-13T00:41:53.489 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3042 ms) 2024-02-13T00:41:53.489 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-02-13T00:41:53.489 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (6866 ms) 2024-02-13T00:41:53.489 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-02-13T00:41:53.489 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (7033 ms) 2024-02-13T00:41:53.489 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2024-02-13T00:41:53.489 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (7019 ms) 2024-02-13T00:41:53.489 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2024-02-13T00:41:53.489 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (7032 ms) 2024-02-13T00:41:53.489 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2024-02-13T00:41:53.489 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (7027 ms) 2024-02-13T00:41:53.489 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2024-02-13T00:41:53.489 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (7026 ms) 2024-02-13T00:41:53.489 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2024-02-13T00:41:53.489 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7030 ms) 2024-02-13T00:41:53.490 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-02-13T00:41:53.490 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (7043 ms) 2024-02-13T00:41:53.490 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-02-13T00:41:53.490 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3004 ms) 2024-02-13T00:41:53.490 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2024-02-13T00:41:53.490 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (7026 ms) 2024-02-13T00:41:53.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:53 smithi106 bash[18459]: cluster 2024-02-13T00:41:52.257749+0000 mgr.y (mgr.24461) 483 : cluster [DBG] pgmap v603: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:41:53.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:53 smithi106 bash[18459]: audit 2024-02-13T00:41:52.470414+0000 mon.a (mon.0) 2150 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_search_last_n","val": "1"}]': finished 2024-02-13T00:41:53.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:53 smithi106 bash[18459]: audit 2024-02-13T00:41:52.470578+0000 mon.a (mon.0) 2151 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi080-54183-60"}]': finished 2024-02-13T00:41:53.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:53 smithi106 bash[18459]: cluster 2024-02-13T00:41:52.470759+0000 mon.a (mon.0) 2152 : cluster [DBG] osdmap e315: 8 total, 8 up, 8 in 2024-02-13T00:41:53.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:53 smithi106 bash[18459]: audit 2024-02-13T00:41:52.472699+0000 mon.c (mon.2) 345 : audit [INF] from='client.? 172.21.15.80:0/1949903987' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:53.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:53 smithi106 bash[18459]: audit 2024-02-13T00:41:52.473285+0000 mon.a (mon.0) 2153 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:53.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:53 smithi080 bash[17386]: cluster 2024-02-13T00:41:52.257749+0000 mgr.y (mgr.24461) 483 : cluster [DBG] pgmap v603: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:41:53.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:53 smithi080 bash[17386]: audit 2024-02-13T00:41:52.470414+0000 mon.a (mon.0) 2150 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_search_last_n","val": "1"}]': finished 2024-02-13T00:41:53.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:53 smithi080 bash[17386]: audit 2024-02-13T00:41:52.470578+0000 mon.a (mon.0) 2151 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi080-54183-60"}]': finished 2024-02-13T00:41:53.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:53 smithi080 bash[17386]: cluster 2024-02-13T00:41:52.470759+0000 mon.a (mon.0) 2152 : cluster [DBG] osdmap e315: 8 total, 8 up, 8 in 2024-02-13T00:41:53.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:53 smithi080 bash[17386]: audit 2024-02-13T00:41:52.472699+0000 mon.c (mon.2) 345 : audit [INF] from='client.? 172.21.15.80:0/1949903987' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:53.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:53 smithi080 bash[17386]: audit 2024-02-13T00:41:52.473285+0000 mon.a (mon.0) 2153 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:53.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:53 smithi080 bash[24237]: cluster 2024-02-13T00:41:52.257749+0000 mgr.y (mgr.24461) 483 : cluster [DBG] pgmap v603: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:41:53.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:53 smithi080 bash[24237]: audit 2024-02-13T00:41:52.470414+0000 mon.a (mon.0) 2150 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-45","var": "hit_set_search_last_n","val": "1"}]': finished 2024-02-13T00:41:53.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:53 smithi080 bash[24237]: audit 2024-02-13T00:41:52.470578+0000 mon.a (mon.0) 2151 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi080-54183-60"}]': finished 2024-02-13T00:41:53.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:53 smithi080 bash[24237]: cluster 2024-02-13T00:41:52.470759+0000 mon.a (mon.0) 2152 : cluster [DBG] osdmap e315: 8 total, 8 up, 8 in 2024-02-13T00:41:53.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:53 smithi080 bash[24237]: audit 2024-02-13T00:41:52.472699+0000 mon.c (mon.2) 345 : audit [INF] from='client.? 172.21.15.80:0/1949903987' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:53.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:53 smithi080 bash[24237]: audit 2024-02-13T00:41:52.473285+0000 mon.a (mon.0) 2153 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi080-54183-60"}]: dispatch 2024-02-13T00:41:54.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:54 smithi106 bash[18459]: audit 2024-02-13T00:41:53.474087+0000 mon.a (mon.0) 2154 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi080-54183-60"}]': finished 2024-02-13T00:41:54.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:54 smithi106 bash[18459]: cluster 2024-02-13T00:41:53.474225+0000 mon.a (mon.0) 2155 : cluster [DBG] osdmap e316: 8 total, 8 up, 8 in 2024-02-13T00:41:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:54 smithi106 bash[18459]: audit 2024-02-13T00:41:53.502006+0000 mon.c (mon.2) 346 : audit [INF] from='client.? 172.21.15.80:0/4256254558' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:41:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:54 smithi106 bash[18459]: audit 2024-02-13T00:41:53.502526+0000 mon.a (mon.0) 2156 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:41:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:54 smithi106 bash[18459]: audit 2024-02-13T00:41:53.503677+0000 mon.c (mon.2) 347 : audit [INF] from='client.? 172.21.15.80:0/4256254558' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:41:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:54 smithi106 bash[18459]: audit 2024-02-13T00:41:53.504128+0000 mon.a (mon.0) 2157 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:41:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:54 smithi106 bash[18459]: audit 2024-02-13T00:41:53.504861+0000 mon.c (mon.2) 348 : audit [INF] from='client.? 172.21.15.80:0/4256254558' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:54 smithi106 bash[18459]: audit 2024-02-13T00:41:53.505280+0000 mon.a (mon.0) 2158 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:54 smithi106 bash[18459]: audit 2024-02-13T00:41:53.565904+0000 mon.a (mon.0) 2159 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:41:54.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:54 smithi080 bash[17386]: audit 2024-02-13T00:41:53.474087+0000 mon.a (mon.0) 2154 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi080-54183-60"}]': finished 2024-02-13T00:41:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:54 smithi080 bash[17386]: cluster 2024-02-13T00:41:53.474225+0000 mon.a (mon.0) 2155 : cluster [DBG] osdmap e316: 8 total, 8 up, 8 in 2024-02-13T00:41:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:54 smithi080 bash[17386]: audit 2024-02-13T00:41:53.502006+0000 mon.c (mon.2) 346 : audit [INF] from='client.? 172.21.15.80:0/4256254558' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:41:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:54 smithi080 bash[17386]: audit 2024-02-13T00:41:53.502526+0000 mon.a (mon.0) 2156 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:41:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:54 smithi080 bash[17386]: audit 2024-02-13T00:41:53.503677+0000 mon.c (mon.2) 347 : audit [INF] from='client.? 172.21.15.80:0/4256254558' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:41:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:54 smithi080 bash[17386]: audit 2024-02-13T00:41:53.504128+0000 mon.a (mon.0) 2157 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:41:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:54 smithi080 bash[17386]: audit 2024-02-13T00:41:53.504861+0000 mon.c (mon.2) 348 : audit [INF] from='client.? 172.21.15.80:0/4256254558' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:54 smithi080 bash[17386]: audit 2024-02-13T00:41:53.505280+0000 mon.a (mon.0) 2158 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:54 smithi080 bash[17386]: audit 2024-02-13T00:41:53.565904+0000 mon.a (mon.0) 2159 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:41:54.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:54 smithi080 bash[24237]: audit 2024-02-13T00:41:53.474087+0000 mon.a (mon.0) 2154 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi080-54183-60"}]': finished 2024-02-13T00:41:54.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:54 smithi080 bash[24237]: cluster 2024-02-13T00:41:53.474225+0000 mon.a (mon.0) 2155 : cluster [DBG] osdmap e316: 8 total, 8 up, 8 in 2024-02-13T00:41:54.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:54 smithi080 bash[24237]: audit 2024-02-13T00:41:53.502006+0000 mon.c (mon.2) 346 : audit [INF] from='client.? 172.21.15.80:0/4256254558' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:41:54.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:54 smithi080 bash[24237]: audit 2024-02-13T00:41:53.502526+0000 mon.a (mon.0) 2156 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:41:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:54 smithi080 bash[24237]: audit 2024-02-13T00:41:53.503677+0000 mon.c (mon.2) 347 : audit [INF] from='client.? 172.21.15.80:0/4256254558' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:41:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:54 smithi080 bash[24237]: audit 2024-02-13T00:41:53.504128+0000 mon.a (mon.0) 2157 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:41:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:54 smithi080 bash[24237]: audit 2024-02-13T00:41:53.504861+0000 mon.c (mon.2) 348 : audit [INF] from='client.? 172.21.15.80:0/4256254558' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:54 smithi080 bash[24237]: audit 2024-02-13T00:41:53.505280+0000 mon.a (mon.0) 2158 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:41:54.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:54 smithi080 bash[24237]: audit 2024-02-13T00:41:53.565904+0000 mon.a (mon.0) 2159 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:41:56.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:55 smithi106 bash[18459]: cluster 2024-02-13T00:41:54.258560+0000 mgr.y (mgr.24461) 484 : cluster [DBG] pgmap v606: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T00:41:56.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:55 smithi106 bash[18459]: audit 2024-02-13T00:41:54.485801+0000 mon.a (mon.0) 2160 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:56.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:55 smithi106 bash[18459]: audit 2024-02-13T00:41:54.485930+0000 mon.a (mon.0) 2161 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:41:56.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:55 smithi106 bash[18459]: cluster 2024-02-13T00:41:54.485998+0000 mon.a (mon.0) 2162 : cluster [DBG] osdmap e317: 8 total, 8 up, 8 in 2024-02-13T00:41:56.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:55 smithi106 bash[18459]: audit 2024-02-13T00:41:54.489524+0000 mon.c (mon.2) 349 : audit [INF] from='client.? 172.21.15.80:0/4256254558' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi080-54183-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:41:56.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:55 smithi106 bash[18459]: audit 2024-02-13T00:41:54.489862+0000 mon.a (mon.0) 2163 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-45"}]: dispatch 2024-02-13T00:41:56.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:55 smithi106 bash[18459]: audit 2024-02-13T00:41:54.495197+0000 mon.a (mon.0) 2164 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi080-54183-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:41:56.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:55 smithi106 bash[18459]: audit 2024-02-13T00:41:55.170892+0000 mon.c (mon.2) 350 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:41:56.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:55 smithi080 bash[17386]: cluster 2024-02-13T00:41:54.258560+0000 mgr.y (mgr.24461) 484 : cluster [DBG] pgmap v606: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T00:41:56.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:55 smithi080 bash[17386]: audit 2024-02-13T00:41:54.485801+0000 mon.a (mon.0) 2160 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:56.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:55 smithi080 bash[17386]: audit 2024-02-13T00:41:54.485930+0000 mon.a (mon.0) 2161 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:41:56.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:55 smithi080 bash[17386]: cluster 2024-02-13T00:41:54.485998+0000 mon.a (mon.0) 2162 : cluster [DBG] osdmap e317: 8 total, 8 up, 8 in 2024-02-13T00:41:56.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:55 smithi080 bash[17386]: audit 2024-02-13T00:41:54.489524+0000 mon.c (mon.2) 349 : audit [INF] from='client.? 172.21.15.80:0/4256254558' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi080-54183-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:41:56.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:55 smithi080 bash[17386]: audit 2024-02-13T00:41:54.489862+0000 mon.a (mon.0) 2163 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-45"}]: dispatch 2024-02-13T00:41:56.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:55 smithi080 bash[17386]: audit 2024-02-13T00:41:54.495197+0000 mon.a (mon.0) 2164 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi080-54183-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:41:56.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:55 smithi080 bash[17386]: audit 2024-02-13T00:41:55.170892+0000 mon.c (mon.2) 350 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:41:56.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:55 smithi080 bash[24237]: cluster 2024-02-13T00:41:54.258560+0000 mgr.y (mgr.24461) 484 : cluster [DBG] pgmap v606: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T00:41:56.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:55 smithi080 bash[24237]: audit 2024-02-13T00:41:54.485801+0000 mon.a (mon.0) 2160 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:41:56.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:55 smithi080 bash[24237]: audit 2024-02-13T00:41:54.485930+0000 mon.a (mon.0) 2161 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:41:56.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:55 smithi080 bash[24237]: cluster 2024-02-13T00:41:54.485998+0000 mon.a (mon.0) 2162 : cluster [DBG] osdmap e317: 8 total, 8 up, 8 in 2024-02-13T00:41:56.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:55 smithi080 bash[24237]: audit 2024-02-13T00:41:54.489524+0000 mon.c (mon.2) 349 : audit [INF] from='client.? 172.21.15.80:0/4256254558' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi080-54183-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:41:56.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:55 smithi080 bash[24237]: audit 2024-02-13T00:41:54.489862+0000 mon.a (mon.0) 2163 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-45"}]: dispatch 2024-02-13T00:41:56.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:55 smithi080 bash[24237]: audit 2024-02-13T00:41:54.495197+0000 mon.a (mon.0) 2164 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi080-54183-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:41:56.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:55 smithi080 bash[24237]: audit 2024-02-13T00:41:55.170892+0000 mon.c (mon.2) 350 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:41:57.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:56 smithi106 bash[18459]: audit 2024-02-13T00:41:55.488709+0000 mon.a (mon.0) 2165 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-45"}]': finished 2024-02-13T00:41:57.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:56 smithi106 bash[18459]: cluster 2024-02-13T00:41:55.921161+0000 mon.a (mon.0) 2166 : cluster [DBG] osdmap e318: 8 total, 8 up, 8 in 2024-02-13T00:41:57.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:56 smithi106 bash[18459]: audit 2024-02-13T00:41:55.959029+0000 mon.a (mon.0) 2167 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:41:57.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:56 smithi106 bash[18459]: audit 2024-02-13T00:41:55.959684+0000 mon.a (mon.0) 2168 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-45"}]: dispatch 2024-02-13T00:41:57.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:56 smithi106 bash[18459]: audit 2024-02-13T00:41:56.493042+0000 mon.a (mon.0) 2169 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi080-54183-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi080-54183-61"}]': finished 2024-02-13T00:41:57.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:56 smithi106 bash[18459]: cluster 2024-02-13T00:41:56.493337+0000 mon.a (mon.0) 2170 : cluster [DBG] osdmap e319: 8 total, 8 up, 8 in 2024-02-13T00:41:57.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:56 smithi080 bash[17386]: audit 2024-02-13T00:41:55.488709+0000 mon.a (mon.0) 2165 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-45"}]': finished 2024-02-13T00:41:57.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:56 smithi080 bash[17386]: cluster 2024-02-13T00:41:55.921161+0000 mon.a (mon.0) 2166 : cluster [DBG] osdmap e318: 8 total, 8 up, 8 in 2024-02-13T00:41:57.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:56 smithi080 bash[17386]: audit 2024-02-13T00:41:55.959029+0000 mon.a (mon.0) 2167 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:41:57.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:56 smithi080 bash[17386]: audit 2024-02-13T00:41:55.959684+0000 mon.a (mon.0) 2168 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-45"}]: dispatch 2024-02-13T00:41:57.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:56 smithi080 bash[17386]: audit 2024-02-13T00:41:56.493042+0000 mon.a (mon.0) 2169 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi080-54183-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi080-54183-61"}]': finished 2024-02-13T00:41:57.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:56 smithi080 bash[17386]: cluster 2024-02-13T00:41:56.493337+0000 mon.a (mon.0) 2170 : cluster [DBG] osdmap e319: 8 total, 8 up, 8 in 2024-02-13T00:41:57.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:56 smithi080 bash[24237]: audit 2024-02-13T00:41:55.488709+0000 mon.a (mon.0) 2165 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-45"}]': finished 2024-02-13T00:41:57.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:56 smithi080 bash[24237]: cluster 2024-02-13T00:41:55.921161+0000 mon.a (mon.0) 2166 : cluster [DBG] osdmap e318: 8 total, 8 up, 8 in 2024-02-13T00:41:57.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:56 smithi080 bash[24237]: audit 2024-02-13T00:41:55.959029+0000 mon.a (mon.0) 2167 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:41:57.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:56 smithi080 bash[24237]: audit 2024-02-13T00:41:55.959684+0000 mon.a (mon.0) 2168 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-45"}]: dispatch 2024-02-13T00:41:57.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:56 smithi080 bash[24237]: audit 2024-02-13T00:41:56.493042+0000 mon.a (mon.0) 2169 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi080-54183-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi080-54183-61"}]': finished 2024-02-13T00:41:57.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:56 smithi080 bash[24237]: cluster 2024-02-13T00:41:56.493337+0000 mon.a (mon.0) 2170 : cluster [DBG] osdmap e319: 8 total, 8 up, 8 in 2024-02-13T00:41:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:57 smithi106 bash[18459]: cluster 2024-02-13T00:41:56.259122+0000 mgr.y (mgr.24461) 485 : cluster [DBG] pgmap v609: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T00:41:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:57 smithi106 bash[18459]: cluster 2024-02-13T00:41:57.499758+0000 mon.a (mon.0) 2171 : cluster [DBG] osdmap e320: 8 total, 8 up, 8 in 2024-02-13T00:41:58.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:57 smithi106 bash[18459]: audit 2024-02-13T00:41:57.508788+0000 mon.a (mon.0) 2172 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:41:58.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:57 smithi080 bash[17386]: cluster 2024-02-13T00:41:56.259122+0000 mgr.y (mgr.24461) 485 : cluster [DBG] pgmap v609: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T00:41:58.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:57 smithi080 bash[17386]: cluster 2024-02-13T00:41:57.499758+0000 mon.a (mon.0) 2171 : cluster [DBG] osdmap e320: 8 total, 8 up, 8 in 2024-02-13T00:41:58.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:57 smithi080 bash[17386]: audit 2024-02-13T00:41:57.508788+0000 mon.a (mon.0) 2172 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:41:58.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:57 smithi080 bash[24237]: cluster 2024-02-13T00:41:56.259122+0000 mgr.y (mgr.24461) 485 : cluster [DBG] pgmap v609: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T00:41:58.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:57 smithi080 bash[24237]: cluster 2024-02-13T00:41:57.499758+0000 mon.a (mon.0) 2171 : cluster [DBG] osdmap e320: 8 total, 8 up, 8 in 2024-02-13T00:41:58.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:57 smithi080 bash[24237]: audit 2024-02-13T00:41:57.508788+0000 mon.a (mon.0) 2172 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:41:58.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:41:58 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:42:00.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:59 smithi106 bash[18459]: cluster 2024-02-13T00:41:58.261261+0000 mgr.y (mgr.24461) 486 : cluster [DBG] pgmap v612: 236 pgs: 32 creating+peering, 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:42:00.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:59 smithi106 bash[18459]: audit 2024-02-13T00:41:58.325700+0000 mgr.y (mgr.24461) 487 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:42:00.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:59 smithi106 bash[18459]: audit 2024-02-13T00:41:58.502122+0000 mon.a (mon.0) 2173 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:00.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:59 smithi106 bash[18459]: cluster 2024-02-13T00:41:58.502647+0000 mon.a (mon.0) 2174 : cluster [DBG] osdmap e321: 8 total, 8 up, 8 in 2024-02-13T00:42:00.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:59 smithi106 bash[18459]: audit 2024-02-13T00:41:58.504683+0000 mon.c (mon.2) 351 : audit [INF] from='client.? 172.21.15.80:0/4256254558' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:42:00.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:59 smithi106 bash[18459]: audit 2024-02-13T00:41:58.505399+0000 mon.a (mon.0) 2175 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:42:00.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:59 smithi106 bash[18459]: audit 2024-02-13T00:41:58.529530+0000 mon.a (mon.0) 2176 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:42:00.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:41:59 smithi106 bash[18459]: cluster 2024-02-13T00:41:58.936480+0000 mon.a (mon.0) 2177 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:42:00.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:59 smithi080 bash[17386]: cluster 2024-02-13T00:41:58.261261+0000 mgr.y (mgr.24461) 486 : cluster [DBG] pgmap v612: 236 pgs: 32 creating+peering, 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:42:00.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:59 smithi080 bash[17386]: audit 2024-02-13T00:41:58.325700+0000 mgr.y (mgr.24461) 487 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:42:00.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:59 smithi080 bash[17386]: audit 2024-02-13T00:41:58.502122+0000 mon.a (mon.0) 2173 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:00.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:59 smithi080 bash[17386]: cluster 2024-02-13T00:41:58.502647+0000 mon.a (mon.0) 2174 : cluster [DBG] osdmap e321: 8 total, 8 up, 8 in 2024-02-13T00:42:00.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:59 smithi080 bash[17386]: audit 2024-02-13T00:41:58.504683+0000 mon.c (mon.2) 351 : audit [INF] from='client.? 172.21.15.80:0/4256254558' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:42:00.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:59 smithi080 bash[17386]: audit 2024-02-13T00:41:58.505399+0000 mon.a (mon.0) 2175 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:42:00.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:59 smithi080 bash[17386]: audit 2024-02-13T00:41:58.529530+0000 mon.a (mon.0) 2176 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:42:00.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:41:59 smithi080 bash[17386]: cluster 2024-02-13T00:41:58.936480+0000 mon.a (mon.0) 2177 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:42:00.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:59 smithi080 bash[24237]: cluster 2024-02-13T00:41:58.261261+0000 mgr.y (mgr.24461) 486 : cluster [DBG] pgmap v612: 236 pgs: 32 creating+peering, 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:42:00.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:59 smithi080 bash[24237]: audit 2024-02-13T00:41:58.325700+0000 mgr.y (mgr.24461) 487 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:42:00.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:59 smithi080 bash[24237]: audit 2024-02-13T00:41:58.502122+0000 mon.a (mon.0) 2173 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:00.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:59 smithi080 bash[24237]: cluster 2024-02-13T00:41:58.502647+0000 mon.a (mon.0) 2174 : cluster [DBG] osdmap e321: 8 total, 8 up, 8 in 2024-02-13T00:42:00.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:59 smithi080 bash[24237]: audit 2024-02-13T00:41:58.504683+0000 mon.c (mon.2) 351 : audit [INF] from='client.? 172.21.15.80:0/4256254558' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:42:00.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:59 smithi080 bash[24237]: audit 2024-02-13T00:41:58.505399+0000 mon.a (mon.0) 2175 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:42:00.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:59 smithi080 bash[24237]: audit 2024-02-13T00:41:58.529530+0000 mon.a (mon.0) 2176 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:42:00.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:41:59 smithi080 bash[24237]: cluster 2024-02-13T00:41:58.936480+0000 mon.a (mon.0) 2177 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:42:00.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:42:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:42:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:42:01.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:00 smithi106 bash[18459]: audit 2024-02-13T00:41:59.503698+0000 mon.a (mon.0) 2178 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61"}]': finished 2024-02-13T00:42:01.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:00 smithi106 bash[18459]: audit 2024-02-13T00:41:59.503911+0000 mon.a (mon.0) 2179 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-47", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:42:01.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:00 smithi106 bash[18459]: cluster 2024-02-13T00:41:59.504090+0000 mon.a (mon.0) 2180 : cluster [DBG] osdmap e322: 8 total, 8 up, 8 in 2024-02-13T00:42:01.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:00 smithi106 bash[18459]: audit 2024-02-13T00:41:59.505186+0000 mon.c (mon.2) 352 : audit [INF] from='client.? 172.21.15.80:0/4256254558' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:42:01.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:00 smithi106 bash[18459]: audit 2024-02-13T00:41:59.505656+0000 mon.a (mon.0) 2181 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-47"}]: dispatch 2024-02-13T00:42:01.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:00 smithi106 bash[18459]: audit 2024-02-13T00:41:59.506135+0000 mon.a (mon.0) 2182 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:42:01.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:00 smithi080 bash[17386]: audit 2024-02-13T00:41:59.503698+0000 mon.a (mon.0) 2178 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61"}]': finished 2024-02-13T00:42:01.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:00 smithi080 bash[17386]: audit 2024-02-13T00:41:59.503911+0000 mon.a (mon.0) 2179 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-47", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:42:01.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:00 smithi080 bash[17386]: cluster 2024-02-13T00:41:59.504090+0000 mon.a (mon.0) 2180 : cluster [DBG] osdmap e322: 8 total, 8 up, 8 in 2024-02-13T00:42:01.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:00 smithi080 bash[17386]: audit 2024-02-13T00:41:59.505186+0000 mon.c (mon.2) 352 : audit [INF] from='client.? 172.21.15.80:0/4256254558' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:42:01.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:00 smithi080 bash[17386]: audit 2024-02-13T00:41:59.505656+0000 mon.a (mon.0) 2181 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-47"}]: dispatch 2024-02-13T00:42:01.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:00 smithi080 bash[17386]: audit 2024-02-13T00:41:59.506135+0000 mon.a (mon.0) 2182 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:42:01.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:00 smithi080 bash[24237]: audit 2024-02-13T00:41:59.503698+0000 mon.a (mon.0) 2178 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi080-54183-61"}]': finished 2024-02-13T00:42:01.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:00 smithi080 bash[24237]: audit 2024-02-13T00:41:59.503911+0000 mon.a (mon.0) 2179 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-47", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:42:01.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:00 smithi080 bash[24237]: cluster 2024-02-13T00:41:59.504090+0000 mon.a (mon.0) 2180 : cluster [DBG] osdmap e322: 8 total, 8 up, 8 in 2024-02-13T00:42:01.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:00 smithi080 bash[24237]: audit 2024-02-13T00:41:59.505186+0000 mon.c (mon.2) 352 : audit [INF] from='client.? 172.21.15.80:0/4256254558' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:42:01.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:00 smithi080 bash[24237]: audit 2024-02-13T00:41:59.505656+0000 mon.a (mon.0) 2181 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-47"}]: dispatch 2024-02-13T00:42:01.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:00 smithi080 bash[24237]: audit 2024-02-13T00:41:59.506135+0000 mon.a (mon.0) 2182 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi080-54183-61"}]: dispatch 2024-02-13T00:42:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:01 smithi106 bash[18459]: cluster 2024-02-13T00:42:00.261952+0000 mgr.y (mgr.24461) 488 : cluster [DBG] pgmap v615: 228 pgs: 32 creating+peering, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:42:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:01 smithi106 bash[18459]: audit 2024-02-13T00:42:00.512559+0000 mon.a (mon.0) 2183 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-47"}]': finished 2024-02-13T00:42:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:01 smithi106 bash[18459]: audit 2024-02-13T00:42:00.512639+0000 mon.a (mon.0) 2184 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi080-54183-61"}]': finished 2024-02-13T00:42:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:01 smithi106 bash[18459]: cluster 2024-02-13T00:42:00.512716+0000 mon.a (mon.0) 2185 : cluster [DBG] osdmap e323: 8 total, 8 up, 8 in 2024-02-13T00:42:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:01 smithi106 bash[18459]: audit 2024-02-13T00:42:00.513797+0000 mon.a (mon.0) 2186 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-47", "mode": "readproxy"}]: dispatch 2024-02-13T00:42:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:01 smithi106 bash[18459]: audit 2024-02-13T00:42:00.545892+0000 mon.c (mon.2) 353 : audit [INF] from='client.? 172.21.15.80:0/4185593988' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:01 smithi106 bash[18459]: audit 2024-02-13T00:42:00.546403+0000 mon.a (mon.0) 2187 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:01 smithi106 bash[18459]: audit 2024-02-13T00:42:00.547039+0000 mon.c (mon.2) 354 : audit [INF] from='client.? 172.21.15.80:0/4185593988' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:01 smithi106 bash[18459]: audit 2024-02-13T00:42:00.547398+0000 mon.a (mon.0) 2188 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:01 smithi106 bash[18459]: audit 2024-02-13T00:42:00.547970+0000 mon.c (mon.2) 355 : audit [INF] from='client.? 172.21.15.80:0/4185593988' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi080-54183-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:42:02.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:01 smithi106 bash[18459]: audit 2024-02-13T00:42:00.548357+0000 mon.a (mon.0) 2189 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi080-54183-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:42:02.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:01 smithi106 bash[18459]: audit 2024-02-13T00:42:00.824066+0000 mon.a (mon.0) 2190 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:42:02.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:01 smithi106 bash[18459]: audit 2024-02-13T00:42:01.122255+0000 mon.c (mon.2) 356 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:42:02.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:01 smithi106 bash[18459]: audit 2024-02-13T00:42:01.123895+0000 mon.c (mon.2) 357 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:42:02.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:01 smithi106 bash[18459]: audit 2024-02-13T00:42:01.132809+0000 mon.a (mon.0) 2191 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:42:02.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:01 smithi106 bash[18459]: cluster 2024-02-13T00:42:01.500851+0000 mon.a (mon.0) 2192 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:42:02.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:01 smithi106 bash[18459]: audit 2024-02-13T00:42:01.510276+0000 mon.a (mon.0) 2193 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-47", "mode": "readproxy"}]': finished 2024-02-13T00:42:02.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:01 smithi106 bash[18459]: audit 2024-02-13T00:42:01.510401+0000 mon.a (mon.0) 2194 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi080-54183-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:42:02.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:01 smithi106 bash[18459]: cluster 2024-02-13T00:42:01.510568+0000 mon.a (mon.0) 2195 : cluster [DBG] osdmap e324: 8 total, 8 up, 8 in 2024-02-13T00:42:02.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:01 smithi106 bash[18459]: audit 2024-02-13T00:42:01.511714+0000 mon.c (mon.2) 358 : audit [INF] from='client.? 172.21.15.80:0/4185593988' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi080-54183-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:02.007 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:01 smithi106 bash[18459]: audit 2024-02-13T00:42:01.512515+0000 mon.a (mon.0) 2196 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi080-54183-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:02.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[24237]: cluster 2024-02-13T00:42:00.261952+0000 mgr.y (mgr.24461) 488 : cluster [DBG] pgmap v615: 228 pgs: 32 creating+peering, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:42:02.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[24237]: audit 2024-02-13T00:42:00.512559+0000 mon.a (mon.0) 2183 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-47"}]': finished 2024-02-13T00:42:02.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[24237]: audit 2024-02-13T00:42:00.512639+0000 mon.a (mon.0) 2184 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi080-54183-61"}]': finished 2024-02-13T00:42:02.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[24237]: cluster 2024-02-13T00:42:00.512716+0000 mon.a (mon.0) 2185 : cluster [DBG] osdmap e323: 8 total, 8 up, 8 in 2024-02-13T00:42:02.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[24237]: audit 2024-02-13T00:42:00.513797+0000 mon.a (mon.0) 2186 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-47", "mode": "readproxy"}]: dispatch 2024-02-13T00:42:02.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[24237]: audit 2024-02-13T00:42:00.545892+0000 mon.c (mon.2) 353 : audit [INF] from='client.? 172.21.15.80:0/4185593988' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:02.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[24237]: audit 2024-02-13T00:42:00.546403+0000 mon.a (mon.0) 2187 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:02.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[24237]: audit 2024-02-13T00:42:00.547039+0000 mon.c (mon.2) 354 : audit [INF] from='client.? 172.21.15.80:0/4185593988' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:02.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[24237]: audit 2024-02-13T00:42:00.547398+0000 mon.a (mon.0) 2188 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:02.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[24237]: audit 2024-02-13T00:42:00.547970+0000 mon.c (mon.2) 355 : audit [INF] from='client.? 172.21.15.80:0/4185593988' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi080-54183-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:42:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[24237]: audit 2024-02-13T00:42:00.548357+0000 mon.a (mon.0) 2189 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi080-54183-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:42:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[24237]: audit 2024-02-13T00:42:00.824066+0000 mon.a (mon.0) 2190 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:42:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[24237]: audit 2024-02-13T00:42:01.122255+0000 mon.c (mon.2) 356 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:42:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[24237]: audit 2024-02-13T00:42:01.123895+0000 mon.c (mon.2) 357 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:42:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[24237]: audit 2024-02-13T00:42:01.132809+0000 mon.a (mon.0) 2191 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:42:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[24237]: cluster 2024-02-13T00:42:01.500851+0000 mon.a (mon.0) 2192 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:42:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[24237]: audit 2024-02-13T00:42:01.510276+0000 mon.a (mon.0) 2193 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-47", "mode": "readproxy"}]': finished 2024-02-13T00:42:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[24237]: audit 2024-02-13T00:42:01.510401+0000 mon.a (mon.0) 2194 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi080-54183-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:42:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[24237]: cluster 2024-02-13T00:42:01.510568+0000 mon.a (mon.0) 2195 : cluster [DBG] osdmap e324: 8 total, 8 up, 8 in 2024-02-13T00:42:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[24237]: audit 2024-02-13T00:42:01.511714+0000 mon.c (mon.2) 358 : audit [INF] from='client.? 172.21.15.80:0/4185593988' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi080-54183-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[24237]: audit 2024-02-13T00:42:01.512515+0000 mon.a (mon.0) 2196 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi080-54183-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:02.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[17386]: cluster 2024-02-13T00:42:00.261952+0000 mgr.y (mgr.24461) 488 : cluster [DBG] pgmap v615: 228 pgs: 32 creating+peering, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:42:02.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[17386]: audit 2024-02-13T00:42:00.512559+0000 mon.a (mon.0) 2183 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-47"}]': finished 2024-02-13T00:42:02.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[17386]: audit 2024-02-13T00:42:00.512639+0000 mon.a (mon.0) 2184 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi080-54183-61"}]': finished 2024-02-13T00:42:02.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[17386]: cluster 2024-02-13T00:42:00.512716+0000 mon.a (mon.0) 2185 : cluster [DBG] osdmap e323: 8 total, 8 up, 8 in 2024-02-13T00:42:02.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[17386]: audit 2024-02-13T00:42:00.513797+0000 mon.a (mon.0) 2186 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-47", "mode": "readproxy"}]: dispatch 2024-02-13T00:42:02.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[17386]: audit 2024-02-13T00:42:00.545892+0000 mon.c (mon.2) 353 : audit [INF] from='client.? 172.21.15.80:0/4185593988' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:02.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[17386]: audit 2024-02-13T00:42:00.546403+0000 mon.a (mon.0) 2187 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:02.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[17386]: audit 2024-02-13T00:42:00.547039+0000 mon.c (mon.2) 354 : audit [INF] from='client.? 172.21.15.80:0/4185593988' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:02.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[17386]: audit 2024-02-13T00:42:00.547398+0000 mon.a (mon.0) 2188 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:02.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[17386]: audit 2024-02-13T00:42:00.547970+0000 mon.c (mon.2) 355 : audit [INF] from='client.? 172.21.15.80:0/4185593988' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi080-54183-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:42:02.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[17386]: audit 2024-02-13T00:42:00.548357+0000 mon.a (mon.0) 2189 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi080-54183-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:42:02.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[17386]: audit 2024-02-13T00:42:00.824066+0000 mon.a (mon.0) 2190 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:42:02.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[17386]: audit 2024-02-13T00:42:01.122255+0000 mon.c (mon.2) 356 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:42:02.010 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[17386]: audit 2024-02-13T00:42:01.123895+0000 mon.c (mon.2) 357 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:42:02.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[17386]: audit 2024-02-13T00:42:01.132809+0000 mon.a (mon.0) 2191 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:42:02.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[17386]: cluster 2024-02-13T00:42:01.500851+0000 mon.a (mon.0) 2192 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:42:02.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[17386]: audit 2024-02-13T00:42:01.510276+0000 mon.a (mon.0) 2193 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-47", "mode": "readproxy"}]': finished 2024-02-13T00:42:02.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[17386]: audit 2024-02-13T00:42:01.510401+0000 mon.a (mon.0) 2194 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi080-54183-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:42:02.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[17386]: cluster 2024-02-13T00:42:01.510568+0000 mon.a (mon.0) 2195 : cluster [DBG] osdmap e324: 8 total, 8 up, 8 in 2024-02-13T00:42:02.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[17386]: audit 2024-02-13T00:42:01.511714+0000 mon.c (mon.2) 358 : audit [INF] from='client.? 172.21.15.80:0/4185593988' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi080-54183-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:02.011 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:01 smithi080 bash[17386]: audit 2024-02-13T00:42:01.512515+0000 mon.a (mon.0) 2196 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi080-54183-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:03.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:42:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:42:03] "GET /metrics HTTP/1.1" 200 187357 "" "Prometheus/2.33.4" 2024-02-13T00:42:04.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:03 smithi106 bash[18459]: cluster 2024-02-13T00:42:02.262670+0000 mgr.y (mgr.24461) 489 : cluster [DBG] pgmap v618: 228 pgs: 32 creating+peering, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:42:04.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:03 smithi106 bash[18459]: cluster 2024-02-13T00:42:02.948812+0000 mon.a (mon.0) 2197 : cluster [DBG] osdmap e325: 8 total, 8 up, 8 in 2024-02-13T00:42:04.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:03 smithi080 bash[17386]: cluster 2024-02-13T00:42:02.262670+0000 mgr.y (mgr.24461) 489 : cluster [DBG] pgmap v618: 228 pgs: 32 creating+peering, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:42:04.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:03 smithi080 bash[17386]: cluster 2024-02-13T00:42:02.948812+0000 mon.a (mon.0) 2197 : cluster [DBG] osdmap e325: 8 total, 8 up, 8 in 2024-02-13T00:42:04.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:03 smithi080 bash[24237]: cluster 2024-02-13T00:42:02.262670+0000 mgr.y (mgr.24461) 489 : cluster [DBG] pgmap v618: 228 pgs: 32 creating+peering, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:42:04.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:03 smithi080 bash[24237]: cluster 2024-02-13T00:42:02.948812+0000 mon.a (mon.0) 2197 : cluster [DBG] osdmap e325: 8 total, 8 up, 8 in 2024-02-13T00:42:05.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:04 smithi106 bash[18459]: audit 2024-02-13T00:42:03.517220+0000 mon.a (mon.0) 2198 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi080-54183-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi080-54183-62"}]': finished 2024-02-13T00:42:05.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:04 smithi106 bash[18459]: cluster 2024-02-13T00:42:03.517354+0000 mon.a (mon.0) 2199 : cluster [DBG] osdmap e326: 8 total, 8 up, 8 in 2024-02-13T00:42:05.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:04 smithi080 bash[17386]: audit 2024-02-13T00:42:03.517220+0000 mon.a (mon.0) 2198 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi080-54183-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi080-54183-62"}]': finished 2024-02-13T00:42:05.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:04 smithi080 bash[17386]: cluster 2024-02-13T00:42:03.517354+0000 mon.a (mon.0) 2199 : cluster [DBG] osdmap e326: 8 total, 8 up, 8 in 2024-02-13T00:42:05.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:04 smithi080 bash[24237]: audit 2024-02-13T00:42:03.517220+0000 mon.a (mon.0) 2198 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi080-54183-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi080-54183-62"}]': finished 2024-02-13T00:42:05.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:04 smithi080 bash[24237]: cluster 2024-02-13T00:42:03.517354+0000 mon.a (mon.0) 2199 : cluster [DBG] osdmap e326: 8 total, 8 up, 8 in 2024-02-13T00:42:06.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:05 smithi106 bash[18459]: cluster 2024-02-13T00:42:04.263498+0000 mgr.y (mgr.24461) 490 : cluster [DBG] pgmap v621: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:42:06.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:05 smithi106 bash[18459]: cluster 2024-02-13T00:42:04.520780+0000 mon.a (mon.0) 2200 : cluster [DBG] osdmap e327: 8 total, 8 up, 8 in 2024-02-13T00:42:06.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:05 smithi080 bash[24237]: cluster 2024-02-13T00:42:04.263498+0000 mgr.y (mgr.24461) 490 : cluster [DBG] pgmap v621: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:42:06.007 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:05 smithi080 bash[24237]: cluster 2024-02-13T00:42:04.520780+0000 mon.a (mon.0) 2200 : cluster [DBG] osdmap e327: 8 total, 8 up, 8 in 2024-02-13T00:42:06.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:05 smithi080 bash[17386]: cluster 2024-02-13T00:42:04.263498+0000 mgr.y (mgr.24461) 490 : cluster [DBG] pgmap v621: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:42:06.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:05 smithi080 bash[17386]: cluster 2024-02-13T00:42:04.520780+0000 mon.a (mon.0) 2200 : cluster [DBG] osdmap e327: 8 total, 8 up, 8 in 2024-02-13T00:42:07.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:06 smithi106 bash[18459]: cluster 2024-02-13T00:42:05.537975+0000 mon.a (mon.0) 2201 : cluster [DBG] osdmap e328: 8 total, 8 up, 8 in 2024-02-13T00:42:07.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:06 smithi106 bash[18459]: audit 2024-02-13T00:42:05.540654+0000 mon.c (mon.2) 359 : audit [INF] from='client.? 172.21.15.80:0/4185593988' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:07.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:06 smithi106 bash[18459]: audit 2024-02-13T00:42:05.546619+0000 mon.a (mon.0) 2202 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:07.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:06 smithi080 bash[17386]: cluster 2024-02-13T00:42:05.537975+0000 mon.a (mon.0) 2201 : cluster [DBG] osdmap e328: 8 total, 8 up, 8 in 2024-02-13T00:42:07.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:06 smithi080 bash[17386]: audit 2024-02-13T00:42:05.540654+0000 mon.c (mon.2) 359 : audit [INF] from='client.? 172.21.15.80:0/4185593988' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:07.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:06 smithi080 bash[17386]: audit 2024-02-13T00:42:05.546619+0000 mon.a (mon.0) 2202 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:07.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:06 smithi080 bash[24237]: cluster 2024-02-13T00:42:05.537975+0000 mon.a (mon.0) 2201 : cluster [DBG] osdmap e328: 8 total, 8 up, 8 in 2024-02-13T00:42:07.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:06 smithi080 bash[24237]: audit 2024-02-13T00:42:05.540654+0000 mon.c (mon.2) 359 : audit [INF] from='client.? 172.21.15.80:0/4185593988' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:07.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:06 smithi080 bash[24237]: audit 2024-02-13T00:42:05.546619+0000 mon.a (mon.0) 2202 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:08.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:07 smithi106 bash[18459]: cluster 2024-02-13T00:42:06.264335+0000 mgr.y (mgr.24461) 491 : cluster [DBG] pgmap v624: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:42:08.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:07 smithi106 bash[18459]: audit 2024-02-13T00:42:06.548186+0000 mon.a (mon.0) 2203 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi080-54183-62"}]': finished 2024-02-13T00:42:08.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:07 smithi106 bash[18459]: cluster 2024-02-13T00:42:06.548294+0000 mon.a (mon.0) 2204 : cluster [DBG] osdmap e329: 8 total, 8 up, 8 in 2024-02-13T00:42:08.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:07 smithi106 bash[18459]: audit 2024-02-13T00:42:06.554493+0000 mon.c (mon.2) 360 : audit [INF] from='client.? 172.21.15.80:0/4185593988' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:08.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:07 smithi106 bash[18459]: audit 2024-02-13T00:42:06.559452+0000 mon.a (mon.0) 2205 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:08.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:07 smithi106 bash[18459]: cluster 2024-02-13T00:42:07.241974+0000 mon.a (mon.0) 2206 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:42:08.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:07 smithi080 bash[17386]: cluster 2024-02-13T00:42:06.264335+0000 mgr.y (mgr.24461) 491 : cluster [DBG] pgmap v624: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:42:08.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:07 smithi080 bash[17386]: audit 2024-02-13T00:42:06.548186+0000 mon.a (mon.0) 2203 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi080-54183-62"}]': finished 2024-02-13T00:42:08.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:07 smithi080 bash[17386]: cluster 2024-02-13T00:42:06.548294+0000 mon.a (mon.0) 2204 : cluster [DBG] osdmap e329: 8 total, 8 up, 8 in 2024-02-13T00:42:08.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:07 smithi080 bash[17386]: audit 2024-02-13T00:42:06.554493+0000 mon.c (mon.2) 360 : audit [INF] from='client.? 172.21.15.80:0/4185593988' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:08.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:07 smithi080 bash[17386]: audit 2024-02-13T00:42:06.559452+0000 mon.a (mon.0) 2205 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:08.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:07 smithi080 bash[17386]: cluster 2024-02-13T00:42:07.241974+0000 mon.a (mon.0) 2206 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:42:08.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:07 smithi080 bash[24237]: cluster 2024-02-13T00:42:06.264335+0000 mgr.y (mgr.24461) 491 : cluster [DBG] pgmap v624: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:42:08.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:07 smithi080 bash[24237]: audit 2024-02-13T00:42:06.548186+0000 mon.a (mon.0) 2203 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi080-54183-62"}]': finished 2024-02-13T00:42:08.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:07 smithi080 bash[24237]: cluster 2024-02-13T00:42:06.548294+0000 mon.a (mon.0) 2204 : cluster [DBG] osdmap e329: 8 total, 8 up, 8 in 2024-02-13T00:42:08.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:07 smithi080 bash[24237]: audit 2024-02-13T00:42:06.554493+0000 mon.c (mon.2) 360 : audit [INF] from='client.? 172.21.15.80:0/4185593988' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:08.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:07 smithi080 bash[24237]: audit 2024-02-13T00:42:06.559452+0000 mon.a (mon.0) 2205 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi080-54183-62"}]: dispatch 2024-02-13T00:42:08.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:07 smithi080 bash[24237]: cluster 2024-02-13T00:42:07.241974+0000 mon.a (mon.0) 2206 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:42:08.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:42:08 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:42:08.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:08 smithi106 bash[18459]: audit 2024-02-13T00:42:07.571127+0000 mon.a (mon.0) 2207 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi080-54183-62"}]': finished 2024-02-13T00:42:08.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:08 smithi106 bash[18459]: cluster 2024-02-13T00:42:07.571202+0000 mon.a (mon.0) 2208 : cluster [DBG] osdmap e330: 8 total, 8 up, 8 in 2024-02-13T00:42:08.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:08 smithi106 bash[18459]: audit 2024-02-13T00:42:07.599451+0000 mon.a (mon.0) 2209 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi080-54183-63"}]: dispatch 2024-02-13T00:42:08.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:08 smithi106 bash[18459]: audit 2024-02-13T00:42:07.601699+0000 mon.a (mon.0) 2210 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi080-54183-63"}]: dispatch 2024-02-13T00:42:08.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:08 smithi106 bash[18459]: audit 2024-02-13T00:42:07.602317+0000 mon.a (mon.0) 2211 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi080-54183-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:42:09.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:08 smithi080 bash[17386]: audit 2024-02-13T00:42:07.571127+0000 mon.a (mon.0) 2207 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi080-54183-62"}]': finished 2024-02-13T00:42:09.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:08 smithi080 bash[17386]: cluster 2024-02-13T00:42:07.571202+0000 mon.a (mon.0) 2208 : cluster [DBG] osdmap e330: 8 total, 8 up, 8 in 2024-02-13T00:42:09.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:08 smithi080 bash[17386]: audit 2024-02-13T00:42:07.599451+0000 mon.a (mon.0) 2209 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi080-54183-63"}]: dispatch 2024-02-13T00:42:09.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:08 smithi080 bash[17386]: audit 2024-02-13T00:42:07.601699+0000 mon.a (mon.0) 2210 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi080-54183-63"}]: dispatch 2024-02-13T00:42:09.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:08 smithi080 bash[17386]: audit 2024-02-13T00:42:07.602317+0000 mon.a (mon.0) 2211 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi080-54183-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:42:09.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:08 smithi080 bash[24237]: audit 2024-02-13T00:42:07.571127+0000 mon.a (mon.0) 2207 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi080-54183-62"}]': finished 2024-02-13T00:42:09.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:08 smithi080 bash[24237]: cluster 2024-02-13T00:42:07.571202+0000 mon.a (mon.0) 2208 : cluster [DBG] osdmap e330: 8 total, 8 up, 8 in 2024-02-13T00:42:09.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:08 smithi080 bash[24237]: audit 2024-02-13T00:42:07.599451+0000 mon.a (mon.0) 2209 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi080-54183-63"}]: dispatch 2024-02-13T00:42:09.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:08 smithi080 bash[24237]: audit 2024-02-13T00:42:07.601699+0000 mon.a (mon.0) 2210 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi080-54183-63"}]: dispatch 2024-02-13T00:42:09.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:08 smithi080 bash[24237]: audit 2024-02-13T00:42:07.602317+0000 mon.a (mon.0) 2211 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi080-54183-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:42:10.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:42:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:42:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:42:10.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:10 smithi106 bash[18459]: cluster 2024-02-13T00:42:08.266378+0000 mgr.y (mgr.24461) 492 : cluster [DBG] pgmap v627: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:42:10.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:10 smithi106 bash[18459]: audit 2024-02-13T00:42:08.337088+0000 mgr.y (mgr.24461) 493 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:42:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:10 smithi106 bash[18459]: audit 2024-02-13T00:42:08.592135+0000 mon.a (mon.0) 2212 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi080-54183-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:42:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:10 smithi106 bash[18459]: cluster 2024-02-13T00:42:08.592243+0000 mon.a (mon.0) 2213 : cluster [DBG] osdmap e331: 8 total, 8 up, 8 in 2024-02-13T00:42:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:10 smithi106 bash[18459]: audit 2024-02-13T00:42:08.593592+0000 mon.a (mon.0) 2214 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi080-54183-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi080-54183-63"}]: dispatch 2024-02-13T00:42:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:10 smithi080 bash[17386]: cluster 2024-02-13T00:42:08.266378+0000 mgr.y (mgr.24461) 492 : cluster [DBG] pgmap v627: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:42:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:10 smithi080 bash[17386]: audit 2024-02-13T00:42:08.337088+0000 mgr.y (mgr.24461) 493 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:42:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:10 smithi080 bash[17386]: audit 2024-02-13T00:42:08.592135+0000 mon.a (mon.0) 2212 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi080-54183-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:42:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:10 smithi080 bash[17386]: cluster 2024-02-13T00:42:08.592243+0000 mon.a (mon.0) 2213 : cluster [DBG] osdmap e331: 8 total, 8 up, 8 in 2024-02-13T00:42:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:10 smithi080 bash[17386]: audit 2024-02-13T00:42:08.593592+0000 mon.a (mon.0) 2214 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi080-54183-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi080-54183-63"}]: dispatch 2024-02-13T00:42:10.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:10 smithi080 bash[24237]: cluster 2024-02-13T00:42:08.266378+0000 mgr.y (mgr.24461) 492 : cluster [DBG] pgmap v627: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:42:10.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:10 smithi080 bash[24237]: audit 2024-02-13T00:42:08.337088+0000 mgr.y (mgr.24461) 493 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:42:10.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:10 smithi080 bash[24237]: audit 2024-02-13T00:42:08.592135+0000 mon.a (mon.0) 2212 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi080-54183-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:42:10.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:10 smithi080 bash[24237]: cluster 2024-02-13T00:42:08.592243+0000 mon.a (mon.0) 2213 : cluster [DBG] osdmap e331: 8 total, 8 up, 8 in 2024-02-13T00:42:10.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:10 smithi080 bash[24237]: audit 2024-02-13T00:42:08.593592+0000 mon.a (mon.0) 2214 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi080-54183-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi080-54183-63"}]: dispatch 2024-02-13T00:42:11.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:11 smithi106 bash[18459]: cluster 2024-02-13T00:42:10.027231+0000 mon.a (mon.0) 2215 : cluster [DBG] osdmap e332: 8 total, 8 up, 8 in 2024-02-13T00:42:11.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:11 smithi106 bash[18459]: audit 2024-02-13T00:42:10.605634+0000 mon.a (mon.0) 2216 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi080-54183-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi080-54183-63"}]': finished 2024-02-13T00:42:11.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:11 smithi106 bash[18459]: cluster 2024-02-13T00:42:10.605787+0000 mon.a (mon.0) 2217 : cluster [DBG] osdmap e333: 8 total, 8 up, 8 in 2024-02-13T00:42:11.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:11 smithi080 bash[17386]: cluster 2024-02-13T00:42:10.027231+0000 mon.a (mon.0) 2215 : cluster [DBG] osdmap e332: 8 total, 8 up, 8 in 2024-02-13T00:42:11.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:11 smithi080 bash[17386]: audit 2024-02-13T00:42:10.605634+0000 mon.a (mon.0) 2216 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi080-54183-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi080-54183-63"}]': finished 2024-02-13T00:42:11.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:11 smithi080 bash[17386]: cluster 2024-02-13T00:42:10.605787+0000 mon.a (mon.0) 2217 : cluster [DBG] osdmap e333: 8 total, 8 up, 8 in 2024-02-13T00:42:11.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:11 smithi080 bash[24237]: cluster 2024-02-13T00:42:10.027231+0000 mon.a (mon.0) 2215 : cluster [DBG] osdmap e332: 8 total, 8 up, 8 in 2024-02-13T00:42:11.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:11 smithi080 bash[24237]: audit 2024-02-13T00:42:10.605634+0000 mon.a (mon.0) 2216 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi080-54183-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi080-54183-63"}]': finished 2024-02-13T00:42:11.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:11 smithi080 bash[24237]: cluster 2024-02-13T00:42:10.605787+0000 mon.a (mon.0) 2217 : cluster [DBG] osdmap e333: 8 total, 8 up, 8 in 2024-02-13T00:42:12.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:12 smithi106 bash[18459]: cluster 2024-02-13T00:42:10.267201+0000 mgr.y (mgr.24461) 494 : cluster [DBG] pgmap v630: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:42:12.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:12 smithi106 bash[18459]: cluster 2024-02-13T00:42:11.603008+0000 mon.a (mon.0) 2218 : cluster [DBG] osdmap e334: 8 total, 8 up, 8 in 2024-02-13T00:42:12.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:12 smithi080 bash[17386]: cluster 2024-02-13T00:42:10.267201+0000 mgr.y (mgr.24461) 494 : cluster [DBG] pgmap v630: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:42:12.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:12 smithi080 bash[17386]: cluster 2024-02-13T00:42:11.603008+0000 mon.a (mon.0) 2218 : cluster [DBG] osdmap e334: 8 total, 8 up, 8 in 2024-02-13T00:42:12.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:12 smithi080 bash[24237]: cluster 2024-02-13T00:42:10.267201+0000 mgr.y (mgr.24461) 494 : cluster [DBG] pgmap v630: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:42:12.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:12 smithi080 bash[24237]: cluster 2024-02-13T00:42:11.603008+0000 mon.a (mon.0) 2218 : cluster [DBG] osdmap e334: 8 total, 8 up, 8 in 2024-02-13T00:42:13.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:13 smithi106 bash[18459]: audit 2024-02-13T00:42:12.201081+0000 mon.a (mon.0) 2219 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:13.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:13 smithi106 bash[18459]: audit 2024-02-13T00:42:12.611212+0000 mon.a (mon.0) 2220 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:42:13.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:13 smithi106 bash[18459]: cluster 2024-02-13T00:42:12.611330+0000 mon.a (mon.0) 2221 : cluster [DBG] osdmap e335: 8 total, 8 up, 8 in 2024-02-13T00:42:13.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:13 smithi106 bash[18459]: audit 2024-02-13T00:42:12.613029+0000 mon.a (mon.0) 2222 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-47"}]: dispatch 2024-02-13T00:42:13.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:13 smithi106 bash[18459]: audit 2024-02-13T00:42:12.614823+0000 mon.a (mon.0) 2223 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi080-54183-63"}]: dispatch 2024-02-13T00:42:13.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:42:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:42:13] "GET /metrics HTTP/1.1" 200 187357 "" "Prometheus/2.33.4" 2024-02-13T00:42:13.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:13 smithi080 bash[17386]: audit 2024-02-13T00:42:12.201081+0000 mon.a (mon.0) 2219 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:13.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:13 smithi080 bash[17386]: audit 2024-02-13T00:42:12.611212+0000 mon.a (mon.0) 2220 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:42:13.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:13 smithi080 bash[17386]: cluster 2024-02-13T00:42:12.611330+0000 mon.a (mon.0) 2221 : cluster [DBG] osdmap e335: 8 total, 8 up, 8 in 2024-02-13T00:42:13.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:13 smithi080 bash[17386]: audit 2024-02-13T00:42:12.613029+0000 mon.a (mon.0) 2222 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-47"}]: dispatch 2024-02-13T00:42:13.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:13 smithi080 bash[17386]: audit 2024-02-13T00:42:12.614823+0000 mon.a (mon.0) 2223 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi080-54183-63"}]: dispatch 2024-02-13T00:42:13.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:13 smithi080 bash[24237]: audit 2024-02-13T00:42:12.201081+0000 mon.a (mon.0) 2219 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:13.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:13 smithi080 bash[24237]: audit 2024-02-13T00:42:12.611212+0000 mon.a (mon.0) 2220 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:42:13.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:13 smithi080 bash[24237]: cluster 2024-02-13T00:42:12.611330+0000 mon.a (mon.0) 2221 : cluster [DBG] osdmap e335: 8 total, 8 up, 8 in 2024-02-13T00:42:13.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:13 smithi080 bash[24237]: audit 2024-02-13T00:42:12.613029+0000 mon.a (mon.0) 2222 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-47"}]: dispatch 2024-02-13T00:42:13.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:13 smithi080 bash[24237]: audit 2024-02-13T00:42:12.614823+0000 mon.a (mon.0) 2223 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi080-54183-63"}]: dispatch 2024-02-13T00:42:14.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:14 smithi106 bash[18459]: cluster 2024-02-13T00:42:12.268025+0000 mgr.y (mgr.24461) 495 : cluster [DBG] pgmap v633: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:42:14.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:14 smithi106 bash[18459]: cluster 2024-02-13T00:42:13.601936+0000 mon.a (mon.0) 2224 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:42:14.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:14 smithi106 bash[18459]: audit 2024-02-13T00:42:13.610033+0000 mon.a (mon.0) 2225 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-47"}]': finished 2024-02-13T00:42:14.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:14 smithi106 bash[18459]: audit 2024-02-13T00:42:13.610206+0000 mon.a (mon.0) 2226 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi080-54183-63"}]': finished 2024-02-13T00:42:14.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:14 smithi106 bash[18459]: cluster 2024-02-13T00:42:13.610333+0000 mon.a (mon.0) 2227 : cluster [DBG] osdmap e336: 8 total, 8 up, 8 in 2024-02-13T00:42:14.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:14 smithi106 bash[18459]: audit 2024-02-13T00:42:13.611645+0000 mon.a (mon.0) 2228 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi080-54183-63"}]: dispatch 2024-02-13T00:42:14.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:14 smithi106 bash[18459]: audit 2024-02-13T00:42:13.648981+0000 mon.a (mon.0) 2229 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:14.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:14 smithi106 bash[18459]: audit 2024-02-13T00:42:13.649783+0000 mon.a (mon.0) 2230 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-47"}]: dispatch 2024-02-13T00:42:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:14 smithi080 bash[17386]: cluster 2024-02-13T00:42:12.268025+0000 mgr.y (mgr.24461) 495 : cluster [DBG] pgmap v633: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:42:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:14 smithi080 bash[17386]: cluster 2024-02-13T00:42:13.601936+0000 mon.a (mon.0) 2224 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:42:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:14 smithi080 bash[17386]: audit 2024-02-13T00:42:13.610033+0000 mon.a (mon.0) 2225 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-47"}]': finished 2024-02-13T00:42:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:14 smithi080 bash[17386]: audit 2024-02-13T00:42:13.610206+0000 mon.a (mon.0) 2226 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi080-54183-63"}]': finished 2024-02-13T00:42:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:14 smithi080 bash[17386]: cluster 2024-02-13T00:42:13.610333+0000 mon.a (mon.0) 2227 : cluster [DBG] osdmap e336: 8 total, 8 up, 8 in 2024-02-13T00:42:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:14 smithi080 bash[17386]: audit 2024-02-13T00:42:13.611645+0000 mon.a (mon.0) 2228 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi080-54183-63"}]: dispatch 2024-02-13T00:42:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:14 smithi080 bash[17386]: audit 2024-02-13T00:42:13.648981+0000 mon.a (mon.0) 2229 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:14 smithi080 bash[17386]: audit 2024-02-13T00:42:13.649783+0000 mon.a (mon.0) 2230 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-47"}]: dispatch 2024-02-13T00:42:14.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:14 smithi080 bash[24237]: cluster 2024-02-13T00:42:12.268025+0000 mgr.y (mgr.24461) 495 : cluster [DBG] pgmap v633: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:42:14.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:14 smithi080 bash[24237]: cluster 2024-02-13T00:42:13.601936+0000 mon.a (mon.0) 2224 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:42:14.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:14 smithi080 bash[24237]: audit 2024-02-13T00:42:13.610033+0000 mon.a (mon.0) 2225 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-47"}]': finished 2024-02-13T00:42:14.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:14 smithi080 bash[24237]: audit 2024-02-13T00:42:13.610206+0000 mon.a (mon.0) 2226 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi080-54183-63"}]': finished 2024-02-13T00:42:14.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:14 smithi080 bash[24237]: cluster 2024-02-13T00:42:13.610333+0000 mon.a (mon.0) 2227 : cluster [DBG] osdmap e336: 8 total, 8 up, 8 in 2024-02-13T00:42:14.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:14 smithi080 bash[24237]: audit 2024-02-13T00:42:13.611645+0000 mon.a (mon.0) 2228 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi080-54183-63"}]: dispatch 2024-02-13T00:42:14.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:14 smithi080 bash[24237]: audit 2024-02-13T00:42:13.648981+0000 mon.a (mon.0) 2229 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:14.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:14 smithi080 bash[24237]: audit 2024-02-13T00:42:13.649783+0000 mon.a (mon.0) 2230 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-47"}]: dispatch 2024-02-13T00:42:16.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:15 smithi106 bash[18459]: cluster 2024-02-13T00:42:14.268841+0000 mgr.y (mgr.24461) 496 : cluster [DBG] pgmap v636: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:42:16.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:15 smithi106 bash[18459]: audit 2024-02-13T00:42:14.613898+0000 mon.a (mon.0) 2231 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi080-54183-63"}]': finished 2024-02-13T00:42:16.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:15 smithi106 bash[18459]: cluster 2024-02-13T00:42:14.614022+0000 mon.a (mon.0) 2232 : cluster [DBG] osdmap e337: 8 total, 8 up, 8 in 2024-02-13T00:42:16.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:15 smithi106 bash[18459]: audit 2024-02-13T00:42:14.639567+0000 mon.c (mon.2) 361 : audit [INF] from='client.? 172.21.15.80:0/3322787137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:16.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:15 smithi106 bash[18459]: audit 2024-02-13T00:42:15.084499+0000 mon.a (mon.0) 2233 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:16.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:15 smithi106 bash[18459]: audit 2024-02-13T00:42:15.087703+0000 mon.c (mon.2) 362 : audit [INF] from='client.? 172.21.15.80:0/3322787137' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:16.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:15 smithi106 bash[18459]: audit 2024-02-13T00:42:15.089973+0000 mon.a (mon.0) 2234 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:16.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:15 smithi106 bash[18459]: audit 2024-02-13T00:42:15.090606+0000 mon.c (mon.2) 363 : audit [INF] from='client.? 172.21.15.80:0/3322787137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi080-54183-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:42:16.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:15 smithi106 bash[18459]: audit 2024-02-13T00:42:15.090921+0000 mon.a (mon.0) 2235 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi080-54183-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:42:16.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:15 smithi080 bash[17386]: cluster 2024-02-13T00:42:14.268841+0000 mgr.y (mgr.24461) 496 : cluster [DBG] pgmap v636: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:42:16.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:15 smithi080 bash[17386]: audit 2024-02-13T00:42:14.613898+0000 mon.a (mon.0) 2231 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi080-54183-63"}]': finished 2024-02-13T00:42:16.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:15 smithi080 bash[17386]: cluster 2024-02-13T00:42:14.614022+0000 mon.a (mon.0) 2232 : cluster [DBG] osdmap e337: 8 total, 8 up, 8 in 2024-02-13T00:42:16.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:15 smithi080 bash[17386]: audit 2024-02-13T00:42:14.639567+0000 mon.c (mon.2) 361 : audit [INF] from='client.? 172.21.15.80:0/3322787137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:16.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:15 smithi080 bash[17386]: audit 2024-02-13T00:42:15.084499+0000 mon.a (mon.0) 2233 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:16.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:15 smithi080 bash[17386]: audit 2024-02-13T00:42:15.087703+0000 mon.c (mon.2) 362 : audit [INF] from='client.? 172.21.15.80:0/3322787137' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:16.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:15 smithi080 bash[17386]: audit 2024-02-13T00:42:15.089973+0000 mon.a (mon.0) 2234 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:16.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:15 smithi080 bash[17386]: audit 2024-02-13T00:42:15.090606+0000 mon.c (mon.2) 363 : audit [INF] from='client.? 172.21.15.80:0/3322787137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi080-54183-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:42:16.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:15 smithi080 bash[17386]: audit 2024-02-13T00:42:15.090921+0000 mon.a (mon.0) 2235 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi080-54183-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:42:16.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:15 smithi080 bash[24237]: cluster 2024-02-13T00:42:14.268841+0000 mgr.y (mgr.24461) 496 : cluster [DBG] pgmap v636: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:42:16.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:15 smithi080 bash[24237]: audit 2024-02-13T00:42:14.613898+0000 mon.a (mon.0) 2231 : audit [INF] from='client.? 172.21.15.80:0/4024167725' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi080-54183-63"}]': finished 2024-02-13T00:42:16.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:15 smithi080 bash[24237]: cluster 2024-02-13T00:42:14.614022+0000 mon.a (mon.0) 2232 : cluster [DBG] osdmap e337: 8 total, 8 up, 8 in 2024-02-13T00:42:16.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:15 smithi080 bash[24237]: audit 2024-02-13T00:42:14.639567+0000 mon.c (mon.2) 361 : audit [INF] from='client.? 172.21.15.80:0/3322787137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:16.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:15 smithi080 bash[24237]: audit 2024-02-13T00:42:15.084499+0000 mon.a (mon.0) 2233 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:16.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:15 smithi080 bash[24237]: audit 2024-02-13T00:42:15.087703+0000 mon.c (mon.2) 362 : audit [INF] from='client.? 172.21.15.80:0/3322787137' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:16.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:15 smithi080 bash[24237]: audit 2024-02-13T00:42:15.089973+0000 mon.a (mon.0) 2234 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:16.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:15 smithi080 bash[24237]: audit 2024-02-13T00:42:15.090606+0000 mon.c (mon.2) 363 : audit [INF] from='client.? 172.21.15.80:0/3322787137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi080-54183-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:42:16.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:15 smithi080 bash[24237]: audit 2024-02-13T00:42:15.090921+0000 mon.a (mon.0) 2235 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi080-54183-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:42:17.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:16 smithi106 bash[18459]: audit 2024-02-13T00:42:15.623094+0000 mon.a (mon.0) 2236 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi080-54183-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:42:17.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:16 smithi106 bash[18459]: cluster 2024-02-13T00:42:15.623222+0000 mon.a (mon.0) 2237 : cluster [DBG] osdmap e338: 8 total, 8 up, 8 in 2024-02-13T00:42:17.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:16 smithi106 bash[18459]: audit 2024-02-13T00:42:15.624840+0000 mon.c (mon.2) 364 : audit [INF] from='client.? 172.21.15.80:0/3322787137' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi080-54183-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:17.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:16 smithi106 bash[18459]: audit 2024-02-13T00:42:15.625305+0000 mon.a (mon.0) 2238 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:42:17.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:16 smithi106 bash[18459]: audit 2024-02-13T00:42:15.625977+0000 mon.a (mon.0) 2239 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi080-54183-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:17.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:16 smithi080 bash[17386]: audit 2024-02-13T00:42:15.623094+0000 mon.a (mon.0) 2236 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi080-54183-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:42:17.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:16 smithi080 bash[17386]: cluster 2024-02-13T00:42:15.623222+0000 mon.a (mon.0) 2237 : cluster [DBG] osdmap e338: 8 total, 8 up, 8 in 2024-02-13T00:42:17.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:16 smithi080 bash[17386]: audit 2024-02-13T00:42:15.624840+0000 mon.c (mon.2) 364 : audit [INF] from='client.? 172.21.15.80:0/3322787137' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi080-54183-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:17.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:16 smithi080 bash[17386]: audit 2024-02-13T00:42:15.625305+0000 mon.a (mon.0) 2238 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:42:17.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:16 smithi080 bash[17386]: audit 2024-02-13T00:42:15.625977+0000 mon.a (mon.0) 2239 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi080-54183-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:17.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:16 smithi080 bash[24237]: audit 2024-02-13T00:42:15.623094+0000 mon.a (mon.0) 2236 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi080-54183-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:42:17.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:16 smithi080 bash[24237]: cluster 2024-02-13T00:42:15.623222+0000 mon.a (mon.0) 2237 : cluster [DBG] osdmap e338: 8 total, 8 up, 8 in 2024-02-13T00:42:17.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:16 smithi080 bash[24237]: audit 2024-02-13T00:42:15.624840+0000 mon.c (mon.2) 364 : audit [INF] from='client.? 172.21.15.80:0/3322787137' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi080-54183-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:17.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:16 smithi080 bash[24237]: audit 2024-02-13T00:42:15.625305+0000 mon.a (mon.0) 2238 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:42:17.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:16 smithi080 bash[24237]: audit 2024-02-13T00:42:15.625977+0000 mon.a (mon.0) 2239 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi080-54183-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:18.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:17 smithi106 bash[18459]: cluster 2024-02-13T00:42:16.269656+0000 mgr.y (mgr.24461) 497 : cluster [DBG] pgmap v639: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:42:18.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:17 smithi106 bash[18459]: audit 2024-02-13T00:42:16.633528+0000 mon.a (mon.0) 2240 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:18.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:17 smithi106 bash[18459]: cluster 2024-02-13T00:42:17.068546+0000 mon.a (mon.0) 2241 : cluster [DBG] osdmap e339: 8 total, 8 up, 8 in 2024-02-13T00:42:18.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:17 smithi106 bash[18459]: audit 2024-02-13T00:42:17.081143+0000 mon.a (mon.0) 2242 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:42:18.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:17 smithi106 bash[18459]: audit 2024-02-13T00:42:17.094973+0000 mon.a (mon.0) 2243 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:42:18.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:17 smithi080 bash[24237]: cluster 2024-02-13T00:42:16.269656+0000 mgr.y (mgr.24461) 497 : cluster [DBG] pgmap v639: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:42:18.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:17 smithi080 bash[24237]: audit 2024-02-13T00:42:16.633528+0000 mon.a (mon.0) 2240 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:18.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:17 smithi080 bash[24237]: cluster 2024-02-13T00:42:17.068546+0000 mon.a (mon.0) 2241 : cluster [DBG] osdmap e339: 8 total, 8 up, 8 in 2024-02-13T00:42:18.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:17 smithi080 bash[24237]: audit 2024-02-13T00:42:17.081143+0000 mon.a (mon.0) 2242 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:42:18.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:17 smithi080 bash[24237]: audit 2024-02-13T00:42:17.094973+0000 mon.a (mon.0) 2243 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:42:18.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:17 smithi080 bash[17386]: cluster 2024-02-13T00:42:16.269656+0000 mgr.y (mgr.24461) 497 : cluster [DBG] pgmap v639: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:42:18.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:17 smithi080 bash[17386]: audit 2024-02-13T00:42:16.633528+0000 mon.a (mon.0) 2240 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:18.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:17 smithi080 bash[17386]: cluster 2024-02-13T00:42:17.068546+0000 mon.a (mon.0) 2241 : cluster [DBG] osdmap e339: 8 total, 8 up, 8 in 2024-02-13T00:42:18.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:17 smithi080 bash[17386]: audit 2024-02-13T00:42:17.081143+0000 mon.a (mon.0) 2242 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:42:18.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:17 smithi080 bash[17386]: audit 2024-02-13T00:42:17.094973+0000 mon.a (mon.0) 2243 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:42:18.664 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:42:18 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:42:18.664 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:18 smithi106 bash[18459]: audit 2024-02-13T00:42:17.649723+0000 mon.a (mon.0) 2244 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi080-54183-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi080-54183-64"}]': finished 2024-02-13T00:42:18.664 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:18 smithi106 bash[18459]: audit 2024-02-13T00:42:17.651156+0000 mon.a (mon.0) 2245 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-49", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:42:18.664 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:18 smithi106 bash[18459]: cluster 2024-02-13T00:42:17.651282+0000 mon.a (mon.0) 2246 : cluster [DBG] osdmap e340: 8 total, 8 up, 8 in 2024-02-13T00:42:18.664 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:18 smithi106 bash[18459]: audit 2024-02-13T00:42:17.656666+0000 mon.a (mon.0) 2247 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-49"}]: dispatch 2024-02-13T00:42:19.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:18 smithi080 bash[17386]: audit 2024-02-13T00:42:17.649723+0000 mon.a (mon.0) 2244 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi080-54183-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi080-54183-64"}]': finished 2024-02-13T00:42:19.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:18 smithi080 bash[17386]: audit 2024-02-13T00:42:17.651156+0000 mon.a (mon.0) 2245 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-49", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:42:19.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:18 smithi080 bash[17386]: cluster 2024-02-13T00:42:17.651282+0000 mon.a (mon.0) 2246 : cluster [DBG] osdmap e340: 8 total, 8 up, 8 in 2024-02-13T00:42:19.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:18 smithi080 bash[17386]: audit 2024-02-13T00:42:17.656666+0000 mon.a (mon.0) 2247 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-49"}]: dispatch 2024-02-13T00:42:19.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:18 smithi080 bash[24237]: audit 2024-02-13T00:42:17.649723+0000 mon.a (mon.0) 2244 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi080-54183-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi080-54183-64"}]': finished 2024-02-13T00:42:19.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:18 smithi080 bash[24237]: audit 2024-02-13T00:42:17.651156+0000 mon.a (mon.0) 2245 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-49", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:42:19.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:18 smithi080 bash[24237]: cluster 2024-02-13T00:42:17.651282+0000 mon.a (mon.0) 2246 : cluster [DBG] osdmap e340: 8 total, 8 up, 8 in 2024-02-13T00:42:19.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:18 smithi080 bash[24237]: audit 2024-02-13T00:42:17.656666+0000 mon.a (mon.0) 2247 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-49"}]: dispatch 2024-02-13T00:42:20.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:19 smithi106 bash[18459]: cluster 2024-02-13T00:42:18.271796+0000 mgr.y (mgr.24461) 498 : cluster [DBG] pgmap v642: 236 pgs: 8 creating+peering, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T00:42:20.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:19 smithi106 bash[18459]: audit 2024-02-13T00:42:18.345634+0000 mgr.y (mgr.24461) 499 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:42:20.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:19 smithi106 bash[18459]: audit 2024-02-13T00:42:18.653488+0000 mon.a (mon.0) 2248 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-49"}]': finished 2024-02-13T00:42:20.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:19 smithi106 bash[18459]: cluster 2024-02-13T00:42:18.653730+0000 mon.a (mon.0) 2249 : cluster [DBG] osdmap e341: 8 total, 8 up, 8 in 2024-02-13T00:42:20.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:19 smithi106 bash[18459]: audit 2024-02-13T00:42:18.655923+0000 mon.a (mon.0) 2250 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-49", "mode": "writeback"}]: dispatch 2024-02-13T00:42:20.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:19 smithi106 bash[18459]: cluster 2024-02-13T00:42:19.644795+0000 mon.a (mon.0) 2251 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:42:20.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:19 smithi106 bash[18459]: audit 2024-02-13T00:42:19.653300+0000 mon.a (mon.0) 2252 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-49", "mode": "writeback"}]': finished 2024-02-13T00:42:20.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:19 smithi106 bash[18459]: cluster 2024-02-13T00:42:19.653452+0000 mon.a (mon.0) 2253 : cluster [DBG] osdmap e342: 8 total, 8 up, 8 in 2024-02-13T00:42:20.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:19 smithi106 bash[18459]: audit 2024-02-13T00:42:19.655687+0000 mon.c (mon.2) 365 : audit [INF] from='client.? 172.21.15.80:0/3322787137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:20.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:19 smithi106 bash[18459]: audit 2024-02-13T00:42:19.657201+0000 mon.a (mon.0) 2254 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:20.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:19 smithi080 bash[17386]: cluster 2024-02-13T00:42:18.271796+0000 mgr.y (mgr.24461) 498 : cluster [DBG] pgmap v642: 236 pgs: 8 creating+peering, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T00:42:20.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:19 smithi080 bash[17386]: audit 2024-02-13T00:42:18.345634+0000 mgr.y (mgr.24461) 499 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:42:20.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:19 smithi080 bash[17386]: audit 2024-02-13T00:42:18.653488+0000 mon.a (mon.0) 2248 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-49"}]': finished 2024-02-13T00:42:20.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:19 smithi080 bash[17386]: cluster 2024-02-13T00:42:18.653730+0000 mon.a (mon.0) 2249 : cluster [DBG] osdmap e341: 8 total, 8 up, 8 in 2024-02-13T00:42:20.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:19 smithi080 bash[17386]: audit 2024-02-13T00:42:18.655923+0000 mon.a (mon.0) 2250 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-49", "mode": "writeback"}]: dispatch 2024-02-13T00:42:20.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:19 smithi080 bash[17386]: cluster 2024-02-13T00:42:19.644795+0000 mon.a (mon.0) 2251 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:42:20.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:19 smithi080 bash[17386]: audit 2024-02-13T00:42:19.653300+0000 mon.a (mon.0) 2252 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-49", "mode": "writeback"}]': finished 2024-02-13T00:42:20.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:19 smithi080 bash[17386]: cluster 2024-02-13T00:42:19.653452+0000 mon.a (mon.0) 2253 : cluster [DBG] osdmap e342: 8 total, 8 up, 8 in 2024-02-13T00:42:20.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:19 smithi080 bash[17386]: audit 2024-02-13T00:42:19.655687+0000 mon.c (mon.2) 365 : audit [INF] from='client.? 172.21.15.80:0/3322787137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:20.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:19 smithi080 bash[17386]: audit 2024-02-13T00:42:19.657201+0000 mon.a (mon.0) 2254 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:20.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:19 smithi080 bash[24237]: cluster 2024-02-13T00:42:18.271796+0000 mgr.y (mgr.24461) 498 : cluster [DBG] pgmap v642: 236 pgs: 8 creating+peering, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T00:42:20.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:19 smithi080 bash[24237]: audit 2024-02-13T00:42:18.345634+0000 mgr.y (mgr.24461) 499 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:42:20.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:19 smithi080 bash[24237]: audit 2024-02-13T00:42:18.653488+0000 mon.a (mon.0) 2248 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-49"}]': finished 2024-02-13T00:42:20.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:19 smithi080 bash[24237]: cluster 2024-02-13T00:42:18.653730+0000 mon.a (mon.0) 2249 : cluster [DBG] osdmap e341: 8 total, 8 up, 8 in 2024-02-13T00:42:20.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:19 smithi080 bash[24237]: audit 2024-02-13T00:42:18.655923+0000 mon.a (mon.0) 2250 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-49", "mode": "writeback"}]: dispatch 2024-02-13T00:42:20.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:19 smithi080 bash[24237]: cluster 2024-02-13T00:42:19.644795+0000 mon.a (mon.0) 2251 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:42:20.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:19 smithi080 bash[24237]: audit 2024-02-13T00:42:19.653300+0000 mon.a (mon.0) 2252 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-49", "mode": "writeback"}]': finished 2024-02-13T00:42:20.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:19 smithi080 bash[24237]: cluster 2024-02-13T00:42:19.653452+0000 mon.a (mon.0) 2253 : cluster [DBG] osdmap e342: 8 total, 8 up, 8 in 2024-02-13T00:42:20.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:19 smithi080 bash[24237]: audit 2024-02-13T00:42:19.655687+0000 mon.c (mon.2) 365 : audit [INF] from='client.? 172.21.15.80:0/3322787137' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:20.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:19 smithi080 bash[24237]: audit 2024-02-13T00:42:19.657201+0000 mon.a (mon.0) 2254 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:20.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:42:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:42:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:42:21.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:20 smithi106 bash[18459]: audit 2024-02-13T00:42:19.713423+0000 mon.a (mon.0) 2255 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:42:21.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:20 smithi106 bash[18459]: audit 2024-02-13T00:42:20.656491+0000 mon.a (mon.0) 2256 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi080-54183-64"}]': finished 2024-02-13T00:42:21.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:20 smithi106 bash[18459]: audit 2024-02-13T00:42:20.656635+0000 mon.a (mon.0) 2257 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:42:21.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:20 smithi106 bash[18459]: cluster 2024-02-13T00:42:20.656719+0000 mon.a (mon.0) 2258 : cluster [DBG] osdmap e343: 8 total, 8 up, 8 in 2024-02-13T00:42:21.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:20 smithi106 bash[18459]: audit 2024-02-13T00:42:20.657958+0000 mon.a (mon.0) 2259 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:42:21.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:20 smithi106 bash[18459]: audit 2024-02-13T00:42:20.658868+0000 mon.c (mon.2) 366 : audit [INF] from='client.? 172.21.15.80:0/3322787137' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:21.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:20 smithi106 bash[18459]: audit 2024-02-13T00:42:20.659301+0000 mon.a (mon.0) 2260 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:20 smithi080 bash[17386]: audit 2024-02-13T00:42:19.713423+0000 mon.a (mon.0) 2255 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:42:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:20 smithi080 bash[17386]: audit 2024-02-13T00:42:20.656491+0000 mon.a (mon.0) 2256 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi080-54183-64"}]': finished 2024-02-13T00:42:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:20 smithi080 bash[17386]: audit 2024-02-13T00:42:20.656635+0000 mon.a (mon.0) 2257 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:42:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:20 smithi080 bash[17386]: cluster 2024-02-13T00:42:20.656719+0000 mon.a (mon.0) 2258 : cluster [DBG] osdmap e343: 8 total, 8 up, 8 in 2024-02-13T00:42:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:20 smithi080 bash[17386]: audit 2024-02-13T00:42:20.657958+0000 mon.a (mon.0) 2259 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:42:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:20 smithi080 bash[17386]: audit 2024-02-13T00:42:20.658868+0000 mon.c (mon.2) 366 : audit [INF] from='client.? 172.21.15.80:0/3322787137' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:21.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:20 smithi080 bash[17386]: audit 2024-02-13T00:42:20.659301+0000 mon.a (mon.0) 2260 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:21.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:20 smithi080 bash[24237]: audit 2024-02-13T00:42:19.713423+0000 mon.a (mon.0) 2255 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:42:21.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:20 smithi080 bash[24237]: audit 2024-02-13T00:42:20.656491+0000 mon.a (mon.0) 2256 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi080-54183-64"}]': finished 2024-02-13T00:42:21.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:20 smithi080 bash[24237]: audit 2024-02-13T00:42:20.656635+0000 mon.a (mon.0) 2257 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:42:21.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:20 smithi080 bash[24237]: cluster 2024-02-13T00:42:20.656719+0000 mon.a (mon.0) 2258 : cluster [DBG] osdmap e343: 8 total, 8 up, 8 in 2024-02-13T00:42:21.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:20 smithi080 bash[24237]: audit 2024-02-13T00:42:20.657958+0000 mon.a (mon.0) 2259 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:42:21.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:20 smithi080 bash[24237]: audit 2024-02-13T00:42:20.658868+0000 mon.c (mon.2) 366 : audit [INF] from='client.? 172.21.15.80:0/3322787137' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:21.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:20 smithi080 bash[24237]: audit 2024-02-13T00:42:20.659301+0000 mon.a (mon.0) 2260 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi080-54183-64"}]: dispatch 2024-02-13T00:42:22.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:21 smithi106 bash[18459]: cluster 2024-02-13T00:42:20.272577+0000 mgr.y (mgr.24461) 500 : cluster [DBG] pgmap v645: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T00:42:22.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:21 smithi106 bash[18459]: audit 2024-02-13T00:42:21.659638+0000 mon.a (mon.0) 2261 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:42:22.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:21 smithi106 bash[18459]: audit 2024-02-13T00:42:21.659757+0000 mon.a (mon.0) 2262 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi080-54183-64"}]': finished 2024-02-13T00:42:22.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:21 smithi106 bash[18459]: cluster 2024-02-13T00:42:21.659879+0000 mon.a (mon.0) 2263 : cluster [DBG] osdmap e344: 8 total, 8 up, 8 in 2024-02-13T00:42:22.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:21 smithi106 bash[18459]: audit 2024-02-13T00:42:21.661347+0000 mon.a (mon.0) 2264 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:42:22.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:21 smithi080 bash[17386]: cluster 2024-02-13T00:42:20.272577+0000 mgr.y (mgr.24461) 500 : cluster [DBG] pgmap v645: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T00:42:22.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:21 smithi080 bash[17386]: audit 2024-02-13T00:42:21.659638+0000 mon.a (mon.0) 2261 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:42:22.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:21 smithi080 bash[17386]: audit 2024-02-13T00:42:21.659757+0000 mon.a (mon.0) 2262 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi080-54183-64"}]': finished 2024-02-13T00:42:22.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:21 smithi080 bash[17386]: cluster 2024-02-13T00:42:21.659879+0000 mon.a (mon.0) 2263 : cluster [DBG] osdmap e344: 8 total, 8 up, 8 in 2024-02-13T00:42:22.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:21 smithi080 bash[17386]: audit 2024-02-13T00:42:21.661347+0000 mon.a (mon.0) 2264 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:42:22.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:21 smithi080 bash[24237]: cluster 2024-02-13T00:42:20.272577+0000 mgr.y (mgr.24461) 500 : cluster [DBG] pgmap v645: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T00:42:22.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:21 smithi080 bash[24237]: audit 2024-02-13T00:42:21.659638+0000 mon.a (mon.0) 2261 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:42:22.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:21 smithi080 bash[24237]: audit 2024-02-13T00:42:21.659757+0000 mon.a (mon.0) 2262 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi080-54183-64"}]': finished 2024-02-13T00:42:22.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:21 smithi080 bash[24237]: cluster 2024-02-13T00:42:21.659879+0000 mon.a (mon.0) 2263 : cluster [DBG] osdmap e344: 8 total, 8 up, 8 in 2024-02-13T00:42:22.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:21 smithi080 bash[24237]: audit 2024-02-13T00:42:21.661347+0000 mon.a (mon.0) 2264 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:42:22.988 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:22 smithi080 bash[24237]: audit 2024-02-13T00:42:21.684760+0000 mon.a (mon.0) 2265 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi080-54183-65"}]: dispatch 2024-02-13T00:42:22.988 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:22 smithi080 bash[24237]: audit 2024-02-13T00:42:21.685327+0000 mon.a (mon.0) 2266 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi080-54183-65"}]: dispatch 2024-02-13T00:42:22.988 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:22 smithi080 bash[24237]: audit 2024-02-13T00:42:21.685819+0000 mon.a (mon.0) 2267 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi080-54183-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:42:22.989 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:22 smithi080 bash[24237]: cluster 2024-02-13T00:42:22.653567+0000 mon.a (mon.0) 2268 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:42:22.989 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:22 smithi080 bash[24237]: audit 2024-02-13T00:42:22.661181+0000 mon.a (mon.0) 2269 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T00:42:22.989 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:22 smithi080 bash[24237]: audit 2024-02-13T00:42:22.661423+0000 mon.a (mon.0) 2270 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi080-54183-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:42:22.989 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:22 smithi080 bash[24237]: cluster 2024-02-13T00:42:22.661908+0000 mon.a (mon.0) 2271 : cluster [DBG] osdmap e345: 8 total, 8 up, 8 in 2024-02-13T00:42:22.989 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:22 smithi080 bash[24237]: audit 2024-02-13T00:42:22.662873+0000 mon.a (mon.0) 2272 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T00:42:22.989 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:22 smithi080 bash[24237]: audit 2024-02-13T00:42:22.663410+0000 mon.a (mon.0) 2273 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi080-54183-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi080-54183-65"}]: dispatch 2024-02-13T00:42:22.989 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:22 smithi080 bash[17386]: audit 2024-02-13T00:42:21.684760+0000 mon.a (mon.0) 2265 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi080-54183-65"}]: dispatch 2024-02-13T00:42:22.989 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:22 smithi080 bash[17386]: audit 2024-02-13T00:42:21.685327+0000 mon.a (mon.0) 2266 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi080-54183-65"}]: dispatch 2024-02-13T00:42:22.989 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:22 smithi080 bash[17386]: audit 2024-02-13T00:42:21.685819+0000 mon.a (mon.0) 2267 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi080-54183-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:42:22.989 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:22 smithi080 bash[17386]: cluster 2024-02-13T00:42:22.653567+0000 mon.a (mon.0) 2268 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:42:22.989 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:22 smithi080 bash[17386]: audit 2024-02-13T00:42:22.661181+0000 mon.a (mon.0) 2269 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T00:42:22.989 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:22 smithi080 bash[17386]: audit 2024-02-13T00:42:22.661423+0000 mon.a (mon.0) 2270 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi080-54183-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:42:22.990 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:22 smithi080 bash[17386]: cluster 2024-02-13T00:42:22.661908+0000 mon.a (mon.0) 2271 : cluster [DBG] osdmap e345: 8 total, 8 up, 8 in 2024-02-13T00:42:22.990 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:22 smithi080 bash[17386]: audit 2024-02-13T00:42:22.662873+0000 mon.a (mon.0) 2272 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T00:42:22.990 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:22 smithi080 bash[17386]: audit 2024-02-13T00:42:22.663410+0000 mon.a (mon.0) 2273 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi080-54183-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi080-54183-65"}]: dispatch 2024-02-13T00:42:23.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:22 smithi106 bash[18459]: audit 2024-02-13T00:42:21.684760+0000 mon.a (mon.0) 2265 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi080-54183-65"}]: dispatch 2024-02-13T00:42:23.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:22 smithi106 bash[18459]: audit 2024-02-13T00:42:21.685327+0000 mon.a (mon.0) 2266 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi080-54183-65"}]: dispatch 2024-02-13T00:42:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:22 smithi106 bash[18459]: audit 2024-02-13T00:42:21.685819+0000 mon.a (mon.0) 2267 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi080-54183-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:42:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:22 smithi106 bash[18459]: cluster 2024-02-13T00:42:22.653567+0000 mon.a (mon.0) 2268 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:42:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:22 smithi106 bash[18459]: audit 2024-02-13T00:42:22.661181+0000 mon.a (mon.0) 2269 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T00:42:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:22 smithi106 bash[18459]: audit 2024-02-13T00:42:22.661423+0000 mon.a (mon.0) 2270 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi080-54183-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:42:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:22 smithi106 bash[18459]: cluster 2024-02-13T00:42:22.661908+0000 mon.a (mon.0) 2271 : cluster [DBG] osdmap e345: 8 total, 8 up, 8 in 2024-02-13T00:42:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:22 smithi106 bash[18459]: audit 2024-02-13T00:42:22.662873+0000 mon.a (mon.0) 2272 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T00:42:23.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:22 smithi106 bash[18459]: audit 2024-02-13T00:42:22.663410+0000 mon.a (mon.0) 2273 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi080-54183-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi080-54183-65"}]: dispatch 2024-02-13T00:42:23.258 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:42:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:42:23] "GET /metrics HTTP/1.1" 200 187470 "" "Prometheus/2.33.4" 2024-02-13T00:42:24.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:24 smithi106 bash[18459]: cluster 2024-02-13T00:42:22.273240+0000 mgr.y (mgr.24461) 501 : cluster [DBG] pgmap v648: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:42:24.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:24 smithi106 bash[18459]: audit 2024-02-13T00:42:23.664787+0000 mon.a (mon.0) 2274 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T00:42:24.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:24 smithi106 bash[18459]: cluster 2024-02-13T00:42:24.094632+0000 mon.a (mon.0) 2275 : cluster [DBG] osdmap e346: 8 total, 8 up, 8 in 2024-02-13T00:42:24.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:24 smithi080 bash[17386]: cluster 2024-02-13T00:42:22.273240+0000 mgr.y (mgr.24461) 501 : cluster [DBG] pgmap v648: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:42:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:24 smithi080 bash[17386]: audit 2024-02-13T00:42:23.664787+0000 mon.a (mon.0) 2274 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T00:42:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:24 smithi080 bash[17386]: cluster 2024-02-13T00:42:24.094632+0000 mon.a (mon.0) 2275 : cluster [DBG] osdmap e346: 8 total, 8 up, 8 in 2024-02-13T00:42:24.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:24 smithi080 bash[24237]: cluster 2024-02-13T00:42:22.273240+0000 mgr.y (mgr.24461) 501 : cluster [DBG] pgmap v648: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:42:24.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:24 smithi080 bash[24237]: audit 2024-02-13T00:42:23.664787+0000 mon.a (mon.0) 2274 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T00:42:24.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:24 smithi080 bash[24237]: cluster 2024-02-13T00:42:24.094632+0000 mon.a (mon.0) 2275 : cluster [DBG] osdmap e346: 8 total, 8 up, 8 in 2024-02-13T00:42:25.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:25 smithi106 bash[18459]: audit 2024-02-13T00:42:24.095632+0000 mon.a (mon.0) 2276 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "target_max_objects","val": "1"}]: dispatch 2024-02-13T00:42:25.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:25 smithi106 bash[18459]: audit 2024-02-13T00:42:24.668599+0000 mon.a (mon.0) 2277 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi080-54183-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi080-54183-65"}]': finished 2024-02-13T00:42:25.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:25 smithi106 bash[18459]: audit 2024-02-13T00:42:24.668811+0000 mon.a (mon.0) 2278 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "target_max_objects","val": "1"}]': finished 2024-02-13T00:42:25.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:25 smithi106 bash[18459]: cluster 2024-02-13T00:42:24.668915+0000 mon.a (mon.0) 2279 : cluster [DBG] osdmap e347: 8 total, 8 up, 8 in 2024-02-13T00:42:25.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:25 smithi080 bash[17386]: audit 2024-02-13T00:42:24.095632+0000 mon.a (mon.0) 2276 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "target_max_objects","val": "1"}]: dispatch 2024-02-13T00:42:25.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:25 smithi080 bash[17386]: audit 2024-02-13T00:42:24.668599+0000 mon.a (mon.0) 2277 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi080-54183-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi080-54183-65"}]': finished 2024-02-13T00:42:25.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:25 smithi080 bash[17386]: audit 2024-02-13T00:42:24.668811+0000 mon.a (mon.0) 2278 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "target_max_objects","val": "1"}]': finished 2024-02-13T00:42:25.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:25 smithi080 bash[17386]: cluster 2024-02-13T00:42:24.668915+0000 mon.a (mon.0) 2279 : cluster [DBG] osdmap e347: 8 total, 8 up, 8 in 2024-02-13T00:42:25.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:25 smithi080 bash[24237]: audit 2024-02-13T00:42:24.095632+0000 mon.a (mon.0) 2276 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "target_max_objects","val": "1"}]: dispatch 2024-02-13T00:42:25.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:25 smithi080 bash[24237]: audit 2024-02-13T00:42:24.668599+0000 mon.a (mon.0) 2277 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi080-54183-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi080-54183-65"}]': finished 2024-02-13T00:42:25.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:25 smithi080 bash[24237]: audit 2024-02-13T00:42:24.668811+0000 mon.a (mon.0) 2278 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-49","var": "target_max_objects","val": "1"}]': finished 2024-02-13T00:42:25.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:25 smithi080 bash[24237]: cluster 2024-02-13T00:42:24.668915+0000 mon.a (mon.0) 2279 : cluster [DBG] osdmap e347: 8 total, 8 up, 8 in 2024-02-13T00:42:26.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:26 smithi106 bash[18459]: cluster 2024-02-13T00:42:24.274026+0000 mgr.y (mgr.24461) 502 : cluster [DBG] pgmap v651: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-13T00:42:26.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:26 smithi106 bash[18459]: cluster 2024-02-13T00:42:25.673488+0000 mon.a (mon.0) 2280 : cluster [DBG] osdmap e348: 8 total, 8 up, 8 in 2024-02-13T00:42:26.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:26 smithi080 bash[17386]: cluster 2024-02-13T00:42:24.274026+0000 mgr.y (mgr.24461) 502 : cluster [DBG] pgmap v651: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-13T00:42:26.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:26 smithi080 bash[17386]: cluster 2024-02-13T00:42:25.673488+0000 mon.a (mon.0) 2280 : cluster [DBG] osdmap e348: 8 total, 8 up, 8 in 2024-02-13T00:42:26.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:26 smithi080 bash[24237]: cluster 2024-02-13T00:42:24.274026+0000 mgr.y (mgr.24461) 502 : cluster [DBG] pgmap v651: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-13T00:42:26.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:26 smithi080 bash[24237]: cluster 2024-02-13T00:42:25.673488+0000 mon.a (mon.0) 2280 : cluster [DBG] osdmap e348: 8 total, 8 up, 8 in 2024-02-13T00:42:28.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:27 smithi106 bash[18459]: cluster 2024-02-13T00:42:26.274889+0000 mgr.y (mgr.24461) 503 : cluster [DBG] pgmap v654: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-13T00:42:28.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:27 smithi106 bash[18459]: cluster 2024-02-13T00:42:26.672614+0000 mon.a (mon.0) 2281 : cluster [DBG] osdmap e349: 8 total, 8 up, 8 in 2024-02-13T00:42:28.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:27 smithi106 bash[18459]: audit 2024-02-13T00:42:26.673835+0000 mon.a (mon.0) 2282 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi080-54183-65"}]: dispatch 2024-02-13T00:42:28.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:27 smithi106 bash[18459]: cluster 2024-02-13T00:42:27.109303+0000 mon.a (mon.0) 2283 : cluster [WRN] Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-02-13T00:42:28.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:27 smithi080 bash[17386]: cluster 2024-02-13T00:42:26.274889+0000 mgr.y (mgr.24461) 503 : cluster [DBG] pgmap v654: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-13T00:42:28.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:27 smithi080 bash[17386]: cluster 2024-02-13T00:42:26.672614+0000 mon.a (mon.0) 2281 : cluster [DBG] osdmap e349: 8 total, 8 up, 8 in 2024-02-13T00:42:28.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:27 smithi080 bash[17386]: audit 2024-02-13T00:42:26.673835+0000 mon.a (mon.0) 2282 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi080-54183-65"}]: dispatch 2024-02-13T00:42:28.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:27 smithi080 bash[17386]: cluster 2024-02-13T00:42:27.109303+0000 mon.a (mon.0) 2283 : cluster [WRN] Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-02-13T00:42:28.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:27 smithi080 bash[24237]: cluster 2024-02-13T00:42:26.274889+0000 mgr.y (mgr.24461) 503 : cluster [DBG] pgmap v654: 236 pgs: 8 unknown, 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-13T00:42:28.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:27 smithi080 bash[24237]: cluster 2024-02-13T00:42:26.672614+0000 mon.a (mon.0) 2281 : cluster [DBG] osdmap e349: 8 total, 8 up, 8 in 2024-02-13T00:42:28.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:27 smithi080 bash[24237]: audit 2024-02-13T00:42:26.673835+0000 mon.a (mon.0) 2282 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi080-54183-65"}]: dispatch 2024-02-13T00:42:28.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:27 smithi080 bash[24237]: cluster 2024-02-13T00:42:27.109303+0000 mon.a (mon.0) 2283 : cluster [WRN] Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-02-13T00:42:28.686 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:42:28 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:42:28.688 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-02-13T00:42:28.689 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (7036 ms) 2024-02-13T00:42:28.689 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2024-02-13T00:42:28.689 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7062 ms) 2024-02-13T00:42:28.689 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2024-02-13T00:42:28.689 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (7036 ms) 2024-02-13T00:42:28.689 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2024-02-13T00:42:28.689 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7046 ms) 2024-02-13T00:42:28.689 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2024-02-13T00:42:28.689 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (7020 ms) 2024-02-13T00:42:28.689 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (139443 ms total) 2024-02-13T00:42:28.689 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: 2024-02-13T00:42:28.689 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [----------] Global test environment tear-down 2024-02-13T00:42:28.689 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [==========] 56 tests from 4 test suites ran. (299748 ms total) 2024-02-13T00:42:28.689 INFO:tasks.workunit.client.0.smithi080.stdout: api_aio_pp: [ PASSED ] 56 tests. 2024-02-13T00:42:29.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:28 smithi106 bash[18459]: audit 2024-02-13T00:42:27.674900+0000 mon.a (mon.0) 2284 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi080-54183-65"}]': finished 2024-02-13T00:42:29.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:28 smithi106 bash[18459]: cluster 2024-02-13T00:42:27.675148+0000 mon.a (mon.0) 2285 : cluster [DBG] osdmap e350: 8 total, 8 up, 8 in 2024-02-13T00:42:29.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:28 smithi106 bash[18459]: audit 2024-02-13T00:42:27.676858+0000 mon.a (mon.0) 2286 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi080-54183-65"}]: dispatch 2024-02-13T00:42:29.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:28 smithi080 bash[17386]: audit 2024-02-13T00:42:27.674900+0000 mon.a (mon.0) 2284 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi080-54183-65"}]': finished 2024-02-13T00:42:29.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:28 smithi080 bash[17386]: cluster 2024-02-13T00:42:27.675148+0000 mon.a (mon.0) 2285 : cluster [DBG] osdmap e350: 8 total, 8 up, 8 in 2024-02-13T00:42:29.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:28 smithi080 bash[17386]: audit 2024-02-13T00:42:27.676858+0000 mon.a (mon.0) 2286 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi080-54183-65"}]: dispatch 2024-02-13T00:42:29.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:28 smithi080 bash[24237]: audit 2024-02-13T00:42:27.674900+0000 mon.a (mon.0) 2284 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi080-54183-65"}]': finished 2024-02-13T00:42:29.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:28 smithi080 bash[24237]: cluster 2024-02-13T00:42:27.675148+0000 mon.a (mon.0) 2285 : cluster [DBG] osdmap e350: 8 total, 8 up, 8 in 2024-02-13T00:42:29.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:28 smithi080 bash[24237]: audit 2024-02-13T00:42:27.676858+0000 mon.a (mon.0) 2286 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi080-54183-65"}]: dispatch 2024-02-13T00:42:30.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:29 smithi106 bash[18459]: cluster 2024-02-13T00:42:28.277134+0000 mgr.y (mgr.24461) 504 : cluster [DBG] pgmap v657: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:42:30.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:29 smithi106 bash[18459]: audit 2024-02-13T00:42:28.353555+0000 mgr.y (mgr.24461) 505 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:42:30.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:29 smithi106 bash[18459]: audit 2024-02-13T00:42:28.679491+0000 mon.a (mon.0) 2287 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi080-54183-65"}]': finished 2024-02-13T00:42:30.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:29 smithi106 bash[18459]: cluster 2024-02-13T00:42:28.679613+0000 mon.a (mon.0) 2288 : cluster [DBG] osdmap e351: 8 total, 8 up, 8 in 2024-02-13T00:42:30.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:29 smithi080 bash[17386]: cluster 2024-02-13T00:42:28.277134+0000 mgr.y (mgr.24461) 504 : cluster [DBG] pgmap v657: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:42:30.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:29 smithi080 bash[17386]: audit 2024-02-13T00:42:28.353555+0000 mgr.y (mgr.24461) 505 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:42:30.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:29 smithi080 bash[17386]: audit 2024-02-13T00:42:28.679491+0000 mon.a (mon.0) 2287 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi080-54183-65"}]': finished 2024-02-13T00:42:30.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:29 smithi080 bash[17386]: cluster 2024-02-13T00:42:28.679613+0000 mon.a (mon.0) 2288 : cluster [DBG] osdmap e351: 8 total, 8 up, 8 in 2024-02-13T00:42:30.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:29 smithi080 bash[24237]: cluster 2024-02-13T00:42:28.277134+0000 mgr.y (mgr.24461) 504 : cluster [DBG] pgmap v657: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:42:30.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:29 smithi080 bash[24237]: audit 2024-02-13T00:42:28.353555+0000 mgr.y (mgr.24461) 505 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:42:30.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:29 smithi080 bash[24237]: audit 2024-02-13T00:42:28.679491+0000 mon.a (mon.0) 2287 : audit [INF] from='client.? 172.21.15.80:0/2644528702' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi080-54183-65"}]': finished 2024-02-13T00:42:30.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:29 smithi080 bash[24237]: cluster 2024-02-13T00:42:28.679613+0000 mon.a (mon.0) 2288 : cluster [DBG] osdmap e351: 8 total, 8 up, 8 in 2024-02-13T00:42:30.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:42:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:42:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:42:32.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:31 smithi106 bash[18459]: cluster 2024-02-13T00:42:30.277928+0000 mgr.y (mgr.24461) 506 : cluster [DBG] pgmap v659: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:42:32.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:31 smithi080 bash[17386]: cluster 2024-02-13T00:42:30.277928+0000 mgr.y (mgr.24461) 506 : cluster [DBG] pgmap v659: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:42:32.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:31 smithi080 bash[24237]: cluster 2024-02-13T00:42:30.277928+0000 mgr.y (mgr.24461) 506 : cluster [DBG] pgmap v659: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:42:33.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:32 smithi106 bash[18459]: audit 2024-02-13T00:42:31.921357+0000 mon.a (mon.0) 2289 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:42:33.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:32 smithi080 bash[17386]: audit 2024-02-13T00:42:31.921357+0000 mon.a (mon.0) 2289 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:42:33.258 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:42:33 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:42:33] "GET /metrics HTTP/1.1" 200 187568 "" "Prometheus/2.33.4" 2024-02-13T00:42:33.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:32 smithi080 bash[24237]: audit 2024-02-13T00:42:31.921357+0000 mon.a (mon.0) 2289 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:42:34.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:33 smithi106 bash[18459]: cluster 2024-02-13T00:42:32.278712+0000 mgr.y (mgr.24461) 507 : cluster [DBG] pgmap v660: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:42:34.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:33 smithi080 bash[17386]: cluster 2024-02-13T00:42:32.278712+0000 mgr.y (mgr.24461) 507 : cluster [DBG] pgmap v660: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:42:34.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:33 smithi080 bash[24237]: cluster 2024-02-13T00:42:32.278712+0000 mgr.y (mgr.24461) 507 : cluster [DBG] pgmap v660: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:42:35.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:34 smithi106 bash[18459]: audit 2024-02-13T00:42:34.694877+0000 mon.a (mon.0) 2290 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:35.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:34 smithi080 bash[17386]: audit 2024-02-13T00:42:34.694877+0000 mon.a (mon.0) 2290 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:35.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:34 smithi080 bash[24237]: audit 2024-02-13T00:42:34.694877+0000 mon.a (mon.0) 2290 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:36.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:35 smithi106 bash[18459]: cluster 2024-02-13T00:42:34.280943+0000 mgr.y (mgr.24461) 508 : cluster [DBG] pgmap v661: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:42:36.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:35 smithi106 bash[18459]: audit 2024-02-13T00:42:34.942577+0000 mon.a (mon.0) 2291 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:42:36.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:35 smithi106 bash[18459]: cluster 2024-02-13T00:42:34.942675+0000 mon.a (mon.0) 2292 : cluster [DBG] osdmap e352: 8 total, 8 up, 8 in 2024-02-13T00:42:36.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:35 smithi106 bash[18459]: audit 2024-02-13T00:42:34.944276+0000 mon.a (mon.0) 2293 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-49"}]: dispatch 2024-02-13T00:42:36.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:35 smithi080 bash[17386]: cluster 2024-02-13T00:42:34.280943+0000 mgr.y (mgr.24461) 508 : cluster [DBG] pgmap v661: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:42:36.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:35 smithi080 bash[17386]: audit 2024-02-13T00:42:34.942577+0000 mon.a (mon.0) 2291 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:42:36.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:35 smithi080 bash[17386]: cluster 2024-02-13T00:42:34.942675+0000 mon.a (mon.0) 2292 : cluster [DBG] osdmap e352: 8 total, 8 up, 8 in 2024-02-13T00:42:36.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:35 smithi080 bash[17386]: audit 2024-02-13T00:42:34.944276+0000 mon.a (mon.0) 2293 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-49"}]: dispatch 2024-02-13T00:42:36.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:35 smithi080 bash[24237]: cluster 2024-02-13T00:42:34.280943+0000 mgr.y (mgr.24461) 508 : cluster [DBG] pgmap v661: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:42:36.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:35 smithi080 bash[24237]: audit 2024-02-13T00:42:34.942577+0000 mon.a (mon.0) 2291 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:42:36.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:35 smithi080 bash[24237]: cluster 2024-02-13T00:42:34.942675+0000 mon.a (mon.0) 2292 : cluster [DBG] osdmap e352: 8 total, 8 up, 8 in 2024-02-13T00:42:36.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:35 smithi080 bash[24237]: audit 2024-02-13T00:42:34.944276+0000 mon.a (mon.0) 2293 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-49"}]: dispatch 2024-02-13T00:42:36.962 INFO:tasks.workunit.client.0.smithi080.stdout:b4c720e9:::166:head 2024-02-13T00:42:37.022 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:e694b040:::167:head 2024-02-13T00:42:37.022 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:afa38db2:::168:head 2024-02-13T00:42:37.022 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:77ba9f53:::169:head 2024-02-13T00:42:37.022 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:87495034:::170:head 2024-02-13T00:42:37.022 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:7c96bf0e:::171:head 2024-02-13T00:42:37.022 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:dbe346cc:::172:head 2024-02-13T00:42:37.022 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:e943ec24:::173:head 2024-02-13T00:42:37.022 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:f97a9c0c:::174:head 2024-02-13T00:42:37.023 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:6f26e74d:::175:head 2024-02-13T00:42:37.023 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:4f95e106:::176:head 2024-02-13T00:42:37.023 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:0e6f2f8f:::177:head 2024-02-13T00:42:37.023 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:05db05f1:::178:head 2024-02-13T00:42:37.023 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:38a78d66:::179:head 2024-02-13T00:42:37.023 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:d095610b:::180:head 2024-02-13T00:42:37.023 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:a1a9d709:::181:head 2024-02-13T00:42:37.023 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:1e5d39db:::182:head 2024-02-13T00:42:37.023 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:f7df4fb9:::183:head 2024-02-13T00:42:37.023 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:03a7f161:::184:head 2024-02-13T00:42:37.023 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:ba70721e:::185:head 2024-02-13T00:42:37.023 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:28e5662d:::186:head 2024-02-13T00:42:37.023 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:973d52de:::187:head 2024-02-13T00:42:37.023 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:4303eb1c:::188:head 2024-02-13T00:42:37.024 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:b990b48e:::189:head 2024-02-13T00:42:37.024 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:29b8165b:::190:head 2024-02-13T00:42:37.024 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:3547f197:::191:head 2024-02-13T00:42:37.024 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:7e260936:::192:head 2024-02-13T00:42:37.024 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:1abec7b1:::193:head 2024-02-13T00:42:37.024 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:10fdda93:::194:head 2024-02-13T00:42:37.024 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:15817eea:::195:head 2024-02-13T00:42:37.024 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:770bab57:::196:head 2024-02-13T00:42:37.024 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:ed9e13e7:::197:head 2024-02-13T00:42:37.024 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:71471a8f:::198:head 2024-02-13T00:42:37.024 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: checking for 191:10fb1d02:::199:head 2024-02-13T00:42:37.024 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetWrite (8027 ms) 2024-02-13T00:42:37.024 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-02-13T00:42:37.024 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707784888,0 2024-02-13T00:42:37.024 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: first is 1707784888 2024-02-13T00:42:37.025 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707784888,0 2024-02-13T00:42:37.025 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707784888,0 2024-02-13T00:42:37.025 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707784888,1707784890,1707784891,0 2024-02-13T00:42:37.025 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707784888,1707784890,1707784891,0 2024-02-13T00:42:37.025 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707784888,1707784890,1707784891,0 2024-02-13T00:42:37.025 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707784888,1707784890,1707784891,1707784893,1707784894,0 2024-02-13T00:42:37.025 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707784888,1707784890,1707784891,1707784893,1707784894,0 2024-02-13T00:42:37.025 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707784888,1707784890,1707784891,1707784893,1707784894,0 2024-02-13T00:42:37.025 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707784888,1707784890,1707784891,1707784893,1707784894,1707784896,1707784897,0 2024-02-13T00:42:37.025 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707784888,1707784890,1707784891,1707784893,1707784894,1707784896,1707784897,0 2024-02-13T00:42:37.025 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707784888,1707784890,1707784891,1707784893,1707784894,1707784896,1707784897,0 2024-02-13T00:42:37.025 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707784891,1707784893,1707784894,1707784896,1707784897,1707784899,1707784900,0 2024-02-13T00:42:37.025 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: first now 1707784891, trimmed 2024-02-13T00:42:37.025 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetTrim (21099 ms) 2024-02-13T00:42:37.025 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-02-13T00:42:37.026 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: foo0 2024-02-13T00:42:37.026 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-02-13T00:42:37.026 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteOn2ndRead (15054 ms) 2024-02-13T00:42:37.026 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-02-13T00:42:37.026 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ProxyRead (18121 ms) 2024-02-13T00:42:37.026 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2024-02-13T00:42:37.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:36 smithi106 bash[18459]: audit 2024-02-13T00:42:35.942981+0000 mon.a (mon.0) 2294 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-49"}]': finished 2024-02-13T00:42:37.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:36 smithi106 bash[18459]: cluster 2024-02-13T00:42:35.943086+0000 mon.a (mon.0) 2295 : cluster [DBG] osdmap e353: 8 total, 8 up, 8 in 2024-02-13T00:42:37.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:36 smithi106 bash[18459]: audit 2024-02-13T00:42:35.983277+0000 mon.a (mon.0) 2296 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:37.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:36 smithi106 bash[18459]: audit 2024-02-13T00:42:35.983833+0000 mon.a (mon.0) 2297 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-49"}]: dispatch 2024-02-13T00:42:37.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:36 smithi080 bash[17386]: audit 2024-02-13T00:42:35.942981+0000 mon.a (mon.0) 2294 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-49"}]': finished 2024-02-13T00:42:37.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:36 smithi080 bash[17386]: cluster 2024-02-13T00:42:35.943086+0000 mon.a (mon.0) 2295 : cluster [DBG] osdmap e353: 8 total, 8 up, 8 in 2024-02-13T00:42:37.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:36 smithi080 bash[17386]: audit 2024-02-13T00:42:35.983277+0000 mon.a (mon.0) 2296 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:37.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:36 smithi080 bash[17386]: audit 2024-02-13T00:42:35.983833+0000 mon.a (mon.0) 2297 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-49"}]: dispatch 2024-02-13T00:42:37.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:36 smithi080 bash[24237]: audit 2024-02-13T00:42:35.942981+0000 mon.a (mon.0) 2294 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-49"}]': finished 2024-02-13T00:42:37.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:36 smithi080 bash[24237]: cluster 2024-02-13T00:42:35.943086+0000 mon.a (mon.0) 2295 : cluster [DBG] osdmap e353: 8 total, 8 up, 8 in 2024-02-13T00:42:37.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:36 smithi080 bash[24237]: audit 2024-02-13T00:42:35.983277+0000 mon.a (mon.0) 2296 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:37.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:36 smithi080 bash[24237]: audit 2024-02-13T00:42:35.983833+0000 mon.a (mon.0) 2297 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-49"}]: dispatch 2024-02-13T00:42:38.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:37 smithi106 bash[18459]: cluster 2024-02-13T00:42:36.281798+0000 mgr.y (mgr.24461) 509 : cluster [DBG] pgmap v664: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 673 B/s rd, 0 op/s 2024-02-13T00:42:38.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:37 smithi106 bash[18459]: cluster 2024-02-13T00:42:36.947861+0000 mon.a (mon.0) 2298 : cluster [INF] Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-02-13T00:42:38.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:37 smithi106 bash[18459]: cluster 2024-02-13T00:42:36.959781+0000 mon.a (mon.0) 2299 : cluster [DBG] osdmap e354: 8 total, 8 up, 8 in 2024-02-13T00:42:38.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:37 smithi080 bash[17386]: cluster 2024-02-13T00:42:36.281798+0000 mgr.y (mgr.24461) 509 : cluster [DBG] pgmap v664: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 673 B/s rd, 0 op/s 2024-02-13T00:42:38.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:37 smithi080 bash[17386]: cluster 2024-02-13T00:42:36.947861+0000 mon.a (mon.0) 2298 : cluster [INF] Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-02-13T00:42:38.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:37 smithi080 bash[17386]: cluster 2024-02-13T00:42:36.959781+0000 mon.a (mon.0) 2299 : cluster [DBG] osdmap e354: 8 total, 8 up, 8 in 2024-02-13T00:42:38.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:37 smithi080 bash[24237]: cluster 2024-02-13T00:42:36.281798+0000 mgr.y (mgr.24461) 509 : cluster [DBG] pgmap v664: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 673 B/s rd, 0 op/s 2024-02-13T00:42:38.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:37 smithi080 bash[24237]: cluster 2024-02-13T00:42:36.947861+0000 mon.a (mon.0) 2298 : cluster [INF] Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-02-13T00:42:38.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:37 smithi080 bash[24237]: cluster 2024-02-13T00:42:36.959781+0000 mon.a (mon.0) 2299 : cluster [DBG] osdmap e354: 8 total, 8 up, 8 in 2024-02-13T00:42:38.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:42:38 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:42:39.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:38 smithi106 bash[18459]: cluster 2024-02-13T00:42:37.963797+0000 mon.a (mon.0) 2300 : cluster [DBG] osdmap e355: 8 total, 8 up, 8 in 2024-02-13T00:42:39.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:38 smithi106 bash[18459]: audit 2024-02-13T00:42:37.967656+0000 mon.a (mon.0) 2301 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:42:39.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:38 smithi080 bash[17386]: cluster 2024-02-13T00:42:37.963797+0000 mon.a (mon.0) 2300 : cluster [DBG] osdmap e355: 8 total, 8 up, 8 in 2024-02-13T00:42:39.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:38 smithi080 bash[17386]: audit 2024-02-13T00:42:37.967656+0000 mon.a (mon.0) 2301 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:42:39.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:38 smithi080 bash[24237]: cluster 2024-02-13T00:42:37.963797+0000 mon.a (mon.0) 2300 : cluster [DBG] osdmap e355: 8 total, 8 up, 8 in 2024-02-13T00:42:39.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:38 smithi080 bash[24237]: audit 2024-02-13T00:42:37.967656+0000 mon.a (mon.0) 2301 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:42:40.438 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:42:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:42:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:42:40.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:40 smithi106 bash[18459]: cluster 2024-02-13T00:42:38.282613+0000 mgr.y (mgr.24461) 510 : cluster [DBG] pgmap v667: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-13T00:42:40.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:40 smithi106 bash[18459]: audit 2024-02-13T00:42:38.355582+0000 mgr.y (mgr.24461) 511 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:42:40.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:40 smithi106 bash[18459]: audit 2024-02-13T00:42:38.973479+0000 mon.a (mon.0) 2302 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:40.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:40 smithi106 bash[18459]: cluster 2024-02-13T00:42:38.973707+0000 mon.a (mon.0) 2303 : cluster [DBG] osdmap e356: 8 total, 8 up, 8 in 2024-02-13T00:42:40.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:40 smithi106 bash[18459]: audit 2024-02-13T00:42:39.019640+0000 mon.a (mon.0) 2304 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:40.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:40 smithi106 bash[18459]: audit 2024-02-13T00:42:39.020371+0000 mon.a (mon.0) 2305 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-51"}]: dispatch 2024-02-13T00:42:40.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:40 smithi080 bash[24237]: cluster 2024-02-13T00:42:38.282613+0000 mgr.y (mgr.24461) 510 : cluster [DBG] pgmap v667: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-13T00:42:40.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:40 smithi080 bash[24237]: audit 2024-02-13T00:42:38.355582+0000 mgr.y (mgr.24461) 511 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:42:40.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:40 smithi080 bash[24237]: audit 2024-02-13T00:42:38.973479+0000 mon.a (mon.0) 2302 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:40.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:40 smithi080 bash[24237]: cluster 2024-02-13T00:42:38.973707+0000 mon.a (mon.0) 2303 : cluster [DBG] osdmap e356: 8 total, 8 up, 8 in 2024-02-13T00:42:40.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:40 smithi080 bash[24237]: audit 2024-02-13T00:42:39.019640+0000 mon.a (mon.0) 2304 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:40.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:40 smithi080 bash[24237]: audit 2024-02-13T00:42:39.020371+0000 mon.a (mon.0) 2305 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-51"}]: dispatch 2024-02-13T00:42:40.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:40 smithi080 bash[17386]: cluster 2024-02-13T00:42:38.282613+0000 mgr.y (mgr.24461) 510 : cluster [DBG] pgmap v667: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-13T00:42:40.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:40 smithi080 bash[17386]: audit 2024-02-13T00:42:38.355582+0000 mgr.y (mgr.24461) 511 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:42:40.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:40 smithi080 bash[17386]: audit 2024-02-13T00:42:38.973479+0000 mon.a (mon.0) 2302 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:40.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:40 smithi080 bash[17386]: cluster 2024-02-13T00:42:38.973707+0000 mon.a (mon.0) 2303 : cluster [DBG] osdmap e356: 8 total, 8 up, 8 in 2024-02-13T00:42:40.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:40 smithi080 bash[17386]: audit 2024-02-13T00:42:39.019640+0000 mon.a (mon.0) 2304 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:40.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:40 smithi080 bash[17386]: audit 2024-02-13T00:42:39.020371+0000 mon.a (mon.0) 2305 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-51"}]: dispatch 2024-02-13T00:42:41.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:41 smithi106 bash[18459]: cluster 2024-02-13T00:42:39.977760+0000 mon.a (mon.0) 2306 : cluster [DBG] osdmap e357: 8 total, 8 up, 8 in 2024-02-13T00:42:41.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:41 smithi106 bash[18459]: cluster 2024-02-13T00:42:40.283332+0000 mgr.y (mgr.24461) 512 : cluster [DBG] pgmap v670: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-13T00:42:41.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:41 smithi106 bash[18459]: cluster 2024-02-13T00:42:40.981690+0000 mon.a (mon.0) 2307 : cluster [DBG] osdmap e358: 8 total, 8 up, 8 in 2024-02-13T00:42:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:41 smithi106 bash[18459]: audit 2024-02-13T00:42:40.987290+0000 mon.a (mon.0) 2308 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:42:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:41 smithi080 bash[17386]: cluster 2024-02-13T00:42:39.977760+0000 mon.a (mon.0) 2306 : cluster [DBG] osdmap e357: 8 total, 8 up, 8 in 2024-02-13T00:42:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:41 smithi080 bash[17386]: cluster 2024-02-13T00:42:40.283332+0000 mgr.y (mgr.24461) 512 : cluster [DBG] pgmap v670: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-13T00:42:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:41 smithi080 bash[17386]: cluster 2024-02-13T00:42:40.981690+0000 mon.a (mon.0) 2307 : cluster [DBG] osdmap e358: 8 total, 8 up, 8 in 2024-02-13T00:42:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:41 smithi080 bash[17386]: audit 2024-02-13T00:42:40.987290+0000 mon.a (mon.0) 2308 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:42:41.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:41 smithi080 bash[24237]: cluster 2024-02-13T00:42:39.977760+0000 mon.a (mon.0) 2306 : cluster [DBG] osdmap e357: 8 total, 8 up, 8 in 2024-02-13T00:42:41.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:41 smithi080 bash[24237]: cluster 2024-02-13T00:42:40.283332+0000 mgr.y (mgr.24461) 512 : cluster [DBG] pgmap v670: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-13T00:42:41.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:41 smithi080 bash[24237]: cluster 2024-02-13T00:42:40.981690+0000 mon.a (mon.0) 2307 : cluster [DBG] osdmap e358: 8 total, 8 up, 8 in 2024-02-13T00:42:41.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:41 smithi080 bash[24237]: audit 2024-02-13T00:42:40.987290+0000 mon.a (mon.0) 2308 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:42:43.448 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:42:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:42:43] "GET /metrics HTTP/1.1" 200 187568 "" "Prometheus/2.33.4" 2024-02-13T00:42:43.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:43 smithi106 bash[18459]: audit 2024-02-13T00:42:41.989561+0000 mon.a (mon.0) 2309 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:43.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:43 smithi106 bash[18459]: cluster 2024-02-13T00:42:41.990022+0000 mon.a (mon.0) 2310 : cluster [DBG] osdmap e359: 8 total, 8 up, 8 in 2024-02-13T00:42:43.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:43 smithi106 bash[18459]: audit 2024-02-13T00:42:41.995073+0000 mon.a (mon.0) 2311 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:42:43.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:43 smithi106 bash[18459]: audit 2024-02-13T00:42:42.056473+0000 mon.a (mon.0) 2312 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:43.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:43 smithi106 bash[18459]: audit 2024-02-13T00:42:42.057193+0000 mon.a (mon.0) 2313 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-53"}]: dispatch 2024-02-13T00:42:43.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:43 smithi080 bash[17386]: audit 2024-02-13T00:42:41.989561+0000 mon.a (mon.0) 2309 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:43.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:43 smithi080 bash[17386]: cluster 2024-02-13T00:42:41.990022+0000 mon.a (mon.0) 2310 : cluster [DBG] osdmap e359: 8 total, 8 up, 8 in 2024-02-13T00:42:43.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:43 smithi080 bash[17386]: audit 2024-02-13T00:42:41.995073+0000 mon.a (mon.0) 2311 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:42:43.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:43 smithi080 bash[17386]: audit 2024-02-13T00:42:42.056473+0000 mon.a (mon.0) 2312 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:43.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:43 smithi080 bash[17386]: audit 2024-02-13T00:42:42.057193+0000 mon.a (mon.0) 2313 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-53"}]: dispatch 2024-02-13T00:42:43.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:43 smithi080 bash[24237]: audit 2024-02-13T00:42:41.989561+0000 mon.a (mon.0) 2309 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:43.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:43 smithi080 bash[24237]: cluster 2024-02-13T00:42:41.990022+0000 mon.a (mon.0) 2310 : cluster [DBG] osdmap e359: 8 total, 8 up, 8 in 2024-02-13T00:42:43.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:43 smithi080 bash[24237]: audit 2024-02-13T00:42:41.995073+0000 mon.a (mon.0) 2311 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:42:43.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:43 smithi080 bash[24237]: audit 2024-02-13T00:42:42.056473+0000 mon.a (mon.0) 2312 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:43.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:43 smithi080 bash[24237]: audit 2024-02-13T00:42:42.057193+0000 mon.a (mon.0) 2313 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-53"}]: dispatch 2024-02-13T00:42:44.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:44 smithi106 bash[18459]: cluster 2024-02-13T00:42:42.284057+0000 mgr.y (mgr.24461) 513 : cluster [DBG] pgmap v673: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:42:44.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:44 smithi106 bash[18459]: cluster 2024-02-13T00:42:42.988381+0000 mon.a (mon.0) 2314 : cluster [DBG] osdmap e360: 8 total, 8 up, 8 in 2024-02-13T00:42:44.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:44 smithi106 bash[18459]: cluster 2024-02-13T00:42:43.995000+0000 mon.a (mon.0) 2315 : cluster [DBG] osdmap e361: 8 total, 8 up, 8 in 2024-02-13T00:42:44.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:44 smithi106 bash[18459]: audit 2024-02-13T00:42:44.006771+0000 mon.a (mon.0) 2316 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:42:44.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:44 smithi080 bash[17386]: cluster 2024-02-13T00:42:42.284057+0000 mgr.y (mgr.24461) 513 : cluster [DBG] pgmap v673: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:42:44.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:44 smithi080 bash[17386]: cluster 2024-02-13T00:42:42.988381+0000 mon.a (mon.0) 2314 : cluster [DBG] osdmap e360: 8 total, 8 up, 8 in 2024-02-13T00:42:44.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:44 smithi080 bash[17386]: cluster 2024-02-13T00:42:43.995000+0000 mon.a (mon.0) 2315 : cluster [DBG] osdmap e361: 8 total, 8 up, 8 in 2024-02-13T00:42:44.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:44 smithi080 bash[17386]: audit 2024-02-13T00:42:44.006771+0000 mon.a (mon.0) 2316 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:42:44.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:44 smithi080 bash[24237]: cluster 2024-02-13T00:42:42.284057+0000 mgr.y (mgr.24461) 513 : cluster [DBG] pgmap v673: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:42:44.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:44 smithi080 bash[24237]: cluster 2024-02-13T00:42:42.988381+0000 mon.a (mon.0) 2314 : cluster [DBG] osdmap e360: 8 total, 8 up, 8 in 2024-02-13T00:42:44.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:44 smithi080 bash[24237]: cluster 2024-02-13T00:42:43.995000+0000 mon.a (mon.0) 2315 : cluster [DBG] osdmap e361: 8 total, 8 up, 8 in 2024-02-13T00:42:44.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:44 smithi080 bash[24237]: audit 2024-02-13T00:42:44.006771+0000 mon.a (mon.0) 2316 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:42:46.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:46 smithi106 bash[18459]: cluster 2024-02-13T00:42:44.284883+0000 mgr.y (mgr.24461) 514 : cluster [DBG] pgmap v676: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-13T00:42:46.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:46 smithi106 bash[18459]: audit 2024-02-13T00:42:44.997331+0000 mon.a (mon.0) 2317 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:46.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:46 smithi106 bash[18459]: cluster 2024-02-13T00:42:44.997428+0000 mon.a (mon.0) 2318 : cluster [DBG] osdmap e362: 8 total, 8 up, 8 in 2024-02-13T00:42:46.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:46 smithi106 bash[18459]: audit 2024-02-13T00:42:45.181989+0000 mon.a (mon.0) 2319 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:46.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:46 smithi106 bash[18459]: audit 2024-02-13T00:42:45.182812+0000 mon.a (mon.0) 2320 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-55"}]: dispatch 2024-02-13T00:42:46.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:46 smithi080 bash[17386]: cluster 2024-02-13T00:42:44.284883+0000 mgr.y (mgr.24461) 514 : cluster [DBG] pgmap v676: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-13T00:42:46.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:46 smithi080 bash[17386]: audit 2024-02-13T00:42:44.997331+0000 mon.a (mon.0) 2317 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:46.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:46 smithi080 bash[17386]: cluster 2024-02-13T00:42:44.997428+0000 mon.a (mon.0) 2318 : cluster [DBG] osdmap e362: 8 total, 8 up, 8 in 2024-02-13T00:42:46.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:46 smithi080 bash[17386]: audit 2024-02-13T00:42:45.181989+0000 mon.a (mon.0) 2319 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:46.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:46 smithi080 bash[17386]: audit 2024-02-13T00:42:45.182812+0000 mon.a (mon.0) 2320 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-55"}]: dispatch 2024-02-13T00:42:46.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:46 smithi080 bash[24237]: cluster 2024-02-13T00:42:44.284883+0000 mgr.y (mgr.24461) 514 : cluster [DBG] pgmap v676: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-13T00:42:46.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:46 smithi080 bash[24237]: audit 2024-02-13T00:42:44.997331+0000 mon.a (mon.0) 2317 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:46.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:46 smithi080 bash[24237]: cluster 2024-02-13T00:42:44.997428+0000 mon.a (mon.0) 2318 : cluster [DBG] osdmap e362: 8 total, 8 up, 8 in 2024-02-13T00:42:46.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:46 smithi080 bash[24237]: audit 2024-02-13T00:42:45.181989+0000 mon.a (mon.0) 2319 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:46.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:46 smithi080 bash[24237]: audit 2024-02-13T00:42:45.182812+0000 mon.a (mon.0) 2320 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-55"}]: dispatch 2024-02-13T00:42:47.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:47 smithi106 bash[18459]: cluster 2024-02-13T00:42:46.005202+0000 mon.a (mon.0) 2321 : cluster [DBG] osdmap e363: 8 total, 8 up, 8 in 2024-02-13T00:42:47.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:47 smithi106 bash[18459]: cluster 2024-02-13T00:42:46.285617+0000 mgr.y (mgr.24461) 515 : cluster [DBG] pgmap v679: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-13T00:42:47.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:47 smithi106 bash[18459]: audit 2024-02-13T00:42:46.918955+0000 mon.a (mon.0) 2322 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:42:47.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:47 smithi106 bash[18459]: cluster 2024-02-13T00:42:47.009603+0000 mon.a (mon.0) 2323 : cluster [DBG] osdmap e364: 8 total, 8 up, 8 in 2024-02-13T00:42:47.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:47 smithi106 bash[18459]: audit 2024-02-13T00:42:47.015782+0000 mon.a (mon.0) 2324 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:42:47.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:47 smithi080 bash[17386]: cluster 2024-02-13T00:42:46.005202+0000 mon.a (mon.0) 2321 : cluster [DBG] osdmap e363: 8 total, 8 up, 8 in 2024-02-13T00:42:47.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:47 smithi080 bash[17386]: cluster 2024-02-13T00:42:46.285617+0000 mgr.y (mgr.24461) 515 : cluster [DBG] pgmap v679: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-13T00:42:47.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:47 smithi080 bash[17386]: audit 2024-02-13T00:42:46.918955+0000 mon.a (mon.0) 2322 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:42:47.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:47 smithi080 bash[17386]: cluster 2024-02-13T00:42:47.009603+0000 mon.a (mon.0) 2323 : cluster [DBG] osdmap e364: 8 total, 8 up, 8 in 2024-02-13T00:42:47.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:47 smithi080 bash[17386]: audit 2024-02-13T00:42:47.015782+0000 mon.a (mon.0) 2324 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:42:47.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:47 smithi080 bash[24237]: cluster 2024-02-13T00:42:46.005202+0000 mon.a (mon.0) 2321 : cluster [DBG] osdmap e363: 8 total, 8 up, 8 in 2024-02-13T00:42:47.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:47 smithi080 bash[24237]: cluster 2024-02-13T00:42:46.285617+0000 mgr.y (mgr.24461) 515 : cluster [DBG] pgmap v679: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-13T00:42:47.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:47 smithi080 bash[24237]: audit 2024-02-13T00:42:46.918955+0000 mon.a (mon.0) 2322 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:42:47.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:47 smithi080 bash[24237]: cluster 2024-02-13T00:42:47.009603+0000 mon.a (mon.0) 2323 : cluster [DBG] osdmap e364: 8 total, 8 up, 8 in 2024-02-13T00:42:47.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:47 smithi080 bash[24237]: audit 2024-02-13T00:42:47.015782+0000 mon.a (mon.0) 2324 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:42:48.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:42:48 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:42:49.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:49 smithi080 bash[17386]: audit 2024-02-13T00:42:48.008860+0000 mon.a (mon.0) 2325 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:49.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:49 smithi080 bash[17386]: cluster 2024-02-13T00:42:48.008997+0000 mon.a (mon.0) 2326 : cluster [DBG] osdmap e365: 8 total, 8 up, 8 in 2024-02-13T00:42:49.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:49 smithi080 bash[17386]: audit 2024-02-13T00:42:48.011670+0000 mon.a (mon.0) 2327 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:42:49.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:49 smithi080 bash[17386]: audit 2024-02-13T00:42:48.068043+0000 mon.a (mon.0) 2328 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:49.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:49 smithi080 bash[17386]: audit 2024-02-13T00:42:48.068845+0000 mon.a (mon.0) 2329 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-57"}]: dispatch 2024-02-13T00:42:49.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:49 smithi080 bash[24237]: audit 2024-02-13T00:42:48.008860+0000 mon.a (mon.0) 2325 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:49.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:49 smithi080 bash[24237]: cluster 2024-02-13T00:42:48.008997+0000 mon.a (mon.0) 2326 : cluster [DBG] osdmap e365: 8 total, 8 up, 8 in 2024-02-13T00:42:49.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:49 smithi080 bash[24237]: audit 2024-02-13T00:42:48.011670+0000 mon.a (mon.0) 2327 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:42:49.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:49 smithi080 bash[24237]: audit 2024-02-13T00:42:48.068043+0000 mon.a (mon.0) 2328 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:49.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:49 smithi080 bash[24237]: audit 2024-02-13T00:42:48.068845+0000 mon.a (mon.0) 2329 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-57"}]: dispatch 2024-02-13T00:42:49.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:49 smithi106 bash[18459]: audit 2024-02-13T00:42:48.008860+0000 mon.a (mon.0) 2325 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:49.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:49 smithi106 bash[18459]: cluster 2024-02-13T00:42:48.008997+0000 mon.a (mon.0) 2326 : cluster [DBG] osdmap e365: 8 total, 8 up, 8 in 2024-02-13T00:42:49.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:49 smithi106 bash[18459]: audit 2024-02-13T00:42:48.011670+0000 mon.a (mon.0) 2327 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:42:49.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:49 smithi106 bash[18459]: audit 2024-02-13T00:42:48.068043+0000 mon.a (mon.0) 2328 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:49.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:49 smithi106 bash[18459]: audit 2024-02-13T00:42:48.068845+0000 mon.a (mon.0) 2329 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-57"}]: dispatch 2024-02-13T00:42:50.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:42:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:42:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:42:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:50 smithi106 bash[18459]: cluster 2024-02-13T00:42:48.286470+0000 mgr.y (mgr.24461) 516 : cluster [DBG] pgmap v682: 228 pgs: 32 creating+peering, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-13T00:42:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:50 smithi106 bash[18459]: audit 2024-02-13T00:42:48.367096+0000 mgr.y (mgr.24461) 517 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:42:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:50 smithi106 bash[18459]: cluster 2024-02-13T00:42:49.015129+0000 mon.a (mon.0) 2330 : cluster [DBG] osdmap e366: 8 total, 8 up, 8 in 2024-02-13T00:42:50.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:50 smithi080 bash[17386]: cluster 2024-02-13T00:42:48.286470+0000 mgr.y (mgr.24461) 516 : cluster [DBG] pgmap v682: 228 pgs: 32 creating+peering, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-13T00:42:50.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:50 smithi080 bash[17386]: audit 2024-02-13T00:42:48.367096+0000 mgr.y (mgr.24461) 517 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:42:50.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:50 smithi080 bash[17386]: cluster 2024-02-13T00:42:49.015129+0000 mon.a (mon.0) 2330 : cluster [DBG] osdmap e366: 8 total, 8 up, 8 in 2024-02-13T00:42:50.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:50 smithi080 bash[24237]: cluster 2024-02-13T00:42:48.286470+0000 mgr.y (mgr.24461) 516 : cluster [DBG] pgmap v682: 228 pgs: 32 creating+peering, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-13T00:42:50.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:50 smithi080 bash[24237]: audit 2024-02-13T00:42:48.367096+0000 mgr.y (mgr.24461) 517 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:42:50.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:50 smithi080 bash[24237]: cluster 2024-02-13T00:42:49.015129+0000 mon.a (mon.0) 2330 : cluster [DBG] osdmap e366: 8 total, 8 up, 8 in 2024-02-13T00:42:51.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:51 smithi106 bash[18459]: cluster 2024-02-13T00:42:50.022542+0000 mon.a (mon.0) 2331 : cluster [DBG] osdmap e367: 8 total, 8 up, 8 in 2024-02-13T00:42:51.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:51 smithi106 bash[18459]: audit 2024-02-13T00:42:50.033823+0000 mon.a (mon.0) 2332 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:42:51.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:51 smithi106 bash[18459]: audit 2024-02-13T00:42:51.024907+0000 mon.a (mon.0) 2333 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:51.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:51 smithi106 bash[18459]: cluster 2024-02-13T00:42:51.025431+0000 mon.a (mon.0) 2334 : cluster [DBG] osdmap e368: 8 total, 8 up, 8 in 2024-02-13T00:42:51.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:51 smithi106 bash[18459]: audit 2024-02-13T00:42:51.030328+0000 mon.a (mon.0) 2335 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:42:51.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:51 smithi080 bash[24237]: cluster 2024-02-13T00:42:50.022542+0000 mon.a (mon.0) 2331 : cluster [DBG] osdmap e367: 8 total, 8 up, 8 in 2024-02-13T00:42:51.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:51 smithi080 bash[24237]: audit 2024-02-13T00:42:50.033823+0000 mon.a (mon.0) 2332 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:42:51.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:51 smithi080 bash[24237]: audit 2024-02-13T00:42:51.024907+0000 mon.a (mon.0) 2333 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:51.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:51 smithi080 bash[24237]: cluster 2024-02-13T00:42:51.025431+0000 mon.a (mon.0) 2334 : cluster [DBG] osdmap e368: 8 total, 8 up, 8 in 2024-02-13T00:42:51.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:51 smithi080 bash[24237]: audit 2024-02-13T00:42:51.030328+0000 mon.a (mon.0) 2335 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:42:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:51 smithi080 bash[17386]: cluster 2024-02-13T00:42:50.022542+0000 mon.a (mon.0) 2331 : cluster [DBG] osdmap e367: 8 total, 8 up, 8 in 2024-02-13T00:42:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:51 smithi080 bash[17386]: audit 2024-02-13T00:42:50.033823+0000 mon.a (mon.0) 2332 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:42:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:51 smithi080 bash[17386]: audit 2024-02-13T00:42:51.024907+0000 mon.a (mon.0) 2333 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:51 smithi080 bash[17386]: cluster 2024-02-13T00:42:51.025431+0000 mon.a (mon.0) 2334 : cluster [DBG] osdmap e368: 8 total, 8 up, 8 in 2024-02-13T00:42:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:51 smithi080 bash[17386]: audit 2024-02-13T00:42:51.030328+0000 mon.a (mon.0) 2335 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:42:52.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:52 smithi106 bash[18459]: cluster 2024-02-13T00:42:50.287297+0000 mgr.y (mgr.24461) 518 : cluster [DBG] pgmap v685: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-13T00:42:52.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:52 smithi106 bash[18459]: audit 2024-02-13T00:42:51.035378+0000 mon.a (mon.0) 2336 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:42:52.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:52 smithi106 bash[18459]: audit 2024-02-13T00:42:52.026886+0000 mon.a (mon.0) 2337 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:42:52.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:52 smithi106 bash[18459]: cluster 2024-02-13T00:42:52.027131+0000 mon.a (mon.0) 2338 : cluster [DBG] osdmap e369: 8 total, 8 up, 8 in 2024-02-13T00:42:52.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:52 smithi080 bash[17386]: cluster 2024-02-13T00:42:50.287297+0000 mgr.y (mgr.24461) 518 : cluster [DBG] pgmap v685: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-13T00:42:52.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:52 smithi080 bash[17386]: audit 2024-02-13T00:42:51.035378+0000 mon.a (mon.0) 2336 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:42:52.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:52 smithi080 bash[17386]: audit 2024-02-13T00:42:52.026886+0000 mon.a (mon.0) 2337 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:42:52.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:52 smithi080 bash[17386]: cluster 2024-02-13T00:42:52.027131+0000 mon.a (mon.0) 2338 : cluster [DBG] osdmap e369: 8 total, 8 up, 8 in 2024-02-13T00:42:52.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:52 smithi080 bash[24237]: cluster 2024-02-13T00:42:50.287297+0000 mgr.y (mgr.24461) 518 : cluster [DBG] pgmap v685: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-13T00:42:52.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:52 smithi080 bash[24237]: audit 2024-02-13T00:42:51.035378+0000 mon.a (mon.0) 2336 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:42:52.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:52 smithi080 bash[24237]: audit 2024-02-13T00:42:52.026886+0000 mon.a (mon.0) 2337 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:42:52.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:52 smithi080 bash[24237]: cluster 2024-02-13T00:42:52.027131+0000 mon.a (mon.0) 2338 : cluster [DBG] osdmap e369: 8 total, 8 up, 8 in 2024-02-13T00:42:53.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:53 smithi106 bash[18459]: audit 2024-02-13T00:42:52.073958+0000 mon.a (mon.0) 2339 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:53.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:53 smithi106 bash[18459]: audit 2024-02-13T00:42:52.074656+0000 mon.a (mon.0) 2340 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-59"}]: dispatch 2024-02-13T00:42:53.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:42:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:42:53] "GET /metrics HTTP/1.1" 200 185124 "" "Prometheus/2.33.4" 2024-02-13T00:42:53.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:53 smithi080 bash[17386]: audit 2024-02-13T00:42:52.073958+0000 mon.a (mon.0) 2339 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:53.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:53 smithi080 bash[17386]: audit 2024-02-13T00:42:52.074656+0000 mon.a (mon.0) 2340 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-59"}]: dispatch 2024-02-13T00:42:53.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:53 smithi080 bash[24237]: audit 2024-02-13T00:42:52.073958+0000 mon.a (mon.0) 2339 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:42:53.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:53 smithi080 bash[24237]: audit 2024-02-13T00:42:52.074656+0000 mon.a (mon.0) 2340 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-59"}]: dispatch 2024-02-13T00:42:54.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:54 smithi106 bash[18459]: cluster 2024-02-13T00:42:52.288102+0000 mgr.y (mgr.24461) 519 : cluster [DBG] pgmap v688: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:42:54.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:54 smithi106 bash[18459]: cluster 2024-02-13T00:42:53.064335+0000 mon.a (mon.0) 2341 : cluster [DBG] osdmap e370: 8 total, 8 up, 8 in 2024-02-13T00:42:54.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:54 smithi080 bash[17386]: cluster 2024-02-13T00:42:52.288102+0000 mgr.y (mgr.24461) 519 : cluster [DBG] pgmap v688: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:42:54.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:54 smithi080 bash[17386]: cluster 2024-02-13T00:42:53.064335+0000 mon.a (mon.0) 2341 : cluster [DBG] osdmap e370: 8 total, 8 up, 8 in 2024-02-13T00:42:54.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:54 smithi080 bash[24237]: cluster 2024-02-13T00:42:52.288102+0000 mgr.y (mgr.24461) 519 : cluster [DBG] pgmap v688: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:42:54.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:54 smithi080 bash[24237]: cluster 2024-02-13T00:42:53.064335+0000 mon.a (mon.0) 2341 : cluster [DBG] osdmap e370: 8 total, 8 up, 8 in 2024-02-13T00:42:55.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:55 smithi106 bash[18459]: cluster 2024-02-13T00:42:54.074357+0000 mon.a (mon.0) 2342 : cluster [DBG] osdmap e371: 8 total, 8 up, 8 in 2024-02-13T00:42:55.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:55 smithi106 bash[18459]: audit 2024-02-13T00:42:54.076363+0000 mon.a (mon.0) 2343 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:42:55.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:55 smithi080 bash[17386]: cluster 2024-02-13T00:42:54.074357+0000 mon.a (mon.0) 2342 : cluster [DBG] osdmap e371: 8 total, 8 up, 8 in 2024-02-13T00:42:55.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:55 smithi080 bash[17386]: audit 2024-02-13T00:42:54.076363+0000 mon.a (mon.0) 2343 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:42:55.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:55 smithi080 bash[24237]: cluster 2024-02-13T00:42:54.074357+0000 mon.a (mon.0) 2342 : cluster [DBG] osdmap e371: 8 total, 8 up, 8 in 2024-02-13T00:42:55.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:55 smithi080 bash[24237]: audit 2024-02-13T00:42:54.076363+0000 mon.a (mon.0) 2343 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:42:56.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:56 smithi106 bash[18459]: cluster 2024-02-13T00:42:54.288921+0000 mgr.y (mgr.24461) 520 : cluster [DBG] pgmap v691: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T00:42:56.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:56 smithi106 bash[18459]: audit 2024-02-13T00:42:55.083161+0000 mon.a (mon.0) 2344 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:56.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:56 smithi106 bash[18459]: cluster 2024-02-13T00:42:55.083392+0000 mon.a (mon.0) 2345 : cluster [DBG] osdmap e372: 8 total, 8 up, 8 in 2024-02-13T00:42:56.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:56 smithi106 bash[18459]: audit 2024-02-13T00:42:55.086296+0000 mon.a (mon.0) 2346 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:42:56.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:56 smithi106 bash[18459]: audit 2024-02-13T00:42:55.090751+0000 mon.a (mon.0) 2347 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:42:56.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:56 smithi080 bash[24237]: cluster 2024-02-13T00:42:54.288921+0000 mgr.y (mgr.24461) 520 : cluster [DBG] pgmap v691: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T00:42:56.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:56 smithi080 bash[24237]: audit 2024-02-13T00:42:55.083161+0000 mon.a (mon.0) 2344 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:56.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:56 smithi080 bash[24237]: cluster 2024-02-13T00:42:55.083392+0000 mon.a (mon.0) 2345 : cluster [DBG] osdmap e372: 8 total, 8 up, 8 in 2024-02-13T00:42:56.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:56 smithi080 bash[24237]: audit 2024-02-13T00:42:55.086296+0000 mon.a (mon.0) 2346 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:42:56.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:56 smithi080 bash[24237]: audit 2024-02-13T00:42:55.090751+0000 mon.a (mon.0) 2347 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:42:56.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:56 smithi080 bash[17386]: cluster 2024-02-13T00:42:54.288921+0000 mgr.y (mgr.24461) 520 : cluster [DBG] pgmap v691: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T00:42:56.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:56 smithi080 bash[17386]: audit 2024-02-13T00:42:55.083161+0000 mon.a (mon.0) 2344 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:42:56.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:56 smithi080 bash[17386]: cluster 2024-02-13T00:42:55.083392+0000 mon.a (mon.0) 2345 : cluster [DBG] osdmap e372: 8 total, 8 up, 8 in 2024-02-13T00:42:56.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:56 smithi080 bash[17386]: audit 2024-02-13T00:42:55.086296+0000 mon.a (mon.0) 2346 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:42:56.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:56 smithi080 bash[17386]: audit 2024-02-13T00:42:55.090751+0000 mon.a (mon.0) 2347 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:42:57.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:57 smithi106 bash[18459]: audit 2024-02-13T00:42:56.087208+0000 mon.a (mon.0) 2348 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:42:57.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:57 smithi106 bash[18459]: cluster 2024-02-13T00:42:56.087363+0000 mon.a (mon.0) 2349 : cluster [DBG] osdmap e373: 8 total, 8 up, 8 in 2024-02-13T00:42:57.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:57 smithi080 bash[17386]: audit 2024-02-13T00:42:56.087208+0000 mon.a (mon.0) 2348 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:42:57.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:57 smithi080 bash[17386]: cluster 2024-02-13T00:42:56.087363+0000 mon.a (mon.0) 2349 : cluster [DBG] osdmap e373: 8 total, 8 up, 8 in 2024-02-13T00:42:57.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:57 smithi080 bash[24237]: audit 2024-02-13T00:42:56.087208+0000 mon.a (mon.0) 2348 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:42:57.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:57 smithi080 bash[24237]: cluster 2024-02-13T00:42:56.087363+0000 mon.a (mon.0) 2349 : cluster [DBG] osdmap e373: 8 total, 8 up, 8 in 2024-02-13T00:42:58.382 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:58 smithi106 bash[18459]: cluster 2024-02-13T00:42:56.289734+0000 mgr.y (mgr.24461) 521 : cluster [DBG] pgmap v694: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T00:42:58.382 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:58 smithi106 bash[18459]: cluster 2024-02-13T00:42:57.109695+0000 mon.a (mon.0) 2350 : cluster [DBG] osdmap e374: 8 total, 8 up, 8 in 2024-02-13T00:42:58.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:58 smithi080 bash[17386]: cluster 2024-02-13T00:42:56.289734+0000 mgr.y (mgr.24461) 521 : cluster [DBG] pgmap v694: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T00:42:58.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:58 smithi080 bash[17386]: cluster 2024-02-13T00:42:57.109695+0000 mon.a (mon.0) 2350 : cluster [DBG] osdmap e374: 8 total, 8 up, 8 in 2024-02-13T00:42:58.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:58 smithi080 bash[24237]: cluster 2024-02-13T00:42:56.289734+0000 mgr.y (mgr.24461) 521 : cluster [DBG] pgmap v694: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T00:42:58.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:58 smithi080 bash[24237]: cluster 2024-02-13T00:42:57.109695+0000 mon.a (mon.0) 2350 : cluster [DBG] osdmap e374: 8 total, 8 up, 8 in 2024-02-13T00:42:58.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:42:58 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:42:59.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:42:59 smithi106 bash[18459]: cluster 2024-02-13T00:42:58.114500+0000 mon.a (mon.0) 2351 : cluster [DBG] osdmap e375: 8 total, 8 up, 8 in 2024-02-13T00:42:59.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:42:59 smithi080 bash[17386]: cluster 2024-02-13T00:42:58.114500+0000 mon.a (mon.0) 2351 : cluster [DBG] osdmap e375: 8 total, 8 up, 8 in 2024-02-13T00:42:59.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:42:59 smithi080 bash[24237]: cluster 2024-02-13T00:42:58.114500+0000 mon.a (mon.0) 2351 : cluster [DBG] osdmap e375: 8 total, 8 up, 8 in 2024-02-13T00:43:00.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:43:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:43:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:43:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:00 smithi106 bash[18459]: cluster 2024-02-13T00:42:58.290530+0000 mgr.y (mgr.24461) 522 : cluster [DBG] pgmap v697: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-13T00:43:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:00 smithi106 bash[18459]: audit 2024-02-13T00:42:58.378610+0000 mgr.y (mgr.24461) 523 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:43:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:00 smithi106 bash[18459]: cluster 2024-02-13T00:42:59.132887+0000 mon.a (mon.0) 2352 : cluster [DBG] osdmap e376: 8 total, 8 up, 8 in 2024-02-13T00:43:00.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:00 smithi080 bash[17386]: cluster 2024-02-13T00:42:58.290530+0000 mgr.y (mgr.24461) 522 : cluster [DBG] pgmap v697: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-13T00:43:00.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:00 smithi080 bash[17386]: audit 2024-02-13T00:42:58.378610+0000 mgr.y (mgr.24461) 523 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:43:00.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:00 smithi080 bash[17386]: cluster 2024-02-13T00:42:59.132887+0000 mon.a (mon.0) 2352 : cluster [DBG] osdmap e376: 8 total, 8 up, 8 in 2024-02-13T00:43:00.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:00 smithi080 bash[24237]: cluster 2024-02-13T00:42:58.290530+0000 mgr.y (mgr.24461) 522 : cluster [DBG] pgmap v697: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-13T00:43:00.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:00 smithi080 bash[24237]: audit 2024-02-13T00:42:58.378610+0000 mgr.y (mgr.24461) 523 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:43:00.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:00 smithi080 bash[24237]: cluster 2024-02-13T00:42:59.132887+0000 mon.a (mon.0) 2352 : cluster [DBG] osdmap e376: 8 total, 8 up, 8 in 2024-02-13T00:43:01.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:01 smithi106 bash[18459]: cluster 2024-02-13T00:43:00.145561+0000 mon.a (mon.0) 2353 : cluster [DBG] osdmap e377: 8 total, 8 up, 8 in 2024-02-13T00:43:01.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:01 smithi080 bash[17386]: cluster 2024-02-13T00:43:00.145561+0000 mon.a (mon.0) 2353 : cluster [DBG] osdmap e377: 8 total, 8 up, 8 in 2024-02-13T00:43:01.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:01 smithi080 bash[24237]: cluster 2024-02-13T00:43:00.145561+0000 mon.a (mon.0) 2353 : cluster [DBG] osdmap e377: 8 total, 8 up, 8 in 2024-02-13T00:43:02.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:02 smithi106 bash[18459]: cluster 2024-02-13T00:43:00.291401+0000 mgr.y (mgr.24461) 524 : cluster [DBG] pgmap v700: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-13T00:43:02.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:02 smithi106 bash[18459]: audit 2024-02-13T00:43:01.140784+0000 mon.c (mon.2) 367 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:43:02.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:02 smithi106 bash[18459]: audit 2024-02-13T00:43:01.422548+0000 mon.a (mon.0) 2354 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:43:02.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:02 smithi080 bash[17386]: cluster 2024-02-13T00:43:00.291401+0000 mgr.y (mgr.24461) 524 : cluster [DBG] pgmap v700: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-13T00:43:02.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:02 smithi080 bash[17386]: audit 2024-02-13T00:43:01.140784+0000 mon.c (mon.2) 367 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:43:02.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:02 smithi080 bash[17386]: audit 2024-02-13T00:43:01.422548+0000 mon.a (mon.0) 2354 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:43:02.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:02 smithi080 bash[24237]: cluster 2024-02-13T00:43:00.291401+0000 mgr.y (mgr.24461) 524 : cluster [DBG] pgmap v700: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-13T00:43:02.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:02 smithi080 bash[24237]: audit 2024-02-13T00:43:01.140784+0000 mon.c (mon.2) 367 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:43:02.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:02 smithi080 bash[24237]: audit 2024-02-13T00:43:01.422548+0000 mon.a (mon.0) 2354 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:43:03.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:43:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:43:03] "GET /metrics HTTP/1.1" 200 187687 "" "Prometheus/2.33.4" 2024-02-13T00:43:04.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:04 smithi106 bash[18459]: cluster 2024-02-13T00:43:02.292305+0000 mgr.y (mgr.24461) 525 : cluster [DBG] pgmap v701: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-02-13T00:43:04.507 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:04 smithi080 bash[24237]: cluster 2024-02-13T00:43:02.292305+0000 mgr.y (mgr.24461) 525 : cluster [DBG] pgmap v701: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-02-13T00:43:04.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:04 smithi080 bash[17386]: cluster 2024-02-13T00:43:02.292305+0000 mgr.y (mgr.24461) 525 : cluster [DBG] pgmap v701: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-02-13T00:43:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:06 smithi106 bash[18459]: cluster 2024-02-13T00:43:04.294504+0000 mgr.y (mgr.24461) 526 : cluster [DBG] pgmap v702: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.8 KiB/s rd, 662 B/s wr, 2 op/s 2024-02-13T00:43:06.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:06 smithi080 bash[17386]: cluster 2024-02-13T00:43:04.294504+0000 mgr.y (mgr.24461) 526 : cluster [DBG] pgmap v702: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.8 KiB/s rd, 662 B/s wr, 2 op/s 2024-02-13T00:43:06.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:06 smithi080 bash[24237]: cluster 2024-02-13T00:43:04.294504+0000 mgr.y (mgr.24461) 526 : cluster [DBG] pgmap v702: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.8 KiB/s rd, 662 B/s wr, 2 op/s 2024-02-13T00:43:08.392 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:08 smithi106 bash[18459]: cluster 2024-02-13T00:43:06.295375+0000 mgr.y (mgr.24461) 527 : cluster [DBG] pgmap v703: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T00:43:08.393 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:08 smithi106 bash[18459]: audit 2024-02-13T00:43:07.129669+0000 mon.a (mon.0) 2355 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:43:08.393 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:08 smithi106 bash[18459]: audit 2024-02-13T00:43:07.408117+0000 mon.c (mon.2) 368 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:43:08.393 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:08 smithi106 bash[18459]: audit 2024-02-13T00:43:07.410004+0000 mon.c (mon.2) 369 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:43:08.393 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:08 smithi106 bash[18459]: audit 2024-02-13T00:43:07.418886+0000 mon.a (mon.0) 2356 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:43:08.393 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:08 smithi106 bash[18459]: cluster 2024-02-13T00:43:07.429221+0000 mon.a (mon.0) 2357 : cluster [DBG] osdmap e378: 8 total, 8 up, 8 in 2024-02-13T00:43:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:08 smithi080 bash[24237]: cluster 2024-02-13T00:43:06.295375+0000 mgr.y (mgr.24461) 527 : cluster [DBG] pgmap v703: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T00:43:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:08 smithi080 bash[24237]: audit 2024-02-13T00:43:07.129669+0000 mon.a (mon.0) 2355 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:43:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:08 smithi080 bash[24237]: audit 2024-02-13T00:43:07.408117+0000 mon.c (mon.2) 368 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:43:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:08 smithi080 bash[24237]: audit 2024-02-13T00:43:07.410004+0000 mon.c (mon.2) 369 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:43:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:08 smithi080 bash[24237]: audit 2024-02-13T00:43:07.418886+0000 mon.a (mon.0) 2356 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:43:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:08 smithi080 bash[24237]: cluster 2024-02-13T00:43:07.429221+0000 mon.a (mon.0) 2357 : cluster [DBG] osdmap e378: 8 total, 8 up, 8 in 2024-02-13T00:43:08.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:08 smithi080 bash[17386]: cluster 2024-02-13T00:43:06.295375+0000 mgr.y (mgr.24461) 527 : cluster [DBG] pgmap v703: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T00:43:08.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:08 smithi080 bash[17386]: audit 2024-02-13T00:43:07.129669+0000 mon.a (mon.0) 2355 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:43:08.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:08 smithi080 bash[17386]: audit 2024-02-13T00:43:07.408117+0000 mon.c (mon.2) 368 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:43:08.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:08 smithi080 bash[17386]: audit 2024-02-13T00:43:07.410004+0000 mon.c (mon.2) 369 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:43:08.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:08 smithi080 bash[17386]: audit 2024-02-13T00:43:07.418886+0000 mon.a (mon.0) 2356 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:43:08.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:08 smithi080 bash[17386]: cluster 2024-02-13T00:43:07.429221+0000 mon.a (mon.0) 2357 : cluster [DBG] osdmap e378: 8 total, 8 up, 8 in 2024-02-13T00:43:08.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:43:08 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:43:10.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:43:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:43:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:43:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:10 smithi106 bash[18459]: cluster 2024-02-13T00:43:08.297577+0000 mgr.y (mgr.24461) 528 : cluster [DBG] pgmap v705: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 502 B/s wr, 2 op/s 2024-02-13T00:43:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:10 smithi106 bash[18459]: audit 2024-02-13T00:43:08.389511+0000 mgr.y (mgr.24461) 529 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:43:10.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:10 smithi080 bash[17386]: cluster 2024-02-13T00:43:08.297577+0000 mgr.y (mgr.24461) 528 : cluster [DBG] pgmap v705: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 502 B/s wr, 2 op/s 2024-02-13T00:43:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:10 smithi080 bash[17386]: audit 2024-02-13T00:43:08.389511+0000 mgr.y (mgr.24461) 529 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:43:10.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:10 smithi080 bash[24237]: cluster 2024-02-13T00:43:08.297577+0000 mgr.y (mgr.24461) 528 : cluster [DBG] pgmap v705: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 502 B/s wr, 2 op/s 2024-02-13T00:43:10.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:10 smithi080 bash[24237]: audit 2024-02-13T00:43:08.389511+0000 mgr.y (mgr.24461) 529 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:43:12.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:12 smithi106 bash[18459]: cluster 2024-02-13T00:43:10.298432+0000 mgr.y (mgr.24461) 530 : cluster [DBG] pgmap v706: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 409 B/s wr, 2 op/s 2024-02-13T00:43:12.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:12 smithi106 bash[18459]: cluster 2024-02-13T00:43:11.150444+0000 mon.a (mon.0) 2358 : cluster [DBG] osdmap e379: 8 total, 8 up, 8 in 2024-02-13T00:43:12.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:12 smithi080 bash[17386]: cluster 2024-02-13T00:43:10.298432+0000 mgr.y (mgr.24461) 530 : cluster [DBG] pgmap v706: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 409 B/s wr, 2 op/s 2024-02-13T00:43:12.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:12 smithi080 bash[17386]: cluster 2024-02-13T00:43:11.150444+0000 mon.a (mon.0) 2358 : cluster [DBG] osdmap e379: 8 total, 8 up, 8 in 2024-02-13T00:43:12.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:12 smithi080 bash[24237]: cluster 2024-02-13T00:43:10.298432+0000 mgr.y (mgr.24461) 530 : cluster [DBG] pgmap v706: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 409 B/s wr, 2 op/s 2024-02-13T00:43:12.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:12 smithi080 bash[24237]: cluster 2024-02-13T00:43:11.150444+0000 mon.a (mon.0) 2358 : cluster [DBG] osdmap e379: 8 total, 8 up, 8 in 2024-02-13T00:43:13.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:43:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:43:13] "GET /metrics HTTP/1.1" 200 187687 "" "Prometheus/2.33.4" 2024-02-13T00:43:14.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:14 smithi106 bash[18459]: cluster 2024-02-13T00:43:12.299195+0000 mgr.y (mgr.24461) 531 : cluster [DBG] pgmap v708: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:43:14.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:14 smithi080 bash[17386]: cluster 2024-02-13T00:43:12.299195+0000 mgr.y (mgr.24461) 531 : cluster [DBG] pgmap v708: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:43:14.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:14 smithi080 bash[24237]: cluster 2024-02-13T00:43:12.299195+0000 mgr.y (mgr.24461) 531 : cluster [DBG] pgmap v708: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:43:16.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:16 smithi106 bash[18459]: cluster 2024-02-13T00:43:14.301376+0000 mgr.y (mgr.24461) 532 : cluster [DBG] pgmap v709: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:43:16.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:16 smithi080 bash[17386]: cluster 2024-02-13T00:43:14.301376+0000 mgr.y (mgr.24461) 532 : cluster [DBG] pgmap v709: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:43:16.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:16 smithi080 bash[24237]: cluster 2024-02-13T00:43:14.301376+0000 mgr.y (mgr.24461) 532 : cluster [DBG] pgmap v709: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:43:17.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:17 smithi106 bash[18459]: audit 2024-02-13T00:43:16.730188+0000 mon.c (mon.2) 370 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "62.0", "id": [7, 5]}]: dispatch 2024-02-13T00:43:17.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:17 smithi106 bash[18459]: audit 2024-02-13T00:43:16.731022+0000 mon.a (mon.0) 2359 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "62.0", "id": [7, 5]}]: dispatch 2024-02-13T00:43:17.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:17 smithi080 bash[17386]: audit 2024-02-13T00:43:16.730188+0000 mon.c (mon.2) 370 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "62.0", "id": [7, 5]}]: dispatch 2024-02-13T00:43:17.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:17 smithi080 bash[17386]: audit 2024-02-13T00:43:16.731022+0000 mon.a (mon.0) 2359 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "62.0", "id": [7, 5]}]: dispatch 2024-02-13T00:43:17.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:17 smithi080 bash[24237]: audit 2024-02-13T00:43:16.730188+0000 mon.c (mon.2) 370 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "62.0", "id": [7, 5]}]: dispatch 2024-02-13T00:43:17.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:17 smithi080 bash[24237]: audit 2024-02-13T00:43:16.731022+0000 mon.a (mon.0) 2359 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "62.0", "id": [7, 5]}]: dispatch 2024-02-13T00:43:18.505 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:43:18 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:43:18.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:18 smithi106 bash[18459]: cluster 2024-02-13T00:43:16.302192+0000 mgr.y (mgr.24461) 533 : cluster [DBG] pgmap v710: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:43:18.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:18 smithi106 bash[18459]: audit 2024-02-13T00:43:17.174015+0000 mon.a (mon.0) 2360 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "62.0", "id": [7, 5]}]': finished 2024-02-13T00:43:18.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:18 smithi106 bash[18459]: cluster 2024-02-13T00:43:17.174105+0000 mon.a (mon.0) 2361 : cluster [DBG] osdmap e380: 8 total, 8 up, 8 in 2024-02-13T00:43:18.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:18 smithi106 bash[18459]: cluster 2024-02-13T00:43:17.436430+0000 mon.a (mon.0) 2362 : cluster [DBG] osdmap e381: 8 total, 8 up, 8 in 2024-02-13T00:43:18.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:18 smithi080 bash[24237]: cluster 2024-02-13T00:43:16.302192+0000 mgr.y (mgr.24461) 533 : cluster [DBG] pgmap v710: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:43:18.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:18 smithi080 bash[24237]: audit 2024-02-13T00:43:17.174015+0000 mon.a (mon.0) 2360 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "62.0", "id": [7, 5]}]': finished 2024-02-13T00:43:18.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:18 smithi080 bash[24237]: cluster 2024-02-13T00:43:17.174105+0000 mon.a (mon.0) 2361 : cluster [DBG] osdmap e380: 8 total, 8 up, 8 in 2024-02-13T00:43:18.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:18 smithi080 bash[24237]: cluster 2024-02-13T00:43:17.436430+0000 mon.a (mon.0) 2362 : cluster [DBG] osdmap e381: 8 total, 8 up, 8 in 2024-02-13T00:43:18.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:18 smithi080 bash[17386]: cluster 2024-02-13T00:43:16.302192+0000 mgr.y (mgr.24461) 533 : cluster [DBG] pgmap v710: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:43:18.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:18 smithi080 bash[17386]: audit 2024-02-13T00:43:17.174015+0000 mon.a (mon.0) 2360 : audit [INF] from='mgr.24461 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "62.0", "id": [7, 5]}]': finished 2024-02-13T00:43:18.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:18 smithi080 bash[17386]: cluster 2024-02-13T00:43:17.174105+0000 mon.a (mon.0) 2361 : cluster [DBG] osdmap e380: 8 total, 8 up, 8 in 2024-02-13T00:43:18.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:18 smithi080 bash[17386]: cluster 2024-02-13T00:43:17.436430+0000 mon.a (mon.0) 2362 : cluster [DBG] osdmap e381: 8 total, 8 up, 8 in 2024-02-13T00:43:20.507 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:43:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:43:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:43:20.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:20 smithi106 bash[18459]: cluster 2024-02-13T00:43:18.304291+0000 mgr.y (mgr.24461) 534 : cluster [DBG] pgmap v713: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s; 5 B/s, 1 objects/s recovering 2024-02-13T00:43:20.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:20 smithi106 bash[18459]: audit 2024-02-13T00:43:18.400757+0000 mgr.y (mgr.24461) 535 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:43:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:20 smithi080 bash[17386]: cluster 2024-02-13T00:43:18.304291+0000 mgr.y (mgr.24461) 534 : cluster [DBG] pgmap v713: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s; 5 B/s, 1 objects/s recovering 2024-02-13T00:43:20.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:20 smithi080 bash[17386]: audit 2024-02-13T00:43:18.400757+0000 mgr.y (mgr.24461) 535 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:43:20.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:20 smithi080 bash[24237]: cluster 2024-02-13T00:43:18.304291+0000 mgr.y (mgr.24461) 534 : cluster [DBG] pgmap v713: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s; 5 B/s, 1 objects/s recovering 2024-02-13T00:43:20.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:20 smithi080 bash[24237]: audit 2024-02-13T00:43:18.400757+0000 mgr.y (mgr.24461) 535 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:43:22.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:22 smithi106 bash[18459]: cluster 2024-02-13T00:43:20.305048+0000 mgr.y (mgr.24461) 536 : cluster [DBG] pgmap v714: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s; 4 B/s, 1 objects/s recovering 2024-02-13T00:43:22.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:22 smithi106 bash[18459]: cluster 2024-02-13T00:43:21.189635+0000 mon.a (mon.0) 2363 : cluster [DBG] osdmap e382: 8 total, 8 up, 8 in 2024-02-13T00:43:22.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:22 smithi080 bash[17386]: cluster 2024-02-13T00:43:20.305048+0000 mgr.y (mgr.24461) 536 : cluster [DBG] pgmap v714: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s; 4 B/s, 1 objects/s recovering 2024-02-13T00:43:22.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:22 smithi080 bash[17386]: cluster 2024-02-13T00:43:21.189635+0000 mon.a (mon.0) 2363 : cluster [DBG] osdmap e382: 8 total, 8 up, 8 in 2024-02-13T00:43:22.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:22 smithi080 bash[24237]: cluster 2024-02-13T00:43:20.305048+0000 mgr.y (mgr.24461) 536 : cluster [DBG] pgmap v714: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s; 4 B/s, 1 objects/s recovering 2024-02-13T00:43:22.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:22 smithi080 bash[24237]: cluster 2024-02-13T00:43:21.189635+0000 mon.a (mon.0) 2363 : cluster [DBG] osdmap e382: 8 total, 8 up, 8 in 2024-02-13T00:43:23.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:43:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:43:23] "GET /metrics HTTP/1.1" 200 187692 "" "Prometheus/2.33.4" 2024-02-13T00:43:24.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:24 smithi106 bash[18459]: cluster 2024-02-13T00:43:22.305791+0000 mgr.y (mgr.24461) 537 : cluster [DBG] pgmap v716: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 6 B/s, 1 objects/s recovering 2024-02-13T00:43:24.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:24 smithi080 bash[17386]: cluster 2024-02-13T00:43:22.305791+0000 mgr.y (mgr.24461) 537 : cluster [DBG] pgmap v716: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 6 B/s, 1 objects/s recovering 2024-02-13T00:43:24.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:24 smithi080 bash[24237]: cluster 2024-02-13T00:43:22.305791+0000 mgr.y (mgr.24461) 537 : cluster [DBG] pgmap v716: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 6 B/s, 1 objects/s recovering 2024-02-13T00:43:26.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:26 smithi106 bash[18459]: cluster 2024-02-13T00:43:24.307675+0000 mgr.y (mgr.24461) 538 : cluster [DBG] pgmap v717: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 5 B/s, 1 objects/s recovering 2024-02-13T00:43:26.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:26 smithi080 bash[17386]: cluster 2024-02-13T00:43:24.307675+0000 mgr.y (mgr.24461) 538 : cluster [DBG] pgmap v717: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 5 B/s, 1 objects/s recovering 2024-02-13T00:43:26.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:26 smithi080 bash[24237]: cluster 2024-02-13T00:43:24.307675+0000 mgr.y (mgr.24461) 538 : cluster [DBG] pgmap v717: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 5 B/s, 1 objects/s recovering 2024-02-13T00:43:28.505 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:43:28 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:43:28.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:28 smithi106 bash[18459]: cluster 2024-02-13T00:43:26.308525+0000 mgr.y (mgr.24461) 539 : cluster [DBG] pgmap v718: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 op/s; 4 B/s, 1 objects/s recovering 2024-02-13T00:43:28.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:28 smithi106 bash[18459]: cluster 2024-02-13T00:43:27.438658+0000 mon.a (mon.0) 2364 : cluster [DBG] osdmap e383: 8 total, 8 up, 8 in 2024-02-13T00:43:28.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:28 smithi080 bash[17386]: cluster 2024-02-13T00:43:26.308525+0000 mgr.y (mgr.24461) 539 : cluster [DBG] pgmap v718: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 op/s; 4 B/s, 1 objects/s recovering 2024-02-13T00:43:28.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:28 smithi080 bash[17386]: cluster 2024-02-13T00:43:27.438658+0000 mon.a (mon.0) 2364 : cluster [DBG] osdmap e383: 8 total, 8 up, 8 in 2024-02-13T00:43:28.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:28 smithi080 bash[24237]: cluster 2024-02-13T00:43:26.308525+0000 mgr.y (mgr.24461) 539 : cluster [DBG] pgmap v718: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 op/s; 4 B/s, 1 objects/s recovering 2024-02-13T00:43:28.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:28 smithi080 bash[24237]: cluster 2024-02-13T00:43:27.438658+0000 mon.a (mon.0) 2364 : cluster [DBG] osdmap e383: 8 total, 8 up, 8 in 2024-02-13T00:43:30.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:43:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:43:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:43:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:30 smithi106 bash[18459]: cluster 2024-02-13T00:43:28.310584+0000 mgr.y (mgr.24461) 540 : cluster [DBG] pgmap v720: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-13T00:43:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:30 smithi106 bash[18459]: audit 2024-02-13T00:43:28.409807+0000 mgr.y (mgr.24461) 541 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:43:30.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:30 smithi080 bash[17386]: cluster 2024-02-13T00:43:28.310584+0000 mgr.y (mgr.24461) 540 : cluster [DBG] pgmap v720: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-13T00:43:30.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:30 smithi080 bash[17386]: audit 2024-02-13T00:43:28.409807+0000 mgr.y (mgr.24461) 541 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:43:30.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:30 smithi080 bash[24237]: cluster 2024-02-13T00:43:28.310584+0000 mgr.y (mgr.24461) 540 : cluster [DBG] pgmap v720: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-13T00:43:30.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:30 smithi080 bash[24237]: audit 2024-02-13T00:43:28.409807+0000 mgr.y (mgr.24461) 541 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:43:33.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:32 smithi106 bash[18459]: cluster 2024-02-13T00:43:30.311406+0000 mgr.y (mgr.24461) 542 : cluster [DBG] pgmap v721: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:43:33.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:32 smithi106 bash[18459]: audit 2024-02-13T00:43:31.223857+0000 mon.a (mon.0) 2365 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:43:33.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:32 smithi106 bash[18459]: audit 2024-02-13T00:43:31.224448+0000 mon.a (mon.0) 2366 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-61"}]: dispatch 2024-02-13T00:43:33.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:32 smithi080 bash[17386]: cluster 2024-02-13T00:43:30.311406+0000 mgr.y (mgr.24461) 542 : cluster [DBG] pgmap v721: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:43:33.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:32 smithi080 bash[17386]: audit 2024-02-13T00:43:31.223857+0000 mon.a (mon.0) 2365 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:43:33.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:32 smithi080 bash[17386]: audit 2024-02-13T00:43:31.224448+0000 mon.a (mon.0) 2366 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-61"}]: dispatch 2024-02-13T00:43:33.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:32 smithi080 bash[24237]: cluster 2024-02-13T00:43:30.311406+0000 mgr.y (mgr.24461) 542 : cluster [DBG] pgmap v721: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:43:33.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:32 smithi080 bash[24237]: audit 2024-02-13T00:43:31.223857+0000 mon.a (mon.0) 2365 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:43:33.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:32 smithi080 bash[24237]: audit 2024-02-13T00:43:31.224448+0000 mon.a (mon.0) 2366 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-61"}]: dispatch 2024-02-13T00:43:33.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:43:33 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:43:33] "GET /metrics HTTP/1.1" 200 187692 "" "Prometheus/2.33.4" 2024-02-13T00:43:34.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:33 smithi106 bash[18459]: cluster 2024-02-13T00:43:32.225117+0000 mon.a (mon.0) 2367 : cluster [DBG] osdmap e384: 8 total, 8 up, 8 in 2024-02-13T00:43:34.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:33 smithi106 bash[18459]: cluster 2024-02-13T00:43:32.312111+0000 mgr.y (mgr.24461) 543 : cluster [DBG] pgmap v723: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:43:34.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:33 smithi106 bash[18459]: cluster 2024-02-13T00:43:33.229543+0000 mon.a (mon.0) 2368 : cluster [DBG] osdmap e385: 8 total, 8 up, 8 in 2024-02-13T00:43:34.008 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:33 smithi106 bash[18459]: audit 2024-02-13T00:43:33.231749+0000 mon.a (mon.0) 2369 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:43:34.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:33 smithi080 bash[17386]: cluster 2024-02-13T00:43:32.225117+0000 mon.a (mon.0) 2367 : cluster [DBG] osdmap e384: 8 total, 8 up, 8 in 2024-02-13T00:43:34.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:33 smithi080 bash[17386]: cluster 2024-02-13T00:43:32.312111+0000 mgr.y (mgr.24461) 543 : cluster [DBG] pgmap v723: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:43:34.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:33 smithi080 bash[17386]: cluster 2024-02-13T00:43:33.229543+0000 mon.a (mon.0) 2368 : cluster [DBG] osdmap e385: 8 total, 8 up, 8 in 2024-02-13T00:43:34.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:33 smithi080 bash[17386]: audit 2024-02-13T00:43:33.231749+0000 mon.a (mon.0) 2369 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:43:34.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:33 smithi080 bash[24237]: cluster 2024-02-13T00:43:32.225117+0000 mon.a (mon.0) 2367 : cluster [DBG] osdmap e384: 8 total, 8 up, 8 in 2024-02-13T00:43:34.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:33 smithi080 bash[24237]: cluster 2024-02-13T00:43:32.312111+0000 mgr.y (mgr.24461) 543 : cluster [DBG] pgmap v723: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:43:34.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:33 smithi080 bash[24237]: cluster 2024-02-13T00:43:33.229543+0000 mon.a (mon.0) 2368 : cluster [DBG] osdmap e385: 8 total, 8 up, 8 in 2024-02-13T00:43:34.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:33 smithi080 bash[24237]: audit 2024-02-13T00:43:33.231749+0000 mon.a (mon.0) 2369 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:43:35.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:35 smithi106 bash[18459]: audit 2024-02-13T00:43:34.232543+0000 mon.a (mon.0) 2370 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:43:35.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:35 smithi106 bash[18459]: cluster 2024-02-13T00:43:34.233206+0000 mon.a (mon.0) 2371 : cluster [DBG] osdmap e386: 8 total, 8 up, 8 in 2024-02-13T00:43:35.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:35 smithi106 bash[18459]: audit 2024-02-13T00:43:34.235880+0000 mon.a (mon.0) 2372 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:43:35.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:35 smithi106 bash[18459]: audit 2024-02-13T00:43:34.239992+0000 mon.a (mon.0) 2373 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:43:35.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:35 smithi106 bash[18459]: cluster 2024-02-13T00:43:34.312939+0000 mgr.y (mgr.24461) 544 : cluster [DBG] pgmap v726: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:43:35.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:35 smithi080 bash[17386]: audit 2024-02-13T00:43:34.232543+0000 mon.a (mon.0) 2370 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:43:35.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:35 smithi080 bash[17386]: cluster 2024-02-13T00:43:34.233206+0000 mon.a (mon.0) 2371 : cluster [DBG] osdmap e386: 8 total, 8 up, 8 in 2024-02-13T00:43:35.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:35 smithi080 bash[17386]: audit 2024-02-13T00:43:34.235880+0000 mon.a (mon.0) 2372 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:43:35.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:35 smithi080 bash[17386]: audit 2024-02-13T00:43:34.239992+0000 mon.a (mon.0) 2373 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:43:35.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:35 smithi080 bash[17386]: cluster 2024-02-13T00:43:34.312939+0000 mgr.y (mgr.24461) 544 : cluster [DBG] pgmap v726: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:43:35.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:35 smithi080 bash[24237]: audit 2024-02-13T00:43:34.232543+0000 mon.a (mon.0) 2370 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:43:35.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:35 smithi080 bash[24237]: cluster 2024-02-13T00:43:34.233206+0000 mon.a (mon.0) 2371 : cluster [DBG] osdmap e386: 8 total, 8 up, 8 in 2024-02-13T00:43:35.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:35 smithi080 bash[24237]: audit 2024-02-13T00:43:34.235880+0000 mon.a (mon.0) 2372 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:43:35.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:35 smithi080 bash[24237]: audit 2024-02-13T00:43:34.239992+0000 mon.a (mon.0) 2373 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:43:35.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:35 smithi080 bash[24237]: cluster 2024-02-13T00:43:34.312939+0000 mgr.y (mgr.24461) 544 : cluster [DBG] pgmap v726: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:43:36.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:36 smithi106 bash[18459]: audit 2024-02-13T00:43:35.241071+0000 mon.a (mon.0) 2374 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:43:36.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:36 smithi106 bash[18459]: cluster 2024-02-13T00:43:35.241155+0000 mon.a (mon.0) 2375 : cluster [DBG] osdmap e387: 8 total, 8 up, 8 in 2024-02-13T00:43:36.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:36 smithi080 bash[17386]: audit 2024-02-13T00:43:35.241071+0000 mon.a (mon.0) 2374 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:43:36.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:36 smithi080 bash[17386]: cluster 2024-02-13T00:43:35.241155+0000 mon.a (mon.0) 2375 : cluster [DBG] osdmap e387: 8 total, 8 up, 8 in 2024-02-13T00:43:36.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:36 smithi080 bash[24237]: audit 2024-02-13T00:43:35.241071+0000 mon.a (mon.0) 2374 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:43:36.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:36 smithi080 bash[24237]: cluster 2024-02-13T00:43:35.241155+0000 mon.a (mon.0) 2375 : cluster [DBG] osdmap e387: 8 total, 8 up, 8 in 2024-02-13T00:43:37.261 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:37 smithi106 bash[18459]: cluster 2024-02-13T00:43:36.254280+0000 mon.a (mon.0) 2376 : cluster [DBG] osdmap e388: 8 total, 8 up, 8 in 2024-02-13T00:43:37.261 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:37 smithi106 bash[18459]: cluster 2024-02-13T00:43:36.313763+0000 mgr.y (mgr.24461) 545 : cluster [DBG] pgmap v729: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:43:37.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:37 smithi080 bash[17386]: cluster 2024-02-13T00:43:36.254280+0000 mon.a (mon.0) 2376 : cluster [DBG] osdmap e388: 8 total, 8 up, 8 in 2024-02-13T00:43:37.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:37 smithi080 bash[17386]: cluster 2024-02-13T00:43:36.313763+0000 mgr.y (mgr.24461) 545 : cluster [DBG] pgmap v729: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:43:37.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:37 smithi080 bash[24237]: cluster 2024-02-13T00:43:36.254280+0000 mon.a (mon.0) 2376 : cluster [DBG] osdmap e388: 8 total, 8 up, 8 in 2024-02-13T00:43:37.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:37 smithi080 bash[24237]: cluster 2024-02-13T00:43:36.313763+0000 mgr.y (mgr.24461) 545 : cluster [DBG] pgmap v729: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:43:38.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:38 smithi106 bash[18459]: cluster 2024-02-13T00:43:37.260732+0000 mon.a (mon.0) 2377 : cluster [DBG] osdmap e389: 8 total, 8 up, 8 in 2024-02-13T00:43:38.756 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:43:38 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:43:38.757 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:38 smithi080 bash[17386]: cluster 2024-02-13T00:43:37.260732+0000 mon.a (mon.0) 2377 : cluster [DBG] osdmap e389: 8 total, 8 up, 8 in 2024-02-13T00:43:38.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:38 smithi080 bash[24237]: cluster 2024-02-13T00:43:37.260732+0000 mon.a (mon.0) 2377 : cluster [DBG] osdmap e389: 8 total, 8 up, 8 in 2024-02-13T00:43:39.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:39 smithi106 bash[18459]: cluster 2024-02-13T00:43:38.264333+0000 mon.a (mon.0) 2378 : cluster [DBG] osdmap e390: 8 total, 8 up, 8 in 2024-02-13T00:43:39.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:39 smithi106 bash[18459]: cluster 2024-02-13T00:43:38.314545+0000 mgr.y (mgr.24461) 546 : cluster [DBG] pgmap v732: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-02-13T00:43:39.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:39 smithi106 bash[18459]: audit 2024-02-13T00:43:38.413807+0000 mgr.y (mgr.24461) 547 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:43:39.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:39 smithi080 bash[17386]: cluster 2024-02-13T00:43:38.264333+0000 mon.a (mon.0) 2378 : cluster [DBG] osdmap e390: 8 total, 8 up, 8 in 2024-02-13T00:43:39.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:39 smithi080 bash[17386]: cluster 2024-02-13T00:43:38.314545+0000 mgr.y (mgr.24461) 546 : cluster [DBG] pgmap v732: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-02-13T00:43:39.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:39 smithi080 bash[17386]: audit 2024-02-13T00:43:38.413807+0000 mgr.y (mgr.24461) 547 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:43:39.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:39 smithi080 bash[24237]: cluster 2024-02-13T00:43:38.264333+0000 mon.a (mon.0) 2378 : cluster [DBG] osdmap e390: 8 total, 8 up, 8 in 2024-02-13T00:43:39.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:39 smithi080 bash[24237]: cluster 2024-02-13T00:43:38.314545+0000 mgr.y (mgr.24461) 546 : cluster [DBG] pgmap v732: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-02-13T00:43:39.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:39 smithi080 bash[24237]: audit 2024-02-13T00:43:38.413807+0000 mgr.y (mgr.24461) 547 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:43:40.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:43:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:43:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:43:41.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:41 smithi106 bash[18459]: cluster 2024-02-13T00:43:40.315368+0000 mgr.y (mgr.24461) 548 : cluster [DBG] pgmap v733: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-02-13T00:43:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:41 smithi080 bash[17386]: cluster 2024-02-13T00:43:40.315368+0000 mgr.y (mgr.24461) 548 : cluster [DBG] pgmap v733: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-02-13T00:43:41.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:41 smithi080 bash[24237]: cluster 2024-02-13T00:43:40.315368+0000 mgr.y (mgr.24461) 548 : cluster [DBG] pgmap v733: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-02-13T00:43:43.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:43:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:43:43] "GET /metrics HTTP/1.1" 200 187692 "" "Prometheus/2.33.4" 2024-02-13T00:43:44.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:43 smithi106 bash[18459]: cluster 2024-02-13T00:43:42.316184+0000 mgr.y (mgr.24461) 549 : cluster [DBG] pgmap v734: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-02-13T00:43:44.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:43 smithi080 bash[17386]: cluster 2024-02-13T00:43:42.316184+0000 mgr.y (mgr.24461) 549 : cluster [DBG] pgmap v734: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-02-13T00:43:44.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:43 smithi080 bash[24237]: cluster 2024-02-13T00:43:42.316184+0000 mgr.y (mgr.24461) 549 : cluster [DBG] pgmap v734: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-02-13T00:43:46.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:45 smithi106 bash[18459]: cluster 2024-02-13T00:43:44.318248+0000 mgr.y (mgr.24461) 550 : cluster [DBG] pgmap v735: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-02-13T00:43:46.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:45 smithi080 bash[17386]: cluster 2024-02-13T00:43:44.318248+0000 mgr.y (mgr.24461) 550 : cluster [DBG] pgmap v735: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-02-13T00:43:46.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:45 smithi080 bash[24237]: cluster 2024-02-13T00:43:44.318248+0000 mgr.y (mgr.24461) 550 : cluster [DBG] pgmap v735: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-02-13T00:43:48.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:47 smithi106 bash[18459]: cluster 2024-02-13T00:43:46.319061+0000 mgr.y (mgr.24461) 551 : cluster [DBG] pgmap v736: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-02-13T00:43:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:47 smithi106 bash[18459]: cluster 2024-02-13T00:43:47.701965+0000 mon.a (mon.0) 2379 : cluster [DBG] osdmap e391: 8 total, 8 up, 8 in 2024-02-13T00:43:48.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:47 smithi080 bash[17386]: cluster 2024-02-13T00:43:46.319061+0000 mgr.y (mgr.24461) 551 : cluster [DBG] pgmap v736: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-02-13T00:43:48.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:47 smithi080 bash[17386]: cluster 2024-02-13T00:43:47.701965+0000 mon.a (mon.0) 2379 : cluster [DBG] osdmap e391: 8 total, 8 up, 8 in 2024-02-13T00:43:48.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:47 smithi080 bash[24237]: cluster 2024-02-13T00:43:46.319061+0000 mgr.y (mgr.24461) 551 : cluster [DBG] pgmap v736: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-02-13T00:43:48.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:47 smithi080 bash[24237]: cluster 2024-02-13T00:43:47.701965+0000 mon.a (mon.0) 2379 : cluster [DBG] osdmap e391: 8 total, 8 up, 8 in 2024-02-13T00:43:48.718 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:43:48 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:43:49.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:48 smithi106 bash[18459]: audit 2024-02-13T00:43:48.307405+0000 mon.a (mon.0) 2380 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:43:49.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:48 smithi106 bash[18459]: audit 2024-02-13T00:43:48.308024+0000 mon.a (mon.0) 2381 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-63"}]: dispatch 2024-02-13T00:43:49.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:48 smithi080 bash[17386]: audit 2024-02-13T00:43:48.307405+0000 mon.a (mon.0) 2380 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:43:49.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:48 smithi080 bash[17386]: audit 2024-02-13T00:43:48.308024+0000 mon.a (mon.0) 2381 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-63"}]: dispatch 2024-02-13T00:43:49.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:48 smithi080 bash[24237]: audit 2024-02-13T00:43:48.307405+0000 mon.a (mon.0) 2380 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:43:49.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:48 smithi080 bash[24237]: audit 2024-02-13T00:43:48.308024+0000 mon.a (mon.0) 2381 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-63"}]: dispatch 2024-02-13T00:43:50.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:49 smithi106 bash[18459]: cluster 2024-02-13T00:43:48.320829+0000 mgr.y (mgr.24461) 552 : cluster [DBG] pgmap v738: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:43:50.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:49 smithi106 bash[18459]: audit 2024-02-13T00:43:48.421799+0000 mgr.y (mgr.24461) 553 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:43:50.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:49 smithi106 bash[18459]: cluster 2024-02-13T00:43:48.725930+0000 mon.a (mon.0) 2382 : cluster [DBG] osdmap e392: 8 total, 8 up, 8 in 2024-02-13T00:43:50.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:49 smithi080 bash[17386]: cluster 2024-02-13T00:43:48.320829+0000 mgr.y (mgr.24461) 552 : cluster [DBG] pgmap v738: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:43:50.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:49 smithi080 bash[17386]: audit 2024-02-13T00:43:48.421799+0000 mgr.y (mgr.24461) 553 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:43:50.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:49 smithi080 bash[17386]: cluster 2024-02-13T00:43:48.725930+0000 mon.a (mon.0) 2382 : cluster [DBG] osdmap e392: 8 total, 8 up, 8 in 2024-02-13T00:43:50.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:49 smithi080 bash[24237]: cluster 2024-02-13T00:43:48.320829+0000 mgr.y (mgr.24461) 552 : cluster [DBG] pgmap v738: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:43:50.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:49 smithi080 bash[24237]: audit 2024-02-13T00:43:48.421799+0000 mgr.y (mgr.24461) 553 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:43:50.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:49 smithi080 bash[24237]: cluster 2024-02-13T00:43:48.725930+0000 mon.a (mon.0) 2382 : cluster [DBG] osdmap e392: 8 total, 8 up, 8 in 2024-02-13T00:43:50.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:43:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:43:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:43:51.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:50 smithi080 bash[17386]: cluster 2024-02-13T00:43:49.736848+0000 mon.a (mon.0) 2383 : cluster [DBG] osdmap e393: 8 total, 8 up, 8 in 2024-02-13T00:43:51.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:50 smithi080 bash[17386]: audit 2024-02-13T00:43:49.739495+0000 mon.a (mon.0) 2384 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:43:51.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:50 smithi080 bash[24237]: cluster 2024-02-13T00:43:49.736848+0000 mon.a (mon.0) 2383 : cluster [DBG] osdmap e393: 8 total, 8 up, 8 in 2024-02-13T00:43:51.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:50 smithi080 bash[24237]: audit 2024-02-13T00:43:49.739495+0000 mon.a (mon.0) 2384 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:43:51.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:50 smithi106 bash[18459]: cluster 2024-02-13T00:43:49.736848+0000 mon.a (mon.0) 2383 : cluster [DBG] osdmap e393: 8 total, 8 up, 8 in 2024-02-13T00:43:51.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:50 smithi106 bash[18459]: audit 2024-02-13T00:43:49.739495+0000 mon.a (mon.0) 2384 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:43:52.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:51 smithi106 bash[18459]: cluster 2024-02-13T00:43:50.321610+0000 mgr.y (mgr.24461) 554 : cluster [DBG] pgmap v741: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:43:52.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:51 smithi106 bash[18459]: audit 2024-02-13T00:43:50.743361+0000 mon.a (mon.0) 2385 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:43:52.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:51 smithi106 bash[18459]: cluster 2024-02-13T00:43:50.743769+0000 mon.a (mon.0) 2386 : cluster [DBG] osdmap e394: 8 total, 8 up, 8 in 2024-02-13T00:43:52.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:51 smithi106 bash[18459]: audit 2024-02-13T00:43:50.746324+0000 mon.a (mon.0) 2387 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:43:52.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:51 smithi080 bash[17386]: cluster 2024-02-13T00:43:50.321610+0000 mgr.y (mgr.24461) 554 : cluster [DBG] pgmap v741: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:43:52.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:51 smithi080 bash[17386]: audit 2024-02-13T00:43:50.743361+0000 mon.a (mon.0) 2385 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:43:52.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:51 smithi080 bash[17386]: cluster 2024-02-13T00:43:50.743769+0000 mon.a (mon.0) 2386 : cluster [DBG] osdmap e394: 8 total, 8 up, 8 in 2024-02-13T00:43:52.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:51 smithi080 bash[17386]: audit 2024-02-13T00:43:50.746324+0000 mon.a (mon.0) 2387 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:43:52.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:51 smithi080 bash[24237]: cluster 2024-02-13T00:43:50.321610+0000 mgr.y (mgr.24461) 554 : cluster [DBG] pgmap v741: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:43:52.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:51 smithi080 bash[24237]: audit 2024-02-13T00:43:50.743361+0000 mon.a (mon.0) 2385 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:43:52.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:51 smithi080 bash[24237]: cluster 2024-02-13T00:43:50.743769+0000 mon.a (mon.0) 2386 : cluster [DBG] osdmap e394: 8 total, 8 up, 8 in 2024-02-13T00:43:52.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:51 smithi080 bash[24237]: audit 2024-02-13T00:43:50.746324+0000 mon.a (mon.0) 2387 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:43:53.116 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:52 smithi080 bash[17386]: cluster 2024-02-13T00:43:51.757529+0000 mon.a (mon.0) 2388 : cluster [DBG] osdmap e395: 8 total, 8 up, 8 in 2024-02-13T00:43:53.116 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:52 smithi080 bash[17386]: audit 2024-02-13T00:43:51.807500+0000 mon.a (mon.0) 2389 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:43:53.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:52 smithi080 bash[17386]: audit 2024-02-13T00:43:51.808302+0000 mon.a (mon.0) 2390 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-65"}]: dispatch 2024-02-13T00:43:53.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:52 smithi080 bash[24237]: cluster 2024-02-13T00:43:51.757529+0000 mon.a (mon.0) 2388 : cluster [DBG] osdmap e395: 8 total, 8 up, 8 in 2024-02-13T00:43:53.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:52 smithi080 bash[24237]: audit 2024-02-13T00:43:51.807500+0000 mon.a (mon.0) 2389 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:43:53.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:52 smithi080 bash[24237]: audit 2024-02-13T00:43:51.808302+0000 mon.a (mon.0) 2390 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-65"}]: dispatch 2024-02-13T00:43:53.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:52 smithi106 bash[18459]: cluster 2024-02-13T00:43:51.757529+0000 mon.a (mon.0) 2388 : cluster [DBG] osdmap e395: 8 total, 8 up, 8 in 2024-02-13T00:43:53.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:52 smithi106 bash[18459]: audit 2024-02-13T00:43:51.807500+0000 mon.a (mon.0) 2389 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:43:53.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:52 smithi106 bash[18459]: audit 2024-02-13T00:43:51.808302+0000 mon.a (mon.0) 2390 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-65"}]: dispatch 2024-02-13T00:43:53.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:43:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:43:53] "GET /metrics HTTP/1.1" 200 187811 "" "Prometheus/2.33.4" 2024-02-13T00:43:54.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:53 smithi106 bash[18459]: cluster 2024-02-13T00:43:52.322364+0000 mgr.y (mgr.24461) 555 : cluster [DBG] pgmap v744: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:43:54.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:53 smithi106 bash[18459]: cluster 2024-02-13T00:43:52.774643+0000 mon.a (mon.0) 2391 : cluster [DBG] osdmap e396: 8 total, 8 up, 8 in 2024-02-13T00:43:54.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:53 smithi080 bash[17386]: cluster 2024-02-13T00:43:52.322364+0000 mgr.y (mgr.24461) 555 : cluster [DBG] pgmap v744: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:43:54.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:53 smithi080 bash[17386]: cluster 2024-02-13T00:43:52.774643+0000 mon.a (mon.0) 2391 : cluster [DBG] osdmap e396: 8 total, 8 up, 8 in 2024-02-13T00:43:54.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:53 smithi080 bash[24237]: cluster 2024-02-13T00:43:52.322364+0000 mgr.y (mgr.24461) 555 : cluster [DBG] pgmap v744: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:43:54.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:53 smithi080 bash[24237]: cluster 2024-02-13T00:43:52.774643+0000 mon.a (mon.0) 2391 : cluster [DBG] osdmap e396: 8 total, 8 up, 8 in 2024-02-13T00:43:55.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:54 smithi106 bash[18459]: cluster 2024-02-13T00:43:53.782361+0000 mon.a (mon.0) 2392 : cluster [DBG] osdmap e397: 8 total, 8 up, 8 in 2024-02-13T00:43:55.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:54 smithi106 bash[18459]: audit 2024-02-13T00:43:53.783657+0000 mon.a (mon.0) 2393 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:43:55.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:54 smithi080 bash[17386]: cluster 2024-02-13T00:43:53.782361+0000 mon.a (mon.0) 2392 : cluster [DBG] osdmap e397: 8 total, 8 up, 8 in 2024-02-13T00:43:55.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:54 smithi080 bash[17386]: audit 2024-02-13T00:43:53.783657+0000 mon.a (mon.0) 2393 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:43:55.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:54 smithi080 bash[24237]: cluster 2024-02-13T00:43:53.782361+0000 mon.a (mon.0) 2392 : cluster [DBG] osdmap e397: 8 total, 8 up, 8 in 2024-02-13T00:43:55.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:54 smithi080 bash[24237]: audit 2024-02-13T00:43:53.783657+0000 mon.a (mon.0) 2393 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:43:56.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:56 smithi106 bash[18459]: cluster 2024-02-13T00:43:54.323172+0000 mgr.y (mgr.24461) 556 : cluster [DBG] pgmap v747: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:43:56.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:56 smithi106 bash[18459]: audit 2024-02-13T00:43:54.788798+0000 mon.a (mon.0) 2394 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:43:56.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:56 smithi106 bash[18459]: cluster 2024-02-13T00:43:54.789046+0000 mon.a (mon.0) 2395 : cluster [DBG] osdmap e398: 8 total, 8 up, 8 in 2024-02-13T00:43:56.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:56 smithi106 bash[18459]: audit 2024-02-13T00:43:54.790960+0000 mon.a (mon.0) 2396 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:43:56.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:56 smithi106 bash[18459]: audit 2024-02-13T00:43:54.846847+0000 mon.a (mon.0) 2397 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:43:56.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:56 smithi106 bash[18459]: audit 2024-02-13T00:43:54.847504+0000 mon.a (mon.0) 2398 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-67"}]: dispatch 2024-02-13T00:43:56.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:56 smithi080 bash[17386]: cluster 2024-02-13T00:43:54.323172+0000 mgr.y (mgr.24461) 556 : cluster [DBG] pgmap v747: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:43:56.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:56 smithi080 bash[17386]: audit 2024-02-13T00:43:54.788798+0000 mon.a (mon.0) 2394 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:43:56.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:56 smithi080 bash[17386]: cluster 2024-02-13T00:43:54.789046+0000 mon.a (mon.0) 2395 : cluster [DBG] osdmap e398: 8 total, 8 up, 8 in 2024-02-13T00:43:56.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:56 smithi080 bash[17386]: audit 2024-02-13T00:43:54.790960+0000 mon.a (mon.0) 2396 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:43:56.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:56 smithi080 bash[17386]: audit 2024-02-13T00:43:54.846847+0000 mon.a (mon.0) 2397 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:43:56.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:56 smithi080 bash[17386]: audit 2024-02-13T00:43:54.847504+0000 mon.a (mon.0) 2398 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-67"}]: dispatch 2024-02-13T00:43:56.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:56 smithi080 bash[24237]: cluster 2024-02-13T00:43:54.323172+0000 mgr.y (mgr.24461) 556 : cluster [DBG] pgmap v747: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:43:56.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:56 smithi080 bash[24237]: audit 2024-02-13T00:43:54.788798+0000 mon.a (mon.0) 2394 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:43:56.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:56 smithi080 bash[24237]: cluster 2024-02-13T00:43:54.789046+0000 mon.a (mon.0) 2395 : cluster [DBG] osdmap e398: 8 total, 8 up, 8 in 2024-02-13T00:43:56.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:56 smithi080 bash[24237]: audit 2024-02-13T00:43:54.790960+0000 mon.a (mon.0) 2396 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:43:56.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:56 smithi080 bash[24237]: audit 2024-02-13T00:43:54.846847+0000 mon.a (mon.0) 2397 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:43:56.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:56 smithi080 bash[24237]: audit 2024-02-13T00:43:54.847504+0000 mon.a (mon.0) 2398 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-67"}]: dispatch 2024-02-13T00:43:57.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:57 smithi080 bash[17386]: cluster 2024-02-13T00:43:55.801455+0000 mon.a (mon.0) 2399 : cluster [DBG] osdmap e399: 8 total, 8 up, 8 in 2024-02-13T00:43:57.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:57 smithi080 bash[17386]: cluster 2024-02-13T00:43:56.323720+0000 mgr.y (mgr.24461) 557 : cluster [DBG] pgmap v750: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:43:57.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:57 smithi080 bash[17386]: cluster 2024-02-13T00:43:56.806465+0000 mon.a (mon.0) 2400 : cluster [DBG] osdmap e400: 8 total, 8 up, 8 in 2024-02-13T00:43:57.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:57 smithi080 bash[17386]: audit 2024-02-13T00:43:56.807659+0000 mon.a (mon.0) 2401 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:43:57.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:57 smithi080 bash[24237]: cluster 2024-02-13T00:43:55.801455+0000 mon.a (mon.0) 2399 : cluster [DBG] osdmap e399: 8 total, 8 up, 8 in 2024-02-13T00:43:57.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:57 smithi080 bash[24237]: cluster 2024-02-13T00:43:56.323720+0000 mgr.y (mgr.24461) 557 : cluster [DBG] pgmap v750: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:43:57.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:57 smithi080 bash[24237]: cluster 2024-02-13T00:43:56.806465+0000 mon.a (mon.0) 2400 : cluster [DBG] osdmap e400: 8 total, 8 up, 8 in 2024-02-13T00:43:57.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:57 smithi080 bash[24237]: audit 2024-02-13T00:43:56.807659+0000 mon.a (mon.0) 2401 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:43:57.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:57 smithi106 bash[18459]: cluster 2024-02-13T00:43:55.801455+0000 mon.a (mon.0) 2399 : cluster [DBG] osdmap e399: 8 total, 8 up, 8 in 2024-02-13T00:43:57.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:57 smithi106 bash[18459]: cluster 2024-02-13T00:43:56.323720+0000 mgr.y (mgr.24461) 557 : cluster [DBG] pgmap v750: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:43:57.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:57 smithi106 bash[18459]: cluster 2024-02-13T00:43:56.806465+0000 mon.a (mon.0) 2400 : cluster [DBG] osdmap e400: 8 total, 8 up, 8 in 2024-02-13T00:43:57.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:57 smithi106 bash[18459]: audit 2024-02-13T00:43:56.807659+0000 mon.a (mon.0) 2401 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:43:58.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:43:58 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:43:59.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:58 smithi106 bash[18459]: audit 2024-02-13T00:43:57.810800+0000 mon.a (mon.0) 2402 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:43:59.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:58 smithi106 bash[18459]: cluster 2024-02-13T00:43:57.811225+0000 mon.a (mon.0) 2403 : cluster [DBG] osdmap e401: 8 total, 8 up, 8 in 2024-02-13T00:43:59.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:58 smithi106 bash[18459]: audit 2024-02-13T00:43:57.813970+0000 mon.a (mon.0) 2404 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:43:59.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:58 smithi106 bash[18459]: audit 2024-02-13T00:43:57.818784+0000 mon.a (mon.0) 2405 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:43:59.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:58 smithi080 bash[24237]: audit 2024-02-13T00:43:57.810800+0000 mon.a (mon.0) 2402 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:43:59.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:58 smithi080 bash[24237]: cluster 2024-02-13T00:43:57.811225+0000 mon.a (mon.0) 2403 : cluster [DBG] osdmap e401: 8 total, 8 up, 8 in 2024-02-13T00:43:59.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:58 smithi080 bash[24237]: audit 2024-02-13T00:43:57.813970+0000 mon.a (mon.0) 2404 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:43:59.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:58 smithi080 bash[24237]: audit 2024-02-13T00:43:57.818784+0000 mon.a (mon.0) 2405 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:43:59.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:58 smithi080 bash[17386]: audit 2024-02-13T00:43:57.810800+0000 mon.a (mon.0) 2402 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:43:59.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:58 smithi080 bash[17386]: cluster 2024-02-13T00:43:57.811225+0000 mon.a (mon.0) 2403 : cluster [DBG] osdmap e401: 8 total, 8 up, 8 in 2024-02-13T00:43:59.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:58 smithi080 bash[17386]: audit 2024-02-13T00:43:57.813970+0000 mon.a (mon.0) 2404 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:43:59.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:58 smithi080 bash[17386]: audit 2024-02-13T00:43:57.818784+0000 mon.a (mon.0) 2405 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:44:00.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:59 smithi106 bash[18459]: cluster 2024-02-13T00:43:58.325215+0000 mgr.y (mgr.24461) 558 : cluster [DBG] pgmap v753: 228 pgs: 1 active, 3 creating+activating, 13 creating+peering, 211 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-13T00:44:00.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:59 smithi106 bash[18459]: audit 2024-02-13T00:43:58.433131+0000 mgr.y (mgr.24461) 559 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:44:00.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:59 smithi106 bash[18459]: audit 2024-02-13T00:43:58.813610+0000 mon.a (mon.0) 2406 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:44:00.145 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:43:59 smithi106 bash[18459]: cluster 2024-02-13T00:43:58.813733+0000 mon.a (mon.0) 2407 : cluster [DBG] osdmap e402: 8 total, 8 up, 8 in 2024-02-13T00:44:00.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:59 smithi080 bash[17386]: cluster 2024-02-13T00:43:58.325215+0000 mgr.y (mgr.24461) 558 : cluster [DBG] pgmap v753: 228 pgs: 1 active, 3 creating+activating, 13 creating+peering, 211 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-13T00:44:00.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:59 smithi080 bash[17386]: audit 2024-02-13T00:43:58.433131+0000 mgr.y (mgr.24461) 559 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:44:00.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:59 smithi080 bash[17386]: audit 2024-02-13T00:43:58.813610+0000 mon.a (mon.0) 2406 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:44:00.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:43:59 smithi080 bash[17386]: cluster 2024-02-13T00:43:58.813733+0000 mon.a (mon.0) 2407 : cluster [DBG] osdmap e402: 8 total, 8 up, 8 in 2024-02-13T00:44:00.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:59 smithi080 bash[24237]: cluster 2024-02-13T00:43:58.325215+0000 mgr.y (mgr.24461) 558 : cluster [DBG] pgmap v753: 228 pgs: 1 active, 3 creating+activating, 13 creating+peering, 211 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-13T00:44:00.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:59 smithi080 bash[24237]: audit 2024-02-13T00:43:58.433131+0000 mgr.y (mgr.24461) 559 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:44:00.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:59 smithi080 bash[24237]: audit 2024-02-13T00:43:58.813610+0000 mon.a (mon.0) 2406 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:44:00.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:43:59 smithi080 bash[24237]: cluster 2024-02-13T00:43:58.813733+0000 mon.a (mon.0) 2407 : cluster [DBG] osdmap e402: 8 total, 8 up, 8 in 2024-02-13T00:44:00.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:44:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:44:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:44:01.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:00 smithi106 bash[18459]: cluster 2024-02-13T00:43:59.834231+0000 mon.a (mon.0) 2408 : cluster [DBG] osdmap e403: 8 total, 8 up, 8 in 2024-02-13T00:44:01.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:00 smithi080 bash[17386]: cluster 2024-02-13T00:43:59.834231+0000 mon.a (mon.0) 2408 : cluster [DBG] osdmap e403: 8 total, 8 up, 8 in 2024-02-13T00:44:01.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:00 smithi080 bash[24237]: cluster 2024-02-13T00:43:59.834231+0000 mon.a (mon.0) 2408 : cluster [DBG] osdmap e403: 8 total, 8 up, 8 in 2024-02-13T00:44:02.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:01 smithi106 bash[18459]: cluster 2024-02-13T00:44:00.326069+0000 mgr.y (mgr.24461) 560 : cluster [DBG] pgmap v756: 228 pgs: 1 active, 3 creating+activating, 13 creating+peering, 211 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-13T00:44:02.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:01 smithi080 bash[17386]: cluster 2024-02-13T00:44:00.326069+0000 mgr.y (mgr.24461) 560 : cluster [DBG] pgmap v756: 228 pgs: 1 active, 3 creating+activating, 13 creating+peering, 211 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-13T00:44:02.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:01 smithi080 bash[24237]: cluster 2024-02-13T00:44:00.326069+0000 mgr.y (mgr.24461) 560 : cluster [DBG] pgmap v756: 228 pgs: 1 active, 3 creating+activating, 13 creating+peering, 211 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-13T00:44:03.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:44:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:44:03] "GET /metrics HTTP/1.1" 200 187910 "" "Prometheus/2.33.4" 2024-02-13T00:44:04.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:03 smithi106 bash[18459]: cluster 2024-02-13T00:44:02.326880+0000 mgr.y (mgr.24461) 561 : cluster [DBG] pgmap v757: 228 pgs: 1 active, 3 creating+activating, 13 creating+peering, 211 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 556 B/s wr, 1 op/s 2024-02-13T00:44:04.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:03 smithi080 bash[17386]: cluster 2024-02-13T00:44:02.326880+0000 mgr.y (mgr.24461) 561 : cluster [DBG] pgmap v757: 228 pgs: 1 active, 3 creating+activating, 13 creating+peering, 211 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 556 B/s wr, 1 op/s 2024-02-13T00:44:04.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:03 smithi080 bash[24237]: cluster 2024-02-13T00:44:02.326880+0000 mgr.y (mgr.24461) 561 : cluster [DBG] pgmap v757: 228 pgs: 1 active, 3 creating+activating, 13 creating+peering, 211 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 556 B/s wr, 1 op/s 2024-02-13T00:44:06.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:05 smithi106 bash[18459]: cluster 2024-02-13T00:44:04.329031+0000 mgr.y (mgr.24461) 562 : cluster [DBG] pgmap v758: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 942 B/s rd, 2.0 KiB/s wr, 4 op/s 2024-02-13T00:44:06.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:05 smithi080 bash[17386]: cluster 2024-02-13T00:44:04.329031+0000 mgr.y (mgr.24461) 562 : cluster [DBG] pgmap v758: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 942 B/s rd, 2.0 KiB/s wr, 4 op/s 2024-02-13T00:44:06.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:05 smithi080 bash[24237]: cluster 2024-02-13T00:44:04.329031+0000 mgr.y (mgr.24461) 562 : cluster [DBG] pgmap v758: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 942 B/s rd, 2.0 KiB/s wr, 4 op/s 2024-02-13T00:44:08.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:07 smithi106 bash[18459]: cluster 2024-02-13T00:44:06.329849+0000 mgr.y (mgr.24461) 563 : cluster [DBG] pgmap v759: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 1.6 KiB/s wr, 3 op/s 2024-02-13T00:44:08.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:07 smithi106 bash[18459]: audit 2024-02-13T00:44:07.427941+0000 mon.c (mon.2) 371 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:44:08.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:07 smithi106 bash[18459]: audit 2024-02-13T00:44:07.704676+0000 mon.a (mon.0) 2409 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:44:08.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:07 smithi080 bash[17386]: cluster 2024-02-13T00:44:06.329849+0000 mgr.y (mgr.24461) 563 : cluster [DBG] pgmap v759: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 1.6 KiB/s wr, 3 op/s 2024-02-13T00:44:08.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:07 smithi080 bash[17386]: audit 2024-02-13T00:44:07.427941+0000 mon.c (mon.2) 371 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:44:08.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:07 smithi080 bash[17386]: audit 2024-02-13T00:44:07.704676+0000 mon.a (mon.0) 2409 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:44:08.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:07 smithi080 bash[24237]: cluster 2024-02-13T00:44:06.329849+0000 mgr.y (mgr.24461) 563 : cluster [DBG] pgmap v759: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 1.6 KiB/s wr, 3 op/s 2024-02-13T00:44:08.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:07 smithi080 bash[24237]: audit 2024-02-13T00:44:07.427941+0000 mon.c (mon.2) 371 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:44:08.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:07 smithi080 bash[24237]: audit 2024-02-13T00:44:07.704676+0000 mon.a (mon.0) 2409 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:44:08.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:44:08 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:44:09.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:08 smithi106 bash[18459]: audit 2024-02-13T00:44:07.971614+0000 mon.c (mon.2) 372 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:44:09.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:08 smithi106 bash[18459]: audit 2024-02-13T00:44:07.973556+0000 mon.c (mon.2) 373 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:44:09.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:08 smithi106 bash[18459]: audit 2024-02-13T00:44:07.983295+0000 mon.a (mon.0) 2410 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:44:09.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:08 smithi080 bash[17386]: audit 2024-02-13T00:44:07.971614+0000 mon.c (mon.2) 372 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:44:09.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:08 smithi080 bash[17386]: audit 2024-02-13T00:44:07.973556+0000 mon.c (mon.2) 373 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:44:09.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:08 smithi080 bash[17386]: audit 2024-02-13T00:44:07.983295+0000 mon.a (mon.0) 2410 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:44:09.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:08 smithi080 bash[24237]: audit 2024-02-13T00:44:07.971614+0000 mon.c (mon.2) 372 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:44:09.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:08 smithi080 bash[24237]: audit 2024-02-13T00:44:07.973556+0000 mon.c (mon.2) 373 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:44:09.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:08 smithi080 bash[24237]: audit 2024-02-13T00:44:07.983295+0000 mon.a (mon.0) 2410 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:44:10.255 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:44:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:44:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:44:10.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:09 smithi106 bash[18459]: cluster 2024-02-13T00:44:08.332033+0000 mgr.y (mgr.24461) 564 : cluster [DBG] pgmap v760: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-02-13T00:44:10.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:09 smithi106 bash[18459]: audit 2024-02-13T00:44:08.444605+0000 mgr.y (mgr.24461) 565 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:44:10.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:09 smithi080 bash[17386]: cluster 2024-02-13T00:44:08.332033+0000 mgr.y (mgr.24461) 564 : cluster [DBG] pgmap v760: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-02-13T00:44:10.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:09 smithi080 bash[17386]: audit 2024-02-13T00:44:08.444605+0000 mgr.y (mgr.24461) 565 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:44:10.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:09 smithi080 bash[24237]: cluster 2024-02-13T00:44:08.332033+0000 mgr.y (mgr.24461) 564 : cluster [DBG] pgmap v760: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-02-13T00:44:10.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:09 smithi080 bash[24237]: audit 2024-02-13T00:44:08.444605+0000 mgr.y (mgr.24461) 565 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:44:12.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:11 smithi106 bash[18459]: cluster 2024-02-13T00:44:10.332878+0000 mgr.y (mgr.24461) 566 : cluster [DBG] pgmap v761: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-02-13T00:44:12.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:11 smithi080 bash[17386]: cluster 2024-02-13T00:44:10.332878+0000 mgr.y (mgr.24461) 566 : cluster [DBG] pgmap v761: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-02-13T00:44:12.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:11 smithi080 bash[24237]: cluster 2024-02-13T00:44:10.332878+0000 mgr.y (mgr.24461) 566 : cluster [DBG] pgmap v761: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-02-13T00:44:13.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:44:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:44:13] "GET /metrics HTTP/1.1" 200 187910 "" "Prometheus/2.33.4" 2024-02-13T00:44:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:13 smithi106 bash[18459]: cluster 2024-02-13T00:44:12.333791+0000 mgr.y (mgr.24461) 567 : cluster [DBG] pgmap v762: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 938 B/s rd, 1.1 KiB/s wr, 2 op/s 2024-02-13T00:44:14.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:13 smithi080 bash[17386]: cluster 2024-02-13T00:44:12.333791+0000 mgr.y (mgr.24461) 567 : cluster [DBG] pgmap v762: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 938 B/s rd, 1.1 KiB/s wr, 2 op/s 2024-02-13T00:44:14.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:13 smithi080 bash[24237]: cluster 2024-02-13T00:44:12.333791+0000 mgr.y (mgr.24461) 567 : cluster [DBG] pgmap v762: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 938 B/s rd, 1.1 KiB/s wr, 2 op/s 2024-02-13T00:44:16.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:16 smithi080 bash[17386]: cluster 2024-02-13T00:44:14.336022+0000 mgr.y (mgr.24461) 568 : cluster [DBG] pgmap v763: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-02-13T00:44:16.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:16 smithi080 bash[24237]: cluster 2024-02-13T00:44:14.336022+0000 mgr.y (mgr.24461) 568 : cluster [DBG] pgmap v763: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-02-13T00:44:16.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:16 smithi106 bash[18459]: cluster 2024-02-13T00:44:14.336022+0000 mgr.y (mgr.24461) 568 : cluster [DBG] pgmap v763: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 4 op/s 2024-02-13T00:44:18.459 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:18 smithi106 bash[18459]: cluster 2024-02-13T00:44:16.336875+0000 mgr.y (mgr.24461) 569 : cluster [DBG] pgmap v764: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T00:44:18.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:18 smithi080 bash[24237]: cluster 2024-02-13T00:44:16.336875+0000 mgr.y (mgr.24461) 569 : cluster [DBG] pgmap v764: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T00:44:18.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:18 smithi080 bash[17386]: cluster 2024-02-13T00:44:16.336875+0000 mgr.y (mgr.24461) 569 : cluster [DBG] pgmap v764: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T00:44:18.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:44:18 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:44:20.484 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:44:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:44:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:44:20.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:20 smithi106 bash[18459]: cluster 2024-02-13T00:44:18.339116+0000 mgr.y (mgr.24461) 570 : cluster [DBG] pgmap v765: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T00:44:20.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:20 smithi106 bash[18459]: audit 2024-02-13T00:44:18.456094+0000 mgr.y (mgr.24461) 571 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:44:20.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:20 smithi106 bash[18459]: audit 2024-02-13T00:44:19.908122+0000 mon.a (mon.0) 2411 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:44:20.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:20 smithi106 bash[18459]: audit 2024-02-13T00:44:19.908957+0000 mon.a (mon.0) 2412 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-69"}]: dispatch 2024-02-13T00:44:20.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:20 smithi080 bash[17386]: cluster 2024-02-13T00:44:18.339116+0000 mgr.y (mgr.24461) 570 : cluster [DBG] pgmap v765: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T00:44:20.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:20 smithi080 bash[17386]: audit 2024-02-13T00:44:18.456094+0000 mgr.y (mgr.24461) 571 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:44:20.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:20 smithi080 bash[17386]: audit 2024-02-13T00:44:19.908122+0000 mon.a (mon.0) 2411 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:44:20.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:20 smithi080 bash[17386]: audit 2024-02-13T00:44:19.908957+0000 mon.a (mon.0) 2412 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-69"}]: dispatch 2024-02-13T00:44:20.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:20 smithi080 bash[24237]: cluster 2024-02-13T00:44:18.339116+0000 mgr.y (mgr.24461) 570 : cluster [DBG] pgmap v765: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T00:44:20.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:20 smithi080 bash[24237]: audit 2024-02-13T00:44:18.456094+0000 mgr.y (mgr.24461) 571 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:44:20.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:20 smithi080 bash[24237]: audit 2024-02-13T00:44:19.908122+0000 mon.a (mon.0) 2411 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:44:20.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:20 smithi080 bash[24237]: audit 2024-02-13T00:44:19.908957+0000 mon.a (mon.0) 2412 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-69"}]: dispatch 2024-02-13T00:44:21.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:21 smithi106 bash[18459]: cluster 2024-02-13T00:44:20.019942+0000 mon.a (mon.0) 2413 : cluster [DBG] osdmap e404: 8 total, 8 up, 8 in 2024-02-13T00:44:21.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:21 smithi106 bash[18459]: cluster 2024-02-13T00:44:20.339827+0000 mgr.y (mgr.24461) 572 : cluster [DBG] pgmap v767: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 920 B/s rd, 0 op/s 2024-02-13T00:44:21.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:21 smithi106 bash[18459]: cluster 2024-02-13T00:44:21.024065+0000 mon.a (mon.0) 2414 : cluster [DBG] osdmap e405: 8 total, 8 up, 8 in 2024-02-13T00:44:21.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:21 smithi106 bash[18459]: audit 2024-02-13T00:44:21.028217+0000 mon.a (mon.0) 2415 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:44:21.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:21 smithi080 bash[17386]: cluster 2024-02-13T00:44:20.019942+0000 mon.a (mon.0) 2413 : cluster [DBG] osdmap e404: 8 total, 8 up, 8 in 2024-02-13T00:44:21.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:21 smithi080 bash[17386]: cluster 2024-02-13T00:44:20.339827+0000 mgr.y (mgr.24461) 572 : cluster [DBG] pgmap v767: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 920 B/s rd, 0 op/s 2024-02-13T00:44:21.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:21 smithi080 bash[17386]: cluster 2024-02-13T00:44:21.024065+0000 mon.a (mon.0) 2414 : cluster [DBG] osdmap e405: 8 total, 8 up, 8 in 2024-02-13T00:44:21.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:21 smithi080 bash[17386]: audit 2024-02-13T00:44:21.028217+0000 mon.a (mon.0) 2415 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:44:21.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:21 smithi080 bash[24237]: cluster 2024-02-13T00:44:20.019942+0000 mon.a (mon.0) 2413 : cluster [DBG] osdmap e404: 8 total, 8 up, 8 in 2024-02-13T00:44:21.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:21 smithi080 bash[24237]: cluster 2024-02-13T00:44:20.339827+0000 mgr.y (mgr.24461) 572 : cluster [DBG] pgmap v767: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 920 B/s rd, 0 op/s 2024-02-13T00:44:21.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:21 smithi080 bash[24237]: cluster 2024-02-13T00:44:21.024065+0000 mon.a (mon.0) 2414 : cluster [DBG] osdmap e405: 8 total, 8 up, 8 in 2024-02-13T00:44:21.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:21 smithi080 bash[24237]: audit 2024-02-13T00:44:21.028217+0000 mon.a (mon.0) 2415 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:44:23.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:23 smithi106 bash[18459]: audit 2024-02-13T00:44:22.026152+0000 mon.a (mon.0) 2416 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:44:23.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:23 smithi106 bash[18459]: cluster 2024-02-13T00:44:22.026512+0000 mon.a (mon.0) 2417 : cluster [DBG] osdmap e406: 8 total, 8 up, 8 in 2024-02-13T00:44:23.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:23 smithi106 bash[18459]: audit 2024-02-13T00:44:22.028839+0000 mon.a (mon.0) 2418 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:44:23.507 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:44:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:44:23] "GET /metrics HTTP/1.1" 200 187942 "" "Prometheus/2.33.4" 2024-02-13T00:44:23.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:23 smithi080 bash[17386]: audit 2024-02-13T00:44:22.026152+0000 mon.a (mon.0) 2416 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:44:23.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:23 smithi080 bash[17386]: cluster 2024-02-13T00:44:22.026512+0000 mon.a (mon.0) 2417 : cluster [DBG] osdmap e406: 8 total, 8 up, 8 in 2024-02-13T00:44:23.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:23 smithi080 bash[17386]: audit 2024-02-13T00:44:22.028839+0000 mon.a (mon.0) 2418 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:44:23.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:23 smithi080 bash[24237]: audit 2024-02-13T00:44:22.026152+0000 mon.a (mon.0) 2416 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:44:23.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:23 smithi080 bash[24237]: cluster 2024-02-13T00:44:22.026512+0000 mon.a (mon.0) 2417 : cluster [DBG] osdmap e406: 8 total, 8 up, 8 in 2024-02-13T00:44:23.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:23 smithi080 bash[24237]: audit 2024-02-13T00:44:22.028839+0000 mon.a (mon.0) 2418 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:44:24.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:24 smithi106 bash[18459]: cluster 2024-02-13T00:44:22.340673+0000 mgr.y (mgr.24461) 573 : cluster [DBG] pgmap v770: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:44:24.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:24 smithi106 bash[18459]: cluster 2024-02-13T00:44:23.033128+0000 mon.a (mon.0) 2419 : cluster [DBG] osdmap e407: 8 total, 8 up, 8 in 2024-02-13T00:44:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:24 smithi080 bash[17386]: cluster 2024-02-13T00:44:22.340673+0000 mgr.y (mgr.24461) 573 : cluster [DBG] pgmap v770: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:44:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:24 smithi080 bash[17386]: cluster 2024-02-13T00:44:23.033128+0000 mon.a (mon.0) 2419 : cluster [DBG] osdmap e407: 8 total, 8 up, 8 in 2024-02-13T00:44:24.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:24 smithi080 bash[24237]: cluster 2024-02-13T00:44:22.340673+0000 mgr.y (mgr.24461) 573 : cluster [DBG] pgmap v770: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:44:24.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:24 smithi080 bash[24237]: cluster 2024-02-13T00:44:23.033128+0000 mon.a (mon.0) 2419 : cluster [DBG] osdmap e407: 8 total, 8 up, 8 in 2024-02-13T00:44:25.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:25 smithi106 bash[18459]: cluster 2024-02-13T00:44:24.036395+0000 mon.a (mon.0) 2420 : cluster [DBG] osdmap e408: 8 total, 8 up, 8 in 2024-02-13T00:44:25.507 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:25 smithi080 bash[17386]: cluster 2024-02-13T00:44:24.036395+0000 mon.a (mon.0) 2420 : cluster [DBG] osdmap e408: 8 total, 8 up, 8 in 2024-02-13T00:44:25.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:25 smithi080 bash[24237]: cluster 2024-02-13T00:44:24.036395+0000 mon.a (mon.0) 2420 : cluster [DBG] osdmap e408: 8 total, 8 up, 8 in 2024-02-13T00:44:26.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:26 smithi106 bash[18459]: cluster 2024-02-13T00:44:24.341587+0000 mgr.y (mgr.24461) 574 : cluster [DBG] pgmap v773: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T00:44:26.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:26 smithi080 bash[17386]: cluster 2024-02-13T00:44:24.341587+0000 mgr.y (mgr.24461) 574 : cluster [DBG] pgmap v773: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T00:44:26.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:26 smithi080 bash[24237]: cluster 2024-02-13T00:44:24.341587+0000 mgr.y (mgr.24461) 574 : cluster [DBG] pgmap v773: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T00:44:28.469 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:28 smithi106 bash[18459]: cluster 2024-02-13T00:44:26.342569+0000 mgr.y (mgr.24461) 575 : cluster [DBG] pgmap v774: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 961 B/s rd, 961 B/s wr, 1 op/s 2024-02-13T00:44:28.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:28 smithi080 bash[17386]: cluster 2024-02-13T00:44:26.342569+0000 mgr.y (mgr.24461) 575 : cluster [DBG] pgmap v774: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 961 B/s rd, 961 B/s wr, 1 op/s 2024-02-13T00:44:28.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:28 smithi080 bash[24237]: cluster 2024-02-13T00:44:26.342569+0000 mgr.y (mgr.24461) 575 : cluster [DBG] pgmap v774: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 961 B/s rd, 961 B/s wr, 1 op/s 2024-02-13T00:44:28.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:44:28 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:44:30.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:30 smithi106 bash[18459]: cluster 2024-02-13T00:44:28.344789+0000 mgr.y (mgr.24461) 576 : cluster [DBG] pgmap v775: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-02-13T00:44:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:30 smithi106 bash[18459]: audit 2024-02-13T00:44:28.465707+0000 mgr.y (mgr.24461) 577 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:44:30.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:44:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:44:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:44:30.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:30 smithi080 bash[17386]: cluster 2024-02-13T00:44:28.344789+0000 mgr.y (mgr.24461) 576 : cluster [DBG] pgmap v775: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-02-13T00:44:30.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:30 smithi080 bash[17386]: audit 2024-02-13T00:44:28.465707+0000 mgr.y (mgr.24461) 577 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:44:30.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:30 smithi080 bash[24237]: cluster 2024-02-13T00:44:28.344789+0000 mgr.y (mgr.24461) 576 : cluster [DBG] pgmap v775: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-02-13T00:44:30.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:30 smithi080 bash[24237]: audit 2024-02-13T00:44:28.465707+0000 mgr.y (mgr.24461) 577 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:44:32.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:32 smithi106 bash[18459]: cluster 2024-02-13T00:44:30.345736+0000 mgr.y (mgr.24461) 578 : cluster [DBG] pgmap v776: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.9 KiB/s rd, 895 B/s wr, 3 op/s 2024-02-13T00:44:32.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:32 smithi080 bash[17386]: cluster 2024-02-13T00:44:30.345736+0000 mgr.y (mgr.24461) 578 : cluster [DBG] pgmap v776: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.9 KiB/s rd, 895 B/s wr, 3 op/s 2024-02-13T00:44:32.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:32 smithi080 bash[24237]: cluster 2024-02-13T00:44:30.345736+0000 mgr.y (mgr.24461) 578 : cluster [DBG] pgmap v776: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.9 KiB/s rd, 895 B/s wr, 3 op/s 2024-02-13T00:44:33.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:44:33 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:44:33] "GET /metrics HTTP/1.1" 200 188057 "" "Prometheus/2.33.4" 2024-02-13T00:44:34.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:34 smithi106 bash[18459]: cluster 2024-02-13T00:44:32.346689+0000 mgr.y (mgr.24461) 579 : cluster [DBG] pgmap v777: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 219 B/s wr, 2 op/s 2024-02-13T00:44:34.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:34 smithi080 bash[17386]: cluster 2024-02-13T00:44:32.346689+0000 mgr.y (mgr.24461) 579 : cluster [DBG] pgmap v777: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 219 B/s wr, 2 op/s 2024-02-13T00:44:34.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:34 smithi080 bash[24237]: cluster 2024-02-13T00:44:32.346689+0000 mgr.y (mgr.24461) 579 : cluster [DBG] pgmap v777: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 219 B/s wr, 2 op/s 2024-02-13T00:44:35.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:35 smithi106 bash[18459]: audit 2024-02-13T00:44:34.101120+0000 mon.a (mon.0) 2421 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:44:35.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:35 smithi106 bash[18459]: audit 2024-02-13T00:44:34.101910+0000 mon.a (mon.0) 2422 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-71"}]: dispatch 2024-02-13T00:44:35.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:35 smithi080 bash[17386]: audit 2024-02-13T00:44:34.101120+0000 mon.a (mon.0) 2421 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:44:35.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:35 smithi080 bash[17386]: audit 2024-02-13T00:44:34.101910+0000 mon.a (mon.0) 2422 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-71"}]: dispatch 2024-02-13T00:44:35.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:35 smithi080 bash[24237]: audit 2024-02-13T00:44:34.101120+0000 mon.a (mon.0) 2421 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:44:35.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:35 smithi080 bash[24237]: audit 2024-02-13T00:44:34.101910+0000 mon.a (mon.0) 2422 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-71"}]: dispatch 2024-02-13T00:44:36.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:36 smithi106 bash[18459]: cluster 2024-02-13T00:44:34.348946+0000 mgr.y (mgr.24461) 580 : cluster [DBG] pgmap v778: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 198 B/s wr, 2 op/s 2024-02-13T00:44:36.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:36 smithi106 bash[18459]: cluster 2024-02-13T00:44:35.091434+0000 mon.a (mon.0) 2423 : cluster [DBG] osdmap e409: 8 total, 8 up, 8 in 2024-02-13T00:44:36.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:36 smithi080 bash[17386]: cluster 2024-02-13T00:44:34.348946+0000 mgr.y (mgr.24461) 580 : cluster [DBG] pgmap v778: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 198 B/s wr, 2 op/s 2024-02-13T00:44:36.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:36 smithi080 bash[17386]: cluster 2024-02-13T00:44:35.091434+0000 mon.a (mon.0) 2423 : cluster [DBG] osdmap e409: 8 total, 8 up, 8 in 2024-02-13T00:44:36.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:36 smithi080 bash[24237]: cluster 2024-02-13T00:44:34.348946+0000 mgr.y (mgr.24461) 580 : cluster [DBG] pgmap v778: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 198 B/s wr, 2 op/s 2024-02-13T00:44:36.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:36 smithi080 bash[24237]: cluster 2024-02-13T00:44:35.091434+0000 mon.a (mon.0) 2423 : cluster [DBG] osdmap e409: 8 total, 8 up, 8 in 2024-02-13T00:44:37.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:37 smithi106 bash[18459]: cluster 2024-02-13T00:44:36.102097+0000 mon.a (mon.0) 2424 : cluster [DBG] osdmap e410: 8 total, 8 up, 8 in 2024-02-13T00:44:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:37 smithi106 bash[18459]: audit 2024-02-13T00:44:36.104442+0000 mon.a (mon.0) 2425 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:44:37.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:37 smithi080 bash[17386]: cluster 2024-02-13T00:44:36.102097+0000 mon.a (mon.0) 2424 : cluster [DBG] osdmap e410: 8 total, 8 up, 8 in 2024-02-13T00:44:37.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:37 smithi080 bash[17386]: audit 2024-02-13T00:44:36.104442+0000 mon.a (mon.0) 2425 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:44:37.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:37 smithi080 bash[24237]: cluster 2024-02-13T00:44:36.102097+0000 mon.a (mon.0) 2424 : cluster [DBG] osdmap e410: 8 total, 8 up, 8 in 2024-02-13T00:44:37.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:37 smithi080 bash[24237]: audit 2024-02-13T00:44:36.104442+0000 mon.a (mon.0) 2425 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:44:38.480 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:38 smithi106 bash[18459]: cluster 2024-02-13T00:44:36.349715+0000 mgr.y (mgr.24461) 581 : cluster [DBG] pgmap v781: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:44:38.480 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:38 smithi106 bash[18459]: audit 2024-02-13T00:44:37.106139+0000 mon.a (mon.0) 2426 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:44:38.480 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:38 smithi106 bash[18459]: cluster 2024-02-13T00:44:37.106436+0000 mon.a (mon.0) 2427 : cluster [DBG] osdmap e411: 8 total, 8 up, 8 in 2024-02-13T00:44:38.481 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:38 smithi106 bash[18459]: audit 2024-02-13T00:44:37.117977+0000 mon.a (mon.0) 2428 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:44:38.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:38 smithi080 bash[24237]: cluster 2024-02-13T00:44:36.349715+0000 mgr.y (mgr.24461) 581 : cluster [DBG] pgmap v781: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:44:38.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:38 smithi080 bash[24237]: audit 2024-02-13T00:44:37.106139+0000 mon.a (mon.0) 2426 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:44:38.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:38 smithi080 bash[24237]: cluster 2024-02-13T00:44:37.106436+0000 mon.a (mon.0) 2427 : cluster [DBG] osdmap e411: 8 total, 8 up, 8 in 2024-02-13T00:44:38.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:38 smithi080 bash[24237]: audit 2024-02-13T00:44:37.117977+0000 mon.a (mon.0) 2428 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:44:38.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:38 smithi080 bash[17386]: cluster 2024-02-13T00:44:36.349715+0000 mgr.y (mgr.24461) 581 : cluster [DBG] pgmap v781: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:44:38.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:38 smithi080 bash[17386]: audit 2024-02-13T00:44:37.106139+0000 mon.a (mon.0) 2426 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:44:38.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:38 smithi080 bash[17386]: cluster 2024-02-13T00:44:37.106436+0000 mon.a (mon.0) 2427 : cluster [DBG] osdmap e411: 8 total, 8 up, 8 in 2024-02-13T00:44:38.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:38 smithi080 bash[17386]: audit 2024-02-13T00:44:37.117977+0000 mon.a (mon.0) 2428 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:44:38.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:44:38 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:44:39.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:39 smithi106 bash[18459]: cluster 2024-02-13T00:44:38.126319+0000 mon.a (mon.0) 2429 : cluster [DBG] osdmap e412: 8 total, 8 up, 8 in 2024-02-13T00:44:39.506 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:44:39 smithi106 bash[31333]: debug 2024-02-13T00:44:39.167+0000 7f2523b3d700 -1 snap_mapper.add_oid found existing snaps mapped on 62:2667779c:test-rados-api-smithi080-54255-74::foo:24, removing 2024-02-13T00:44:39.506 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:44:39 smithi106 bash[36129]: debug 2024-02-13T00:44:39.167+0000 7f93c3d46700 -1 snap_mapper.add_oid found existing snaps mapped on 62:2667779c:test-rados-api-smithi080-54255-74::foo:24, removing 2024-02-13T00:44:39.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:39 smithi080 bash[17386]: cluster 2024-02-13T00:44:38.126319+0000 mon.a (mon.0) 2429 : cluster [DBG] osdmap e412: 8 total, 8 up, 8 in 2024-02-13T00:44:39.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:39 smithi080 bash[24237]: cluster 2024-02-13T00:44:38.126319+0000 mon.a (mon.0) 2429 : cluster [DBG] osdmap e412: 8 total, 8 up, 8 in 2024-02-13T00:44:39.508 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 13 00:44:39 smithi080 bash[27380]: debug 2024-02-13T00:44:39.165+0000 7fc7a691e700 -1 snap_mapper.add_oid found existing snaps mapped on 62:2667779c:test-rados-api-smithi080-54255-74::foo:24, removing 2024-02-13T00:44:40.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:44:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:44:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:44:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:40 smithi106 bash[18459]: cluster 2024-02-13T00:44:38.350502+0000 mgr.y (mgr.24461) 582 : cluster [DBG] pgmap v784: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:44:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:40 smithi106 bash[18459]: audit 2024-02-13T00:44:38.477010+0000 mgr.y (mgr.24461) 583 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:44:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:40 smithi106 bash[18459]: cluster 2024-02-13T00:44:39.131202+0000 mon.a (mon.0) 2430 : cluster [DBG] osdmap e413: 8 total, 8 up, 8 in 2024-02-13T00:44:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:40 smithi106 bash[18459]: audit 2024-02-13T00:44:39.203613+0000 mon.a (mon.0) 2431 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:44:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:40 smithi106 bash[18459]: audit 2024-02-13T00:44:39.204400+0000 mon.a (mon.0) 2432 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-73"}]: dispatch 2024-02-13T00:44:40.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:40 smithi080 bash[17386]: cluster 2024-02-13T00:44:38.350502+0000 mgr.y (mgr.24461) 582 : cluster [DBG] pgmap v784: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:44:40.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:40 smithi080 bash[17386]: audit 2024-02-13T00:44:38.477010+0000 mgr.y (mgr.24461) 583 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:44:40.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:40 smithi080 bash[17386]: cluster 2024-02-13T00:44:39.131202+0000 mon.a (mon.0) 2430 : cluster [DBG] osdmap e413: 8 total, 8 up, 8 in 2024-02-13T00:44:40.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:40 smithi080 bash[17386]: audit 2024-02-13T00:44:39.203613+0000 mon.a (mon.0) 2431 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:44:40.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:40 smithi080 bash[17386]: audit 2024-02-13T00:44:39.204400+0000 mon.a (mon.0) 2432 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-73"}]: dispatch 2024-02-13T00:44:40.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:40 smithi080 bash[24237]: cluster 2024-02-13T00:44:38.350502+0000 mgr.y (mgr.24461) 582 : cluster [DBG] pgmap v784: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:44:40.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:40 smithi080 bash[24237]: audit 2024-02-13T00:44:38.477010+0000 mgr.y (mgr.24461) 583 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:44:40.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:40 smithi080 bash[24237]: cluster 2024-02-13T00:44:39.131202+0000 mon.a (mon.0) 2430 : cluster [DBG] osdmap e413: 8 total, 8 up, 8 in 2024-02-13T00:44:40.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:40 smithi080 bash[24237]: audit 2024-02-13T00:44:39.203613+0000 mon.a (mon.0) 2431 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:44:40.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:40 smithi080 bash[24237]: audit 2024-02-13T00:44:39.204400+0000 mon.a (mon.0) 2432 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-73"}]: dispatch 2024-02-13T00:44:41.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:41 smithi106 bash[18459]: cluster 2024-02-13T00:44:40.150730+0000 mon.a (mon.0) 2433 : cluster [DBG] osdmap e414: 8 total, 8 up, 8 in 2024-02-13T00:44:41.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:41 smithi080 bash[17386]: cluster 2024-02-13T00:44:40.150730+0000 mon.a (mon.0) 2433 : cluster [DBG] osdmap e414: 8 total, 8 up, 8 in 2024-02-13T00:44:41.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:41 smithi080 bash[24237]: cluster 2024-02-13T00:44:40.150730+0000 mon.a (mon.0) 2433 : cluster [DBG] osdmap e414: 8 total, 8 up, 8 in 2024-02-13T00:44:42.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:42 smithi106 bash[18459]: cluster 2024-02-13T00:44:40.351256+0000 mgr.y (mgr.24461) 584 : cluster [DBG] pgmap v787: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:44:42.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:42 smithi106 bash[18459]: cluster 2024-02-13T00:44:41.163586+0000 mon.a (mon.0) 2434 : cluster [DBG] osdmap e415: 8 total, 8 up, 8 in 2024-02-13T00:44:42.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:42 smithi106 bash[18459]: audit 2024-02-13T00:44:41.166506+0000 mon.a (mon.0) 2435 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:44:42.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:42 smithi080 bash[17386]: cluster 2024-02-13T00:44:40.351256+0000 mgr.y (mgr.24461) 584 : cluster [DBG] pgmap v787: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:44:42.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:42 smithi080 bash[17386]: cluster 2024-02-13T00:44:41.163586+0000 mon.a (mon.0) 2434 : cluster [DBG] osdmap e415: 8 total, 8 up, 8 in 2024-02-13T00:44:42.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:42 smithi080 bash[17386]: audit 2024-02-13T00:44:41.166506+0000 mon.a (mon.0) 2435 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:44:42.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:42 smithi080 bash[24237]: cluster 2024-02-13T00:44:40.351256+0000 mgr.y (mgr.24461) 584 : cluster [DBG] pgmap v787: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:44:42.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:42 smithi080 bash[24237]: cluster 2024-02-13T00:44:41.163586+0000 mon.a (mon.0) 2434 : cluster [DBG] osdmap e415: 8 total, 8 up, 8 in 2024-02-13T00:44:42.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:42 smithi080 bash[24237]: audit 2024-02-13T00:44:41.166506+0000 mon.a (mon.0) 2435 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:44:43.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:43 smithi106 bash[18459]: audit 2024-02-13T00:44:42.177634+0000 mon.a (mon.0) 2436 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:44:43.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:43 smithi106 bash[18459]: cluster 2024-02-13T00:44:42.177945+0000 mon.a (mon.0) 2437 : cluster [DBG] osdmap e416: 8 total, 8 up, 8 in 2024-02-13T00:44:43.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:43 smithi106 bash[18459]: audit 2024-02-13T00:44:42.182379+0000 mon.a (mon.0) 2438 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:44:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:43 smithi080 bash[17386]: audit 2024-02-13T00:44:42.177634+0000 mon.a (mon.0) 2436 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:44:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:43 smithi080 bash[17386]: cluster 2024-02-13T00:44:42.177945+0000 mon.a (mon.0) 2437 : cluster [DBG] osdmap e416: 8 total, 8 up, 8 in 2024-02-13T00:44:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:43 smithi080 bash[17386]: audit 2024-02-13T00:44:42.182379+0000 mon.a (mon.0) 2438 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:44:43.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:44:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:44:43] "GET /metrics HTTP/1.1" 200 188057 "" "Prometheus/2.33.4" 2024-02-13T00:44:43.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:43 smithi080 bash[24237]: audit 2024-02-13T00:44:42.177634+0000 mon.a (mon.0) 2436 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:44:43.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:43 smithi080 bash[24237]: cluster 2024-02-13T00:44:42.177945+0000 mon.a (mon.0) 2437 : cluster [DBG] osdmap e416: 8 total, 8 up, 8 in 2024-02-13T00:44:43.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:43 smithi080 bash[24237]: audit 2024-02-13T00:44:42.182379+0000 mon.a (mon.0) 2438 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:44:44.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:44 smithi106 bash[18459]: cluster 2024-02-13T00:44:42.352019+0000 mgr.y (mgr.24461) 585 : cluster [DBG] pgmap v790: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:44:44.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:44 smithi106 bash[18459]: cluster 2024-02-13T00:44:43.181063+0000 mon.a (mon.0) 2439 : cluster [DBG] osdmap e417: 8 total, 8 up, 8 in 2024-02-13T00:44:44.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:44 smithi080 bash[24237]: cluster 2024-02-13T00:44:42.352019+0000 mgr.y (mgr.24461) 585 : cluster [DBG] pgmap v790: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:44:44.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:44 smithi080 bash[24237]: cluster 2024-02-13T00:44:43.181063+0000 mon.a (mon.0) 2439 : cluster [DBG] osdmap e417: 8 total, 8 up, 8 in 2024-02-13T00:44:44.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:44 smithi080 bash[17386]: cluster 2024-02-13T00:44:42.352019+0000 mgr.y (mgr.24461) 585 : cluster [DBG] pgmap v790: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:44:44.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:44 smithi080 bash[17386]: cluster 2024-02-13T00:44:43.181063+0000 mon.a (mon.0) 2439 : cluster [DBG] osdmap e417: 8 total, 8 up, 8 in 2024-02-13T00:44:45.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:45 smithi106 bash[18459]: cluster 2024-02-13T00:44:44.193624+0000 mon.a (mon.0) 2440 : cluster [DBG] osdmap e418: 8 total, 8 up, 8 in 2024-02-13T00:44:45.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:45 smithi106 bash[18459]: audit 2024-02-13T00:44:44.214175+0000 mon.a (mon.0) 2441 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "219.d"}]: dispatch 2024-02-13T00:44:45.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:45 smithi106 bash[18459]: audit 2024-02-13T00:44:44.214407+0000 mgr.y (mgr.24461) 586 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "219.d"}]: dispatch 2024-02-13T00:44:45.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:45 smithi080 bash[17386]: cluster 2024-02-13T00:44:44.193624+0000 mon.a (mon.0) 2440 : cluster [DBG] osdmap e418: 8 total, 8 up, 8 in 2024-02-13T00:44:45.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:45 smithi080 bash[17386]: audit 2024-02-13T00:44:44.214175+0000 mon.a (mon.0) 2441 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "219.d"}]: dispatch 2024-02-13T00:44:45.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:45 smithi080 bash[17386]: audit 2024-02-13T00:44:44.214407+0000 mgr.y (mgr.24461) 586 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "219.d"}]: dispatch 2024-02-13T00:44:45.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:45 smithi080 bash[24237]: cluster 2024-02-13T00:44:44.193624+0000 mon.a (mon.0) 2440 : cluster [DBG] osdmap e418: 8 total, 8 up, 8 in 2024-02-13T00:44:45.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:45 smithi080 bash[24237]: audit 2024-02-13T00:44:44.214175+0000 mon.a (mon.0) 2441 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "219.d"}]: dispatch 2024-02-13T00:44:45.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:45 smithi080 bash[24237]: audit 2024-02-13T00:44:44.214407+0000 mgr.y (mgr.24461) 586 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "219.d"}]: dispatch 2024-02-13T00:44:46.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:46 smithi106 bash[18459]: cluster 2024-02-13T00:44:44.352944+0000 mgr.y (mgr.24461) 587 : cluster [DBG] pgmap v793: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2024-02-13T00:44:46.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:46 smithi080 bash[17386]: cluster 2024-02-13T00:44:44.352944+0000 mgr.y (mgr.24461) 587 : cluster [DBG] pgmap v793: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2024-02-13T00:44:46.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:46 smithi080 bash[24237]: cluster 2024-02-13T00:44:44.352944+0000 mgr.y (mgr.24461) 587 : cluster [DBG] pgmap v793: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2024-02-13T00:44:48.488 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:48 smithi106 bash[18459]: cluster 2024-02-13T00:44:46.353775+0000 mgr.y (mgr.24461) 588 : cluster [DBG] pgmap v794: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 988 B/s rd, 1.9 KiB/s wr, 3 op/s 2024-02-13T00:44:48.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:48 smithi080 bash[17386]: cluster 2024-02-13T00:44:46.353775+0000 mgr.y (mgr.24461) 588 : cluster [DBG] pgmap v794: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 988 B/s rd, 1.9 KiB/s wr, 3 op/s 2024-02-13T00:44:48.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:48 smithi080 bash[24237]: cluster 2024-02-13T00:44:46.353775+0000 mgr.y (mgr.24461) 588 : cluster [DBG] pgmap v794: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 988 B/s rd, 1.9 KiB/s wr, 3 op/s 2024-02-13T00:44:48.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:44:48 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:44:50.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:44:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:44:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:44:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:50 smithi106 bash[18459]: cluster 2024-02-13T00:44:48.355945+0000 mgr.y (mgr.24461) 589 : cluster [DBG] pgmap v795: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.9 KiB/s wr, 4 op/s 2024-02-13T00:44:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:50 smithi106 bash[18459]: audit 2024-02-13T00:44:48.484999+0000 mgr.y (mgr.24461) 590 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:44:50.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:50 smithi080 bash[17386]: cluster 2024-02-13T00:44:48.355945+0000 mgr.y (mgr.24461) 589 : cluster [DBG] pgmap v795: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.9 KiB/s wr, 4 op/s 2024-02-13T00:44:50.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:50 smithi080 bash[17386]: audit 2024-02-13T00:44:48.484999+0000 mgr.y (mgr.24461) 590 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:44:50.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:50 smithi080 bash[24237]: cluster 2024-02-13T00:44:48.355945+0000 mgr.y (mgr.24461) 589 : cluster [DBG] pgmap v795: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.9 KiB/s wr, 4 op/s 2024-02-13T00:44:50.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:50 smithi080 bash[24237]: audit 2024-02-13T00:44:48.484999+0000 mgr.y (mgr.24461) 590 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:44:51.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:51 smithi106 bash[18459]: cluster 2024-02-13T00:44:49.859852+0000 osd.5 (osd.5) 3 : cluster [DBG] 219.d deep-scrub starts 2024-02-13T00:44:51.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:51 smithi106 bash[18459]: cluster 2024-02-13T00:44:49.864208+0000 osd.5 (osd.5) 4 : cluster [DBG] 219.d deep-scrub ok 2024-02-13T00:44:51.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:51 smithi080 bash[24237]: cluster 2024-02-13T00:44:49.859852+0000 osd.5 (osd.5) 3 : cluster [DBG] 219.d deep-scrub starts 2024-02-13T00:44:51.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:51 smithi080 bash[24237]: cluster 2024-02-13T00:44:49.864208+0000 osd.5 (osd.5) 4 : cluster [DBG] 219.d deep-scrub ok 2024-02-13T00:44:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:51 smithi080 bash[17386]: cluster 2024-02-13T00:44:49.859852+0000 osd.5 (osd.5) 3 : cluster [DBG] 219.d deep-scrub starts 2024-02-13T00:44:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:51 smithi080 bash[17386]: cluster 2024-02-13T00:44:49.864208+0000 osd.5 (osd.5) 4 : cluster [DBG] 219.d deep-scrub ok 2024-02-13T00:44:52.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:52 smithi106 bash[18459]: cluster 2024-02-13T00:44:50.356799+0000 mgr.y (mgr.24461) 591 : cluster [DBG] pgmap v796: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-13T00:44:52.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:52 smithi080 bash[17386]: cluster 2024-02-13T00:44:50.356799+0000 mgr.y (mgr.24461) 591 : cluster [DBG] pgmap v796: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-13T00:44:52.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:52 smithi080 bash[24237]: cluster 2024-02-13T00:44:50.356799+0000 mgr.y (mgr.24461) 591 : cluster [DBG] pgmap v796: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-13T00:44:53.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:44:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:44:53] "GET /metrics HTTP/1.1" 200 188191 "" "Prometheus/2.33.4" 2024-02-13T00:44:54.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:53 smithi106 bash[18459]: cluster 2024-02-13T00:44:52.357575+0000 mgr.y (mgr.24461) 592 : cluster [DBG] pgmap v797: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 557 B/s rd, 223 B/s wr, 1 op/s 2024-02-13T00:44:54.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:53 smithi080 bash[17386]: cluster 2024-02-13T00:44:52.357575+0000 mgr.y (mgr.24461) 592 : cluster [DBG] pgmap v797: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 557 B/s rd, 223 B/s wr, 1 op/s 2024-02-13T00:44:54.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:53 smithi080 bash[24237]: cluster 2024-02-13T00:44:52.357575+0000 mgr.y (mgr.24461) 592 : cluster [DBG] pgmap v797: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 557 B/s rd, 223 B/s wr, 1 op/s 2024-02-13T00:44:56.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:55 smithi106 bash[18459]: cluster 2024-02-13T00:44:54.359740+0000 mgr.y (mgr.24461) 593 : cluster [DBG] pgmap v798: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1007 B/s rd, 201 B/s wr, 1 op/s 2024-02-13T00:44:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:55 smithi080 bash[17386]: cluster 2024-02-13T00:44:54.359740+0000 mgr.y (mgr.24461) 593 : cluster [DBG] pgmap v798: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1007 B/s rd, 201 B/s wr, 1 op/s 2024-02-13T00:44:56.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:55 smithi080 bash[24237]: cluster 2024-02-13T00:44:54.359740+0000 mgr.y (mgr.24461) 593 : cluster [DBG] pgmap v798: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1007 B/s rd, 201 B/s wr, 1 op/s 2024-02-13T00:44:58.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:57 smithi106 bash[18459]: cluster 2024-02-13T00:44:56.360579+0000 mgr.y (mgr.24461) 594 : cluster [DBG] pgmap v799: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-02-13T00:44:58.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:57 smithi080 bash[17386]: cluster 2024-02-13T00:44:56.360579+0000 mgr.y (mgr.24461) 594 : cluster [DBG] pgmap v799: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-02-13T00:44:58.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:57 smithi080 bash[24237]: cluster 2024-02-13T00:44:56.360579+0000 mgr.y (mgr.24461) 594 : cluster [DBG] pgmap v799: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-02-13T00:44:58.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:44:58 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:45:00.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:59 smithi106 bash[18459]: cluster 2024-02-13T00:44:58.362723+0000 mgr.y (mgr.24461) 595 : cluster [DBG] pgmap v800: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 1 op/s 2024-02-13T00:45:00.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:44:59 smithi106 bash[18459]: audit 2024-02-13T00:44:58.496531+0000 mgr.y (mgr.24461) 596 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:45:00.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:59 smithi080 bash[17386]: cluster 2024-02-13T00:44:58.362723+0000 mgr.y (mgr.24461) 595 : cluster [DBG] pgmap v800: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 1 op/s 2024-02-13T00:45:00.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:44:59 smithi080 bash[17386]: audit 2024-02-13T00:44:58.496531+0000 mgr.y (mgr.24461) 596 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:45:00.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:59 smithi080 bash[24237]: cluster 2024-02-13T00:44:58.362723+0000 mgr.y (mgr.24461) 595 : cluster [DBG] pgmap v800: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 1 op/s 2024-02-13T00:45:00.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:44:59 smithi080 bash[24237]: audit 2024-02-13T00:44:58.496531+0000 mgr.y (mgr.24461) 596 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:45:00.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:45:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:45:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:45:02.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:01 smithi106 bash[18459]: cluster 2024-02-13T00:45:00.363305+0000 mgr.y (mgr.24461) 597 : cluster [DBG] pgmap v801: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:45:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:01 smithi080 bash[17386]: cluster 2024-02-13T00:45:00.363305+0000 mgr.y (mgr.24461) 597 : cluster [DBG] pgmap v801: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:45:02.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:01 smithi080 bash[24237]: cluster 2024-02-13T00:45:00.363305+0000 mgr.y (mgr.24461) 597 : cluster [DBG] pgmap v801: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:45:03.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:45:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:45:03] "GET /metrics HTTP/1.1" 200 188193 "" "Prometheus/2.33.4" 2024-02-13T00:45:04.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:03 smithi106 bash[18459]: cluster 2024-02-13T00:45:02.364061+0000 mgr.y (mgr.24461) 598 : cluster [DBG] pgmap v802: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:45:04.007 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:03 smithi080 bash[17386]: cluster 2024-02-13T00:45:02.364061+0000 mgr.y (mgr.24461) 598 : cluster [DBG] pgmap v802: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:45:04.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:03 smithi080 bash[24237]: cluster 2024-02-13T00:45:02.364061+0000 mgr.y (mgr.24461) 598 : cluster [DBG] pgmap v802: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:45:04.506 INFO:journalctl@ceph.osd.4.smithi106.stdout:Feb 13 00:45:04 smithi106 bash[22013]: debug 2024-02-13T00:45:04.238+0000 7fae09e9f700 -1 snap_mapper.add_oid found existing snaps mapped on 219:b4caa67b:test-rados-api-smithi080-54255-76::foo:2, removing 2024-02-13T00:45:04.506 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:45:04 smithi106 bash[26571]: debug 2024-02-13T00:45:04.238+0000 7fc38e5fe700 -1 snap_mapper.add_oid found existing snaps mapped on 219:b4caa67b:test-rados-api-smithi080-54255-76::foo:2, removing 2024-02-13T00:45:04.508 INFO:journalctl@ceph.osd.1.smithi080.stdout:Feb 13 00:45:04 smithi080 bash[31904]: debug 2024-02-13T00:45:04.236+0000 7ff0a7e90700 -1 snap_mapper.add_oid found existing snaps mapped on 219:b4caa67b:test-rados-api-smithi080-54255-76::foo:2, removing 2024-02-13T00:45:05.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:05 smithi106 bash[18459]: audit 2024-02-13T00:45:04.244790+0000 mon.a (mon.0) 2442 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:05 smithi106 bash[18459]: audit 2024-02-13T00:45:04.245737+0000 mon.a (mon.0) 2443 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-75"}]: dispatch 2024-02-13T00:45:05.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:05 smithi080 bash[24237]: audit 2024-02-13T00:45:04.244790+0000 mon.a (mon.0) 2442 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:05.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:05 smithi080 bash[24237]: audit 2024-02-13T00:45:04.245737+0000 mon.a (mon.0) 2443 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-75"}]: dispatch 2024-02-13T00:45:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:05 smithi080 bash[17386]: audit 2024-02-13T00:45:04.244790+0000 mon.a (mon.0) 2442 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:05 smithi080 bash[17386]: audit 2024-02-13T00:45:04.245737+0000 mon.a (mon.0) 2443 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-75"}]: dispatch 2024-02-13T00:45:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:06 smithi106 bash[18459]: cluster 2024-02-13T00:45:04.366118+0000 mgr.y (mgr.24461) 599 : cluster [DBG] pgmap v803: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:45:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:06 smithi106 bash[18459]: cluster 2024-02-13T00:45:04.754163+0000 mon.a (mon.0) 2444 : cluster [DBG] osdmap e419: 8 total, 8 up, 8 in 2024-02-13T00:45:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:06 smithi106 bash[18459]: cluster 2024-02-13T00:45:05.759766+0000 mon.a (mon.0) 2445 : cluster [DBG] osdmap e420: 8 total, 8 up, 8 in 2024-02-13T00:45:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:06 smithi106 bash[18459]: audit 2024-02-13T00:45:05.763871+0000 mon.a (mon.0) 2446 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:45:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:06 smithi080 bash[17386]: cluster 2024-02-13T00:45:04.366118+0000 mgr.y (mgr.24461) 599 : cluster [DBG] pgmap v803: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:45:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:06 smithi080 bash[17386]: cluster 2024-02-13T00:45:04.754163+0000 mon.a (mon.0) 2444 : cluster [DBG] osdmap e419: 8 total, 8 up, 8 in 2024-02-13T00:45:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:06 smithi080 bash[17386]: cluster 2024-02-13T00:45:05.759766+0000 mon.a (mon.0) 2445 : cluster [DBG] osdmap e420: 8 total, 8 up, 8 in 2024-02-13T00:45:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:06 smithi080 bash[17386]: audit 2024-02-13T00:45:05.763871+0000 mon.a (mon.0) 2446 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:45:06.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:06 smithi080 bash[24237]: cluster 2024-02-13T00:45:04.366118+0000 mgr.y (mgr.24461) 599 : cluster [DBG] pgmap v803: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:45:06.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:06 smithi080 bash[24237]: cluster 2024-02-13T00:45:04.754163+0000 mon.a (mon.0) 2444 : cluster [DBG] osdmap e419: 8 total, 8 up, 8 in 2024-02-13T00:45:06.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:06 smithi080 bash[24237]: cluster 2024-02-13T00:45:05.759766+0000 mon.a (mon.0) 2445 : cluster [DBG] osdmap e420: 8 total, 8 up, 8 in 2024-02-13T00:45:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:06 smithi080 bash[24237]: audit 2024-02-13T00:45:05.763871+0000 mon.a (mon.0) 2446 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:45:08.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:07 smithi106 bash[18459]: cluster 2024-02-13T00:45:06.366817+0000 mgr.y (mgr.24461) 600 : cluster [DBG] pgmap v806: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:45:08.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:07 smithi106 bash[18459]: audit 2024-02-13T00:45:06.759124+0000 mon.a (mon.0) 2447 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:45:08.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:07 smithi106 bash[18459]: cluster 2024-02-13T00:45:06.759415+0000 mon.a (mon.0) 2448 : cluster [DBG] osdmap e421: 8 total, 8 up, 8 in 2024-02-13T00:45:08.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:07 smithi106 bash[18459]: audit 2024-02-13T00:45:06.768387+0000 mon.a (mon.0) 2449 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:45:08.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:07 smithi106 bash[18459]: audit 2024-02-13T00:45:06.772958+0000 mon.a (mon.0) 2450 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:45:08.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:07 smithi080 bash[24237]: cluster 2024-02-13T00:45:06.366817+0000 mgr.y (mgr.24461) 600 : cluster [DBG] pgmap v806: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:45:08.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:07 smithi080 bash[24237]: audit 2024-02-13T00:45:06.759124+0000 mon.a (mon.0) 2447 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:45:08.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:07 smithi080 bash[24237]: cluster 2024-02-13T00:45:06.759415+0000 mon.a (mon.0) 2448 : cluster [DBG] osdmap e421: 8 total, 8 up, 8 in 2024-02-13T00:45:08.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:07 smithi080 bash[24237]: audit 2024-02-13T00:45:06.768387+0000 mon.a (mon.0) 2449 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:45:08.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:07 smithi080 bash[24237]: audit 2024-02-13T00:45:06.772958+0000 mon.a (mon.0) 2450 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:45:08.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:07 smithi080 bash[17386]: cluster 2024-02-13T00:45:06.366817+0000 mgr.y (mgr.24461) 600 : cluster [DBG] pgmap v806: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:45:08.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:07 smithi080 bash[17386]: audit 2024-02-13T00:45:06.759124+0000 mon.a (mon.0) 2447 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:45:08.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:07 smithi080 bash[17386]: cluster 2024-02-13T00:45:06.759415+0000 mon.a (mon.0) 2448 : cluster [DBG] osdmap e421: 8 total, 8 up, 8 in 2024-02-13T00:45:08.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:07 smithi080 bash[17386]: audit 2024-02-13T00:45:06.768387+0000 mon.a (mon.0) 2449 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:45:08.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:07 smithi080 bash[17386]: audit 2024-02-13T00:45:06.772958+0000 mon.a (mon.0) 2450 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:45:08.772 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:45:08 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:45:09.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:08 smithi106 bash[18459]: audit 2024-02-13T00:45:07.760581+0000 mon.a (mon.0) 2451 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:45:09.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:08 smithi106 bash[18459]: cluster 2024-02-13T00:45:07.760710+0000 mon.a (mon.0) 2452 : cluster [DBG] osdmap e422: 8 total, 8 up, 8 in 2024-02-13T00:45:09.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:08 smithi106 bash[18459]: audit 2024-02-13T00:45:07.765682+0000 mon.a (mon.0) 2453 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_tier","val": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:09.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:08 smithi106 bash[18459]: audit 2024-02-13T00:45:07.994868+0000 mon.c (mon.2) 374 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:45:09.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:08 smithi106 bash[18459]: audit 2024-02-13T00:45:08.290975+0000 mon.c (mon.2) 375 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:45:09.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:08 smithi106 bash[18459]: audit 2024-02-13T00:45:08.292495+0000 mon.c (mon.2) 376 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:45:09.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:08 smithi106 bash[18459]: audit 2024-02-13T00:45:08.301310+0000 mon.a (mon.0) 2454 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:45:09.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:08 smithi106 bash[18459]: audit 2024-02-13T00:45:08.764790+0000 mon.a (mon.0) 2455 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_tier","val": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:45:09.257 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:08 smithi106 bash[18459]: cluster 2024-02-13T00:45:08.764886+0000 mon.a (mon.0) 2456 : cluster [DBG] osdmap e423: 8 total, 8 up, 8 in 2024-02-13T00:45:09.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:08 smithi080 bash[24237]: audit 2024-02-13T00:45:07.760581+0000 mon.a (mon.0) 2451 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:45:09.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:08 smithi080 bash[24237]: cluster 2024-02-13T00:45:07.760710+0000 mon.a (mon.0) 2452 : cluster [DBG] osdmap e422: 8 total, 8 up, 8 in 2024-02-13T00:45:09.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:08 smithi080 bash[24237]: audit 2024-02-13T00:45:07.765682+0000 mon.a (mon.0) 2453 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_tier","val": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:09.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:08 smithi080 bash[24237]: audit 2024-02-13T00:45:07.994868+0000 mon.c (mon.2) 374 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:45:09.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:08 smithi080 bash[24237]: audit 2024-02-13T00:45:08.290975+0000 mon.c (mon.2) 375 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:45:09.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:08 smithi080 bash[24237]: audit 2024-02-13T00:45:08.292495+0000 mon.c (mon.2) 376 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:45:09.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:08 smithi080 bash[24237]: audit 2024-02-13T00:45:08.301310+0000 mon.a (mon.0) 2454 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:45:09.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:08 smithi080 bash[24237]: audit 2024-02-13T00:45:08.764790+0000 mon.a (mon.0) 2455 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_tier","val": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:45:09.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:08 smithi080 bash[24237]: cluster 2024-02-13T00:45:08.764886+0000 mon.a (mon.0) 2456 : cluster [DBG] osdmap e423: 8 total, 8 up, 8 in 2024-02-13T00:45:09.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:08 smithi080 bash[17386]: audit 2024-02-13T00:45:07.760581+0000 mon.a (mon.0) 2451 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:45:09.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:08 smithi080 bash[17386]: cluster 2024-02-13T00:45:07.760710+0000 mon.a (mon.0) 2452 : cluster [DBG] osdmap e422: 8 total, 8 up, 8 in 2024-02-13T00:45:09.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:08 smithi080 bash[17386]: audit 2024-02-13T00:45:07.765682+0000 mon.a (mon.0) 2453 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_tier","val": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:09.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:08 smithi080 bash[17386]: audit 2024-02-13T00:45:07.994868+0000 mon.c (mon.2) 374 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:45:09.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:08 smithi080 bash[17386]: audit 2024-02-13T00:45:08.290975+0000 mon.c (mon.2) 375 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:45:09.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:08 smithi080 bash[17386]: audit 2024-02-13T00:45:08.292495+0000 mon.c (mon.2) 376 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:45:09.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:08 smithi080 bash[17386]: audit 2024-02-13T00:45:08.301310+0000 mon.a (mon.0) 2454 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:45:09.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:08 smithi080 bash[17386]: audit 2024-02-13T00:45:08.764790+0000 mon.a (mon.0) 2455 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_tier","val": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:45:09.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:08 smithi080 bash[17386]: cluster 2024-02-13T00:45:08.764886+0000 mon.a (mon.0) 2456 : cluster [DBG] osdmap e423: 8 total, 8 up, 8 in 2024-02-13T00:45:10.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:09 smithi106 bash[18459]: cluster 2024-02-13T00:45:08.368406+0000 mgr.y (mgr.24461) 601 : cluster [DBG] pgmap v809: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-02-13T00:45:10.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:09 smithi106 bash[18459]: audit 2024-02-13T00:45:08.505891+0000 mgr.y (mgr.24461) 602 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:45:10.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:09 smithi106 bash[18459]: audit 2024-02-13T00:45:08.768033+0000 mon.a (mon.0) 2457 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T00:45:10.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:09 smithi080 bash[17386]: cluster 2024-02-13T00:45:08.368406+0000 mgr.y (mgr.24461) 601 : cluster [DBG] pgmap v809: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-02-13T00:45:10.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:09 smithi080 bash[17386]: audit 2024-02-13T00:45:08.505891+0000 mgr.y (mgr.24461) 602 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:45:10.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:09 smithi080 bash[17386]: audit 2024-02-13T00:45:08.768033+0000 mon.a (mon.0) 2457 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T00:45:10.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:09 smithi080 bash[24237]: cluster 2024-02-13T00:45:08.368406+0000 mgr.y (mgr.24461) 601 : cluster [DBG] pgmap v809: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-02-13T00:45:10.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:09 smithi080 bash[24237]: audit 2024-02-13T00:45:08.505891+0000 mgr.y (mgr.24461) 602 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:45:10.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:09 smithi080 bash[24237]: audit 2024-02-13T00:45:08.768033+0000 mon.a (mon.0) 2457 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T00:45:10.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:45:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:45:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:45:11.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:10 smithi106 bash[18459]: audit 2024-02-13T00:45:09.767666+0000 mon.a (mon.0) 2458 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T00:45:11.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:10 smithi106 bash[18459]: cluster 2024-02-13T00:45:09.767913+0000 mon.a (mon.0) 2459 : cluster [DBG] osdmap e424: 8 total, 8 up, 8 in 2024-02-13T00:45:11.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:10 smithi106 bash[18459]: audit 2024-02-13T00:45:09.769794+0000 mon.a (mon.0) 2460 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T00:45:11.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:10 smithi106 bash[18459]: audit 2024-02-13T00:45:10.768365+0000 mon.a (mon.0) 2461 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T00:45:11.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:10 smithi106 bash[18459]: cluster 2024-02-13T00:45:10.768490+0000 mon.a (mon.0) 2462 : cluster [DBG] osdmap e425: 8 total, 8 up, 8 in 2024-02-13T00:45:11.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:10 smithi080 bash[17386]: audit 2024-02-13T00:45:09.767666+0000 mon.a (mon.0) 2458 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T00:45:11.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:10 smithi080 bash[17386]: cluster 2024-02-13T00:45:09.767913+0000 mon.a (mon.0) 2459 : cluster [DBG] osdmap e424: 8 total, 8 up, 8 in 2024-02-13T00:45:11.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:10 smithi080 bash[17386]: audit 2024-02-13T00:45:09.769794+0000 mon.a (mon.0) 2460 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T00:45:11.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:10 smithi080 bash[17386]: audit 2024-02-13T00:45:10.768365+0000 mon.a (mon.0) 2461 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T00:45:11.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:10 smithi080 bash[17386]: cluster 2024-02-13T00:45:10.768490+0000 mon.a (mon.0) 2462 : cluster [DBG] osdmap e425: 8 total, 8 up, 8 in 2024-02-13T00:45:11.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:10 smithi080 bash[24237]: audit 2024-02-13T00:45:09.767666+0000 mon.a (mon.0) 2458 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T00:45:11.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:10 smithi080 bash[24237]: cluster 2024-02-13T00:45:09.767913+0000 mon.a (mon.0) 2459 : cluster [DBG] osdmap e424: 8 total, 8 up, 8 in 2024-02-13T00:45:11.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:10 smithi080 bash[24237]: audit 2024-02-13T00:45:09.769794+0000 mon.a (mon.0) 2460 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T00:45:11.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:10 smithi080 bash[24237]: audit 2024-02-13T00:45:10.768365+0000 mon.a (mon.0) 2461 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T00:45:11.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:10 smithi080 bash[24237]: cluster 2024-02-13T00:45:10.768490+0000 mon.a (mon.0) 2462 : cluster [DBG] osdmap e425: 8 total, 8 up, 8 in 2024-02-13T00:45:12.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:11 smithi106 bash[18459]: cluster 2024-02-13T00:45:10.369243+0000 mgr.y (mgr.24461) 603 : cluster [DBG] pgmap v812: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-13T00:45:12.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:11 smithi106 bash[18459]: audit 2024-02-13T00:45:10.794993+0000 mon.a (mon.0) 2463 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-02-13T00:45:12.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:11 smithi080 bash[17386]: cluster 2024-02-13T00:45:10.369243+0000 mgr.y (mgr.24461) 603 : cluster [DBG] pgmap v812: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-13T00:45:12.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:11 smithi080 bash[17386]: audit 2024-02-13T00:45:10.794993+0000 mon.a (mon.0) 2463 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-02-13T00:45:12.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:11 smithi080 bash[24237]: cluster 2024-02-13T00:45:10.369243+0000 mgr.y (mgr.24461) 603 : cluster [DBG] pgmap v812: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-13T00:45:12.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:11 smithi080 bash[24237]: audit 2024-02-13T00:45:10.794993+0000 mon.a (mon.0) 2463 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-02-13T00:45:13.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:12 smithi080 bash[17386]: audit 2024-02-13T00:45:11.794331+0000 mon.a (mon.0) 2464 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-02-13T00:45:13.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:12 smithi080 bash[17386]: cluster 2024-02-13T00:45:11.794424+0000 mon.a (mon.0) 2465 : cluster [DBG] osdmap e426: 8 total, 8 up, 8 in 2024-02-13T00:45:13.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:12 smithi080 bash[17386]: audit 2024-02-13T00:45:11.819464+0000 mon.a (mon.0) 2466 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-02-13T00:45:13.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:12 smithi080 bash[24237]: audit 2024-02-13T00:45:11.794331+0000 mon.a (mon.0) 2464 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-02-13T00:45:13.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:12 smithi080 bash[24237]: cluster 2024-02-13T00:45:11.794424+0000 mon.a (mon.0) 2465 : cluster [DBG] osdmap e426: 8 total, 8 up, 8 in 2024-02-13T00:45:13.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:12 smithi080 bash[24237]: audit 2024-02-13T00:45:11.819464+0000 mon.a (mon.0) 2466 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-02-13T00:45:13.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:12 smithi106 bash[18459]: audit 2024-02-13T00:45:11.794331+0000 mon.a (mon.0) 2464 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-02-13T00:45:13.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:12 smithi106 bash[18459]: cluster 2024-02-13T00:45:11.794424+0000 mon.a (mon.0) 2465 : cluster [DBG] osdmap e426: 8 total, 8 up, 8 in 2024-02-13T00:45:13.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:12 smithi106 bash[18459]: audit 2024-02-13T00:45:11.819464+0000 mon.a (mon.0) 2466 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-02-13T00:45:13.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:45:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:45:13] "GET /metrics HTTP/1.1" 200 188193 "" "Prometheus/2.33.4" 2024-02-13T00:45:14.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:13 smithi106 bash[18459]: cluster 2024-02-13T00:45:12.370047+0000 mgr.y (mgr.24461) 604 : cluster [DBG] pgmap v815: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:45:14.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:13 smithi106 bash[18459]: audit 2024-02-13T00:45:12.808137+0000 mon.a (mon.0) 2467 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-02-13T00:45:14.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:13 smithi106 bash[18459]: cluster 2024-02-13T00:45:12.808232+0000 mon.a (mon.0) 2468 : cluster [DBG] osdmap e427: 8 total, 8 up, 8 in 2024-02-13T00:45:14.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:13 smithi106 bash[18459]: audit 2024-02-13T00:45:12.825444+0000 mon.a (mon.0) 2469 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T00:45:14.288 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:13 smithi080 bash[17386]: cluster 2024-02-13T00:45:12.370047+0000 mgr.y (mgr.24461) 604 : cluster [DBG] pgmap v815: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:45:14.288 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:13 smithi080 bash[17386]: audit 2024-02-13T00:45:12.808137+0000 mon.a (mon.0) 2467 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-02-13T00:45:14.288 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:13 smithi080 bash[17386]: cluster 2024-02-13T00:45:12.808232+0000 mon.a (mon.0) 2468 : cluster [DBG] osdmap e427: 8 total, 8 up, 8 in 2024-02-13T00:45:14.288 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:13 smithi080 bash[17386]: audit 2024-02-13T00:45:12.825444+0000 mon.a (mon.0) 2469 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T00:45:14.288 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:13 smithi080 bash[24237]: cluster 2024-02-13T00:45:12.370047+0000 mgr.y (mgr.24461) 604 : cluster [DBG] pgmap v815: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:45:14.288 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:13 smithi080 bash[24237]: audit 2024-02-13T00:45:12.808137+0000 mon.a (mon.0) 2467 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-02-13T00:45:14.288 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:13 smithi080 bash[24237]: cluster 2024-02-13T00:45:12.808232+0000 mon.a (mon.0) 2468 : cluster [DBG] osdmap e427: 8 total, 8 up, 8 in 2024-02-13T00:45:14.288 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:13 smithi080 bash[24237]: audit 2024-02-13T00:45:12.825444+0000 mon.a (mon.0) 2469 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T00:45:15.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:14 smithi106 bash[18459]: audit 2024-02-13T00:45:13.811697+0000 mon.a (mon.0) 2470 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T00:45:15.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:14 smithi106 bash[18459]: cluster 2024-02-13T00:45:13.811786+0000 mon.a (mon.0) 2471 : cluster [DBG] osdmap e428: 8 total, 8 up, 8 in 2024-02-13T00:45:15.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:14 smithi106 bash[18459]: audit 2024-02-13T00:45:13.857036+0000 mon.a (mon.0) 2472 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:15.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:14 smithi106 bash[18459]: audit 2024-02-13T00:45:13.857859+0000 mon.a (mon.0) 2473 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-77"}]: dispatch 2024-02-13T00:45:15.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:14 smithi080 bash[17386]: audit 2024-02-13T00:45:13.811697+0000 mon.a (mon.0) 2470 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T00:45:15.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:14 smithi080 bash[17386]: cluster 2024-02-13T00:45:13.811786+0000 mon.a (mon.0) 2471 : cluster [DBG] osdmap e428: 8 total, 8 up, 8 in 2024-02-13T00:45:15.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:14 smithi080 bash[17386]: audit 2024-02-13T00:45:13.857036+0000 mon.a (mon.0) 2472 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:15.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:14 smithi080 bash[17386]: audit 2024-02-13T00:45:13.857859+0000 mon.a (mon.0) 2473 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-77"}]: dispatch 2024-02-13T00:45:15.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:14 smithi080 bash[24237]: audit 2024-02-13T00:45:13.811697+0000 mon.a (mon.0) 2470 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-77","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T00:45:15.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:14 smithi080 bash[24237]: cluster 2024-02-13T00:45:13.811786+0000 mon.a (mon.0) 2471 : cluster [DBG] osdmap e428: 8 total, 8 up, 8 in 2024-02-13T00:45:15.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:14 smithi080 bash[24237]: audit 2024-02-13T00:45:13.857036+0000 mon.a (mon.0) 2472 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:15.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:14 smithi080 bash[24237]: audit 2024-02-13T00:45:13.857859+0000 mon.a (mon.0) 2473 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-77"}]: dispatch 2024-02-13T00:45:16.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:15 smithi106 bash[18459]: cluster 2024-02-13T00:45:14.370863+0000 mgr.y (mgr.24461) 605 : cluster [DBG] pgmap v818: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.5 KiB/s rd, 9.2 KiB/s wr, 22 op/s 2024-02-13T00:45:16.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:15 smithi106 bash[18459]: cluster 2024-02-13T00:45:14.835527+0000 mon.a (mon.0) 2474 : cluster [DBG] osdmap e429: 8 total, 8 up, 8 in 2024-02-13T00:45:16.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:15 smithi080 bash[17386]: cluster 2024-02-13T00:45:14.370863+0000 mgr.y (mgr.24461) 605 : cluster [DBG] pgmap v818: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.5 KiB/s rd, 9.2 KiB/s wr, 22 op/s 2024-02-13T00:45:16.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:15 smithi080 bash[17386]: cluster 2024-02-13T00:45:14.835527+0000 mon.a (mon.0) 2474 : cluster [DBG] osdmap e429: 8 total, 8 up, 8 in 2024-02-13T00:45:16.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:15 smithi080 bash[24237]: cluster 2024-02-13T00:45:14.370863+0000 mgr.y (mgr.24461) 605 : cluster [DBG] pgmap v818: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.5 KiB/s rd, 9.2 KiB/s wr, 22 op/s 2024-02-13T00:45:16.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:15 smithi080 bash[24237]: cluster 2024-02-13T00:45:14.835527+0000 mon.a (mon.0) 2474 : cluster [DBG] osdmap e429: 8 total, 8 up, 8 in 2024-02-13T00:45:17.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:16 smithi106 bash[18459]: cluster 2024-02-13T00:45:15.843725+0000 mon.a (mon.0) 2475 : cluster [DBG] osdmap e430: 8 total, 8 up, 8 in 2024-02-13T00:45:17.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:16 smithi106 bash[18459]: audit 2024-02-13T00:45:15.850917+0000 mon.a (mon.0) 2476 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:45:17.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:16 smithi106 bash[18459]: audit 2024-02-13T00:45:16.841425+0000 mon.a (mon.0) 2477 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:45:17.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:16 smithi106 bash[18459]: cluster 2024-02-13T00:45:16.841655+0000 mon.a (mon.0) 2478 : cluster [DBG] osdmap e431: 8 total, 8 up, 8 in 2024-02-13T00:45:17.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:16 smithi106 bash[18459]: audit 2024-02-13T00:45:16.848066+0000 mon.a (mon.0) 2479 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:45:17.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:16 smithi080 bash[17386]: cluster 2024-02-13T00:45:15.843725+0000 mon.a (mon.0) 2475 : cluster [DBG] osdmap e430: 8 total, 8 up, 8 in 2024-02-13T00:45:17.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:16 smithi080 bash[17386]: audit 2024-02-13T00:45:15.850917+0000 mon.a (mon.0) 2476 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:45:17.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:16 smithi080 bash[17386]: audit 2024-02-13T00:45:16.841425+0000 mon.a (mon.0) 2477 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:45:17.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:16 smithi080 bash[17386]: cluster 2024-02-13T00:45:16.841655+0000 mon.a (mon.0) 2478 : cluster [DBG] osdmap e431: 8 total, 8 up, 8 in 2024-02-13T00:45:17.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:16 smithi080 bash[17386]: audit 2024-02-13T00:45:16.848066+0000 mon.a (mon.0) 2479 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:45:17.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:16 smithi080 bash[24237]: cluster 2024-02-13T00:45:15.843725+0000 mon.a (mon.0) 2475 : cluster [DBG] osdmap e430: 8 total, 8 up, 8 in 2024-02-13T00:45:17.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:16 smithi080 bash[24237]: audit 2024-02-13T00:45:15.850917+0000 mon.a (mon.0) 2476 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:45:17.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:16 smithi080 bash[24237]: audit 2024-02-13T00:45:16.841425+0000 mon.a (mon.0) 2477 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:45:17.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:16 smithi080 bash[24237]: cluster 2024-02-13T00:45:16.841655+0000 mon.a (mon.0) 2478 : cluster [DBG] osdmap e431: 8 total, 8 up, 8 in 2024-02-13T00:45:17.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:16 smithi080 bash[24237]: audit 2024-02-13T00:45:16.848066+0000 mon.a (mon.0) 2479 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:45:18.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:17 smithi106 bash[18459]: cluster 2024-02-13T00:45:16.371697+0000 mgr.y (mgr.24461) 606 : cluster [DBG] pgmap v821: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.5 KiB/s rd, 7.0 KiB/s wr, 22 op/s 2024-02-13T00:45:18.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:17 smithi106 bash[18459]: audit 2024-02-13T00:45:16.853193+0000 mon.a (mon.0) 2480 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:45:18.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:17 smithi106 bash[18459]: audit 2024-02-13T00:45:17.844712+0000 mon.a (mon.0) 2481 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:45:18.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:17 smithi106 bash[18459]: cluster 2024-02-13T00:45:17.844849+0000 mon.a (mon.0) 2482 : cluster [DBG] osdmap e432: 8 total, 8 up, 8 in 2024-02-13T00:45:18.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:17 smithi106 bash[18459]: audit 2024-02-13T00:45:17.845423+0000 mon.a (mon.0) 2483 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "dedup_tier","val": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:17 smithi080 bash[17386]: cluster 2024-02-13T00:45:16.371697+0000 mgr.y (mgr.24461) 606 : cluster [DBG] pgmap v821: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.5 KiB/s rd, 7.0 KiB/s wr, 22 op/s 2024-02-13T00:45:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:17 smithi080 bash[17386]: audit 2024-02-13T00:45:16.853193+0000 mon.a (mon.0) 2480 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:45:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:17 smithi080 bash[17386]: audit 2024-02-13T00:45:17.844712+0000 mon.a (mon.0) 2481 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:45:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:17 smithi080 bash[17386]: cluster 2024-02-13T00:45:17.844849+0000 mon.a (mon.0) 2482 : cluster [DBG] osdmap e432: 8 total, 8 up, 8 in 2024-02-13T00:45:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:17 smithi080 bash[17386]: audit 2024-02-13T00:45:17.845423+0000 mon.a (mon.0) 2483 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "dedup_tier","val": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:18.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:17 smithi080 bash[24237]: cluster 2024-02-13T00:45:16.371697+0000 mgr.y (mgr.24461) 606 : cluster [DBG] pgmap v821: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 4.5 KiB/s rd, 7.0 KiB/s wr, 22 op/s 2024-02-13T00:45:18.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:17 smithi080 bash[24237]: audit 2024-02-13T00:45:16.853193+0000 mon.a (mon.0) 2480 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:45:18.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:17 smithi080 bash[24237]: audit 2024-02-13T00:45:17.844712+0000 mon.a (mon.0) 2481 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:45:18.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:17 smithi080 bash[24237]: cluster 2024-02-13T00:45:17.844849+0000 mon.a (mon.0) 2482 : cluster [DBG] osdmap e432: 8 total, 8 up, 8 in 2024-02-13T00:45:18.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:17 smithi080 bash[24237]: audit 2024-02-13T00:45:17.845423+0000 mon.a (mon.0) 2483 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "dedup_tier","val": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:19.006 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:45:18 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:45:20.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:19 smithi106 bash[18459]: cluster 2024-02-13T00:45:18.373278+0000 mgr.y (mgr.24461) 607 : cluster [DBG] pgmap v824: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.7 KiB/s rd, 3.0 KiB/s wr, 17 op/s 2024-02-13T00:45:20.143 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:19 smithi106 bash[18459]: audit 2024-02-13T00:45:18.517410+0000 mgr.y (mgr.24461) 608 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:45:20.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:19 smithi106 bash[18459]: audit 2024-02-13T00:45:18.846442+0000 mon.a (mon.0) 2484 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "dedup_tier","val": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:45:20.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:19 smithi106 bash[18459]: cluster 2024-02-13T00:45:18.846560+0000 mon.a (mon.0) 2485 : cluster [DBG] osdmap e433: 8 total, 8 up, 8 in 2024-02-13T00:45:20.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:19 smithi106 bash[18459]: audit 2024-02-13T00:45:18.847539+0000 mon.a (mon.0) 2486 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T00:45:20.144 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:45:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:45:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:45:20.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:19 smithi080 bash[24237]: cluster 2024-02-13T00:45:18.373278+0000 mgr.y (mgr.24461) 607 : cluster [DBG] pgmap v824: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.7 KiB/s rd, 3.0 KiB/s wr, 17 op/s 2024-02-13T00:45:20.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:19 smithi080 bash[24237]: audit 2024-02-13T00:45:18.517410+0000 mgr.y (mgr.24461) 608 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:45:20.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:19 smithi080 bash[24237]: audit 2024-02-13T00:45:18.846442+0000 mon.a (mon.0) 2484 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "dedup_tier","val": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:45:20.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:19 smithi080 bash[24237]: cluster 2024-02-13T00:45:18.846560+0000 mon.a (mon.0) 2485 : cluster [DBG] osdmap e433: 8 total, 8 up, 8 in 2024-02-13T00:45:20.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:19 smithi080 bash[24237]: audit 2024-02-13T00:45:18.847539+0000 mon.a (mon.0) 2486 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T00:45:20.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:19 smithi080 bash[17386]: cluster 2024-02-13T00:45:18.373278+0000 mgr.y (mgr.24461) 607 : cluster [DBG] pgmap v824: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.7 KiB/s rd, 3.0 KiB/s wr, 17 op/s 2024-02-13T00:45:20.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:19 smithi080 bash[17386]: audit 2024-02-13T00:45:18.517410+0000 mgr.y (mgr.24461) 608 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:45:20.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:19 smithi080 bash[17386]: audit 2024-02-13T00:45:18.846442+0000 mon.a (mon.0) 2484 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "dedup_tier","val": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:45:20.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:19 smithi080 bash[17386]: cluster 2024-02-13T00:45:18.846560+0000 mon.a (mon.0) 2485 : cluster [DBG] osdmap e433: 8 total, 8 up, 8 in 2024-02-13T00:45:20.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:19 smithi080 bash[17386]: audit 2024-02-13T00:45:18.847539+0000 mon.a (mon.0) 2486 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T00:45:21.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:20 smithi106 bash[18459]: audit 2024-02-13T00:45:19.850087+0000 mon.a (mon.0) 2487 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T00:45:21.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:20 smithi106 bash[18459]: cluster 2024-02-13T00:45:19.850266+0000 mon.a (mon.0) 2488 : cluster [DBG] osdmap e434: 8 total, 8 up, 8 in 2024-02-13T00:45:21.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:20 smithi106 bash[18459]: audit 2024-02-13T00:45:19.854962+0000 mon.a (mon.0) 2489 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T00:45:21.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:20 smithi106 bash[18459]: audit 2024-02-13T00:45:20.853515+0000 mon.a (mon.0) 2490 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T00:45:21.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:20 smithi106 bash[18459]: cluster 2024-02-13T00:45:20.853662+0000 mon.a (mon.0) 2491 : cluster [DBG] osdmap e435: 8 total, 8 up, 8 in 2024-02-13T00:45:21.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:20 smithi080 bash[17386]: audit 2024-02-13T00:45:19.850087+0000 mon.a (mon.0) 2487 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T00:45:21.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:20 smithi080 bash[17386]: cluster 2024-02-13T00:45:19.850266+0000 mon.a (mon.0) 2488 : cluster [DBG] osdmap e434: 8 total, 8 up, 8 in 2024-02-13T00:45:21.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:20 smithi080 bash[17386]: audit 2024-02-13T00:45:19.854962+0000 mon.a (mon.0) 2489 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T00:45:21.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:20 smithi080 bash[17386]: audit 2024-02-13T00:45:20.853515+0000 mon.a (mon.0) 2490 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T00:45:21.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:20 smithi080 bash[17386]: cluster 2024-02-13T00:45:20.853662+0000 mon.a (mon.0) 2491 : cluster [DBG] osdmap e435: 8 total, 8 up, 8 in 2024-02-13T00:45:21.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:20 smithi080 bash[24237]: audit 2024-02-13T00:45:19.850087+0000 mon.a (mon.0) 2487 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T00:45:21.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:20 smithi080 bash[24237]: cluster 2024-02-13T00:45:19.850266+0000 mon.a (mon.0) 2488 : cluster [DBG] osdmap e434: 8 total, 8 up, 8 in 2024-02-13T00:45:21.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:20 smithi080 bash[24237]: audit 2024-02-13T00:45:19.854962+0000 mon.a (mon.0) 2489 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T00:45:21.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:20 smithi080 bash[24237]: audit 2024-02-13T00:45:20.853515+0000 mon.a (mon.0) 2490 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-79","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T00:45:21.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:20 smithi080 bash[24237]: cluster 2024-02-13T00:45:20.853662+0000 mon.a (mon.0) 2491 : cluster [DBG] osdmap e435: 8 total, 8 up, 8 in 2024-02-13T00:45:22.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:21 smithi106 bash[18459]: cluster 2024-02-13T00:45:20.374080+0000 mgr.y (mgr.24461) 609 : cluster [DBG] pgmap v827: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.7 KiB/s rd, 5.2 KiB/s wr, 18 op/s 2024-02-13T00:45:22.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:21 smithi080 bash[17386]: cluster 2024-02-13T00:45:20.374080+0000 mgr.y (mgr.24461) 609 : cluster [DBG] pgmap v827: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.7 KiB/s rd, 5.2 KiB/s wr, 18 op/s 2024-02-13T00:45:22.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:21 smithi080 bash[24237]: cluster 2024-02-13T00:45:20.374080+0000 mgr.y (mgr.24461) 609 : cluster [DBG] pgmap v827: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.7 KiB/s rd, 5.2 KiB/s wr, 18 op/s 2024-02-13T00:45:23.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:22 smithi106 bash[18459]: cluster 2024-02-13T00:45:21.877190+0000 mon.a (mon.0) 2492 : cluster [DBG] osdmap e436: 8 total, 8 up, 8 in 2024-02-13T00:45:23.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:22 smithi080 bash[17386]: cluster 2024-02-13T00:45:21.877190+0000 mon.a (mon.0) 2492 : cluster [DBG] osdmap e436: 8 total, 8 up, 8 in 2024-02-13T00:45:23.258 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:45:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:45:23] "GET /metrics HTTP/1.1" 200 188293 "" "Prometheus/2.33.4" 2024-02-13T00:45:23.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:22 smithi080 bash[24237]: cluster 2024-02-13T00:45:21.877190+0000 mon.a (mon.0) 2492 : cluster [DBG] osdmap e436: 8 total, 8 up, 8 in 2024-02-13T00:45:24.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:23 smithi106 bash[18459]: cluster 2024-02-13T00:45:22.374884+0000 mgr.y (mgr.24461) 610 : cluster [DBG] pgmap v830: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:45:24.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:23 smithi106 bash[18459]: cluster 2024-02-13T00:45:22.896115+0000 mon.a (mon.0) 2493 : cluster [DBG] osdmap e437: 8 total, 8 up, 8 in 2024-02-13T00:45:24.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:23 smithi106 bash[18459]: audit 2024-02-13T00:45:22.939709+0000 mon.a (mon.0) 2494 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:24.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:23 smithi106 bash[18459]: audit 2024-02-13T00:45:22.940535+0000 mon.a (mon.0) 2495 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-79"}]: dispatch 2024-02-13T00:45:24.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:23 smithi080 bash[17386]: cluster 2024-02-13T00:45:22.374884+0000 mgr.y (mgr.24461) 610 : cluster [DBG] pgmap v830: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:45:24.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:23 smithi080 bash[17386]: cluster 2024-02-13T00:45:22.896115+0000 mon.a (mon.0) 2493 : cluster [DBG] osdmap e437: 8 total, 8 up, 8 in 2024-02-13T00:45:24.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:23 smithi080 bash[17386]: audit 2024-02-13T00:45:22.939709+0000 mon.a (mon.0) 2494 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:24.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:23 smithi080 bash[17386]: audit 2024-02-13T00:45:22.940535+0000 mon.a (mon.0) 2495 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-79"}]: dispatch 2024-02-13T00:45:24.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:23 smithi080 bash[24237]: cluster 2024-02-13T00:45:22.374884+0000 mgr.y (mgr.24461) 610 : cluster [DBG] pgmap v830: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:45:24.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:23 smithi080 bash[24237]: cluster 2024-02-13T00:45:22.896115+0000 mon.a (mon.0) 2493 : cluster [DBG] osdmap e437: 8 total, 8 up, 8 in 2024-02-13T00:45:24.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:23 smithi080 bash[24237]: audit 2024-02-13T00:45:22.939709+0000 mon.a (mon.0) 2494 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:24.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:23 smithi080 bash[24237]: audit 2024-02-13T00:45:22.940535+0000 mon.a (mon.0) 2495 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-79"}]: dispatch 2024-02-13T00:45:25.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:24 smithi106 bash[18459]: cluster 2024-02-13T00:45:23.905090+0000 mon.a (mon.0) 2496 : cluster [DBG] osdmap e438: 8 total, 8 up, 8 in 2024-02-13T00:45:25.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:24 smithi080 bash[17386]: cluster 2024-02-13T00:45:23.905090+0000 mon.a (mon.0) 2496 : cluster [DBG] osdmap e438: 8 total, 8 up, 8 in 2024-02-13T00:45:25.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:24 smithi080 bash[24237]: cluster 2024-02-13T00:45:23.905090+0000 mon.a (mon.0) 2496 : cluster [DBG] osdmap e438: 8 total, 8 up, 8 in 2024-02-13T00:45:26.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:25 smithi106 bash[18459]: cluster 2024-02-13T00:45:24.375629+0000 mgr.y (mgr.24461) 611 : cluster [DBG] pgmap v833: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 3 op/s 2024-02-13T00:45:26.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:25 smithi106 bash[18459]: cluster 2024-02-13T00:45:24.915873+0000 mon.a (mon.0) 2497 : cluster [DBG] osdmap e439: 8 total, 8 up, 8 in 2024-02-13T00:45:26.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:25 smithi106 bash[18459]: audit 2024-02-13T00:45:24.924129+0000 mon.a (mon.0) 2498 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:45:26.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:25 smithi080 bash[17386]: cluster 2024-02-13T00:45:24.375629+0000 mgr.y (mgr.24461) 611 : cluster [DBG] pgmap v833: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 3 op/s 2024-02-13T00:45:26.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:25 smithi080 bash[17386]: cluster 2024-02-13T00:45:24.915873+0000 mon.a (mon.0) 2497 : cluster [DBG] osdmap e439: 8 total, 8 up, 8 in 2024-02-13T00:45:26.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:25 smithi080 bash[17386]: audit 2024-02-13T00:45:24.924129+0000 mon.a (mon.0) 2498 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:45:26.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:25 smithi080 bash[24237]: cluster 2024-02-13T00:45:24.375629+0000 mgr.y (mgr.24461) 611 : cluster [DBG] pgmap v833: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 3 op/s 2024-02-13T00:45:26.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:25 smithi080 bash[24237]: cluster 2024-02-13T00:45:24.915873+0000 mon.a (mon.0) 2497 : cluster [DBG] osdmap e439: 8 total, 8 up, 8 in 2024-02-13T00:45:26.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:25 smithi080 bash[24237]: audit 2024-02-13T00:45:24.924129+0000 mon.a (mon.0) 2498 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:45:27.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:26 smithi106 bash[18459]: audit 2024-02-13T00:45:25.922318+0000 mon.a (mon.0) 2499 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:45:27.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:26 smithi106 bash[18459]: cluster 2024-02-13T00:45:25.922697+0000 mon.a (mon.0) 2500 : cluster [DBG] osdmap e440: 8 total, 8 up, 8 in 2024-02-13T00:45:27.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:26 smithi106 bash[18459]: audit 2024-02-13T00:45:25.942641+0000 mon.a (mon.0) 2501 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:45:27.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:26 smithi106 bash[18459]: audit 2024-02-13T00:45:25.946738+0000 mon.a (mon.0) 2502 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:45:27.257 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:26 smithi080 bash[17386]: audit 2024-02-13T00:45:25.922318+0000 mon.a (mon.0) 2499 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:45:27.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:26 smithi080 bash[17386]: cluster 2024-02-13T00:45:25.922697+0000 mon.a (mon.0) 2500 : cluster [DBG] osdmap e440: 8 total, 8 up, 8 in 2024-02-13T00:45:27.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:26 smithi080 bash[17386]: audit 2024-02-13T00:45:25.942641+0000 mon.a (mon.0) 2501 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:45:27.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:26 smithi080 bash[17386]: audit 2024-02-13T00:45:25.946738+0000 mon.a (mon.0) 2502 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:45:27.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:26 smithi080 bash[24237]: audit 2024-02-13T00:45:25.922318+0000 mon.a (mon.0) 2499 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:45:27.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:26 smithi080 bash[24237]: cluster 2024-02-13T00:45:25.922697+0000 mon.a (mon.0) 2500 : cluster [DBG] osdmap e440: 8 total, 8 up, 8 in 2024-02-13T00:45:27.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:26 smithi080 bash[24237]: audit 2024-02-13T00:45:25.942641+0000 mon.a (mon.0) 2501 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:45:27.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:26 smithi080 bash[24237]: audit 2024-02-13T00:45:25.946738+0000 mon.a (mon.0) 2502 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:45:28.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:27 smithi106 bash[18459]: cluster 2024-02-13T00:45:26.376431+0000 mgr.y (mgr.24461) 612 : cluster [DBG] pgmap v836: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 3 op/s 2024-02-13T00:45:28.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:27 smithi106 bash[18459]: audit 2024-02-13T00:45:26.943406+0000 mon.a (mon.0) 2503 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:45:28.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:27 smithi106 bash[18459]: cluster 2024-02-13T00:45:26.943495+0000 mon.a (mon.0) 2504 : cluster [DBG] osdmap e441: 8 total, 8 up, 8 in 2024-02-13T00:45:28.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:27 smithi106 bash[18459]: audit 2024-02-13T00:45:26.944317+0000 mon.a (mon.0) 2505 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "dedup_tier","val": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:28.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:27 smithi080 bash[17386]: cluster 2024-02-13T00:45:26.376431+0000 mgr.y (mgr.24461) 612 : cluster [DBG] pgmap v836: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 3 op/s 2024-02-13T00:45:28.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:27 smithi080 bash[17386]: audit 2024-02-13T00:45:26.943406+0000 mon.a (mon.0) 2503 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:45:28.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:27 smithi080 bash[17386]: cluster 2024-02-13T00:45:26.943495+0000 mon.a (mon.0) 2504 : cluster [DBG] osdmap e441: 8 total, 8 up, 8 in 2024-02-13T00:45:28.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:27 smithi080 bash[17386]: audit 2024-02-13T00:45:26.944317+0000 mon.a (mon.0) 2505 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "dedup_tier","val": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:28.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:27 smithi080 bash[24237]: cluster 2024-02-13T00:45:26.376431+0000 mgr.y (mgr.24461) 612 : cluster [DBG] pgmap v836: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 3 op/s 2024-02-13T00:45:28.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:27 smithi080 bash[24237]: audit 2024-02-13T00:45:26.943406+0000 mon.a (mon.0) 2503 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:45:28.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:27 smithi080 bash[24237]: cluster 2024-02-13T00:45:26.943495+0000 mon.a (mon.0) 2504 : cluster [DBG] osdmap e441: 8 total, 8 up, 8 in 2024-02-13T00:45:28.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:27 smithi080 bash[24237]: audit 2024-02-13T00:45:26.944317+0000 mon.a (mon.0) 2505 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "dedup_tier","val": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:28.959 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:45:28 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:45:29.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:28 smithi106 bash[18459]: audit 2024-02-13T00:45:27.949301+0000 mon.a (mon.0) 2506 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "dedup_tier","val": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:45:29.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:28 smithi106 bash[18459]: cluster 2024-02-13T00:45:27.949391+0000 mon.a (mon.0) 2507 : cluster [DBG] osdmap e442: 8 total, 8 up, 8 in 2024-02-13T00:45:29.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:28 smithi106 bash[18459]: audit 2024-02-13T00:45:27.950593+0000 mon.a (mon.0) 2508 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T00:45:29.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:28 smithi080 bash[17386]: audit 2024-02-13T00:45:27.949301+0000 mon.a (mon.0) 2506 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "dedup_tier","val": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:45:29.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:28 smithi080 bash[17386]: cluster 2024-02-13T00:45:27.949391+0000 mon.a (mon.0) 2507 : cluster [DBG] osdmap e442: 8 total, 8 up, 8 in 2024-02-13T00:45:29.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:28 smithi080 bash[17386]: audit 2024-02-13T00:45:27.950593+0000 mon.a (mon.0) 2508 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T00:45:29.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:28 smithi080 bash[24237]: audit 2024-02-13T00:45:27.949301+0000 mon.a (mon.0) 2506 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "dedup_tier","val": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:45:29.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:28 smithi080 bash[24237]: cluster 2024-02-13T00:45:27.949391+0000 mon.a (mon.0) 2507 : cluster [DBG] osdmap e442: 8 total, 8 up, 8 in 2024-02-13T00:45:29.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:28 smithi080 bash[24237]: audit 2024-02-13T00:45:27.950593+0000 mon.a (mon.0) 2508 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T00:45:30.256 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:45:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:45:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:45:30.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:29 smithi106 bash[18459]: cluster 2024-02-13T00:45:28.377270+0000 mgr.y (mgr.24461) 613 : cluster [DBG] pgmap v839: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-02-13T00:45:30.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:29 smithi106 bash[18459]: audit 2024-02-13T00:45:28.528937+0000 mgr.y (mgr.24461) 614 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:45:30.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:29 smithi106 bash[18459]: audit 2024-02-13T00:45:28.951278+0000 mon.a (mon.0) 2509 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T00:45:30.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:29 smithi106 bash[18459]: cluster 2024-02-13T00:45:28.951397+0000 mon.a (mon.0) 2510 : cluster [DBG] osdmap e443: 8 total, 8 up, 8 in 2024-02-13T00:45:30.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:29 smithi106 bash[18459]: audit 2024-02-13T00:45:28.955629+0000 mon.a (mon.0) 2511 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T00:45:30.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:29 smithi106 bash[18459]: audit 2024-02-13T00:45:29.953941+0000 mon.a (mon.0) 2512 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T00:45:30.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:29 smithi106 bash[18459]: cluster 2024-02-13T00:45:29.954091+0000 mon.a (mon.0) 2513 : cluster [DBG] osdmap e444: 8 total, 8 up, 8 in 2024-02-13T00:45:30.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:29 smithi080 bash[17386]: cluster 2024-02-13T00:45:28.377270+0000 mgr.y (mgr.24461) 613 : cluster [DBG] pgmap v839: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-02-13T00:45:30.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:29 smithi080 bash[17386]: audit 2024-02-13T00:45:28.528937+0000 mgr.y (mgr.24461) 614 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:45:30.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:29 smithi080 bash[17386]: audit 2024-02-13T00:45:28.951278+0000 mon.a (mon.0) 2509 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T00:45:30.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:29 smithi080 bash[17386]: cluster 2024-02-13T00:45:28.951397+0000 mon.a (mon.0) 2510 : cluster [DBG] osdmap e443: 8 total, 8 up, 8 in 2024-02-13T00:45:30.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:29 smithi080 bash[17386]: audit 2024-02-13T00:45:28.955629+0000 mon.a (mon.0) 2511 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T00:45:30.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:29 smithi080 bash[17386]: audit 2024-02-13T00:45:29.953941+0000 mon.a (mon.0) 2512 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T00:45:30.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:29 smithi080 bash[17386]: cluster 2024-02-13T00:45:29.954091+0000 mon.a (mon.0) 2513 : cluster [DBG] osdmap e444: 8 total, 8 up, 8 in 2024-02-13T00:45:30.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:29 smithi080 bash[24237]: cluster 2024-02-13T00:45:28.377270+0000 mgr.y (mgr.24461) 613 : cluster [DBG] pgmap v839: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-02-13T00:45:30.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:29 smithi080 bash[24237]: audit 2024-02-13T00:45:28.528937+0000 mgr.y (mgr.24461) 614 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:45:30.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:29 smithi080 bash[24237]: audit 2024-02-13T00:45:28.951278+0000 mon.a (mon.0) 2509 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T00:45:30.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:29 smithi080 bash[24237]: cluster 2024-02-13T00:45:28.951397+0000 mon.a (mon.0) 2510 : cluster [DBG] osdmap e443: 8 total, 8 up, 8 in 2024-02-13T00:45:30.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:29 smithi080 bash[24237]: audit 2024-02-13T00:45:28.955629+0000 mon.a (mon.0) 2511 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T00:45:30.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:29 smithi080 bash[24237]: audit 2024-02-13T00:45:29.953941+0000 mon.a (mon.0) 2512 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T00:45:30.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:29 smithi080 bash[24237]: cluster 2024-02-13T00:45:29.954091+0000 mon.a (mon.0) 2513 : cluster [DBG] osdmap e444: 8 total, 8 up, 8 in 2024-02-13T00:45:32.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:31 smithi106 bash[18459]: cluster 2024-02-13T00:45:30.378049+0000 mgr.y (mgr.24461) 615 : cluster [DBG] pgmap v842: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-02-13T00:45:32.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:31 smithi106 bash[18459]: cluster 2024-02-13T00:45:30.972815+0000 mon.a (mon.0) 2514 : cluster [DBG] osdmap e445: 8 total, 8 up, 8 in 2024-02-13T00:45:32.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:31 smithi080 bash[17386]: cluster 2024-02-13T00:45:30.378049+0000 mgr.y (mgr.24461) 615 : cluster [DBG] pgmap v842: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-02-13T00:45:32.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:31 smithi080 bash[17386]: cluster 2024-02-13T00:45:30.972815+0000 mon.a (mon.0) 2514 : cluster [DBG] osdmap e445: 8 total, 8 up, 8 in 2024-02-13T00:45:32.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:31 smithi080 bash[24237]: cluster 2024-02-13T00:45:30.378049+0000 mgr.y (mgr.24461) 615 : cluster [DBG] pgmap v842: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-02-13T00:45:32.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:31 smithi080 bash[24237]: cluster 2024-02-13T00:45:30.972815+0000 mon.a (mon.0) 2514 : cluster [DBG] osdmap e445: 8 total, 8 up, 8 in 2024-02-13T00:45:33.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:32 smithi106 bash[18459]: cluster 2024-02-13T00:45:31.980199+0000 mon.a (mon.0) 2515 : cluster [DBG] osdmap e446: 8 total, 8 up, 8 in 2024-02-13T00:45:33.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:32 smithi106 bash[18459]: audit 2024-02-13T00:45:32.028613+0000 mon.a (mon.0) 2516 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:33.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:32 smithi106 bash[18459]: audit 2024-02-13T00:45:32.029414+0000 mon.a (mon.0) 2517 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-81"}]: dispatch 2024-02-13T00:45:33.258 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:45:33 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:45:33] "GET /metrics HTTP/1.1" 200 188421 "" "Prometheus/2.33.4" 2024-02-13T00:45:33.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:32 smithi080 bash[17386]: cluster 2024-02-13T00:45:31.980199+0000 mon.a (mon.0) 2515 : cluster [DBG] osdmap e446: 8 total, 8 up, 8 in 2024-02-13T00:45:33.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:32 smithi080 bash[17386]: audit 2024-02-13T00:45:32.028613+0000 mon.a (mon.0) 2516 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:33.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:32 smithi080 bash[17386]: audit 2024-02-13T00:45:32.029414+0000 mon.a (mon.0) 2517 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-81"}]: dispatch 2024-02-13T00:45:33.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:32 smithi080 bash[24237]: cluster 2024-02-13T00:45:31.980199+0000 mon.a (mon.0) 2515 : cluster [DBG] osdmap e446: 8 total, 8 up, 8 in 2024-02-13T00:45:33.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:32 smithi080 bash[24237]: audit 2024-02-13T00:45:32.028613+0000 mon.a (mon.0) 2516 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:33.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:32 smithi080 bash[24237]: audit 2024-02-13T00:45:32.029414+0000 mon.a (mon.0) 2517 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-81"}]: dispatch 2024-02-13T00:45:34.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:33 smithi106 bash[18459]: cluster 2024-02-13T00:45:32.378812+0000 mgr.y (mgr.24461) 616 : cluster [DBG] pgmap v845: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:45:34.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:33 smithi106 bash[18459]: cluster 2024-02-13T00:45:32.989956+0000 mon.a (mon.0) 2518 : cluster [DBG] osdmap e447: 8 total, 8 up, 8 in 2024-02-13T00:45:34.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:33 smithi080 bash[17386]: cluster 2024-02-13T00:45:32.378812+0000 mgr.y (mgr.24461) 616 : cluster [DBG] pgmap v845: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:45:34.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:33 smithi080 bash[17386]: cluster 2024-02-13T00:45:32.989956+0000 mon.a (mon.0) 2518 : cluster [DBG] osdmap e447: 8 total, 8 up, 8 in 2024-02-13T00:45:34.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:33 smithi080 bash[24237]: cluster 2024-02-13T00:45:32.378812+0000 mgr.y (mgr.24461) 616 : cluster [DBG] pgmap v845: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:45:34.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:33 smithi080 bash[24237]: cluster 2024-02-13T00:45:32.989956+0000 mon.a (mon.0) 2518 : cluster [DBG] osdmap e447: 8 total, 8 up, 8 in 2024-02-13T00:45:35.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:35 smithi106 bash[18459]: cluster 2024-02-13T00:45:33.998377+0000 mon.a (mon.0) 2519 : cluster [DBG] osdmap e448: 8 total, 8 up, 8 in 2024-02-13T00:45:35.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:35 smithi106 bash[18459]: audit 2024-02-13T00:45:34.005443+0000 mon.a (mon.0) 2520 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:45:35.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:35 smithi080 bash[17386]: cluster 2024-02-13T00:45:33.998377+0000 mon.a (mon.0) 2519 : cluster [DBG] osdmap e448: 8 total, 8 up, 8 in 2024-02-13T00:45:35.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:35 smithi080 bash[17386]: audit 2024-02-13T00:45:34.005443+0000 mon.a (mon.0) 2520 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:45:35.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:35 smithi080 bash[24237]: cluster 2024-02-13T00:45:33.998377+0000 mon.a (mon.0) 2519 : cluster [DBG] osdmap e448: 8 total, 8 up, 8 in 2024-02-13T00:45:35.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:35 smithi080 bash[24237]: audit 2024-02-13T00:45:34.005443+0000 mon.a (mon.0) 2520 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:45:36.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:36 smithi106 bash[18459]: cluster 2024-02-13T00:45:34.379665+0000 mgr.y (mgr.24461) 617 : cluster [DBG] pgmap v848: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-02-13T00:45:36.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:36 smithi106 bash[18459]: audit 2024-02-13T00:45:35.004701+0000 mon.a (mon.0) 2521 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:45:36.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:36 smithi106 bash[18459]: cluster 2024-02-13T00:45:35.005111+0000 mon.a (mon.0) 2522 : cluster [DBG] osdmap e449: 8 total, 8 up, 8 in 2024-02-13T00:45:36.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:36 smithi106 bash[18459]: audit 2024-02-13T00:45:35.020240+0000 mon.a (mon.0) 2523 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:45:36.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:36 smithi080 bash[17386]: cluster 2024-02-13T00:45:34.379665+0000 mgr.y (mgr.24461) 617 : cluster [DBG] pgmap v848: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-02-13T00:45:36.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:36 smithi080 bash[17386]: audit 2024-02-13T00:45:35.004701+0000 mon.a (mon.0) 2521 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:45:36.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:36 smithi080 bash[17386]: cluster 2024-02-13T00:45:35.005111+0000 mon.a (mon.0) 2522 : cluster [DBG] osdmap e449: 8 total, 8 up, 8 in 2024-02-13T00:45:36.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:36 smithi080 bash[17386]: audit 2024-02-13T00:45:35.020240+0000 mon.a (mon.0) 2523 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:45:36.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:36 smithi080 bash[24237]: cluster 2024-02-13T00:45:34.379665+0000 mgr.y (mgr.24461) 617 : cluster [DBG] pgmap v848: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-02-13T00:45:36.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:36 smithi080 bash[24237]: audit 2024-02-13T00:45:35.004701+0000 mon.a (mon.0) 2521 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:45:36.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:36 smithi080 bash[24237]: cluster 2024-02-13T00:45:35.005111+0000 mon.a (mon.0) 2522 : cluster [DBG] osdmap e449: 8 total, 8 up, 8 in 2024-02-13T00:45:36.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:36 smithi080 bash[24237]: audit 2024-02-13T00:45:35.020240+0000 mon.a (mon.0) 2523 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:45:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:37 smithi106 bash[18459]: cluster 2024-02-13T00:45:36.023400+0000 mon.a (mon.0) 2524 : cluster [DBG] osdmap e450: 8 total, 8 up, 8 in 2024-02-13T00:45:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:37 smithi106 bash[18459]: audit 2024-02-13T00:45:36.027419+0000 mon.a (mon.0) 2525 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:45:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:37 smithi106 bash[18459]: audit 2024-02-13T00:45:37.025768+0000 mon.a (mon.0) 2526 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:45:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:37 smithi106 bash[18459]: cluster 2024-02-13T00:45:37.026403+0000 mon.a (mon.0) 2527 : cluster [DBG] osdmap e451: 8 total, 8 up, 8 in 2024-02-13T00:45:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:37 smithi106 bash[18459]: audit 2024-02-13T00:45:37.028280+0000 mon.a (mon.0) 2528 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "dedup_tier","val": "test-rados-api-smithi080-54255-85-test-flush"}]: dispatch 2024-02-13T00:45:37.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:37 smithi080 bash[17386]: cluster 2024-02-13T00:45:36.023400+0000 mon.a (mon.0) 2524 : cluster [DBG] osdmap e450: 8 total, 8 up, 8 in 2024-02-13T00:45:37.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:37 smithi080 bash[17386]: audit 2024-02-13T00:45:36.027419+0000 mon.a (mon.0) 2525 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:45:37.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:37 smithi080 bash[17386]: audit 2024-02-13T00:45:37.025768+0000 mon.a (mon.0) 2526 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:45:37.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:37 smithi080 bash[17386]: cluster 2024-02-13T00:45:37.026403+0000 mon.a (mon.0) 2527 : cluster [DBG] osdmap e451: 8 total, 8 up, 8 in 2024-02-13T00:45:37.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:37 smithi080 bash[17386]: audit 2024-02-13T00:45:37.028280+0000 mon.a (mon.0) 2528 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "dedup_tier","val": "test-rados-api-smithi080-54255-85-test-flush"}]: dispatch 2024-02-13T00:45:37.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:37 smithi080 bash[24237]: cluster 2024-02-13T00:45:36.023400+0000 mon.a (mon.0) 2524 : cluster [DBG] osdmap e450: 8 total, 8 up, 8 in 2024-02-13T00:45:37.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:37 smithi080 bash[24237]: audit 2024-02-13T00:45:36.027419+0000 mon.a (mon.0) 2525 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:45:37.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:37 smithi080 bash[24237]: audit 2024-02-13T00:45:37.025768+0000 mon.a (mon.0) 2526 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:45:37.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:37 smithi080 bash[24237]: cluster 2024-02-13T00:45:37.026403+0000 mon.a (mon.0) 2527 : cluster [DBG] osdmap e451: 8 total, 8 up, 8 in 2024-02-13T00:45:37.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:37 smithi080 bash[24237]: audit 2024-02-13T00:45:37.028280+0000 mon.a (mon.0) 2528 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "dedup_tier","val": "test-rados-api-smithi080-54255-85-test-flush"}]: dispatch 2024-02-13T00:45:38.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:38 smithi106 bash[18459]: cluster 2024-02-13T00:45:36.380593+0000 mgr.y (mgr.24461) 618 : cluster [DBG] pgmap v851: 260 pgs: 64 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-02-13T00:45:38.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:38 smithi106 bash[18459]: audit 2024-02-13T00:45:38.032460+0000 mon.a (mon.0) 2529 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "dedup_tier","val": "test-rados-api-smithi080-54255-85-test-flush"}]': finished 2024-02-13T00:45:38.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:38 smithi106 bash[18459]: cluster 2024-02-13T00:45:38.032601+0000 mon.a (mon.0) 2530 : cluster [DBG] osdmap e452: 8 total, 8 up, 8 in 2024-02-13T00:45:38.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:38 smithi106 bash[18459]: audit 2024-02-13T00:45:38.034030+0000 mon.a (mon.0) 2531 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T00:45:38.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:38 smithi080 bash[17386]: cluster 2024-02-13T00:45:36.380593+0000 mgr.y (mgr.24461) 618 : cluster [DBG] pgmap v851: 260 pgs: 64 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-02-13T00:45:38.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:38 smithi080 bash[17386]: audit 2024-02-13T00:45:38.032460+0000 mon.a (mon.0) 2529 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "dedup_tier","val": "test-rados-api-smithi080-54255-85-test-flush"}]': finished 2024-02-13T00:45:38.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:38 smithi080 bash[17386]: cluster 2024-02-13T00:45:38.032601+0000 mon.a (mon.0) 2530 : cluster [DBG] osdmap e452: 8 total, 8 up, 8 in 2024-02-13T00:45:38.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:38 smithi080 bash[17386]: audit 2024-02-13T00:45:38.034030+0000 mon.a (mon.0) 2531 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T00:45:38.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:38 smithi080 bash[24237]: cluster 2024-02-13T00:45:36.380593+0000 mgr.y (mgr.24461) 618 : cluster [DBG] pgmap v851: 260 pgs: 64 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-02-13T00:45:38.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:38 smithi080 bash[24237]: audit 2024-02-13T00:45:38.032460+0000 mon.a (mon.0) 2529 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "dedup_tier","val": "test-rados-api-smithi080-54255-85-test-flush"}]': finished 2024-02-13T00:45:38.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:38 smithi080 bash[24237]: cluster 2024-02-13T00:45:38.032601+0000 mon.a (mon.0) 2530 : cluster [DBG] osdmap e452: 8 total, 8 up, 8 in 2024-02-13T00:45:38.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:38 smithi080 bash[24237]: audit 2024-02-13T00:45:38.034030+0000 mon.a (mon.0) 2531 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T00:45:39.005 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:45:38 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:45:40.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:45:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:45:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:45:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:40 smithi106 bash[18459]: cluster 2024-02-13T00:45:38.381400+0000 mgr.y (mgr.24461) 619 : cluster [DBG] pgmap v854: 260 pgs: 260 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:45:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:40 smithi106 bash[18459]: audit 2024-02-13T00:45:38.540722+0000 mgr.y (mgr.24461) 620 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:45:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:40 smithi106 bash[18459]: audit 2024-02-13T00:45:39.036945+0000 mon.a (mon.0) 2532 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T00:45:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:40 smithi106 bash[18459]: cluster 2024-02-13T00:45:39.037040+0000 mon.a (mon.0) 2533 : cluster [DBG] osdmap e453: 8 total, 8 up, 8 in 2024-02-13T00:45:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:40 smithi106 bash[18459]: audit 2024-02-13T00:45:39.038482+0000 mon.a (mon.0) 2534 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T00:45:40.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:40 smithi080 bash[17386]: cluster 2024-02-13T00:45:38.381400+0000 mgr.y (mgr.24461) 619 : cluster [DBG] pgmap v854: 260 pgs: 260 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:45:40.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:40 smithi080 bash[17386]: audit 2024-02-13T00:45:38.540722+0000 mgr.y (mgr.24461) 620 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:45:40.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:40 smithi080 bash[17386]: audit 2024-02-13T00:45:39.036945+0000 mon.a (mon.0) 2532 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T00:45:40.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:40 smithi080 bash[17386]: cluster 2024-02-13T00:45:39.037040+0000 mon.a (mon.0) 2533 : cluster [DBG] osdmap e453: 8 total, 8 up, 8 in 2024-02-13T00:45:40.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:40 smithi080 bash[17386]: audit 2024-02-13T00:45:39.038482+0000 mon.a (mon.0) 2534 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T00:45:40.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:40 smithi080 bash[24237]: cluster 2024-02-13T00:45:38.381400+0000 mgr.y (mgr.24461) 619 : cluster [DBG] pgmap v854: 260 pgs: 260 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:45:40.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:40 smithi080 bash[24237]: audit 2024-02-13T00:45:38.540722+0000 mgr.y (mgr.24461) 620 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:45:40.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:40 smithi080 bash[24237]: audit 2024-02-13T00:45:39.036945+0000 mon.a (mon.0) 2532 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T00:45:40.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:40 smithi080 bash[24237]: cluster 2024-02-13T00:45:39.037040+0000 mon.a (mon.0) 2533 : cluster [DBG] osdmap e453: 8 total, 8 up, 8 in 2024-02-13T00:45:40.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:40 smithi080 bash[24237]: audit 2024-02-13T00:45:39.038482+0000 mon.a (mon.0) 2534 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T00:45:41.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:41 smithi106 bash[18459]: audit 2024-02-13T00:45:40.037811+0000 mon.a (mon.0) 2535 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T00:45:41.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:41 smithi106 bash[18459]: cluster 2024-02-13T00:45:40.037945+0000 mon.a (mon.0) 2536 : cluster [DBG] osdmap e454: 8 total, 8 up, 8 in 2024-02-13T00:45:41.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:41 smithi080 bash[17386]: audit 2024-02-13T00:45:40.037811+0000 mon.a (mon.0) 2535 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T00:45:41.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:41 smithi080 bash[17386]: cluster 2024-02-13T00:45:40.037945+0000 mon.a (mon.0) 2536 : cluster [DBG] osdmap e454: 8 total, 8 up, 8 in 2024-02-13T00:45:41.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:41 smithi080 bash[24237]: audit 2024-02-13T00:45:40.037811+0000 mon.a (mon.0) 2535 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T00:45:41.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:41 smithi080 bash[24237]: cluster 2024-02-13T00:45:40.037945+0000 mon.a (mon.0) 2536 : cluster [DBG] osdmap e454: 8 total, 8 up, 8 in 2024-02-13T00:45:42.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:42 smithi106 bash[18459]: cluster 2024-02-13T00:45:40.382236+0000 mgr.y (mgr.24461) 621 : cluster [DBG] pgmap v857: 260 pgs: 260 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:45:42.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:42 smithi106 bash[18459]: cluster 2024-02-13T00:45:41.049821+0000 mon.a (mon.0) 2537 : cluster [DBG] osdmap e455: 8 total, 8 up, 8 in 2024-02-13T00:45:42.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:42 smithi106 bash[18459]: audit 2024-02-13T00:45:41.100213+0000 mon.a (mon.0) 2538 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:42.508 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:42 smithi106 bash[18459]: audit 2024-02-13T00:45:41.100704+0000 mon.a (mon.0) 2539 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-83"}]: dispatch 2024-02-13T00:45:42.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:42 smithi080 bash[17386]: cluster 2024-02-13T00:45:40.382236+0000 mgr.y (mgr.24461) 621 : cluster [DBG] pgmap v857: 260 pgs: 260 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:45:42.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:42 smithi080 bash[17386]: cluster 2024-02-13T00:45:41.049821+0000 mon.a (mon.0) 2537 : cluster [DBG] osdmap e455: 8 total, 8 up, 8 in 2024-02-13T00:45:42.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:42 smithi080 bash[17386]: audit 2024-02-13T00:45:41.100213+0000 mon.a (mon.0) 2538 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:42.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:42 smithi080 bash[17386]: audit 2024-02-13T00:45:41.100704+0000 mon.a (mon.0) 2539 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-83"}]: dispatch 2024-02-13T00:45:42.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:42 smithi080 bash[24237]: cluster 2024-02-13T00:45:40.382236+0000 mgr.y (mgr.24461) 621 : cluster [DBG] pgmap v857: 260 pgs: 260 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:45:42.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:42 smithi080 bash[24237]: cluster 2024-02-13T00:45:41.049821+0000 mon.a (mon.0) 2537 : cluster [DBG] osdmap e455: 8 total, 8 up, 8 in 2024-02-13T00:45:42.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:42 smithi080 bash[24237]: audit 2024-02-13T00:45:41.100213+0000 mon.a (mon.0) 2538 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:42.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:42 smithi080 bash[24237]: audit 2024-02-13T00:45:41.100704+0000 mon.a (mon.0) 2539 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-83"}]: dispatch 2024-02-13T00:45:43.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:43 smithi106 bash[18459]: cluster 2024-02-13T00:45:42.071025+0000 mon.a (mon.0) 2540 : cluster [DBG] osdmap e456: 8 total, 8 up, 8 in 2024-02-13T00:45:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:43 smithi080 bash[17386]: cluster 2024-02-13T00:45:42.071025+0000 mon.a (mon.0) 2540 : cluster [DBG] osdmap e456: 8 total, 8 up, 8 in 2024-02-13T00:45:43.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:45:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:45:43] "GET /metrics HTTP/1.1" 200 188421 "" "Prometheus/2.33.4" 2024-02-13T00:45:43.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:43 smithi080 bash[24237]: cluster 2024-02-13T00:45:42.071025+0000 mon.a (mon.0) 2540 : cluster [DBG] osdmap e456: 8 total, 8 up, 8 in 2024-02-13T00:45:44.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:44 smithi106 bash[18459]: cluster 2024-02-13T00:45:42.382951+0000 mgr.y (mgr.24461) 622 : cluster [DBG] pgmap v860: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:45:44.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:44 smithi106 bash[18459]: cluster 2024-02-13T00:45:43.081626+0000 mon.a (mon.0) 2541 : cluster [DBG] osdmap e457: 8 total, 8 up, 8 in 2024-02-13T00:45:44.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:44 smithi106 bash[18459]: audit 2024-02-13T00:45:43.086886+0000 mon.a (mon.0) 2542 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-86","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:45:44.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:44 smithi080 bash[17386]: cluster 2024-02-13T00:45:42.382951+0000 mgr.y (mgr.24461) 622 : cluster [DBG] pgmap v860: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:45:44.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:44 smithi080 bash[17386]: cluster 2024-02-13T00:45:43.081626+0000 mon.a (mon.0) 2541 : cluster [DBG] osdmap e457: 8 total, 8 up, 8 in 2024-02-13T00:45:44.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:44 smithi080 bash[17386]: audit 2024-02-13T00:45:43.086886+0000 mon.a (mon.0) 2542 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-86","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:45:44.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:44 smithi080 bash[24237]: cluster 2024-02-13T00:45:42.382951+0000 mgr.y (mgr.24461) 622 : cluster [DBG] pgmap v860: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:45:44.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:44 smithi080 bash[24237]: cluster 2024-02-13T00:45:43.081626+0000 mon.a (mon.0) 2541 : cluster [DBG] osdmap e457: 8 total, 8 up, 8 in 2024-02-13T00:45:44.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:44 smithi080 bash[24237]: audit 2024-02-13T00:45:43.086886+0000 mon.a (mon.0) 2542 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-86","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:45:45.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:45 smithi106 bash[18459]: audit 2024-02-13T00:45:44.089216+0000 mon.a (mon.0) 2543 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-86","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:45:45.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:45 smithi106 bash[18459]: cluster 2024-02-13T00:45:44.089473+0000 mon.a (mon.0) 2544 : cluster [DBG] osdmap e458: 8 total, 8 up, 8 in 2024-02-13T00:45:45.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:45 smithi106 bash[18459]: audit 2024-02-13T00:45:44.102383+0000 mon.a (mon.0) 2545 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:45:45.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:45 smithi106 bash[18459]: audit 2024-02-13T00:45:44.106371+0000 mon.a (mon.0) 2546 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:45:45.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:45 smithi080 bash[17386]: audit 2024-02-13T00:45:44.089216+0000 mon.a (mon.0) 2543 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-86","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:45:45.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:45 smithi080 bash[17386]: cluster 2024-02-13T00:45:44.089473+0000 mon.a (mon.0) 2544 : cluster [DBG] osdmap e458: 8 total, 8 up, 8 in 2024-02-13T00:45:45.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:45 smithi080 bash[17386]: audit 2024-02-13T00:45:44.102383+0000 mon.a (mon.0) 2545 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:45:45.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:45 smithi080 bash[17386]: audit 2024-02-13T00:45:44.106371+0000 mon.a (mon.0) 2546 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:45:45.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:45 smithi080 bash[24237]: audit 2024-02-13T00:45:44.089216+0000 mon.a (mon.0) 2543 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-86","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:45:45.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:45 smithi080 bash[24237]: cluster 2024-02-13T00:45:44.089473+0000 mon.a (mon.0) 2544 : cluster [DBG] osdmap e458: 8 total, 8 up, 8 in 2024-02-13T00:45:45.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:45 smithi080 bash[24237]: audit 2024-02-13T00:45:44.102383+0000 mon.a (mon.0) 2545 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:45:45.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:45 smithi080 bash[24237]: audit 2024-02-13T00:45:44.106371+0000 mon.a (mon.0) 2546 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:45:46.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:46 smithi106 bash[18459]: cluster 2024-02-13T00:45:44.383931+0000 mgr.y (mgr.24461) 623 : cluster [DBG] pgmap v863: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T00:45:46.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:46 smithi106 bash[18459]: audit 2024-02-13T00:45:45.104684+0000 mon.a (mon.0) 2547 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:45:46.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:46 smithi106 bash[18459]: cluster 2024-02-13T00:45:45.104804+0000 mon.a (mon.0) 2548 : cluster [DBG] osdmap e459: 8 total, 8 up, 8 in 2024-02-13T00:45:46.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:46 smithi080 bash[17386]: cluster 2024-02-13T00:45:44.383931+0000 mgr.y (mgr.24461) 623 : cluster [DBG] pgmap v863: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T00:45:46.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:46 smithi080 bash[17386]: audit 2024-02-13T00:45:45.104684+0000 mon.a (mon.0) 2547 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:45:46.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:46 smithi080 bash[17386]: cluster 2024-02-13T00:45:45.104804+0000 mon.a (mon.0) 2548 : cluster [DBG] osdmap e459: 8 total, 8 up, 8 in 2024-02-13T00:45:46.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:46 smithi080 bash[24237]: cluster 2024-02-13T00:45:44.383931+0000 mgr.y (mgr.24461) 623 : cluster [DBG] pgmap v863: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T00:45:46.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:46 smithi080 bash[24237]: audit 2024-02-13T00:45:45.104684+0000 mon.a (mon.0) 2547 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:45:46.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:46 smithi080 bash[24237]: cluster 2024-02-13T00:45:45.104804+0000 mon.a (mon.0) 2548 : cluster [DBG] osdmap e459: 8 total, 8 up, 8 in 2024-02-13T00:45:47.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:47 smithi106 bash[18459]: cluster 2024-02-13T00:45:46.127970+0000 mon.a (mon.0) 2549 : cluster [DBG] osdmap e460: 8 total, 8 up, 8 in 2024-02-13T00:45:47.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:47 smithi080 bash[17386]: cluster 2024-02-13T00:45:46.127970+0000 mon.a (mon.0) 2549 : cluster [DBG] osdmap e460: 8 total, 8 up, 8 in 2024-02-13T00:45:47.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:47 smithi080 bash[24237]: cluster 2024-02-13T00:45:46.127970+0000 mon.a (mon.0) 2549 : cluster [DBG] osdmap e460: 8 total, 8 up, 8 in 2024-02-13T00:45:48.146 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.CachePin (22345 ms) 2024-02-13T00:45:48.147 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-02-13T00:45:48.147 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.SetRedirectRead (3021 ms) 2024-02-13T00:45:48.147 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-02-13T00:45:48.147 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: require_osd_release = pacific 2024-02-13T00:45:48.147 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestPromoteRead (3014 ms) 2024-02-13T00:45:48.147 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-02-13T00:45:48.147 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRefRead (3011 ms) 2024-02-13T00:45:48.147 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-02-13T00:45:48.147 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: require_osd_release = pacific 2024-02-13T00:45:48.147 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestUnset (3014 ms) 2024-02-13T00:45:48.147 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-02-13T00:45:48.148 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: require_osd_release = pacific 2024-02-13T00:45:48.148 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestDedupRefRead (4045 ms) 2024-02-13T00:45:48.148 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-02-13T00:45:48.148 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: require_osd_release = pacific 2024-02-13T00:45:48.148 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount (39165 ms) 2024-02-13T00:45:48.148 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-02-13T00:45:48.148 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: require_osd_release = pacific 2024-02-13T00:45:48.148 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (16497 ms) 2024-02-13T00:45:48.148 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-02-13T00:45:48.148 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: require_osd_release = pacific 2024-02-13T00:45:48.148 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (4047 ms) 2024-02-13T00:45:48.148 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-02-13T00:45:48.148 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: require_osd_release = pacific 2024-02-13T00:45:48.148 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (3028 ms) 2024-02-13T00:45:48.149 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-02-13T00:45:48.149 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: require_osd_release = pacific 2024-02-13T00:45:48.149 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (24224 ms) 2024-02-13T00:45:48.149 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-02-13T00:45:48.149 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: require_osd_release = pacific 2024-02-13T00:45:48.149 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapIncCount (15065 ms) 2024-02-13T00:45:48.149 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-02-13T00:45:48.149 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: require_osd_release = pacific 2024-02-13T00:45:48.149 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvict (5060 ms) 2024-02-13T00:45:48.149 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-02-13T00:45:48.149 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: require_osd_release = pacific 2024-02-13T00:45:48.149 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: waiting for scrubs... 2024-02-13T00:45:48.149 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: done waiting 2024-02-13T00:45:48.149 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (24605 ms) 2024-02-13T00:45:48.150 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-02-13T00:45:48.150 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: require_osd_release = pacific 2024-02-13T00:45:48.150 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.DedupFlushRead (10079 ms) 2024-02-13T00:45:48.150 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-02-13T00:45:48.150 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: require_osd_release = pacific 2024-02-13T00:45:48.150 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushSnap (9069 ms) 2024-02-13T00:45:48.150 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-02-13T00:45:48.150 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: require_osd_release = pacific 2024-02-13T00:45:48.150 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushDupCount (9089 ms) 2024-02-13T00:45:48.150 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-02-13T00:45:48.150 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: require_osd_release = pacific 2024-02-13T00:45:48.150 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringFlush (9077 ms) 2024-02-13T00:45:48.150 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-02-13T00:45:48.150 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: require_osd_release = pacific 2024-02-13T00:45:48.150 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (6073 ms) 2024-02-13T00:45:49.005 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:45:48 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:45:49.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:48 smithi106 bash[18459]: cluster 2024-02-13T00:45:46.384807+0000 mgr.y (mgr.24461) 624 : cluster [DBG] pgmap v866: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T00:45:49.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:48 smithi106 bash[18459]: cluster 2024-02-13T00:45:47.136617+0000 mon.a (mon.0) 2550 : cluster [DBG] osdmap e461: 8 total, 8 up, 8 in 2024-02-13T00:45:49.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:48 smithi106 bash[18459]: audit 2024-02-13T00:45:47.184601+0000 mon.a (mon.0) 2551 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:49.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:48 smithi106 bash[18459]: audit 2024-02-13T00:45:47.185363+0000 mon.a (mon.0) 2552 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-86"}]: dispatch 2024-02-13T00:45:49.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:48 smithi080 bash[17386]: cluster 2024-02-13T00:45:46.384807+0000 mgr.y (mgr.24461) 624 : cluster [DBG] pgmap v866: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T00:45:49.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:48 smithi080 bash[17386]: cluster 2024-02-13T00:45:47.136617+0000 mon.a (mon.0) 2550 : cluster [DBG] osdmap e461: 8 total, 8 up, 8 in 2024-02-13T00:45:49.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:48 smithi080 bash[17386]: audit 2024-02-13T00:45:47.184601+0000 mon.a (mon.0) 2551 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:49.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:48 smithi080 bash[17386]: audit 2024-02-13T00:45:47.185363+0000 mon.a (mon.0) 2552 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-86"}]: dispatch 2024-02-13T00:45:49.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:48 smithi080 bash[24237]: cluster 2024-02-13T00:45:46.384807+0000 mgr.y (mgr.24461) 624 : cluster [DBG] pgmap v866: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T00:45:49.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:48 smithi080 bash[24237]: cluster 2024-02-13T00:45:47.136617+0000 mon.a (mon.0) 2550 : cluster [DBG] osdmap e461: 8 total, 8 up, 8 in 2024-02-13T00:45:49.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:48 smithi080 bash[24237]: audit 2024-02-13T00:45:47.184601+0000 mon.a (mon.0) 2551 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:49.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:48 smithi080 bash[24237]: audit 2024-02-13T00:45:47.185363+0000 mon.a (mon.0) 2552 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-86"}]: dispatch 2024-02-13T00:45:50.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:49 smithi106 bash[18459]: cluster 2024-02-13T00:45:48.141798+0000 mon.a (mon.0) 2553 : cluster [DBG] osdmap e462: 8 total, 8 up, 8 in 2024-02-13T00:45:50.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:49 smithi106 bash[18459]: cluster 2024-02-13T00:45:48.385482+0000 mgr.y (mgr.24461) 625 : cluster [DBG] pgmap v869: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-13T00:45:50.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:49 smithi106 bash[18459]: audit 2024-02-13T00:45:48.546247+0000 mgr.y (mgr.24461) 626 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:45:50.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:49 smithi106 bash[18459]: cluster 2024-02-13T00:45:49.148642+0000 mon.a (mon.0) 2554 : cluster [DBG] osdmap e463: 8 total, 8 up, 8 in 2024-02-13T00:45:50.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:49 smithi106 bash[18459]: audit 2024-02-13T00:45:49.151712+0000 mon.a (mon.0) 2555 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-88","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:45:50.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:49 smithi080 bash[24237]: cluster 2024-02-13T00:45:48.141798+0000 mon.a (mon.0) 2553 : cluster [DBG] osdmap e462: 8 total, 8 up, 8 in 2024-02-13T00:45:50.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:49 smithi080 bash[24237]: cluster 2024-02-13T00:45:48.385482+0000 mgr.y (mgr.24461) 625 : cluster [DBG] pgmap v869: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-13T00:45:50.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:49 smithi080 bash[24237]: audit 2024-02-13T00:45:48.546247+0000 mgr.y (mgr.24461) 626 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:45:50.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:49 smithi080 bash[24237]: cluster 2024-02-13T00:45:49.148642+0000 mon.a (mon.0) 2554 : cluster [DBG] osdmap e463: 8 total, 8 up, 8 in 2024-02-13T00:45:50.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:49 smithi080 bash[24237]: audit 2024-02-13T00:45:49.151712+0000 mon.a (mon.0) 2555 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-88","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:45:50.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:49 smithi080 bash[17386]: cluster 2024-02-13T00:45:48.141798+0000 mon.a (mon.0) 2553 : cluster [DBG] osdmap e462: 8 total, 8 up, 8 in 2024-02-13T00:45:50.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:49 smithi080 bash[17386]: cluster 2024-02-13T00:45:48.385482+0000 mgr.y (mgr.24461) 625 : cluster [DBG] pgmap v869: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-13T00:45:50.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:49 smithi080 bash[17386]: audit 2024-02-13T00:45:48.546247+0000 mgr.y (mgr.24461) 626 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:45:50.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:49 smithi080 bash[17386]: cluster 2024-02-13T00:45:49.148642+0000 mon.a (mon.0) 2554 : cluster [DBG] osdmap e463: 8 total, 8 up, 8 in 2024-02-13T00:45:50.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:49 smithi080 bash[17386]: audit 2024-02-13T00:45:49.151712+0000 mon.a (mon.0) 2555 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-88","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:45:50.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:45:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:45:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:45:51.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:51 smithi106 bash[18459]: audit 2024-02-13T00:45:50.150006+0000 mon.a (mon.0) 2556 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-88","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:45:51.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:51 smithi106 bash[18459]: cluster 2024-02-13T00:45:50.150302+0000 mon.a (mon.0) 2557 : cluster [DBG] osdmap e464: 8 total, 8 up, 8 in 2024-02-13T00:45:51.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:51 smithi106 bash[18459]: audit 2024-02-13T00:45:50.168646+0000 mon.a (mon.0) 2558 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-88", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:45:51.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:51 smithi080 bash[24237]: audit 2024-02-13T00:45:50.150006+0000 mon.a (mon.0) 2556 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-88","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:45:51.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:51 smithi080 bash[24237]: cluster 2024-02-13T00:45:50.150302+0000 mon.a (mon.0) 2557 : cluster [DBG] osdmap e464: 8 total, 8 up, 8 in 2024-02-13T00:45:51.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:51 smithi080 bash[24237]: audit 2024-02-13T00:45:50.168646+0000 mon.a (mon.0) 2558 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-88", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:45:51.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:51 smithi080 bash[17386]: audit 2024-02-13T00:45:50.150006+0000 mon.a (mon.0) 2556 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-88","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:45:51.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:51 smithi080 bash[17386]: cluster 2024-02-13T00:45:50.150302+0000 mon.a (mon.0) 2557 : cluster [DBG] osdmap e464: 8 total, 8 up, 8 in 2024-02-13T00:45:51.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:51 smithi080 bash[17386]: audit 2024-02-13T00:45:50.168646+0000 mon.a (mon.0) 2558 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-88", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:45:52.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:52 smithi106 bash[18459]: cluster 2024-02-13T00:45:50.386300+0000 mgr.y (mgr.24461) 627 : cluster [DBG] pgmap v872: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-13T00:45:52.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:52 smithi106 bash[18459]: audit 2024-02-13T00:45:51.158706+0000 mon.a (mon.0) 2559 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-88", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:45:52.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:52 smithi106 bash[18459]: cluster 2024-02-13T00:45:51.158761+0000 mon.a (mon.0) 2560 : cluster [DBG] osdmap e465: 8 total, 8 up, 8 in 2024-02-13T00:45:52.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:52 smithi106 bash[18459]: audit 2024-02-13T00:45:51.159544+0000 mon.a (mon.0) 2561 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-88", "mode": "writeback"}]: dispatch 2024-02-13T00:45:52.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:52 smithi080 bash[24237]: cluster 2024-02-13T00:45:50.386300+0000 mgr.y (mgr.24461) 627 : cluster [DBG] pgmap v872: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-13T00:45:52.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:52 smithi080 bash[24237]: audit 2024-02-13T00:45:51.158706+0000 mon.a (mon.0) 2559 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-88", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:45:52.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:52 smithi080 bash[24237]: cluster 2024-02-13T00:45:51.158761+0000 mon.a (mon.0) 2560 : cluster [DBG] osdmap e465: 8 total, 8 up, 8 in 2024-02-13T00:45:52.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:52 smithi080 bash[24237]: audit 2024-02-13T00:45:51.159544+0000 mon.a (mon.0) 2561 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-88", "mode": "writeback"}]: dispatch 2024-02-13T00:45:52.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:52 smithi080 bash[17386]: cluster 2024-02-13T00:45:50.386300+0000 mgr.y (mgr.24461) 627 : cluster [DBG] pgmap v872: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-13T00:45:52.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:52 smithi080 bash[17386]: audit 2024-02-13T00:45:51.158706+0000 mon.a (mon.0) 2559 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-88", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:45:52.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:52 smithi080 bash[17386]: cluster 2024-02-13T00:45:51.158761+0000 mon.a (mon.0) 2560 : cluster [DBG] osdmap e465: 8 total, 8 up, 8 in 2024-02-13T00:45:52.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:52 smithi080 bash[17386]: audit 2024-02-13T00:45:51.159544+0000 mon.a (mon.0) 2561 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-88", "mode": "writeback"}]: dispatch 2024-02-13T00:45:53.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:53 smithi106 bash[18459]: cluster 2024-02-13T00:45:52.156787+0000 mon.a (mon.0) 2562 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:45:53.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:53 smithi106 bash[18459]: audit 2024-02-13T00:45:52.165553+0000 mon.a (mon.0) 2563 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-88", "mode": "writeback"}]': finished 2024-02-13T00:45:53.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:53 smithi106 bash[18459]: cluster 2024-02-13T00:45:52.165649+0000 mon.a (mon.0) 2564 : cluster [DBG] osdmap e466: 8 total, 8 up, 8 in 2024-02-13T00:45:53.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:53 smithi106 bash[18459]: audit 2024-02-13T00:45:52.167125+0000 mon.a (mon.0) 2565 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-88"}]: dispatch 2024-02-13T00:45:53.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:53 smithi106 bash[18459]: audit 2024-02-13T00:45:53.170027+0000 mon.a (mon.0) 2566 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-88"}]': finished 2024-02-13T00:45:53.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:53 smithi106 bash[18459]: cluster 2024-02-13T00:45:53.170129+0000 mon.a (mon.0) 2567 : cluster [DBG] osdmap e467: 8 total, 8 up, 8 in 2024-02-13T00:45:53.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:53 smithi106 bash[18459]: audit 2024-02-13T00:45:53.171144+0000 mon.a (mon.0) 2568 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:45:53.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:45:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:45:53] "GET /metrics HTTP/1.1" 200 188553 "" "Prometheus/2.33.4" 2024-02-13T00:45:53.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:53 smithi080 bash[17386]: cluster 2024-02-13T00:45:52.156787+0000 mon.a (mon.0) 2562 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:45:53.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:53 smithi080 bash[17386]: audit 2024-02-13T00:45:52.165553+0000 mon.a (mon.0) 2563 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-88", "mode": "writeback"}]': finished 2024-02-13T00:45:53.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:53 smithi080 bash[17386]: cluster 2024-02-13T00:45:52.165649+0000 mon.a (mon.0) 2564 : cluster [DBG] osdmap e466: 8 total, 8 up, 8 in 2024-02-13T00:45:53.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:53 smithi080 bash[17386]: audit 2024-02-13T00:45:52.167125+0000 mon.a (mon.0) 2565 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-88"}]: dispatch 2024-02-13T00:45:53.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:53 smithi080 bash[17386]: audit 2024-02-13T00:45:53.170027+0000 mon.a (mon.0) 2566 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-88"}]': finished 2024-02-13T00:45:53.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:53 smithi080 bash[17386]: cluster 2024-02-13T00:45:53.170129+0000 mon.a (mon.0) 2567 : cluster [DBG] osdmap e467: 8 total, 8 up, 8 in 2024-02-13T00:45:53.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:53 smithi080 bash[17386]: audit 2024-02-13T00:45:53.171144+0000 mon.a (mon.0) 2568 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:45:53.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:53 smithi080 bash[24237]: cluster 2024-02-13T00:45:52.156787+0000 mon.a (mon.0) 2562 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:45:53.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:53 smithi080 bash[24237]: audit 2024-02-13T00:45:52.165553+0000 mon.a (mon.0) 2563 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-88", "mode": "writeback"}]': finished 2024-02-13T00:45:53.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:53 smithi080 bash[24237]: cluster 2024-02-13T00:45:52.165649+0000 mon.a (mon.0) 2564 : cluster [DBG] osdmap e466: 8 total, 8 up, 8 in 2024-02-13T00:45:53.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:53 smithi080 bash[24237]: audit 2024-02-13T00:45:52.167125+0000 mon.a (mon.0) 2565 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-88"}]: dispatch 2024-02-13T00:45:53.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:53 smithi080 bash[24237]: audit 2024-02-13T00:45:53.170027+0000 mon.a (mon.0) 2566 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-88"}]': finished 2024-02-13T00:45:53.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:53 smithi080 bash[24237]: cluster 2024-02-13T00:45:53.170129+0000 mon.a (mon.0) 2567 : cluster [DBG] osdmap e467: 8 total, 8 up, 8 in 2024-02-13T00:45:53.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:53 smithi080 bash[24237]: audit 2024-02-13T00:45:53.171144+0000 mon.a (mon.0) 2568 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:45:54.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:54 smithi106 bash[18459]: cluster 2024-02-13T00:45:52.387265+0000 mgr.y (mgr.24461) 628 : cluster [DBG] pgmap v875: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:45:54.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:54 smithi106 bash[18459]: cluster 2024-02-13T00:45:54.163634+0000 mon.a (mon.0) 2569 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:45:54.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:54 smithi106 bash[18459]: audit 2024-02-13T00:45:54.172147+0000 mon.a (mon.0) 2570 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T00:45:54.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:54 smithi106 bash[18459]: cluster 2024-02-13T00:45:54.172330+0000 mon.a (mon.0) 2571 : cluster [DBG] osdmap e468: 8 total, 8 up, 8 in 2024-02-13T00:45:54.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:54 smithi106 bash[18459]: audit 2024-02-13T00:45:54.177435+0000 mon.a (mon.0) 2572 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "hit_set_count","val": "1"}]: dispatch 2024-02-13T00:45:54.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:54 smithi080 bash[24237]: cluster 2024-02-13T00:45:52.387265+0000 mgr.y (mgr.24461) 628 : cluster [DBG] pgmap v875: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:45:54.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:54 smithi080 bash[24237]: cluster 2024-02-13T00:45:54.163634+0000 mon.a (mon.0) 2569 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:45:54.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:54 smithi080 bash[24237]: audit 2024-02-13T00:45:54.172147+0000 mon.a (mon.0) 2570 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T00:45:54.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:54 smithi080 bash[24237]: cluster 2024-02-13T00:45:54.172330+0000 mon.a (mon.0) 2571 : cluster [DBG] osdmap e468: 8 total, 8 up, 8 in 2024-02-13T00:45:54.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:54 smithi080 bash[24237]: audit 2024-02-13T00:45:54.177435+0000 mon.a (mon.0) 2572 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "hit_set_count","val": "1"}]: dispatch 2024-02-13T00:45:54.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:54 smithi080 bash[17386]: cluster 2024-02-13T00:45:52.387265+0000 mgr.y (mgr.24461) 628 : cluster [DBG] pgmap v875: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:45:54.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:54 smithi080 bash[17386]: cluster 2024-02-13T00:45:54.163634+0000 mon.a (mon.0) 2569 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:45:54.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:54 smithi080 bash[17386]: audit 2024-02-13T00:45:54.172147+0000 mon.a (mon.0) 2570 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T00:45:54.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:54 smithi080 bash[17386]: cluster 2024-02-13T00:45:54.172330+0000 mon.a (mon.0) 2571 : cluster [DBG] osdmap e468: 8 total, 8 up, 8 in 2024-02-13T00:45:54.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:54 smithi080 bash[17386]: audit 2024-02-13T00:45:54.177435+0000 mon.a (mon.0) 2572 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "hit_set_count","val": "1"}]: dispatch 2024-02-13T00:45:56.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:56 smithi106 bash[18459]: cluster 2024-02-13T00:45:54.388103+0000 mgr.y (mgr.24461) 629 : cluster [DBG] pgmap v878: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:45:56.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:56 smithi106 bash[18459]: audit 2024-02-13T00:45:55.175273+0000 mon.a (mon.0) 2573 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "hit_set_count","val": "1"}]': finished 2024-02-13T00:45:56.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:56 smithi106 bash[18459]: cluster 2024-02-13T00:45:55.175468+0000 mon.a (mon.0) 2574 : cluster [DBG] osdmap e469: 8 total, 8 up, 8 in 2024-02-13T00:45:56.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:56 smithi106 bash[18459]: audit 2024-02-13T00:45:55.176475+0000 mon.a (mon.0) 2575 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:45:56.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:56 smithi080 bash[17386]: cluster 2024-02-13T00:45:54.388103+0000 mgr.y (mgr.24461) 629 : cluster [DBG] pgmap v878: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:45:56.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:56 smithi080 bash[17386]: audit 2024-02-13T00:45:55.175273+0000 mon.a (mon.0) 2573 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "hit_set_count","val": "1"}]': finished 2024-02-13T00:45:56.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:56 smithi080 bash[17386]: cluster 2024-02-13T00:45:55.175468+0000 mon.a (mon.0) 2574 : cluster [DBG] osdmap e469: 8 total, 8 up, 8 in 2024-02-13T00:45:56.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:56 smithi080 bash[17386]: audit 2024-02-13T00:45:55.176475+0000 mon.a (mon.0) 2575 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:45:56.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:56 smithi080 bash[24237]: cluster 2024-02-13T00:45:54.388103+0000 mgr.y (mgr.24461) 629 : cluster [DBG] pgmap v878: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:45:56.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:56 smithi080 bash[24237]: audit 2024-02-13T00:45:55.175273+0000 mon.a (mon.0) 2573 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "hit_set_count","val": "1"}]': finished 2024-02-13T00:45:56.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:56 smithi080 bash[24237]: cluster 2024-02-13T00:45:55.175468+0000 mon.a (mon.0) 2574 : cluster [DBG] osdmap e469: 8 total, 8 up, 8 in 2024-02-13T00:45:56.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:56 smithi080 bash[24237]: audit 2024-02-13T00:45:55.176475+0000 mon.a (mon.0) 2575 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:45:57.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:57 smithi106 bash[18459]: audit 2024-02-13T00:45:56.185057+0000 mon.a (mon.0) 2576 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:45:57.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:57 smithi106 bash[18459]: cluster 2024-02-13T00:45:56.185149+0000 mon.a (mon.0) 2577 : cluster [DBG] osdmap e470: 8 total, 8 up, 8 in 2024-02-13T00:45:57.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:57 smithi106 bash[18459]: audit 2024-02-13T00:45:56.186353+0000 mon.a (mon.0) 2578 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "target_max_objects","val": "250"}]: dispatch 2024-02-13T00:45:57.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:57 smithi080 bash[17386]: audit 2024-02-13T00:45:56.185057+0000 mon.a (mon.0) 2576 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:45:57.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:57 smithi080 bash[17386]: cluster 2024-02-13T00:45:56.185149+0000 mon.a (mon.0) 2577 : cluster [DBG] osdmap e470: 8 total, 8 up, 8 in 2024-02-13T00:45:57.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:57 smithi080 bash[17386]: audit 2024-02-13T00:45:56.186353+0000 mon.a (mon.0) 2578 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "target_max_objects","val": "250"}]: dispatch 2024-02-13T00:45:57.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:57 smithi080 bash[24237]: audit 2024-02-13T00:45:56.185057+0000 mon.a (mon.0) 2576 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:45:57.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:57 smithi080 bash[24237]: cluster 2024-02-13T00:45:56.185149+0000 mon.a (mon.0) 2577 : cluster [DBG] osdmap e470: 8 total, 8 up, 8 in 2024-02-13T00:45:57.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:57 smithi080 bash[24237]: audit 2024-02-13T00:45:56.186353+0000 mon.a (mon.0) 2578 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "target_max_objects","val": "250"}]: dispatch 2024-02-13T00:45:58.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:58 smithi106 bash[18459]: cluster 2024-02-13T00:45:56.388850+0000 mgr.y (mgr.24461) 630 : cluster [DBG] pgmap v881: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:45:58.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:58 smithi106 bash[18459]: audit 2024-02-13T00:45:57.194499+0000 mon.a (mon.0) 2579 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "target_max_objects","val": "250"}]': finished 2024-02-13T00:45:58.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:58 smithi106 bash[18459]: cluster 2024-02-13T00:45:57.194614+0000 mon.a (mon.0) 2580 : cluster [DBG] osdmap e471: 8 total, 8 up, 8 in 2024-02-13T00:45:58.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:58 smithi106 bash[18459]: audit 2024-02-13T00:45:57.231012+0000 mon.a (mon.0) 2581 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:58.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:58 smithi080 bash[17386]: cluster 2024-02-13T00:45:56.388850+0000 mgr.y (mgr.24461) 630 : cluster [DBG] pgmap v881: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:45:58.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:58 smithi080 bash[17386]: audit 2024-02-13T00:45:57.194499+0000 mon.a (mon.0) 2579 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "target_max_objects","val": "250"}]': finished 2024-02-13T00:45:58.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:58 smithi080 bash[17386]: cluster 2024-02-13T00:45:57.194614+0000 mon.a (mon.0) 2580 : cluster [DBG] osdmap e471: 8 total, 8 up, 8 in 2024-02-13T00:45:58.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:58 smithi080 bash[17386]: audit 2024-02-13T00:45:57.231012+0000 mon.a (mon.0) 2581 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:58.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:58 smithi080 bash[24237]: cluster 2024-02-13T00:45:56.388850+0000 mgr.y (mgr.24461) 630 : cluster [DBG] pgmap v881: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:45:58.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:58 smithi080 bash[24237]: audit 2024-02-13T00:45:57.194499+0000 mon.a (mon.0) 2579 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-88","var": "target_max_objects","val": "250"}]': finished 2024-02-13T00:45:58.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:58 smithi080 bash[24237]: cluster 2024-02-13T00:45:57.194614+0000 mon.a (mon.0) 2580 : cluster [DBG] osdmap e471: 8 total, 8 up, 8 in 2024-02-13T00:45:58.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:58 smithi080 bash[24237]: audit 2024-02-13T00:45:57.231012+0000 mon.a (mon.0) 2581 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:45:59.005 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:45:58 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:45:59.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:59 smithi106 bash[18459]: audit 2024-02-13T00:45:58.198928+0000 mon.a (mon.0) 2582 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:45:59.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:59 smithi106 bash[18459]: cluster 2024-02-13T00:45:58.199023+0000 mon.a (mon.0) 2583 : cluster [DBG] osdmap e472: 8 total, 8 up, 8 in 2024-02-13T00:45:59.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:59 smithi106 bash[18459]: audit 2024-02-13T00:45:58.201236+0000 mon.a (mon.0) 2584 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-88"}]: dispatch 2024-02-13T00:45:59.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:59 smithi106 bash[18459]: audit 2024-02-13T00:45:59.200701+0000 mon.a (mon.0) 2585 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-88"}]': finished 2024-02-13T00:45:59.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:45:59 smithi106 bash[18459]: cluster 2024-02-13T00:45:59.200786+0000 mon.a (mon.0) 2586 : cluster [DBG] osdmap e473: 8 total, 8 up, 8 in 2024-02-13T00:45:59.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:59 smithi080 bash[17386]: audit 2024-02-13T00:45:58.198928+0000 mon.a (mon.0) 2582 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:45:59.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:59 smithi080 bash[17386]: cluster 2024-02-13T00:45:58.199023+0000 mon.a (mon.0) 2583 : cluster [DBG] osdmap e472: 8 total, 8 up, 8 in 2024-02-13T00:45:59.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:59 smithi080 bash[17386]: audit 2024-02-13T00:45:58.201236+0000 mon.a (mon.0) 2584 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-88"}]: dispatch 2024-02-13T00:45:59.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:59 smithi080 bash[17386]: audit 2024-02-13T00:45:59.200701+0000 mon.a (mon.0) 2585 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-88"}]': finished 2024-02-13T00:45:59.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:45:59 smithi080 bash[17386]: cluster 2024-02-13T00:45:59.200786+0000 mon.a (mon.0) 2586 : cluster [DBG] osdmap e473: 8 total, 8 up, 8 in 2024-02-13T00:45:59.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:59 smithi080 bash[24237]: audit 2024-02-13T00:45:58.198928+0000 mon.a (mon.0) 2582 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:45:59.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:59 smithi080 bash[24237]: cluster 2024-02-13T00:45:58.199023+0000 mon.a (mon.0) 2583 : cluster [DBG] osdmap e472: 8 total, 8 up, 8 in 2024-02-13T00:45:59.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:59 smithi080 bash[24237]: audit 2024-02-13T00:45:58.201236+0000 mon.a (mon.0) 2584 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-88"}]: dispatch 2024-02-13T00:45:59.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:59 smithi080 bash[24237]: audit 2024-02-13T00:45:59.200701+0000 mon.a (mon.0) 2585 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-88"}]': finished 2024-02-13T00:45:59.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:45:59 smithi080 bash[24237]: cluster 2024-02-13T00:45:59.200786+0000 mon.a (mon.0) 2586 : cluster [DBG] osdmap e473: 8 total, 8 up, 8 in 2024-02-13T00:46:00.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:46:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:46:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:46:01.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:00 smithi106 bash[18459]: cluster 2024-02-13T00:45:58.389806+0000 mgr.y (mgr.24461) 631 : cluster [DBG] pgmap v884: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:46:01.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:00 smithi106 bash[18459]: audit 2024-02-13T00:45:58.549736+0000 mgr.y (mgr.24461) 632 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:46:01.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:00 smithi080 bash[17386]: cluster 2024-02-13T00:45:58.389806+0000 mgr.y (mgr.24461) 631 : cluster [DBG] pgmap v884: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:46:01.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:00 smithi080 bash[17386]: audit 2024-02-13T00:45:58.549736+0000 mgr.y (mgr.24461) 632 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:46:01.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:00 smithi080 bash[24237]: cluster 2024-02-13T00:45:58.389806+0000 mgr.y (mgr.24461) 631 : cluster [DBG] pgmap v884: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:46:01.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:00 smithi080 bash[24237]: audit 2024-02-13T00:45:58.549736+0000 mgr.y (mgr.24461) 632 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:46:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:01 smithi106 bash[18459]: cluster 2024-02-13T00:46:00.220172+0000 mon.a (mon.0) 2587 : cluster [DBG] osdmap e474: 8 total, 8 up, 8 in 2024-02-13T00:46:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:01 smithi106 bash[18459]: cluster 2024-02-13T00:46:00.390578+0000 mgr.y (mgr.24461) 633 : cluster [DBG] pgmap v887: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:01 smithi106 bash[18459]: cluster 2024-02-13T00:46:01.223389+0000 mon.a (mon.0) 2588 : cluster [DBG] osdmap e475: 8 total, 8 up, 8 in 2024-02-13T00:46:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:01 smithi106 bash[18459]: audit 2024-02-13T00:46:01.225681+0000 mon.a (mon.0) 2589 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:46:02.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:01 smithi080 bash[24237]: cluster 2024-02-13T00:46:00.220172+0000 mon.a (mon.0) 2587 : cluster [DBG] osdmap e474: 8 total, 8 up, 8 in 2024-02-13T00:46:02.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:01 smithi080 bash[24237]: cluster 2024-02-13T00:46:00.390578+0000 mgr.y (mgr.24461) 633 : cluster [DBG] pgmap v887: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:02.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:01 smithi080 bash[24237]: cluster 2024-02-13T00:46:01.223389+0000 mon.a (mon.0) 2588 : cluster [DBG] osdmap e475: 8 total, 8 up, 8 in 2024-02-13T00:46:02.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:01 smithi080 bash[24237]: audit 2024-02-13T00:46:01.225681+0000 mon.a (mon.0) 2589 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:46:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:01 smithi080 bash[17386]: cluster 2024-02-13T00:46:00.220172+0000 mon.a (mon.0) 2587 : cluster [DBG] osdmap e474: 8 total, 8 up, 8 in 2024-02-13T00:46:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:01 smithi080 bash[17386]: cluster 2024-02-13T00:46:00.390578+0000 mgr.y (mgr.24461) 633 : cluster [DBG] pgmap v887: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:01 smithi080 bash[17386]: cluster 2024-02-13T00:46:01.223389+0000 mon.a (mon.0) 2588 : cluster [DBG] osdmap e475: 8 total, 8 up, 8 in 2024-02-13T00:46:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:01 smithi080 bash[17386]: audit 2024-02-13T00:46:01.225681+0000 mon.a (mon.0) 2589 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:46:03.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:03 smithi106 bash[18459]: audit 2024-02-13T00:46:02.225727+0000 mon.a (mon.0) 2590 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:46:03.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:03 smithi106 bash[18459]: cluster 2024-02-13T00:46:02.226059+0000 mon.a (mon.0) 2591 : cluster [DBG] osdmap e476: 8 total, 8 up, 8 in 2024-02-13T00:46:03.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:03 smithi106 bash[18459]: audit 2024-02-13T00:46:02.235212+0000 mon.a (mon.0) 2592 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-90", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:46:03.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:46:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:46:03] "GET /metrics HTTP/1.1" 200 188669 "" "Prometheus/2.33.4" 2024-02-13T00:46:03.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:03 smithi080 bash[24237]: audit 2024-02-13T00:46:02.225727+0000 mon.a (mon.0) 2590 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:46:03.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:03 smithi080 bash[24237]: cluster 2024-02-13T00:46:02.226059+0000 mon.a (mon.0) 2591 : cluster [DBG] osdmap e476: 8 total, 8 up, 8 in 2024-02-13T00:46:03.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:03 smithi080 bash[24237]: audit 2024-02-13T00:46:02.235212+0000 mon.a (mon.0) 2592 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-90", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:46:03.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:03 smithi080 bash[17386]: audit 2024-02-13T00:46:02.225727+0000 mon.a (mon.0) 2590 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:46:03.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:03 smithi080 bash[17386]: cluster 2024-02-13T00:46:02.226059+0000 mon.a (mon.0) 2591 : cluster [DBG] osdmap e476: 8 total, 8 up, 8 in 2024-02-13T00:46:03.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:03 smithi080 bash[17386]: audit 2024-02-13T00:46:02.235212+0000 mon.a (mon.0) 2592 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-90", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:46:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:04 smithi106 bash[18459]: cluster 2024-02-13T00:46:02.391370+0000 mgr.y (mgr.24461) 634 : cluster [DBG] pgmap v890: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:46:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:04 smithi106 bash[18459]: audit 2024-02-13T00:46:03.228641+0000 mon.a (mon.0) 2593 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-90", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:46:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:04 smithi106 bash[18459]: cluster 2024-02-13T00:46:03.228805+0000 mon.a (mon.0) 2594 : cluster [DBG] osdmap e477: 8 total, 8 up, 8 in 2024-02-13T00:46:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:04 smithi106 bash[18459]: audit 2024-02-13T00:46:03.231727+0000 mon.a (mon.0) 2595 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-90"}]: dispatch 2024-02-13T00:46:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:04 smithi106 bash[18459]: audit 2024-02-13T00:46:04.231295+0000 mon.a (mon.0) 2596 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-90"}]': finished 2024-02-13T00:46:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:04 smithi106 bash[18459]: cluster 2024-02-13T00:46:04.231397+0000 mon.a (mon.0) 2597 : cluster [DBG] osdmap e478: 8 total, 8 up, 8 in 2024-02-13T00:46:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:04 smithi106 bash[18459]: audit 2024-02-13T00:46:04.232771+0000 mon.a (mon.0) 2598 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-90", "mode": "writeback"}]: dispatch 2024-02-13T00:46:04.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:04 smithi080 bash[17386]: cluster 2024-02-13T00:46:02.391370+0000 mgr.y (mgr.24461) 634 : cluster [DBG] pgmap v890: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:46:04.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:04 smithi080 bash[17386]: audit 2024-02-13T00:46:03.228641+0000 mon.a (mon.0) 2593 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-90", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:46:04.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:04 smithi080 bash[17386]: cluster 2024-02-13T00:46:03.228805+0000 mon.a (mon.0) 2594 : cluster [DBG] osdmap e477: 8 total, 8 up, 8 in 2024-02-13T00:46:04.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:04 smithi080 bash[17386]: audit 2024-02-13T00:46:03.231727+0000 mon.a (mon.0) 2595 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-90"}]: dispatch 2024-02-13T00:46:04.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:04 smithi080 bash[17386]: audit 2024-02-13T00:46:04.231295+0000 mon.a (mon.0) 2596 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-90"}]': finished 2024-02-13T00:46:04.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:04 smithi080 bash[17386]: cluster 2024-02-13T00:46:04.231397+0000 mon.a (mon.0) 2597 : cluster [DBG] osdmap e478: 8 total, 8 up, 8 in 2024-02-13T00:46:04.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:04 smithi080 bash[17386]: audit 2024-02-13T00:46:04.232771+0000 mon.a (mon.0) 2598 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-90", "mode": "writeback"}]: dispatch 2024-02-13T00:46:04.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:04 smithi080 bash[24237]: cluster 2024-02-13T00:46:02.391370+0000 mgr.y (mgr.24461) 634 : cluster [DBG] pgmap v890: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:46:04.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:04 smithi080 bash[24237]: audit 2024-02-13T00:46:03.228641+0000 mon.a (mon.0) 2593 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-90", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:46:04.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:04 smithi080 bash[24237]: cluster 2024-02-13T00:46:03.228805+0000 mon.a (mon.0) 2594 : cluster [DBG] osdmap e477: 8 total, 8 up, 8 in 2024-02-13T00:46:04.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:04 smithi080 bash[24237]: audit 2024-02-13T00:46:03.231727+0000 mon.a (mon.0) 2595 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-90"}]: dispatch 2024-02-13T00:46:04.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:04 smithi080 bash[24237]: audit 2024-02-13T00:46:04.231295+0000 mon.a (mon.0) 2596 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-6", "overlaypool": "test-rados-api-smithi080-54255-90"}]': finished 2024-02-13T00:46:04.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:04 smithi080 bash[24237]: cluster 2024-02-13T00:46:04.231397+0000 mon.a (mon.0) 2597 : cluster [DBG] osdmap e478: 8 total, 8 up, 8 in 2024-02-13T00:46:04.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:04 smithi080 bash[24237]: audit 2024-02-13T00:46:04.232771+0000 mon.a (mon.0) 2598 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-90", "mode": "writeback"}]: dispatch 2024-02-13T00:46:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:05 smithi106 bash[18459]: cluster 2024-02-13T00:46:05.225777+0000 mon.a (mon.0) 2599 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:46:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:05 smithi106 bash[18459]: audit 2024-02-13T00:46:05.234513+0000 mon.a (mon.0) 2600 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-90", "mode": "writeback"}]': finished 2024-02-13T00:46:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:05 smithi106 bash[18459]: cluster 2024-02-13T00:46:05.234931+0000 mon.a (mon.0) 2601 : cluster [DBG] osdmap e479: 8 total, 8 up, 8 in 2024-02-13T00:46:05.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:05 smithi106 bash[18459]: audit 2024-02-13T00:46:05.236140+0000 mon.a (mon.0) 2602 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:46:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:05 smithi080 bash[17386]: cluster 2024-02-13T00:46:05.225777+0000 mon.a (mon.0) 2599 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:46:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:05 smithi080 bash[17386]: audit 2024-02-13T00:46:05.234513+0000 mon.a (mon.0) 2600 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-90", "mode": "writeback"}]': finished 2024-02-13T00:46:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:05 smithi080 bash[17386]: cluster 2024-02-13T00:46:05.234931+0000 mon.a (mon.0) 2601 : cluster [DBG] osdmap e479: 8 total, 8 up, 8 in 2024-02-13T00:46:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:05 smithi080 bash[17386]: audit 2024-02-13T00:46:05.236140+0000 mon.a (mon.0) 2602 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:46:05.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:05 smithi080 bash[24237]: cluster 2024-02-13T00:46:05.225777+0000 mon.a (mon.0) 2599 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:46:05.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:05 smithi080 bash[24237]: audit 2024-02-13T00:46:05.234513+0000 mon.a (mon.0) 2600 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-90", "mode": "writeback"}]': finished 2024-02-13T00:46:05.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:05 smithi080 bash[24237]: cluster 2024-02-13T00:46:05.234931+0000 mon.a (mon.0) 2601 : cluster [DBG] osdmap e479: 8 total, 8 up, 8 in 2024-02-13T00:46:05.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:05 smithi080 bash[24237]: audit 2024-02-13T00:46:05.236140+0000 mon.a (mon.0) 2602 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:46:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:06 smithi106 bash[18459]: cluster 2024-02-13T00:46:04.391884+0000 mgr.y (mgr.24461) 635 : cluster [DBG] pgmap v893: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:06 smithi106 bash[18459]: audit 2024-02-13T00:46:06.236791+0000 mon.a (mon.0) 2603 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:46:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:06 smithi106 bash[18459]: cluster 2024-02-13T00:46:06.236891+0000 mon.a (mon.0) 2604 : cluster [DBG] osdmap e480: 8 total, 8 up, 8 in 2024-02-13T00:46:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:06 smithi106 bash[18459]: audit 2024-02-13T00:46:06.238258+0000 mon.a (mon.0) 2605 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:46:06.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:06 smithi080 bash[24237]: cluster 2024-02-13T00:46:04.391884+0000 mgr.y (mgr.24461) 635 : cluster [DBG] pgmap v893: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:06.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:06 smithi080 bash[24237]: audit 2024-02-13T00:46:06.236791+0000 mon.a (mon.0) 2603 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:46:06.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:06 smithi080 bash[24237]: cluster 2024-02-13T00:46:06.236891+0000 mon.a (mon.0) 2604 : cluster [DBG] osdmap e480: 8 total, 8 up, 8 in 2024-02-13T00:46:06.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:06 smithi080 bash[24237]: audit 2024-02-13T00:46:06.238258+0000 mon.a (mon.0) 2605 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:46:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:06 smithi080 bash[17386]: cluster 2024-02-13T00:46:04.391884+0000 mgr.y (mgr.24461) 635 : cluster [DBG] pgmap v893: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:06 smithi080 bash[17386]: audit 2024-02-13T00:46:06.236791+0000 mon.a (mon.0) 2603 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:46:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:06 smithi080 bash[17386]: cluster 2024-02-13T00:46:06.236891+0000 mon.a (mon.0) 2604 : cluster [DBG] osdmap e480: 8 total, 8 up, 8 in 2024-02-13T00:46:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:06 smithi080 bash[17386]: audit 2024-02-13T00:46:06.238258+0000 mon.a (mon.0) 2605 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:46:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:08 smithi106 bash[18459]: cluster 2024-02-13T00:46:06.392593+0000 mgr.y (mgr.24461) 636 : cluster [DBG] pgmap v896: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:08 smithi106 bash[18459]: audit 2024-02-13T00:46:07.238882+0000 mon.a (mon.0) 2606 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:46:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:08 smithi106 bash[18459]: cluster 2024-02-13T00:46:07.239003+0000 mon.a (mon.0) 2607 : cluster [DBG] osdmap e481: 8 total, 8 up, 8 in 2024-02-13T00:46:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:08 smithi106 bash[18459]: audit 2024-02-13T00:46:07.240496+0000 mon.a (mon.0) 2608 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T00:46:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:08 smithi080 bash[17386]: cluster 2024-02-13T00:46:06.392593+0000 mgr.y (mgr.24461) 636 : cluster [DBG] pgmap v896: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:08 smithi080 bash[17386]: audit 2024-02-13T00:46:07.238882+0000 mon.a (mon.0) 2606 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:46:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:08 smithi080 bash[17386]: cluster 2024-02-13T00:46:07.239003+0000 mon.a (mon.0) 2607 : cluster [DBG] osdmap e481: 8 total, 8 up, 8 in 2024-02-13T00:46:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:08 smithi080 bash[17386]: audit 2024-02-13T00:46:07.240496+0000 mon.a (mon.0) 2608 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T00:46:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:08 smithi080 bash[24237]: cluster 2024-02-13T00:46:06.392593+0000 mgr.y (mgr.24461) 636 : cluster [DBG] pgmap v896: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:08 smithi080 bash[24237]: audit 2024-02-13T00:46:07.238882+0000 mon.a (mon.0) 2606 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:46:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:08 smithi080 bash[24237]: cluster 2024-02-13T00:46:07.239003+0000 mon.a (mon.0) 2607 : cluster [DBG] osdmap e481: 8 total, 8 up, 8 in 2024-02-13T00:46:08.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:08 smithi080 bash[24237]: audit 2024-02-13T00:46:07.240496+0000 mon.a (mon.0) 2608 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T00:46:09.005 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:46:08 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:46:09.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:09 smithi106 bash[18459]: cluster 2024-02-13T00:46:08.233755+0000 mon.a (mon.0) 2609 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:46:09.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:09 smithi106 bash[18459]: audit 2024-02-13T00:46:08.242578+0000 mon.a (mon.0) 2610 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T00:46:09.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:09 smithi106 bash[18459]: cluster 2024-02-13T00:46:08.242731+0000 mon.a (mon.0) 2611 : cluster [DBG] osdmap e482: 8 total, 8 up, 8 in 2024-02-13T00:46:09.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:09 smithi106 bash[18459]: audit 2024-02-13T00:46:08.245235+0000 mon.a (mon.0) 2612 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-02-13T00:46:09.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:09 smithi106 bash[18459]: audit 2024-02-13T00:46:08.309823+0000 mon.c (mon.2) 377 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:46:09.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:09 smithi106 bash[18459]: audit 2024-02-13T00:46:08.614184+0000 mon.c (mon.2) 378 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:46:09.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:09 smithi106 bash[18459]: audit 2024-02-13T00:46:08.615834+0000 mon.c (mon.2) 379 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:46:09.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:09 smithi106 bash[18459]: audit 2024-02-13T00:46:08.624573+0000 mon.a (mon.0) 2613 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:46:09.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:09 smithi106 bash[18459]: audit 2024-02-13T00:46:09.245362+0000 mon.a (mon.0) 2614 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-02-13T00:46:09.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:09 smithi080 bash[17386]: cluster 2024-02-13T00:46:08.233755+0000 mon.a (mon.0) 2609 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:46:09.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:09 smithi080 bash[17386]: audit 2024-02-13T00:46:08.242578+0000 mon.a (mon.0) 2610 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T00:46:09.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:09 smithi080 bash[17386]: cluster 2024-02-13T00:46:08.242731+0000 mon.a (mon.0) 2611 : cluster [DBG] osdmap e482: 8 total, 8 up, 8 in 2024-02-13T00:46:09.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:09 smithi080 bash[17386]: audit 2024-02-13T00:46:08.245235+0000 mon.a (mon.0) 2612 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-02-13T00:46:09.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:09 smithi080 bash[17386]: audit 2024-02-13T00:46:08.309823+0000 mon.c (mon.2) 377 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:46:09.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:09 smithi080 bash[17386]: audit 2024-02-13T00:46:08.614184+0000 mon.c (mon.2) 378 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:46:09.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:09 smithi080 bash[17386]: audit 2024-02-13T00:46:08.615834+0000 mon.c (mon.2) 379 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:46:09.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:09 smithi080 bash[17386]: audit 2024-02-13T00:46:08.624573+0000 mon.a (mon.0) 2613 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:46:09.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:09 smithi080 bash[17386]: audit 2024-02-13T00:46:09.245362+0000 mon.a (mon.0) 2614 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-02-13T00:46:09.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:09 smithi080 bash[24237]: cluster 2024-02-13T00:46:08.233755+0000 mon.a (mon.0) 2609 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:46:09.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:09 smithi080 bash[24237]: audit 2024-02-13T00:46:08.242578+0000 mon.a (mon.0) 2610 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T00:46:09.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:09 smithi080 bash[24237]: cluster 2024-02-13T00:46:08.242731+0000 mon.a (mon.0) 2611 : cluster [DBG] osdmap e482: 8 total, 8 up, 8 in 2024-02-13T00:46:09.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:09 smithi080 bash[24237]: audit 2024-02-13T00:46:08.245235+0000 mon.a (mon.0) 2612 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-02-13T00:46:09.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:09 smithi080 bash[24237]: audit 2024-02-13T00:46:08.309823+0000 mon.c (mon.2) 377 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:46:09.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:09 smithi080 bash[24237]: audit 2024-02-13T00:46:08.614184+0000 mon.c (mon.2) 378 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:46:09.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:09 smithi080 bash[24237]: audit 2024-02-13T00:46:08.615834+0000 mon.c (mon.2) 379 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:46:09.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:09 smithi080 bash[24237]: audit 2024-02-13T00:46:08.624573+0000 mon.a (mon.0) 2613 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:46:09.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:09 smithi080 bash[24237]: audit 2024-02-13T00:46:09.245362+0000 mon.a (mon.0) 2614 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-90","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-02-13T00:46:10.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:46:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:46:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:46:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:10 smithi106 bash[18459]: cluster 2024-02-13T00:46:08.393380+0000 mgr.y (mgr.24461) 637 : cluster [DBG] pgmap v899: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:10 smithi106 bash[18459]: audit 2024-02-13T00:46:08.561069+0000 mgr.y (mgr.24461) 638 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:46:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:10 smithi106 bash[18459]: cluster 2024-02-13T00:46:09.245449+0000 mon.a (mon.0) 2615 : cluster [DBG] osdmap e483: 8 total, 8 up, 8 in 2024-02-13T00:46:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:10 smithi106 bash[18459]: audit 2024-02-13T00:46:09.288411+0000 mon.a (mon.0) 2616 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:46:10.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:10 smithi080 bash[24237]: cluster 2024-02-13T00:46:08.393380+0000 mgr.y (mgr.24461) 637 : cluster [DBG] pgmap v899: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:10.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:10 smithi080 bash[24237]: audit 2024-02-13T00:46:08.561069+0000 mgr.y (mgr.24461) 638 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:46:10.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:10 smithi080 bash[24237]: cluster 2024-02-13T00:46:09.245449+0000 mon.a (mon.0) 2615 : cluster [DBG] osdmap e483: 8 total, 8 up, 8 in 2024-02-13T00:46:10.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:10 smithi080 bash[24237]: audit 2024-02-13T00:46:09.288411+0000 mon.a (mon.0) 2616 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:46:10.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:10 smithi080 bash[17386]: cluster 2024-02-13T00:46:08.393380+0000 mgr.y (mgr.24461) 637 : cluster [DBG] pgmap v899: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:10.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:10 smithi080 bash[17386]: audit 2024-02-13T00:46:08.561069+0000 mgr.y (mgr.24461) 638 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:46:10.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:10 smithi080 bash[17386]: cluster 2024-02-13T00:46:09.245449+0000 mon.a (mon.0) 2615 : cluster [DBG] osdmap e483: 8 total, 8 up, 8 in 2024-02-13T00:46:10.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:10 smithi080 bash[17386]: audit 2024-02-13T00:46:09.288411+0000 mon.a (mon.0) 2616 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:46:11.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:11 smithi106 bash[18459]: audit 2024-02-13T00:46:10.270631+0000 mon.a (mon.0) 2617 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:46:11.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:11 smithi106 bash[18459]: cluster 2024-02-13T00:46:10.270726+0000 mon.a (mon.0) 2618 : cluster [DBG] osdmap e484: 8 total, 8 up, 8 in 2024-02-13T00:46:11.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:11 smithi106 bash[18459]: audit 2024-02-13T00:46:10.271660+0000 mon.a (mon.0) 2619 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-90"}]: dispatch 2024-02-13T00:46:11.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:11 smithi106 bash[18459]: cluster 2024-02-13T00:46:10.394225+0000 mgr.y (mgr.24461) 639 : cluster [DBG] pgmap v902: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:11.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:11 smithi080 bash[24237]: audit 2024-02-13T00:46:10.270631+0000 mon.a (mon.0) 2617 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:46:11.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:11 smithi080 bash[24237]: cluster 2024-02-13T00:46:10.270726+0000 mon.a (mon.0) 2618 : cluster [DBG] osdmap e484: 8 total, 8 up, 8 in 2024-02-13T00:46:11.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:11 smithi080 bash[24237]: audit 2024-02-13T00:46:10.271660+0000 mon.a (mon.0) 2619 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-90"}]: dispatch 2024-02-13T00:46:11.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:11 smithi080 bash[24237]: cluster 2024-02-13T00:46:10.394225+0000 mgr.y (mgr.24461) 639 : cluster [DBG] pgmap v902: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:11.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:11 smithi080 bash[17386]: audit 2024-02-13T00:46:10.270631+0000 mon.a (mon.0) 2617 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]': finished 2024-02-13T00:46:11.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:11 smithi080 bash[17386]: cluster 2024-02-13T00:46:10.270726+0000 mon.a (mon.0) 2618 : cluster [DBG] osdmap e484: 8 total, 8 up, 8 in 2024-02-13T00:46:11.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:11 smithi080 bash[17386]: audit 2024-02-13T00:46:10.271660+0000 mon.a (mon.0) 2619 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-90"}]: dispatch 2024-02-13T00:46:11.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:11 smithi080 bash[17386]: cluster 2024-02-13T00:46:10.394225+0000 mgr.y (mgr.24461) 639 : cluster [DBG] pgmap v902: 228 pgs: 228 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:12.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:12 smithi106 bash[18459]: audit 2024-02-13T00:46:11.279838+0000 mon.a (mon.0) 2620 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-90"}]': finished 2024-02-13T00:46:12.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:12 smithi106 bash[18459]: cluster 2024-02-13T00:46:11.279981+0000 mon.a (mon.0) 2621 : cluster [DBG] osdmap e485: 8 total, 8 up, 8 in 2024-02-13T00:46:12.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:12 smithi080 bash[17386]: audit 2024-02-13T00:46:11.279838+0000 mon.a (mon.0) 2620 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-90"}]': finished 2024-02-13T00:46:12.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:12 smithi080 bash[17386]: cluster 2024-02-13T00:46:11.279981+0000 mon.a (mon.0) 2621 : cluster [DBG] osdmap e485: 8 total, 8 up, 8 in 2024-02-13T00:46:12.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:12 smithi080 bash[24237]: audit 2024-02-13T00:46:11.279838+0000 mon.a (mon.0) 2620 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-90"}]': finished 2024-02-13T00:46:12.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:12 smithi080 bash[24237]: cluster 2024-02-13T00:46:11.279981+0000 mon.a (mon.0) 2621 : cluster [DBG] osdmap e485: 8 total, 8 up, 8 in 2024-02-13T00:46:13.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:13 smithi080 bash[17386]: cluster 2024-02-13T00:46:12.294229+0000 mon.a (mon.0) 2622 : cluster [DBG] osdmap e486: 8 total, 8 up, 8 in 2024-02-13T00:46:13.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:13 smithi080 bash[17386]: cluster 2024-02-13T00:46:12.394818+0000 mgr.y (mgr.24461) 640 : cluster [DBG] pgmap v905: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:46:13.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:46:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:46:13] "GET /metrics HTTP/1.1" 200 188669 "" "Prometheus/2.33.4" 2024-02-13T00:46:13.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:13 smithi080 bash[24237]: cluster 2024-02-13T00:46:12.294229+0000 mon.a (mon.0) 2622 : cluster [DBG] osdmap e486: 8 total, 8 up, 8 in 2024-02-13T00:46:13.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:13 smithi080 bash[24237]: cluster 2024-02-13T00:46:12.394818+0000 mgr.y (mgr.24461) 640 : cluster [DBG] pgmap v905: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:46:13.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:13 smithi106 bash[18459]: cluster 2024-02-13T00:46:12.294229+0000 mon.a (mon.0) 2622 : cluster [DBG] osdmap e486: 8 total, 8 up, 8 in 2024-02-13T00:46:13.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:13 smithi106 bash[18459]: cluster 2024-02-13T00:46:12.394818+0000 mgr.y (mgr.24461) 640 : cluster [DBG] pgmap v905: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:46:14.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:14 smithi106 bash[18459]: cluster 2024-02-13T00:46:13.300043+0000 mon.a (mon.0) 2623 : cluster [DBG] osdmap e487: 8 total, 8 up, 8 in 2024-02-13T00:46:14.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:14 smithi106 bash[18459]: audit 2024-02-13T00:46:13.303950+0000 mon.a (mon.0) 2624 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:46:14.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:14 smithi080 bash[24237]: cluster 2024-02-13T00:46:13.300043+0000 mon.a (mon.0) 2623 : cluster [DBG] osdmap e487: 8 total, 8 up, 8 in 2024-02-13T00:46:14.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:14 smithi080 bash[24237]: audit 2024-02-13T00:46:13.303950+0000 mon.a (mon.0) 2624 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:46:14.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:14 smithi080 bash[17386]: cluster 2024-02-13T00:46:13.300043+0000 mon.a (mon.0) 2623 : cluster [DBG] osdmap e487: 8 total, 8 up, 8 in 2024-02-13T00:46:14.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:14 smithi080 bash[17386]: audit 2024-02-13T00:46:13.303950+0000 mon.a (mon.0) 2624 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:46:15.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:15 smithi106 bash[18459]: audit 2024-02-13T00:46:14.311908+0000 mon.a (mon.0) 2625 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:46:15.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:15 smithi106 bash[18459]: cluster 2024-02-13T00:46:14.312390+0000 mon.a (mon.0) 2626 : cluster [DBG] osdmap e488: 8 total, 8 up, 8 in 2024-02-13T00:46:15.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:15 smithi106 bash[18459]: audit 2024-02-13T00:46:14.315988+0000 mon.a (mon.0) 2627 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:46:15.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:15 smithi106 bash[18459]: audit 2024-02-13T00:46:14.320979+0000 mon.a (mon.0) 2628 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-92","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:46:15.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:15 smithi106 bash[18459]: cluster 2024-02-13T00:46:14.395646+0000 mgr.y (mgr.24461) 641 : cluster [DBG] pgmap v908: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:46:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:15 smithi080 bash[17386]: audit 2024-02-13T00:46:14.311908+0000 mon.a (mon.0) 2625 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:46:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:15 smithi080 bash[17386]: cluster 2024-02-13T00:46:14.312390+0000 mon.a (mon.0) 2626 : cluster [DBG] osdmap e488: 8 total, 8 up, 8 in 2024-02-13T00:46:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:15 smithi080 bash[17386]: audit 2024-02-13T00:46:14.315988+0000 mon.a (mon.0) 2627 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:46:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:15 smithi080 bash[17386]: audit 2024-02-13T00:46:14.320979+0000 mon.a (mon.0) 2628 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-92","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:46:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:15 smithi080 bash[17386]: cluster 2024-02-13T00:46:14.395646+0000 mgr.y (mgr.24461) 641 : cluster [DBG] pgmap v908: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:46:15.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:15 smithi080 bash[24237]: audit 2024-02-13T00:46:14.311908+0000 mon.a (mon.0) 2625 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:46:15.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:15 smithi080 bash[24237]: cluster 2024-02-13T00:46:14.312390+0000 mon.a (mon.0) 2626 : cluster [DBG] osdmap e488: 8 total, 8 up, 8 in 2024-02-13T00:46:15.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:15 smithi080 bash[24237]: audit 2024-02-13T00:46:14.315988+0000 mon.a (mon.0) 2627 : audit [DBG] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T00:46:15.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:15 smithi080 bash[24237]: audit 2024-02-13T00:46:14.320979+0000 mon.a (mon.0) 2628 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-92","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T00:46:15.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:15 smithi080 bash[24237]: cluster 2024-02-13T00:46:14.395646+0000 mgr.y (mgr.24461) 641 : cluster [DBG] pgmap v908: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:46:16.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:16 smithi106 bash[18459]: audit 2024-02-13T00:46:15.314385+0000 mon.a (mon.0) 2629 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-92","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:46:16.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:16 smithi106 bash[18459]: cluster 2024-02-13T00:46:15.314605+0000 mon.a (mon.0) 2630 : cluster [DBG] osdmap e489: 8 total, 8 up, 8 in 2024-02-13T00:46:16.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:16 smithi106 bash[18459]: audit 2024-02-13T00:46:15.316318+0000 mon.a (mon.0) 2631 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-92","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T00:46:16.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:16 smithi080 bash[24237]: audit 2024-02-13T00:46:15.314385+0000 mon.a (mon.0) 2629 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-92","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:46:16.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:16 smithi080 bash[24237]: cluster 2024-02-13T00:46:15.314605+0000 mon.a (mon.0) 2630 : cluster [DBG] osdmap e489: 8 total, 8 up, 8 in 2024-02-13T00:46:16.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:16 smithi080 bash[24237]: audit 2024-02-13T00:46:15.316318+0000 mon.a (mon.0) 2631 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-92","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T00:46:16.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:16 smithi080 bash[17386]: audit 2024-02-13T00:46:15.314385+0000 mon.a (mon.0) 2629 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-92","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T00:46:16.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:16 smithi080 bash[17386]: cluster 2024-02-13T00:46:15.314605+0000 mon.a (mon.0) 2630 : cluster [DBG] osdmap e489: 8 total, 8 up, 8 in 2024-02-13T00:46:16.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:16 smithi080 bash[17386]: audit 2024-02-13T00:46:15.316318+0000 mon.a (mon.0) 2631 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-92","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T00:46:17.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:17 smithi106 bash[18459]: audit 2024-02-13T00:46:16.318358+0000 mon.a (mon.0) 2632 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-92","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T00:46:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:17 smithi106 bash[18459]: cluster 2024-02-13T00:46:16.318446+0000 mon.a (mon.0) 2633 : cluster [DBG] osdmap e490: 8 total, 8 up, 8 in 2024-02-13T00:46:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:17 smithi106 bash[18459]: audit 2024-02-13T00:46:16.321200+0000 mon.a (mon.0) 2634 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-92","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T00:46:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:17 smithi106 bash[18459]: cluster 2024-02-13T00:46:16.396533+0000 mgr.y (mgr.24461) 642 : cluster [DBG] pgmap v911: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:46:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:17 smithi106 bash[18459]: audit 2024-02-13T00:46:17.319600+0000 mon.a (mon.0) 2635 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-92","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T00:46:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:17 smithi106 bash[18459]: cluster 2024-02-13T00:46:17.320216+0000 mon.a (mon.0) 2636 : cluster [DBG] osdmap e491: 8 total, 8 up, 8 in 2024-02-13T00:46:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:17 smithi080 bash[17386]: audit 2024-02-13T00:46:16.318358+0000 mon.a (mon.0) 2632 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-92","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T00:46:17.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:17 smithi080 bash[17386]: cluster 2024-02-13T00:46:16.318446+0000 mon.a (mon.0) 2633 : cluster [DBG] osdmap e490: 8 total, 8 up, 8 in 2024-02-13T00:46:17.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:17 smithi080 bash[17386]: audit 2024-02-13T00:46:16.321200+0000 mon.a (mon.0) 2634 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-92","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T00:46:17.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:17 smithi080 bash[17386]: cluster 2024-02-13T00:46:16.396533+0000 mgr.y (mgr.24461) 642 : cluster [DBG] pgmap v911: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:46:17.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:17 smithi080 bash[17386]: audit 2024-02-13T00:46:17.319600+0000 mon.a (mon.0) 2635 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-92","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T00:46:17.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:17 smithi080 bash[17386]: cluster 2024-02-13T00:46:17.320216+0000 mon.a (mon.0) 2636 : cluster [DBG] osdmap e491: 8 total, 8 up, 8 in 2024-02-13T00:46:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:17 smithi080 bash[24237]: audit 2024-02-13T00:46:16.318358+0000 mon.a (mon.0) 2632 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-92","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T00:46:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:17 smithi080 bash[24237]: cluster 2024-02-13T00:46:16.318446+0000 mon.a (mon.0) 2633 : cluster [DBG] osdmap e490: 8 total, 8 up, 8 in 2024-02-13T00:46:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:17 smithi080 bash[24237]: audit 2024-02-13T00:46:16.321200+0000 mon.a (mon.0) 2634 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-92","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T00:46:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:17 smithi080 bash[24237]: cluster 2024-02-13T00:46:16.396533+0000 mgr.y (mgr.24461) 642 : cluster [DBG] pgmap v911: 228 pgs: 32 unknown, 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:46:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:17 smithi080 bash[24237]: audit 2024-02-13T00:46:17.319600+0000 mon.a (mon.0) 2635 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-92","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T00:46:17.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:17 smithi080 bash[24237]: cluster 2024-02-13T00:46:17.320216+0000 mon.a (mon.0) 2636 : cluster [DBG] osdmap e491: 8 total, 8 up, 8 in 2024-02-13T00:46:18.755 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:46:18 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:46:18.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:18 smithi106 bash[18459]: audit 2024-02-13T00:46:17.360125+0000 mon.a (mon.0) 2637 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:46:18.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:18 smithi106 bash[18459]: audit 2024-02-13T00:46:17.360702+0000 mon.a (mon.0) 2638 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-92"}]: dispatch 2024-02-13T00:46:18.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:18 smithi080 bash[17386]: audit 2024-02-13T00:46:17.360125+0000 mon.a (mon.0) 2637 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:46:18.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:18 smithi080 bash[17386]: audit 2024-02-13T00:46:17.360702+0000 mon.a (mon.0) 2638 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-92"}]: dispatch 2024-02-13T00:46:18.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:18 smithi080 bash[24237]: audit 2024-02-13T00:46:17.360125+0000 mon.a (mon.0) 2637 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-6"}]: dispatch 2024-02-13T00:46:18.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:18 smithi080 bash[24237]: audit 2024-02-13T00:46:17.360702+0000 mon.a (mon.0) 2638 : audit [INF] from='client.? 172.21.15.80:0/1512537311' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-6", "tierpool": "test-rados-api-smithi080-54255-92"}]: dispatch 2024-02-13T00:46:19.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:19 smithi106 bash[18459]: cluster 2024-02-13T00:46:18.351027+0000 mon.a (mon.0) 2639 : cluster [DBG] osdmap e492: 8 total, 8 up, 8 in 2024-02-13T00:46:19.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:19 smithi106 bash[18459]: cluster 2024-02-13T00:46:18.397344+0000 mgr.y (mgr.24461) 643 : cluster [DBG] pgmap v914: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T00:46:19.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:19 smithi106 bash[18459]: audit 2024-02-13T00:46:18.572412+0000 mgr.y (mgr.24461) 644 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:46:19.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:19 smithi080 bash[24237]: cluster 2024-02-13T00:46:18.351027+0000 mon.a (mon.0) 2639 : cluster [DBG] osdmap e492: 8 total, 8 up, 8 in 2024-02-13T00:46:19.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:19 smithi080 bash[24237]: cluster 2024-02-13T00:46:18.397344+0000 mgr.y (mgr.24461) 643 : cluster [DBG] pgmap v914: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T00:46:19.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:19 smithi080 bash[24237]: audit 2024-02-13T00:46:18.572412+0000 mgr.y (mgr.24461) 644 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:46:19.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:19 smithi080 bash[17386]: cluster 2024-02-13T00:46:18.351027+0000 mon.a (mon.0) 2639 : cluster [DBG] osdmap e492: 8 total, 8 up, 8 in 2024-02-13T00:46:19.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:19 smithi080 bash[17386]: cluster 2024-02-13T00:46:18.397344+0000 mgr.y (mgr.24461) 643 : cluster [DBG] pgmap v914: 196 pgs: 196 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T00:46:19.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:19 smithi080 bash[17386]: audit 2024-02-13T00:46:18.572412+0000 mgr.y (mgr.24461) 644 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:46:20.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:46:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:46:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:46:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:20 smithi106 bash[18459]: cluster 2024-02-13T00:46:19.354059+0000 mon.a (mon.0) 2640 : cluster [DBG] osdmap e493: 8 total, 8 up, 8 in 2024-02-13T00:46:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:20 smithi106 bash[18459]: audit 2024-02-13T00:46:19.380292+0000 mon.c (mon.2) 380 : audit [INF] from='client.? 172.21.15.80:0/1337989578' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:20 smithi106 bash[18459]: audit 2024-02-13T00:46:19.380653+0000 mon.a (mon.0) 2641 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:20 smithi106 bash[18459]: audit 2024-02-13T00:46:19.381671+0000 mon.c (mon.2) 381 : audit [INF] from='client.? 172.21.15.80:0/1337989578' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:20 smithi106 bash[18459]: audit 2024-02-13T00:46:19.381992+0000 mon.a (mon.0) 2642 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:20 smithi106 bash[18459]: audit 2024-02-13T00:46:19.382517+0000 mon.c (mon.2) 382 : audit [INF] from='client.? 172.21.15.80:0/1337989578' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:46:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:20 smithi106 bash[18459]: audit 2024-02-13T00:46:19.382860+0000 mon.a (mon.0) 2643 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:46:20.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:20 smithi080 bash[24237]: cluster 2024-02-13T00:46:19.354059+0000 mon.a (mon.0) 2640 : cluster [DBG] osdmap e493: 8 total, 8 up, 8 in 2024-02-13T00:46:20.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:20 smithi080 bash[24237]: audit 2024-02-13T00:46:19.380292+0000 mon.c (mon.2) 380 : audit [INF] from='client.? 172.21.15.80:0/1337989578' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:20.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:20 smithi080 bash[24237]: audit 2024-02-13T00:46:19.380653+0000 mon.a (mon.0) 2641 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:20.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:20 smithi080 bash[24237]: audit 2024-02-13T00:46:19.381671+0000 mon.c (mon.2) 381 : audit [INF] from='client.? 172.21.15.80:0/1337989578' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:20.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:20 smithi080 bash[24237]: audit 2024-02-13T00:46:19.381992+0000 mon.a (mon.0) 2642 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:20.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:20 smithi080 bash[24237]: audit 2024-02-13T00:46:19.382517+0000 mon.c (mon.2) 382 : audit [INF] from='client.? 172.21.15.80:0/1337989578' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:46:20.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:20 smithi080 bash[24237]: audit 2024-02-13T00:46:19.382860+0000 mon.a (mon.0) 2643 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:46:20.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:20 smithi080 bash[17386]: cluster 2024-02-13T00:46:19.354059+0000 mon.a (mon.0) 2640 : cluster [DBG] osdmap e493: 8 total, 8 up, 8 in 2024-02-13T00:46:20.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:20 smithi080 bash[17386]: audit 2024-02-13T00:46:19.380292+0000 mon.c (mon.2) 380 : audit [INF] from='client.? 172.21.15.80:0/1337989578' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:20.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:20 smithi080 bash[17386]: audit 2024-02-13T00:46:19.380653+0000 mon.a (mon.0) 2641 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:20.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:20 smithi080 bash[17386]: audit 2024-02-13T00:46:19.381671+0000 mon.c (mon.2) 381 : audit [INF] from='client.? 172.21.15.80:0/1337989578' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:20.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:20 smithi080 bash[17386]: audit 2024-02-13T00:46:19.381992+0000 mon.a (mon.0) 2642 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:20.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:20 smithi080 bash[17386]: audit 2024-02-13T00:46:19.382517+0000 mon.c (mon.2) 382 : audit [INF] from='client.? 172.21.15.80:0/1337989578' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:46:20.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:20 smithi080 bash[17386]: audit 2024-02-13T00:46:19.382860+0000 mon.a (mon.0) 2643 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:46:22.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:21 smithi106 bash[18459]: audit 2024-02-13T00:46:20.366858+0000 mon.a (mon.0) 2644 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:46:22.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:21 smithi106 bash[18459]: cluster 2024-02-13T00:46:20.367080+0000 mon.a (mon.0) 2645 : cluster [DBG] osdmap e494: 8 total, 8 up, 8 in 2024-02-13T00:46:22.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:21 smithi106 bash[18459]: audit 2024-02-13T00:46:20.369266+0000 mon.c (mon.2) 383 : audit [INF] from='client.? 172.21.15.80:0/1337989578' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi080-54255-94", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:22.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:21 smithi106 bash[18459]: audit 2024-02-13T00:46:20.370014+0000 mon.a (mon.0) 2646 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi080-54255-94", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:22.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:21 smithi106 bash[18459]: cluster 2024-02-13T00:46:20.398010+0000 mgr.y (mgr.24461) 645 : cluster [DBG] pgmap v917: 164 pgs: 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:46:22.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:21 smithi080 bash[24237]: audit 2024-02-13T00:46:20.366858+0000 mon.a (mon.0) 2644 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:46:22.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:21 smithi080 bash[24237]: cluster 2024-02-13T00:46:20.367080+0000 mon.a (mon.0) 2645 : cluster [DBG] osdmap e494: 8 total, 8 up, 8 in 2024-02-13T00:46:22.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:21 smithi080 bash[24237]: audit 2024-02-13T00:46:20.369266+0000 mon.c (mon.2) 383 : audit [INF] from='client.? 172.21.15.80:0/1337989578' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi080-54255-94", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:22.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:21 smithi080 bash[24237]: audit 2024-02-13T00:46:20.370014+0000 mon.a (mon.0) 2646 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi080-54255-94", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:22.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:21 smithi080 bash[24237]: cluster 2024-02-13T00:46:20.398010+0000 mgr.y (mgr.24461) 645 : cluster [DBG] pgmap v917: 164 pgs: 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:46:22.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:21 smithi080 bash[17386]: audit 2024-02-13T00:46:20.366858+0000 mon.a (mon.0) 2644 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:46:22.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:21 smithi080 bash[17386]: cluster 2024-02-13T00:46:20.367080+0000 mon.a (mon.0) 2645 : cluster [DBG] osdmap e494: 8 total, 8 up, 8 in 2024-02-13T00:46:22.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:21 smithi080 bash[17386]: audit 2024-02-13T00:46:20.369266+0000 mon.c (mon.2) 383 : audit [INF] from='client.? 172.21.15.80:0/1337989578' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi080-54255-94", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:22.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:21 smithi080 bash[17386]: audit 2024-02-13T00:46:20.370014+0000 mon.a (mon.0) 2646 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi080-54255-94", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:22.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:21 smithi080 bash[17386]: cluster 2024-02-13T00:46:20.398010+0000 mgr.y (mgr.24461) 645 : cluster [DBG] pgmap v917: 164 pgs: 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:46:23.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:22 smithi080 bash[17386]: cluster 2024-02-13T00:46:21.806464+0000 mon.a (mon.0) 2647 : cluster [DBG] osdmap e495: 8 total, 8 up, 8 in 2024-02-13T00:46:23.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:22 smithi080 bash[17386]: audit 2024-02-13T00:46:22.374029+0000 mon.a (mon.0) 2648 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi080-54255-94", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi080-54255-94"}]': finished 2024-02-13T00:46:23.117 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:22 smithi080 bash[17386]: cluster 2024-02-13T00:46:22.374174+0000 mon.a (mon.0) 2649 : cluster [DBG] osdmap e496: 8 total, 8 up, 8 in 2024-02-13T00:46:23.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:22 smithi080 bash[24237]: cluster 2024-02-13T00:46:21.806464+0000 mon.a (mon.0) 2647 : cluster [DBG] osdmap e495: 8 total, 8 up, 8 in 2024-02-13T00:46:23.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:22 smithi080 bash[24237]: audit 2024-02-13T00:46:22.374029+0000 mon.a (mon.0) 2648 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi080-54255-94", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi080-54255-94"}]': finished 2024-02-13T00:46:23.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:22 smithi080 bash[24237]: cluster 2024-02-13T00:46:22.374174+0000 mon.a (mon.0) 2649 : cluster [DBG] osdmap e496: 8 total, 8 up, 8 in 2024-02-13T00:46:23.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:22 smithi106 bash[18459]: cluster 2024-02-13T00:46:21.806464+0000 mon.a (mon.0) 2647 : cluster [DBG] osdmap e495: 8 total, 8 up, 8 in 2024-02-13T00:46:23.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:22 smithi106 bash[18459]: audit 2024-02-13T00:46:22.374029+0000 mon.a (mon.0) 2648 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi080-54255-94", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi080-54255-94"}]': finished 2024-02-13T00:46:23.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:22 smithi106 bash[18459]: cluster 2024-02-13T00:46:22.374174+0000 mon.a (mon.0) 2649 : cluster [DBG] osdmap e496: 8 total, 8 up, 8 in 2024-02-13T00:46:23.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:46:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:46:23] "GET /metrics HTTP/1.1" 200 188786 "" "Prometheus/2.33.4" 2024-02-13T00:46:24.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:23 smithi106 bash[18459]: cluster 2024-02-13T00:46:22.398606+0000 mgr.y (mgr.24461) 646 : cluster [DBG] pgmap v920: 172 pgs: 8 unknown, 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:46:24.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:23 smithi106 bash[18459]: cluster 2024-02-13T00:46:23.375857+0000 mon.a (mon.0) 2650 : cluster [DBG] osdmap e497: 8 total, 8 up, 8 in 2024-02-13T00:46:24.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:23 smithi080 bash[17386]: cluster 2024-02-13T00:46:22.398606+0000 mgr.y (mgr.24461) 646 : cluster [DBG] pgmap v920: 172 pgs: 8 unknown, 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:46:24.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:23 smithi080 bash[17386]: cluster 2024-02-13T00:46:23.375857+0000 mon.a (mon.0) 2650 : cluster [DBG] osdmap e497: 8 total, 8 up, 8 in 2024-02-13T00:46:24.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:23 smithi080 bash[24237]: cluster 2024-02-13T00:46:22.398606+0000 mgr.y (mgr.24461) 646 : cluster [DBG] pgmap v920: 172 pgs: 8 unknown, 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:46:24.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:23 smithi080 bash[24237]: cluster 2024-02-13T00:46:23.375857+0000 mon.a (mon.0) 2650 : cluster [DBG] osdmap e497: 8 total, 8 up, 8 in 2024-02-13T00:46:25.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:25 smithi106 bash[18459]: cluster 2024-02-13T00:46:24.380929+0000 mon.a (mon.0) 2651 : cluster [DBG] osdmap e498: 8 total, 8 up, 8 in 2024-02-13T00:46:25.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:25 smithi106 bash[18459]: audit 2024-02-13T00:46:24.383693+0000 mon.a (mon.0) 2652 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-97","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:46:25.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:25 smithi106 bash[18459]: cluster 2024-02-13T00:46:24.399106+0000 mgr.y (mgr.24461) 647 : cluster [DBG] pgmap v923: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:25.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:25 smithi080 bash[17386]: cluster 2024-02-13T00:46:24.380929+0000 mon.a (mon.0) 2651 : cluster [DBG] osdmap e498: 8 total, 8 up, 8 in 2024-02-13T00:46:25.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:25 smithi080 bash[17386]: audit 2024-02-13T00:46:24.383693+0000 mon.a (mon.0) 2652 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-97","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:46:25.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:25 smithi080 bash[17386]: cluster 2024-02-13T00:46:24.399106+0000 mgr.y (mgr.24461) 647 : cluster [DBG] pgmap v923: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:25.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:25 smithi080 bash[24237]: cluster 2024-02-13T00:46:24.380929+0000 mon.a (mon.0) 2651 : cluster [DBG] osdmap e498: 8 total, 8 up, 8 in 2024-02-13T00:46:25.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:25 smithi080 bash[24237]: audit 2024-02-13T00:46:24.383693+0000 mon.a (mon.0) 2652 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-97","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:46:25.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:25 smithi080 bash[24237]: cluster 2024-02-13T00:46:24.399106+0000 mgr.y (mgr.24461) 647 : cluster [DBG] pgmap v923: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:26.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:26 smithi106 bash[18459]: audit 2024-02-13T00:46:25.390857+0000 mon.a (mon.0) 2653 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-97","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:46:26.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:26 smithi106 bash[18459]: cluster 2024-02-13T00:46:25.391127+0000 mon.a (mon.0) 2654 : cluster [DBG] osdmap e499: 8 total, 8 up, 8 in 2024-02-13T00:46:26.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:26 smithi080 bash[17386]: audit 2024-02-13T00:46:25.390857+0000 mon.a (mon.0) 2653 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-97","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:46:26.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:26 smithi080 bash[17386]: cluster 2024-02-13T00:46:25.391127+0000 mon.a (mon.0) 2654 : cluster [DBG] osdmap e499: 8 total, 8 up, 8 in 2024-02-13T00:46:26.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:26 smithi080 bash[24237]: audit 2024-02-13T00:46:25.390857+0000 mon.a (mon.0) 2653 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-97","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:46:26.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:26 smithi080 bash[24237]: cluster 2024-02-13T00:46:25.391127+0000 mon.a (mon.0) 2654 : cluster [DBG] osdmap e499: 8 total, 8 up, 8 in 2024-02-13T00:46:27.256 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:46:26 smithi106 bash[41659]: t=2024-02-13T00:46:26+0000 lvl=info msg="Database locked, sleeping then retrying" logger=sqlstore error="database is locked" retry=0 2024-02-13T00:46:27.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:27 smithi106 bash[18459]: cluster 2024-02-13T00:46:26.399669+0000 mgr.y (mgr.24461) 648 : cluster [DBG] pgmap v925: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:27.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:27 smithi106 bash[18459]: cluster 2024-02-13T00:46:26.403566+0000 mon.a (mon.0) 2655 : cluster [DBG] osdmap e500: 8 total, 8 up, 8 in 2024-02-13T00:46:27.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:27 smithi106 bash[18459]: audit 2024-02-13T00:46:26.406738+0000 mon.a (mon.0) 2656 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-97-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:46:27.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:27 smithi080 bash[17386]: cluster 2024-02-13T00:46:26.399669+0000 mgr.y (mgr.24461) 648 : cluster [DBG] pgmap v925: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:27.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:27 smithi080 bash[17386]: cluster 2024-02-13T00:46:26.403566+0000 mon.a (mon.0) 2655 : cluster [DBG] osdmap e500: 8 total, 8 up, 8 in 2024-02-13T00:46:27.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:27 smithi080 bash[17386]: audit 2024-02-13T00:46:26.406738+0000 mon.a (mon.0) 2656 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-97-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:46:27.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:27 smithi080 bash[24237]: cluster 2024-02-13T00:46:26.399669+0000 mgr.y (mgr.24461) 648 : cluster [DBG] pgmap v925: 204 pgs: 32 unknown, 8 creating+peering, 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:27.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:27 smithi080 bash[24237]: cluster 2024-02-13T00:46:26.403566+0000 mon.a (mon.0) 2655 : cluster [DBG] osdmap e500: 8 total, 8 up, 8 in 2024-02-13T00:46:27.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:27 smithi080 bash[24237]: audit 2024-02-13T00:46:26.406738+0000 mon.a (mon.0) 2656 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-97-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:46:28.756 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:46:28 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:46:28.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:28 smithi106 bash[18459]: audit 2024-02-13T00:46:27.413123+0000 mon.a (mon.0) 2657 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-97-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:46:28.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:28 smithi106 bash[18459]: cluster 2024-02-13T00:46:27.413399+0000 mon.a (mon.0) 2658 : cluster [DBG] osdmap e501: 8 total, 8 up, 8 in 2024-02-13T00:46:28.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:28 smithi106 bash[18459]: audit 2024-02-13T00:46:27.417451+0000 mon.a (mon.0) 2659 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-97", "tierpool": "test-rados-api-smithi080-54255-97-cache"}]: dispatch 2024-02-13T00:46:28.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:28 smithi106 bash[18459]: audit 2024-02-13T00:46:28.409977+0000 mon.a (mon.0) 2660 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-97", "tierpool": "test-rados-api-smithi080-54255-97-cache"}]': finished 2024-02-13T00:46:28.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:28 smithi106 bash[18459]: cluster 2024-02-13T00:46:28.410132+0000 mon.a (mon.0) 2661 : cluster [DBG] osdmap e502: 8 total, 8 up, 8 in 2024-02-13T00:46:28.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:28 smithi106 bash[18459]: audit 2024-02-13T00:46:28.410999+0000 mon.a (mon.0) 2662 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-97", "overlaypool": "test-rados-api-smithi080-54255-97-cache"}]: dispatch 2024-02-13T00:46:28.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:28 smithi080 bash[17386]: audit 2024-02-13T00:46:27.413123+0000 mon.a (mon.0) 2657 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-97-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:46:28.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:28 smithi080 bash[17386]: cluster 2024-02-13T00:46:27.413399+0000 mon.a (mon.0) 2658 : cluster [DBG] osdmap e501: 8 total, 8 up, 8 in 2024-02-13T00:46:28.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:28 smithi080 bash[17386]: audit 2024-02-13T00:46:27.417451+0000 mon.a (mon.0) 2659 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-97", "tierpool": "test-rados-api-smithi080-54255-97-cache"}]: dispatch 2024-02-13T00:46:28.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:28 smithi080 bash[17386]: audit 2024-02-13T00:46:28.409977+0000 mon.a (mon.0) 2660 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-97", "tierpool": "test-rados-api-smithi080-54255-97-cache"}]': finished 2024-02-13T00:46:28.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:28 smithi080 bash[17386]: cluster 2024-02-13T00:46:28.410132+0000 mon.a (mon.0) 2661 : cluster [DBG] osdmap e502: 8 total, 8 up, 8 in 2024-02-13T00:46:28.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:28 smithi080 bash[17386]: audit 2024-02-13T00:46:28.410999+0000 mon.a (mon.0) 2662 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-97", "overlaypool": "test-rados-api-smithi080-54255-97-cache"}]: dispatch 2024-02-13T00:46:28.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:28 smithi080 bash[24237]: audit 2024-02-13T00:46:27.413123+0000 mon.a (mon.0) 2657 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-97-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:46:28.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:28 smithi080 bash[24237]: cluster 2024-02-13T00:46:27.413399+0000 mon.a (mon.0) 2658 : cluster [DBG] osdmap e501: 8 total, 8 up, 8 in 2024-02-13T00:46:28.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:28 smithi080 bash[24237]: audit 2024-02-13T00:46:27.417451+0000 mon.a (mon.0) 2659 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-97", "tierpool": "test-rados-api-smithi080-54255-97-cache"}]: dispatch 2024-02-13T00:46:28.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:28 smithi080 bash[24237]: audit 2024-02-13T00:46:28.409977+0000 mon.a (mon.0) 2660 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-97", "tierpool": "test-rados-api-smithi080-54255-97-cache"}]': finished 2024-02-13T00:46:28.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:28 smithi080 bash[24237]: cluster 2024-02-13T00:46:28.410132+0000 mon.a (mon.0) 2661 : cluster [DBG] osdmap e502: 8 total, 8 up, 8 in 2024-02-13T00:46:28.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:28 smithi080 bash[24237]: audit 2024-02-13T00:46:28.410999+0000 mon.a (mon.0) 2662 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-97", "overlaypool": "test-rados-api-smithi080-54255-97-cache"}]: dispatch 2024-02-13T00:46:29.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:29 smithi106 bash[18459]: cluster 2024-02-13T00:46:28.401379+0000 mgr.y (mgr.24461) 649 : cluster [DBG] pgmap v928: 236 pgs: 236 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:46:29.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:29 smithi106 bash[18459]: audit 2024-02-13T00:46:28.583865+0000 mgr.y (mgr.24461) 650 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:46:29.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:29 smithi106 bash[18459]: cluster 2024-02-13T00:46:28.764543+0000 mon.a (mon.0) 2663 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:46:29.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:29 smithi106 bash[18459]: audit 2024-02-13T00:46:29.413749+0000 mon.a (mon.0) 2664 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-97", "overlaypool": "test-rados-api-smithi080-54255-97-cache"}]': finished 2024-02-13T00:46:29.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:29 smithi106 bash[18459]: cluster 2024-02-13T00:46:29.413878+0000 mon.a (mon.0) 2665 : cluster [DBG] osdmap e503: 8 total, 8 up, 8 in 2024-02-13T00:46:29.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:29 smithi106 bash[18459]: audit 2024-02-13T00:46:29.415371+0000 mon.a (mon.0) 2666 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-97-cache", "mode": "writeback"}]: dispatch 2024-02-13T00:46:29.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:29 smithi080 bash[17386]: cluster 2024-02-13T00:46:28.401379+0000 mgr.y (mgr.24461) 649 : cluster [DBG] pgmap v928: 236 pgs: 236 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:46:29.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:29 smithi080 bash[17386]: audit 2024-02-13T00:46:28.583865+0000 mgr.y (mgr.24461) 650 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:46:29.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:29 smithi080 bash[17386]: cluster 2024-02-13T00:46:28.764543+0000 mon.a (mon.0) 2663 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:46:29.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:29 smithi080 bash[17386]: audit 2024-02-13T00:46:29.413749+0000 mon.a (mon.0) 2664 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-97", "overlaypool": "test-rados-api-smithi080-54255-97-cache"}]': finished 2024-02-13T00:46:29.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:29 smithi080 bash[17386]: cluster 2024-02-13T00:46:29.413878+0000 mon.a (mon.0) 2665 : cluster [DBG] osdmap e503: 8 total, 8 up, 8 in 2024-02-13T00:46:29.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:29 smithi080 bash[17386]: audit 2024-02-13T00:46:29.415371+0000 mon.a (mon.0) 2666 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-97-cache", "mode": "writeback"}]: dispatch 2024-02-13T00:46:29.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:29 smithi080 bash[24237]: cluster 2024-02-13T00:46:28.401379+0000 mgr.y (mgr.24461) 649 : cluster [DBG] pgmap v928: 236 pgs: 236 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:46:29.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:29 smithi080 bash[24237]: audit 2024-02-13T00:46:28.583865+0000 mgr.y (mgr.24461) 650 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:46:29.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:29 smithi080 bash[24237]: cluster 2024-02-13T00:46:28.764543+0000 mon.a (mon.0) 2663 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:46:29.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:29 smithi080 bash[24237]: audit 2024-02-13T00:46:29.413749+0000 mon.a (mon.0) 2664 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-97", "overlaypool": "test-rados-api-smithi080-54255-97-cache"}]': finished 2024-02-13T00:46:29.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:29 smithi080 bash[24237]: cluster 2024-02-13T00:46:29.413878+0000 mon.a (mon.0) 2665 : cluster [DBG] osdmap e503: 8 total, 8 up, 8 in 2024-02-13T00:46:29.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:29 smithi080 bash[24237]: audit 2024-02-13T00:46:29.415371+0000 mon.a (mon.0) 2666 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-97-cache", "mode": "writeback"}]: dispatch 2024-02-13T00:46:30.438 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:46:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:46:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:46:30.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:30 smithi106 bash[18459]: cluster 2024-02-13T00:46:30.408514+0000 mon.a (mon.0) 2667 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:46:30.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:30 smithi106 bash[18459]: audit 2024-02-13T00:46:30.416926+0000 mon.a (mon.0) 2668 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-97-cache", "mode": "writeback"}]': finished 2024-02-13T00:46:30.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:30 smithi106 bash[18459]: cluster 2024-02-13T00:46:30.417209+0000 mon.a (mon.0) 2669 : cluster [DBG] osdmap e504: 8 total, 8 up, 8 in 2024-02-13T00:46:30.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:30 smithi080 bash[24237]: cluster 2024-02-13T00:46:30.408514+0000 mon.a (mon.0) 2667 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:46:30.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:30 smithi080 bash[24237]: audit 2024-02-13T00:46:30.416926+0000 mon.a (mon.0) 2668 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-97-cache", "mode": "writeback"}]': finished 2024-02-13T00:46:30.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:30 smithi080 bash[24237]: cluster 2024-02-13T00:46:30.417209+0000 mon.a (mon.0) 2669 : cluster [DBG] osdmap e504: 8 total, 8 up, 8 in 2024-02-13T00:46:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:30 smithi080 bash[17386]: cluster 2024-02-13T00:46:30.408514+0000 mon.a (mon.0) 2667 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:46:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:30 smithi080 bash[17386]: audit 2024-02-13T00:46:30.416926+0000 mon.a (mon.0) 2668 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-97-cache", "mode": "writeback"}]': finished 2024-02-13T00:46:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:30 smithi080 bash[17386]: cluster 2024-02-13T00:46:30.417209+0000 mon.a (mon.0) 2669 : cluster [DBG] osdmap e504: 8 total, 8 up, 8 in 2024-02-13T00:46:31.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:31 smithi106 bash[18459]: cluster 2024-02-13T00:46:30.402222+0000 mgr.y (mgr.24461) 651 : cluster [DBG] pgmap v931: 236 pgs: 236 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:46:31.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:31 smithi106 bash[18459]: audit 2024-02-13T00:46:30.445455+0000 mon.a (mon.0) 2670 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-97"}]: dispatch 2024-02-13T00:46:31.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:31 smithi080 bash[17386]: cluster 2024-02-13T00:46:30.402222+0000 mgr.y (mgr.24461) 651 : cluster [DBG] pgmap v931: 236 pgs: 236 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:46:31.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:31 smithi080 bash[17386]: audit 2024-02-13T00:46:30.445455+0000 mon.a (mon.0) 2670 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-97"}]: dispatch 2024-02-13T00:46:31.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:31 smithi080 bash[24237]: cluster 2024-02-13T00:46:30.402222+0000 mgr.y (mgr.24461) 651 : cluster [DBG] pgmap v931: 236 pgs: 236 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:46:31.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:31 smithi080 bash[24237]: audit 2024-02-13T00:46:30.445455+0000 mon.a (mon.0) 2670 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-97"}]: dispatch 2024-02-13T00:46:32.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:32 smithi106 bash[18459]: audit 2024-02-13T00:46:31.447555+0000 mon.a (mon.0) 2671 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-97"}]': finished 2024-02-13T00:46:32.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:32 smithi106 bash[18459]: cluster 2024-02-13T00:46:31.447618+0000 mon.a (mon.0) 2672 : cluster [DBG] osdmap e505: 8 total, 8 up, 8 in 2024-02-13T00:46:32.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:32 smithi106 bash[18459]: audit 2024-02-13T00:46:31.448463+0000 mon.a (mon.0) 2673 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-97", "tierpool": "test-rados-api-smithi080-54255-97-cache"}]: dispatch 2024-02-13T00:46:32.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:32 smithi106 bash[18459]: audit 2024-02-13T00:46:31.925503+0000 mon.a (mon.0) 2674 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:46:32.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:32 smithi080 bash[17386]: audit 2024-02-13T00:46:31.447555+0000 mon.a (mon.0) 2671 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-97"}]': finished 2024-02-13T00:46:32.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:32 smithi080 bash[17386]: cluster 2024-02-13T00:46:31.447618+0000 mon.a (mon.0) 2672 : cluster [DBG] osdmap e505: 8 total, 8 up, 8 in 2024-02-13T00:46:32.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:32 smithi080 bash[17386]: audit 2024-02-13T00:46:31.448463+0000 mon.a (mon.0) 2673 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-97", "tierpool": "test-rados-api-smithi080-54255-97-cache"}]: dispatch 2024-02-13T00:46:32.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:32 smithi080 bash[17386]: audit 2024-02-13T00:46:31.925503+0000 mon.a (mon.0) 2674 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:46:32.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:32 smithi080 bash[24237]: audit 2024-02-13T00:46:31.447555+0000 mon.a (mon.0) 2671 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-97"}]': finished 2024-02-13T00:46:32.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:32 smithi080 bash[24237]: cluster 2024-02-13T00:46:31.447618+0000 mon.a (mon.0) 2672 : cluster [DBG] osdmap e505: 8 total, 8 up, 8 in 2024-02-13T00:46:32.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:32 smithi080 bash[24237]: audit 2024-02-13T00:46:31.448463+0000 mon.a (mon.0) 2673 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-97", "tierpool": "test-rados-api-smithi080-54255-97-cache"}]: dispatch 2024-02-13T00:46:32.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:32 smithi080 bash[24237]: audit 2024-02-13T00:46:31.925503+0000 mon.a (mon.0) 2674 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:46:33.455 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:46:33 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:46:33] "GET /metrics HTTP/1.1" 200 191580 "" "Prometheus/2.33.4" 2024-02-13T00:46:33.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:33 smithi106 bash[18459]: cluster 2024-02-13T00:46:32.403043+0000 mgr.y (mgr.24461) 652 : cluster [DBG] pgmap v934: 236 pgs: 236 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:46:33.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:33 smithi106 bash[18459]: cluster 2024-02-13T00:46:32.446314+0000 mon.a (mon.0) 2675 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:46:33.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:33 smithi106 bash[18459]: audit 2024-02-13T00:46:32.464528+0000 mon.a (mon.0) 2676 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-97", "tierpool": "test-rados-api-smithi080-54255-97-cache"}]': finished 2024-02-13T00:46:33.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:33 smithi106 bash[18459]: cluster 2024-02-13T00:46:32.464637+0000 mon.a (mon.0) 2677 : cluster [DBG] osdmap e506: 8 total, 8 up, 8 in 2024-02-13T00:46:33.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:33 smithi080 bash[17386]: cluster 2024-02-13T00:46:32.403043+0000 mgr.y (mgr.24461) 652 : cluster [DBG] pgmap v934: 236 pgs: 236 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:46:33.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:33 smithi080 bash[17386]: cluster 2024-02-13T00:46:32.446314+0000 mon.a (mon.0) 2675 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:46:33.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:33 smithi080 bash[17386]: audit 2024-02-13T00:46:32.464528+0000 mon.a (mon.0) 2676 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-97", "tierpool": "test-rados-api-smithi080-54255-97-cache"}]': finished 2024-02-13T00:46:33.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:33 smithi080 bash[17386]: cluster 2024-02-13T00:46:32.464637+0000 mon.a (mon.0) 2677 : cluster [DBG] osdmap e506: 8 total, 8 up, 8 in 2024-02-13T00:46:33.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:33 smithi080 bash[24237]: cluster 2024-02-13T00:46:32.403043+0000 mgr.y (mgr.24461) 652 : cluster [DBG] pgmap v934: 236 pgs: 236 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:46:33.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:33 smithi080 bash[24237]: cluster 2024-02-13T00:46:32.446314+0000 mon.a (mon.0) 2675 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:46:33.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:33 smithi080 bash[24237]: audit 2024-02-13T00:46:32.464528+0000 mon.a (mon.0) 2676 : audit [INF] from='client.? 172.21.15.80:0/1945177652' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-97", "tierpool": "test-rados-api-smithi080-54255-97-cache"}]': finished 2024-02-13T00:46:33.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:33 smithi080 bash[24237]: cluster 2024-02-13T00:46:32.464637+0000 mon.a (mon.0) 2677 : cluster [DBG] osdmap e506: 8 total, 8 up, 8 in 2024-02-13T00:46:34.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:34 smithi106 bash[18459]: cluster 2024-02-13T00:46:33.464329+0000 mon.a (mon.0) 2678 : cluster [DBG] osdmap e507: 8 total, 8 up, 8 in 2024-02-13T00:46:34.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:34 smithi080 bash[17386]: cluster 2024-02-13T00:46:33.464329+0000 mon.a (mon.0) 2678 : cluster [DBG] osdmap e507: 8 total, 8 up, 8 in 2024-02-13T00:46:34.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:34 smithi080 bash[24237]: cluster 2024-02-13T00:46:33.464329+0000 mon.a (mon.0) 2678 : cluster [DBG] osdmap e507: 8 total, 8 up, 8 in 2024-02-13T00:46:35.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:35 smithi106 bash[18459]: cluster 2024-02-13T00:46:34.403847+0000 mgr.y (mgr.24461) 653 : cluster [DBG] pgmap v937: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:46:35.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:35 smithi106 bash[18459]: cluster 2024-02-13T00:46:34.470529+0000 mon.a (mon.0) 2679 : cluster [DBG] osdmap e508: 8 total, 8 up, 8 in 2024-02-13T00:46:35.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:35 smithi106 bash[18459]: audit 2024-02-13T00:46:34.496486+0000 mon.a (mon.0) 2680 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-99"}]: dispatch 2024-02-13T00:46:35.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:35 smithi106 bash[18459]: audit 2024-02-13T00:46:34.498243+0000 mon.a (mon.0) 2681 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-99"}]: dispatch 2024-02-13T00:46:35.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:35 smithi106 bash[18459]: audit 2024-02-13T00:46:34.498813+0000 mon.a (mon.0) 2682 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54255-99", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:46:35.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:35 smithi080 bash[17386]: cluster 2024-02-13T00:46:34.403847+0000 mgr.y (mgr.24461) 653 : cluster [DBG] pgmap v937: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:46:35.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:35 smithi080 bash[17386]: cluster 2024-02-13T00:46:34.470529+0000 mon.a (mon.0) 2679 : cluster [DBG] osdmap e508: 8 total, 8 up, 8 in 2024-02-13T00:46:35.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:35 smithi080 bash[17386]: audit 2024-02-13T00:46:34.496486+0000 mon.a (mon.0) 2680 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-99"}]: dispatch 2024-02-13T00:46:35.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:35 smithi080 bash[17386]: audit 2024-02-13T00:46:34.498243+0000 mon.a (mon.0) 2681 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-99"}]: dispatch 2024-02-13T00:46:35.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:35 smithi080 bash[17386]: audit 2024-02-13T00:46:34.498813+0000 mon.a (mon.0) 2682 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54255-99", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:46:35.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:35 smithi080 bash[24237]: cluster 2024-02-13T00:46:34.403847+0000 mgr.y (mgr.24461) 653 : cluster [DBG] pgmap v937: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:46:35.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:35 smithi080 bash[24237]: cluster 2024-02-13T00:46:34.470529+0000 mon.a (mon.0) 2679 : cluster [DBG] osdmap e508: 8 total, 8 up, 8 in 2024-02-13T00:46:35.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:35 smithi080 bash[24237]: audit 2024-02-13T00:46:34.496486+0000 mon.a (mon.0) 2680 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-99"}]: dispatch 2024-02-13T00:46:35.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:35 smithi080 bash[24237]: audit 2024-02-13T00:46:34.498243+0000 mon.a (mon.0) 2681 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-99"}]: dispatch 2024-02-13T00:46:35.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:35 smithi080 bash[24237]: audit 2024-02-13T00:46:34.498813+0000 mon.a (mon.0) 2682 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54255-99", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:46:36.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:36 smithi106 bash[18459]: audit 2024-02-13T00:46:35.497447+0000 mon.a (mon.0) 2683 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54255-99", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:46:36.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:36 smithi106 bash[18459]: cluster 2024-02-13T00:46:35.497529+0000 mon.a (mon.0) 2684 : cluster [DBG] osdmap e509: 8 total, 8 up, 8 in 2024-02-13T00:46:36.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:36 smithi106 bash[18459]: audit 2024-02-13T00:46:35.498128+0000 mon.a (mon.0) 2685 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54255-99", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54255-99"}]: dispatch 2024-02-13T00:46:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:36 smithi080 bash[17386]: audit 2024-02-13T00:46:35.497447+0000 mon.a (mon.0) 2683 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54255-99", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:46:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:36 smithi080 bash[17386]: cluster 2024-02-13T00:46:35.497529+0000 mon.a (mon.0) 2684 : cluster [DBG] osdmap e509: 8 total, 8 up, 8 in 2024-02-13T00:46:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:36 smithi080 bash[17386]: audit 2024-02-13T00:46:35.498128+0000 mon.a (mon.0) 2685 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54255-99", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54255-99"}]: dispatch 2024-02-13T00:46:36.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:36 smithi080 bash[24237]: audit 2024-02-13T00:46:35.497447+0000 mon.a (mon.0) 2683 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54255-99", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:46:36.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:36 smithi080 bash[24237]: cluster 2024-02-13T00:46:35.497529+0000 mon.a (mon.0) 2684 : cluster [DBG] osdmap e509: 8 total, 8 up, 8 in 2024-02-13T00:46:36.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:36 smithi080 bash[24237]: audit 2024-02-13T00:46:35.498128+0000 mon.a (mon.0) 2685 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54255-99", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54255-99"}]: dispatch 2024-02-13T00:46:38.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:37 smithi106 bash[18459]: cluster 2024-02-13T00:46:36.404531+0000 mgr.y (mgr.24461) 654 : cluster [DBG] pgmap v940: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:38.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:37 smithi106 bash[18459]: cluster 2024-02-13T00:46:36.940547+0000 mon.a (mon.0) 2686 : cluster [DBG] osdmap e510: 8 total, 8 up, 8 in 2024-02-13T00:46:38.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:37 smithi080 bash[17386]: cluster 2024-02-13T00:46:36.404531+0000 mgr.y (mgr.24461) 654 : cluster [DBG] pgmap v940: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:38.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:37 smithi080 bash[17386]: cluster 2024-02-13T00:46:36.940547+0000 mon.a (mon.0) 2686 : cluster [DBG] osdmap e510: 8 total, 8 up, 8 in 2024-02-13T00:46:38.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:37 smithi080 bash[24237]: cluster 2024-02-13T00:46:36.404531+0000 mgr.y (mgr.24461) 654 : cluster [DBG] pgmap v940: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:38.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:37 smithi080 bash[24237]: cluster 2024-02-13T00:46:36.940547+0000 mon.a (mon.0) 2686 : cluster [DBG] osdmap e510: 8 total, 8 up, 8 in 2024-02-13T00:46:38.944 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:46:38 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:46:39.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:38 smithi106 bash[18459]: audit 2024-02-13T00:46:37.507745+0000 mon.a (mon.0) 2687 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54255-99", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54255-99"}]': finished 2024-02-13T00:46:39.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:38 smithi106 bash[18459]: cluster 2024-02-13T00:46:37.507852+0000 mon.a (mon.0) 2688 : cluster [DBG] osdmap e511: 8 total, 8 up, 8 in 2024-02-13T00:46:39.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:38 smithi106 bash[18459]: cluster 2024-02-13T00:46:38.509935+0000 mon.a (mon.0) 2689 : cluster [DBG] osdmap e512: 8 total, 8 up, 8 in 2024-02-13T00:46:39.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:38 smithi106 bash[18459]: audit 2024-02-13T00:46:38.511201+0000 mon.a (mon.0) 2690 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-99-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:46:39.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:38 smithi080 bash[17386]: audit 2024-02-13T00:46:37.507745+0000 mon.a (mon.0) 2687 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54255-99", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54255-99"}]': finished 2024-02-13T00:46:39.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:38 smithi080 bash[17386]: cluster 2024-02-13T00:46:37.507852+0000 mon.a (mon.0) 2688 : cluster [DBG] osdmap e511: 8 total, 8 up, 8 in 2024-02-13T00:46:39.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:38 smithi080 bash[17386]: cluster 2024-02-13T00:46:38.509935+0000 mon.a (mon.0) 2689 : cluster [DBG] osdmap e512: 8 total, 8 up, 8 in 2024-02-13T00:46:39.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:38 smithi080 bash[17386]: audit 2024-02-13T00:46:38.511201+0000 mon.a (mon.0) 2690 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-99-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:46:39.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:38 smithi080 bash[24237]: audit 2024-02-13T00:46:37.507745+0000 mon.a (mon.0) 2687 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54255-99", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54255-99"}]': finished 2024-02-13T00:46:39.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:38 smithi080 bash[24237]: cluster 2024-02-13T00:46:37.507852+0000 mon.a (mon.0) 2688 : cluster [DBG] osdmap e511: 8 total, 8 up, 8 in 2024-02-13T00:46:39.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:38 smithi080 bash[24237]: cluster 2024-02-13T00:46:38.509935+0000 mon.a (mon.0) 2689 : cluster [DBG] osdmap e512: 8 total, 8 up, 8 in 2024-02-13T00:46:39.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:38 smithi080 bash[24237]: audit 2024-02-13T00:46:38.511201+0000 mon.a (mon.0) 2690 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-99-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:46:40.256 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:46:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:46:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:46:40.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:39 smithi106 bash[18459]: cluster 2024-02-13T00:46:38.406405+0000 mgr.y (mgr.24461) 655 : cluster [DBG] pgmap v943: 180 pgs: 6 creating+peering, 2 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:40.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:39 smithi106 bash[18459]: audit 2024-02-13T00:46:38.595458+0000 mgr.y (mgr.24461) 656 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:46:40.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:39 smithi106 bash[18459]: audit 2024-02-13T00:46:39.513550+0000 mon.a (mon.0) 2691 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-99-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:46:40.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:39 smithi106 bash[18459]: cluster 2024-02-13T00:46:39.513825+0000 mon.a (mon.0) 2692 : cluster [DBG] osdmap e513: 8 total, 8 up, 8 in 2024-02-13T00:46:40.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:39 smithi106 bash[18459]: audit 2024-02-13T00:46:39.517508+0000 mon.a (mon.0) 2693 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-99", "tierpool": "test-rados-api-smithi080-54255-99-cache"}]: dispatch 2024-02-13T00:46:40.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:39 smithi080 bash[17386]: cluster 2024-02-13T00:46:38.406405+0000 mgr.y (mgr.24461) 655 : cluster [DBG] pgmap v943: 180 pgs: 6 creating+peering, 2 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:40.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:39 smithi080 bash[17386]: audit 2024-02-13T00:46:38.595458+0000 mgr.y (mgr.24461) 656 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:46:40.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:39 smithi080 bash[17386]: audit 2024-02-13T00:46:39.513550+0000 mon.a (mon.0) 2691 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-99-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:46:40.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:39 smithi080 bash[17386]: cluster 2024-02-13T00:46:39.513825+0000 mon.a (mon.0) 2692 : cluster [DBG] osdmap e513: 8 total, 8 up, 8 in 2024-02-13T00:46:40.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:39 smithi080 bash[17386]: audit 2024-02-13T00:46:39.517508+0000 mon.a (mon.0) 2693 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-99", "tierpool": "test-rados-api-smithi080-54255-99-cache"}]: dispatch 2024-02-13T00:46:40.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:39 smithi080 bash[24237]: cluster 2024-02-13T00:46:38.406405+0000 mgr.y (mgr.24461) 655 : cluster [DBG] pgmap v943: 180 pgs: 6 creating+peering, 2 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:40.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:39 smithi080 bash[24237]: audit 2024-02-13T00:46:38.595458+0000 mgr.y (mgr.24461) 656 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:46:40.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:39 smithi080 bash[24237]: audit 2024-02-13T00:46:39.513550+0000 mon.a (mon.0) 2691 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-99-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:46:40.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:39 smithi080 bash[24237]: cluster 2024-02-13T00:46:39.513825+0000 mon.a (mon.0) 2692 : cluster [DBG] osdmap e513: 8 total, 8 up, 8 in 2024-02-13T00:46:40.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:39 smithi080 bash[24237]: audit 2024-02-13T00:46:39.517508+0000 mon.a (mon.0) 2693 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-99", "tierpool": "test-rados-api-smithi080-54255-99-cache"}]: dispatch 2024-02-13T00:46:42.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:41 smithi106 bash[18459]: cluster 2024-02-13T00:46:40.407260+0000 mgr.y (mgr.24461) 657 : cluster [DBG] pgmap v946: 212 pgs: 6 creating+peering, 34 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:42.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:41 smithi106 bash[18459]: audit 2024-02-13T00:46:40.516297+0000 mon.a (mon.0) 2694 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-99", "tierpool": "test-rados-api-smithi080-54255-99-cache"}]': finished 2024-02-13T00:46:42.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:41 smithi106 bash[18459]: cluster 2024-02-13T00:46:40.516387+0000 mon.a (mon.0) 2695 : cluster [DBG] osdmap e514: 8 total, 8 up, 8 in 2024-02-13T00:46:42.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:41 smithi106 bash[18459]: audit 2024-02-13T00:46:40.518085+0000 mon.a (mon.0) 2696 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-99", "overlaypool": "test-rados-api-smithi080-54255-99-cache"}]: dispatch 2024-02-13T00:46:42.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:41 smithi080 bash[24237]: cluster 2024-02-13T00:46:40.407260+0000 mgr.y (mgr.24461) 657 : cluster [DBG] pgmap v946: 212 pgs: 6 creating+peering, 34 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:42.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:41 smithi080 bash[24237]: audit 2024-02-13T00:46:40.516297+0000 mon.a (mon.0) 2694 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-99", "tierpool": "test-rados-api-smithi080-54255-99-cache"}]': finished 2024-02-13T00:46:42.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:41 smithi080 bash[24237]: cluster 2024-02-13T00:46:40.516387+0000 mon.a (mon.0) 2695 : cluster [DBG] osdmap e514: 8 total, 8 up, 8 in 2024-02-13T00:46:42.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:41 smithi080 bash[24237]: audit 2024-02-13T00:46:40.518085+0000 mon.a (mon.0) 2696 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-99", "overlaypool": "test-rados-api-smithi080-54255-99-cache"}]: dispatch 2024-02-13T00:46:42.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:41 smithi080 bash[17386]: cluster 2024-02-13T00:46:40.407260+0000 mgr.y (mgr.24461) 657 : cluster [DBG] pgmap v946: 212 pgs: 6 creating+peering, 34 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:42.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:41 smithi080 bash[17386]: audit 2024-02-13T00:46:40.516297+0000 mon.a (mon.0) 2694 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-99", "tierpool": "test-rados-api-smithi080-54255-99-cache"}]': finished 2024-02-13T00:46:42.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:41 smithi080 bash[17386]: cluster 2024-02-13T00:46:40.516387+0000 mon.a (mon.0) 2695 : cluster [DBG] osdmap e514: 8 total, 8 up, 8 in 2024-02-13T00:46:42.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:41 smithi080 bash[17386]: audit 2024-02-13T00:46:40.518085+0000 mon.a (mon.0) 2696 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-99", "overlaypool": "test-rados-api-smithi080-54255-99-cache"}]: dispatch 2024-02-13T00:46:43.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:42 smithi106 bash[18459]: audit 2024-02-13T00:46:41.519630+0000 mon.a (mon.0) 2697 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-99", "overlaypool": "test-rados-api-smithi080-54255-99-cache"}]': finished 2024-02-13T00:46:43.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:42 smithi106 bash[18459]: cluster 2024-02-13T00:46:41.519877+0000 mon.a (mon.0) 2698 : cluster [DBG] osdmap e515: 8 total, 8 up, 8 in 2024-02-13T00:46:43.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:42 smithi106 bash[18459]: audit 2024-02-13T00:46:41.521468+0000 mon.a (mon.0) 2699 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-99-cache", "mode": "writeback"}]: dispatch 2024-02-13T00:46:43.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:42 smithi106 bash[18459]: cluster 2024-02-13T00:46:42.512895+0000 mon.a (mon.0) 2700 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:46:43.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:42 smithi106 bash[18459]: audit 2024-02-13T00:46:42.521867+0000 mon.a (mon.0) 2701 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-99-cache", "mode": "writeback"}]': finished 2024-02-13T00:46:43.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:42 smithi106 bash[18459]: cluster 2024-02-13T00:46:42.522091+0000 mon.a (mon.0) 2702 : cluster [DBG] osdmap e516: 8 total, 8 up, 8 in 2024-02-13T00:46:43.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:42 smithi080 bash[17386]: audit 2024-02-13T00:46:41.519630+0000 mon.a (mon.0) 2697 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-99", "overlaypool": "test-rados-api-smithi080-54255-99-cache"}]': finished 2024-02-13T00:46:43.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:42 smithi080 bash[17386]: cluster 2024-02-13T00:46:41.519877+0000 mon.a (mon.0) 2698 : cluster [DBG] osdmap e515: 8 total, 8 up, 8 in 2024-02-13T00:46:43.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:42 smithi080 bash[17386]: audit 2024-02-13T00:46:41.521468+0000 mon.a (mon.0) 2699 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-99-cache", "mode": "writeback"}]: dispatch 2024-02-13T00:46:43.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:42 smithi080 bash[17386]: cluster 2024-02-13T00:46:42.512895+0000 mon.a (mon.0) 2700 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:46:43.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:42 smithi080 bash[17386]: audit 2024-02-13T00:46:42.521867+0000 mon.a (mon.0) 2701 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-99-cache", "mode": "writeback"}]': finished 2024-02-13T00:46:43.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:42 smithi080 bash[17386]: cluster 2024-02-13T00:46:42.522091+0000 mon.a (mon.0) 2702 : cluster [DBG] osdmap e516: 8 total, 8 up, 8 in 2024-02-13T00:46:43.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:42 smithi080 bash[24237]: audit 2024-02-13T00:46:41.519630+0000 mon.a (mon.0) 2697 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-99", "overlaypool": "test-rados-api-smithi080-54255-99-cache"}]': finished 2024-02-13T00:46:43.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:42 smithi080 bash[24237]: cluster 2024-02-13T00:46:41.519877+0000 mon.a (mon.0) 2698 : cluster [DBG] osdmap e515: 8 total, 8 up, 8 in 2024-02-13T00:46:43.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:42 smithi080 bash[24237]: audit 2024-02-13T00:46:41.521468+0000 mon.a (mon.0) 2699 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-99-cache", "mode": "writeback"}]: dispatch 2024-02-13T00:46:43.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:42 smithi080 bash[24237]: cluster 2024-02-13T00:46:42.512895+0000 mon.a (mon.0) 2700 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:46:43.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:42 smithi080 bash[24237]: audit 2024-02-13T00:46:42.521867+0000 mon.a (mon.0) 2701 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-99-cache", "mode": "writeback"}]': finished 2024-02-13T00:46:43.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:42 smithi080 bash[24237]: cluster 2024-02-13T00:46:42.522091+0000 mon.a (mon.0) 2702 : cluster [DBG] osdmap e516: 8 total, 8 up, 8 in 2024-02-13T00:46:43.511 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:46:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:46:43] "GET /metrics HTTP/1.1" 200 191580 "" "Prometheus/2.33.4" 2024-02-13T00:46:44.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:43 smithi106 bash[18459]: cluster 2024-02-13T00:46:42.408018+0000 mgr.y (mgr.24461) 658 : cluster [DBG] pgmap v949: 212 pgs: 6 creating+peering, 34 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:46:44.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:43 smithi106 bash[18459]: audit 2024-02-13T00:46:42.523281+0000 mon.a (mon.0) 2703 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:46:44.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:43 smithi080 bash[24237]: cluster 2024-02-13T00:46:42.408018+0000 mgr.y (mgr.24461) 658 : cluster [DBG] pgmap v949: 212 pgs: 6 creating+peering, 34 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:46:44.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:43 smithi080 bash[24237]: audit 2024-02-13T00:46:42.523281+0000 mon.a (mon.0) 2703 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:46:44.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:43 smithi080 bash[17386]: cluster 2024-02-13T00:46:42.408018+0000 mgr.y (mgr.24461) 658 : cluster [DBG] pgmap v949: 212 pgs: 6 creating+peering, 34 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:46:44.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:43 smithi080 bash[17386]: audit 2024-02-13T00:46:42.523281+0000 mon.a (mon.0) 2703 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:46:45.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:44 smithi106 bash[18459]: audit 2024-02-13T00:46:43.524730+0000 mon.a (mon.0) 2704 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:46:45.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:44 smithi106 bash[18459]: cluster 2024-02-13T00:46:43.524839+0000 mon.a (mon.0) 2705 : cluster [DBG] osdmap e517: 8 total, 8 up, 8 in 2024-02-13T00:46:45.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:44 smithi106 bash[18459]: audit 2024-02-13T00:46:43.526279+0000 mon.a (mon.0) 2706 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:46:45.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:44 smithi106 bash[18459]: audit 2024-02-13T00:46:44.525877+0000 mon.a (mon.0) 2707 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:46:45.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:44 smithi106 bash[18459]: cluster 2024-02-13T00:46:44.526030+0000 mon.a (mon.0) 2708 : cluster [DBG] osdmap e518: 8 total, 8 up, 8 in 2024-02-13T00:46:45.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:44 smithi106 bash[18459]: audit 2024-02-13T00:46:44.527214+0000 mon.a (mon.0) 2709 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T00:46:45.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:44 smithi080 bash[17386]: audit 2024-02-13T00:46:43.524730+0000 mon.a (mon.0) 2704 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:46:45.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:44 smithi080 bash[17386]: cluster 2024-02-13T00:46:43.524839+0000 mon.a (mon.0) 2705 : cluster [DBG] osdmap e517: 8 total, 8 up, 8 in 2024-02-13T00:46:45.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:44 smithi080 bash[17386]: audit 2024-02-13T00:46:43.526279+0000 mon.a (mon.0) 2706 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:46:45.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:44 smithi080 bash[17386]: audit 2024-02-13T00:46:44.525877+0000 mon.a (mon.0) 2707 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:46:45.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:44 smithi080 bash[17386]: cluster 2024-02-13T00:46:44.526030+0000 mon.a (mon.0) 2708 : cluster [DBG] osdmap e518: 8 total, 8 up, 8 in 2024-02-13T00:46:45.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:44 smithi080 bash[17386]: audit 2024-02-13T00:46:44.527214+0000 mon.a (mon.0) 2709 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T00:46:45.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:44 smithi080 bash[24237]: audit 2024-02-13T00:46:43.524730+0000 mon.a (mon.0) 2704 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:46:45.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:44 smithi080 bash[24237]: cluster 2024-02-13T00:46:43.524839+0000 mon.a (mon.0) 2705 : cluster [DBG] osdmap e517: 8 total, 8 up, 8 in 2024-02-13T00:46:45.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:44 smithi080 bash[24237]: audit 2024-02-13T00:46:43.526279+0000 mon.a (mon.0) 2706 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:46:45.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:44 smithi080 bash[24237]: audit 2024-02-13T00:46:44.525877+0000 mon.a (mon.0) 2707 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:46:45.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:44 smithi080 bash[24237]: cluster 2024-02-13T00:46:44.526030+0000 mon.a (mon.0) 2708 : cluster [DBG] osdmap e518: 8 total, 8 up, 8 in 2024-02-13T00:46:45.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:44 smithi080 bash[24237]: audit 2024-02-13T00:46:44.527214+0000 mon.a (mon.0) 2709 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T00:46:46.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:45 smithi106 bash[18459]: cluster 2024-02-13T00:46:44.408877+0000 mgr.y (mgr.24461) 659 : cluster [DBG] pgmap v952: 212 pgs: 212 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:46.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:45 smithi106 bash[18459]: cluster 2024-02-13T00:46:45.520755+0000 mon.a (mon.0) 2710 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:46:46.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:45 smithi106 bash[18459]: audit 2024-02-13T00:46:45.530193+0000 mon.a (mon.0) 2711 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T00:46:46.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:45 smithi106 bash[18459]: cluster 2024-02-13T00:46:45.530296+0000 mon.a (mon.0) 2712 : cluster [DBG] osdmap e519: 8 total, 8 up, 8 in 2024-02-13T00:46:46.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:45 smithi106 bash[18459]: audit 2024-02-13T00:46:45.531267+0000 mon.a (mon.0) 2713 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-02-13T00:46:46.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:45 smithi080 bash[24237]: cluster 2024-02-13T00:46:44.408877+0000 mgr.y (mgr.24461) 659 : cluster [DBG] pgmap v952: 212 pgs: 212 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:46.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:45 smithi080 bash[24237]: cluster 2024-02-13T00:46:45.520755+0000 mon.a (mon.0) 2710 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:46:46.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:45 smithi080 bash[24237]: audit 2024-02-13T00:46:45.530193+0000 mon.a (mon.0) 2711 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T00:46:46.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:45 smithi080 bash[24237]: cluster 2024-02-13T00:46:45.530296+0000 mon.a (mon.0) 2712 : cluster [DBG] osdmap e519: 8 total, 8 up, 8 in 2024-02-13T00:46:46.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:45 smithi080 bash[24237]: audit 2024-02-13T00:46:45.531267+0000 mon.a (mon.0) 2713 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-02-13T00:46:46.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:45 smithi080 bash[17386]: cluster 2024-02-13T00:46:44.408877+0000 mgr.y (mgr.24461) 659 : cluster [DBG] pgmap v952: 212 pgs: 212 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:46.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:45 smithi080 bash[17386]: cluster 2024-02-13T00:46:45.520755+0000 mon.a (mon.0) 2710 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:46:46.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:45 smithi080 bash[17386]: audit 2024-02-13T00:46:45.530193+0000 mon.a (mon.0) 2711 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T00:46:46.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:45 smithi080 bash[17386]: cluster 2024-02-13T00:46:45.530296+0000 mon.a (mon.0) 2712 : cluster [DBG] osdmap e519: 8 total, 8 up, 8 in 2024-02-13T00:46:46.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:45 smithi080 bash[17386]: audit 2024-02-13T00:46:45.531267+0000 mon.a (mon.0) 2713 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-02-13T00:46:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:47 smithi106 bash[18459]: cluster 2024-02-13T00:46:46.409611+0000 mgr.y (mgr.24461) 660 : cluster [DBG] pgmap v955: 212 pgs: 212 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:47 smithi106 bash[18459]: audit 2024-02-13T00:46:46.530167+0000 mon.a (mon.0) 2714 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-02-13T00:46:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:47 smithi106 bash[18459]: cluster 2024-02-13T00:46:46.530395+0000 mon.a (mon.0) 2715 : cluster [DBG] osdmap e520: 8 total, 8 up, 8 in 2024-02-13T00:46:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:47 smithi106 bash[18459]: audit 2024-02-13T00:46:46.577846+0000 mon.a (mon.0) 2716 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-99"}]: dispatch 2024-02-13T00:46:48.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:47 smithi106 bash[18459]: audit 2024-02-13T00:46:46.925698+0000 mon.a (mon.0) 2717 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:46:48.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:47 smithi080 bash[17386]: cluster 2024-02-13T00:46:46.409611+0000 mgr.y (mgr.24461) 660 : cluster [DBG] pgmap v955: 212 pgs: 212 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:48.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:47 smithi080 bash[17386]: audit 2024-02-13T00:46:46.530167+0000 mon.a (mon.0) 2714 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-02-13T00:46:48.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:47 smithi080 bash[17386]: cluster 2024-02-13T00:46:46.530395+0000 mon.a (mon.0) 2715 : cluster [DBG] osdmap e520: 8 total, 8 up, 8 in 2024-02-13T00:46:48.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:47 smithi080 bash[17386]: audit 2024-02-13T00:46:46.577846+0000 mon.a (mon.0) 2716 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-99"}]: dispatch 2024-02-13T00:46:48.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:47 smithi080 bash[17386]: audit 2024-02-13T00:46:46.925698+0000 mon.a (mon.0) 2717 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:46:48.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:47 smithi080 bash[24237]: cluster 2024-02-13T00:46:46.409611+0000 mgr.y (mgr.24461) 660 : cluster [DBG] pgmap v955: 212 pgs: 212 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:46:48.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:47 smithi080 bash[24237]: audit 2024-02-13T00:46:46.530167+0000 mon.a (mon.0) 2714 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-99-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-02-13T00:46:48.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:47 smithi080 bash[24237]: cluster 2024-02-13T00:46:46.530395+0000 mon.a (mon.0) 2715 : cluster [DBG] osdmap e520: 8 total, 8 up, 8 in 2024-02-13T00:46:48.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:47 smithi080 bash[24237]: audit 2024-02-13T00:46:46.577846+0000 mon.a (mon.0) 2716 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-99"}]: dispatch 2024-02-13T00:46:48.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:47 smithi080 bash[24237]: audit 2024-02-13T00:46:46.925698+0000 mon.a (mon.0) 2717 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:46:49.005 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:46:48 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:46:49.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:48 smithi106 bash[18459]: audit 2024-02-13T00:46:47.551744+0000 mon.a (mon.0) 2718 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-99"}]': finished 2024-02-13T00:46:49.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:48 smithi106 bash[18459]: cluster 2024-02-13T00:46:47.551842+0000 mon.a (mon.0) 2719 : cluster [DBG] osdmap e521: 8 total, 8 up, 8 in 2024-02-13T00:46:49.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:48 smithi106 bash[18459]: audit 2024-02-13T00:46:47.552906+0000 mon.a (mon.0) 2720 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-99", "tierpool": "test-rados-api-smithi080-54255-99-cache"}]: dispatch 2024-02-13T00:46:49.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:48 smithi080 bash[17386]: audit 2024-02-13T00:46:47.551744+0000 mon.a (mon.0) 2718 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-99"}]': finished 2024-02-13T00:46:49.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:48 smithi080 bash[17386]: cluster 2024-02-13T00:46:47.551842+0000 mon.a (mon.0) 2719 : cluster [DBG] osdmap e521: 8 total, 8 up, 8 in 2024-02-13T00:46:49.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:48 smithi080 bash[17386]: audit 2024-02-13T00:46:47.552906+0000 mon.a (mon.0) 2720 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-99", "tierpool": "test-rados-api-smithi080-54255-99-cache"}]: dispatch 2024-02-13T00:46:49.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:48 smithi080 bash[24237]: audit 2024-02-13T00:46:47.551744+0000 mon.a (mon.0) 2718 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-99"}]': finished 2024-02-13T00:46:49.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:48 smithi080 bash[24237]: cluster 2024-02-13T00:46:47.551842+0000 mon.a (mon.0) 2719 : cluster [DBG] osdmap e521: 8 total, 8 up, 8 in 2024-02-13T00:46:49.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:48 smithi080 bash[24237]: audit 2024-02-13T00:46:47.552906+0000 mon.a (mon.0) 2720 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-99", "tierpool": "test-rados-api-smithi080-54255-99-cache"}]: dispatch 2024-02-13T00:46:50.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:49 smithi106 bash[18459]: cluster 2024-02-13T00:46:48.411672+0000 mgr.y (mgr.24461) 661 : cluster [DBG] pgmap v958: 212 pgs: 212 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T00:46:50.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:49 smithi106 bash[18459]: audit 2024-02-13T00:46:48.553701+0000 mon.a (mon.0) 2721 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-99", "tierpool": "test-rados-api-smithi080-54255-99-cache"}]': finished 2024-02-13T00:46:50.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:49 smithi106 bash[18459]: cluster 2024-02-13T00:46:48.553828+0000 mon.a (mon.0) 2722 : cluster [DBG] osdmap e522: 8 total, 8 up, 8 in 2024-02-13T00:46:50.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:49 smithi106 bash[18459]: audit 2024-02-13T00:46:48.598666+0000 mgr.y (mgr.24461) 662 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:46:50.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:49 smithi106 bash[18459]: cluster 2024-02-13T00:46:48.941679+0000 mon.a (mon.0) 2723 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:46:50.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:49 smithi080 bash[24237]: cluster 2024-02-13T00:46:48.411672+0000 mgr.y (mgr.24461) 661 : cluster [DBG] pgmap v958: 212 pgs: 212 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T00:46:50.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:49 smithi080 bash[24237]: audit 2024-02-13T00:46:48.553701+0000 mon.a (mon.0) 2721 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-99", "tierpool": "test-rados-api-smithi080-54255-99-cache"}]': finished 2024-02-13T00:46:50.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:49 smithi080 bash[24237]: cluster 2024-02-13T00:46:48.553828+0000 mon.a (mon.0) 2722 : cluster [DBG] osdmap e522: 8 total, 8 up, 8 in 2024-02-13T00:46:50.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:49 smithi080 bash[24237]: audit 2024-02-13T00:46:48.598666+0000 mgr.y (mgr.24461) 662 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:46:50.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:49 smithi080 bash[24237]: cluster 2024-02-13T00:46:48.941679+0000 mon.a (mon.0) 2723 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:46:50.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:49 smithi080 bash[17386]: cluster 2024-02-13T00:46:48.411672+0000 mgr.y (mgr.24461) 661 : cluster [DBG] pgmap v958: 212 pgs: 212 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T00:46:50.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:49 smithi080 bash[17386]: audit 2024-02-13T00:46:48.553701+0000 mon.a (mon.0) 2721 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-99", "tierpool": "test-rados-api-smithi080-54255-99-cache"}]': finished 2024-02-13T00:46:50.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:49 smithi080 bash[17386]: cluster 2024-02-13T00:46:48.553828+0000 mon.a (mon.0) 2722 : cluster [DBG] osdmap e522: 8 total, 8 up, 8 in 2024-02-13T00:46:50.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:49 smithi080 bash[17386]: audit 2024-02-13T00:46:48.598666+0000 mgr.y (mgr.24461) 662 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:46:50.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:49 smithi080 bash[17386]: cluster 2024-02-13T00:46:48.941679+0000 mon.a (mon.0) 2723 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:46:50.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:46:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:46:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:46:51.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:50 smithi106 bash[18459]: cluster 2024-02-13T00:46:49.572168+0000 mon.a (mon.0) 2724 : cluster [DBG] osdmap e523: 8 total, 8 up, 8 in 2024-02-13T00:46:51.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:50 smithi080 bash[17386]: cluster 2024-02-13T00:46:49.572168+0000 mon.a (mon.0) 2724 : cluster [DBG] osdmap e523: 8 total, 8 up, 8 in 2024-02-13T00:46:51.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:50 smithi080 bash[24237]: cluster 2024-02-13T00:46:49.572168+0000 mon.a (mon.0) 2724 : cluster [DBG] osdmap e523: 8 total, 8 up, 8 in 2024-02-13T00:46:52.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:51 smithi106 bash[18459]: cluster 2024-02-13T00:46:50.412524+0000 mgr.y (mgr.24461) 663 : cluster [DBG] pgmap v961: 180 pgs: 180 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:46:52.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:51 smithi106 bash[18459]: cluster 2024-02-13T00:46:50.585236+0000 mon.a (mon.0) 2725 : cluster [DBG] osdmap e524: 8 total, 8 up, 8 in 2024-02-13T00:46:52.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:51 smithi106 bash[18459]: audit 2024-02-13T00:46:50.587285+0000 mon.a (mon.0) 2726 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-99"}]: dispatch 2024-02-13T00:46:52.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:51 smithi080 bash[17386]: cluster 2024-02-13T00:46:50.412524+0000 mgr.y (mgr.24461) 663 : cluster [DBG] pgmap v961: 180 pgs: 180 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:46:52.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:51 smithi080 bash[17386]: cluster 2024-02-13T00:46:50.585236+0000 mon.a (mon.0) 2725 : cluster [DBG] osdmap e524: 8 total, 8 up, 8 in 2024-02-13T00:46:52.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:51 smithi080 bash[17386]: audit 2024-02-13T00:46:50.587285+0000 mon.a (mon.0) 2726 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-99"}]: dispatch 2024-02-13T00:46:52.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:51 smithi080 bash[24237]: cluster 2024-02-13T00:46:50.412524+0000 mgr.y (mgr.24461) 663 : cluster [DBG] pgmap v961: 180 pgs: 180 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:46:52.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:51 smithi080 bash[24237]: cluster 2024-02-13T00:46:50.585236+0000 mon.a (mon.0) 2725 : cluster [DBG] osdmap e524: 8 total, 8 up, 8 in 2024-02-13T00:46:52.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:51 smithi080 bash[24237]: audit 2024-02-13T00:46:50.587285+0000 mon.a (mon.0) 2726 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-99"}]: dispatch 2024-02-13T00:46:53.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:52 smithi106 bash[18459]: audit 2024-02-13T00:46:51.587954+0000 mon.a (mon.0) 2727 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-99"}]': finished 2024-02-13T00:46:53.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:52 smithi106 bash[18459]: cluster 2024-02-13T00:46:51.588250+0000 mon.a (mon.0) 2728 : cluster [DBG] osdmap e525: 8 total, 8 up, 8 in 2024-02-13T00:46:53.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:52 smithi106 bash[18459]: audit 2024-02-13T00:46:51.589535+0000 mon.a (mon.0) 2729 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-99"}]: dispatch 2024-02-13T00:46:53.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:52 smithi080 bash[17386]: audit 2024-02-13T00:46:51.587954+0000 mon.a (mon.0) 2727 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-99"}]': finished 2024-02-13T00:46:53.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:52 smithi080 bash[17386]: cluster 2024-02-13T00:46:51.588250+0000 mon.a (mon.0) 2728 : cluster [DBG] osdmap e525: 8 total, 8 up, 8 in 2024-02-13T00:46:53.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:52 smithi080 bash[17386]: audit 2024-02-13T00:46:51.589535+0000 mon.a (mon.0) 2729 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-99"}]: dispatch 2024-02-13T00:46:53.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:52 smithi080 bash[24237]: audit 2024-02-13T00:46:51.587954+0000 mon.a (mon.0) 2727 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-99"}]': finished 2024-02-13T00:46:53.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:52 smithi080 bash[24237]: cluster 2024-02-13T00:46:51.588250+0000 mon.a (mon.0) 2728 : cluster [DBG] osdmap e525: 8 total, 8 up, 8 in 2024-02-13T00:46:53.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:52 smithi080 bash[24237]: audit 2024-02-13T00:46:51.589535+0000 mon.a (mon.0) 2729 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-99"}]: dispatch 2024-02-13T00:46:53.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:46:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:46:53] "GET /metrics HTTP/1.1" 200 191808 "" "Prometheus/2.33.4" 2024-02-13T00:46:54.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:53 smithi106 bash[18459]: cluster 2024-02-13T00:46:52.413294+0000 mgr.y (mgr.24461) 664 : cluster [DBG] pgmap v964: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:46:54.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:53 smithi106 bash[18459]: audit 2024-02-13T00:46:52.591145+0000 mon.a (mon.0) 2730 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-99"}]': finished 2024-02-13T00:46:54.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:53 smithi106 bash[18459]: cluster 2024-02-13T00:46:52.591253+0000 mon.a (mon.0) 2731 : cluster [DBG] osdmap e526: 8 total, 8 up, 8 in 2024-02-13T00:46:54.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:53 smithi080 bash[17386]: cluster 2024-02-13T00:46:52.413294+0000 mgr.y (mgr.24461) 664 : cluster [DBG] pgmap v964: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:46:54.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:53 smithi080 bash[17386]: audit 2024-02-13T00:46:52.591145+0000 mon.a (mon.0) 2730 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-99"}]': finished 2024-02-13T00:46:54.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:53 smithi080 bash[17386]: cluster 2024-02-13T00:46:52.591253+0000 mon.a (mon.0) 2731 : cluster [DBG] osdmap e526: 8 total, 8 up, 8 in 2024-02-13T00:46:54.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:53 smithi080 bash[24237]: cluster 2024-02-13T00:46:52.413294+0000 mgr.y (mgr.24461) 664 : cluster [DBG] pgmap v964: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:46:54.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:53 smithi080 bash[24237]: audit 2024-02-13T00:46:52.591145+0000 mon.a (mon.0) 2730 : audit [INF] from='client.? 172.21.15.80:0/1623311728' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-99"}]': finished 2024-02-13T00:46:54.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:53 smithi080 bash[24237]: cluster 2024-02-13T00:46:52.591253+0000 mon.a (mon.0) 2731 : cluster [DBG] osdmap e526: 8 total, 8 up, 8 in 2024-02-13T00:46:55.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:54 smithi106 bash[18459]: cluster 2024-02-13T00:46:53.613714+0000 mon.a (mon.0) 2732 : cluster [DBG] osdmap e527: 8 total, 8 up, 8 in 2024-02-13T00:46:55.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:54 smithi106 bash[18459]: audit 2024-02-13T00:46:53.617079+0000 mon.c (mon.2) 384 : audit [INF] from='client.? 172.21.15.80:0/1337989578' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:55.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:54 smithi106 bash[18459]: audit 2024-02-13T00:46:53.618097+0000 mon.a (mon.0) 2733 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:55.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:54 smithi080 bash[17386]: cluster 2024-02-13T00:46:53.613714+0000 mon.a (mon.0) 2732 : cluster [DBG] osdmap e527: 8 total, 8 up, 8 in 2024-02-13T00:46:55.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:54 smithi080 bash[17386]: audit 2024-02-13T00:46:53.617079+0000 mon.c (mon.2) 384 : audit [INF] from='client.? 172.21.15.80:0/1337989578' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:55.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:54 smithi080 bash[17386]: audit 2024-02-13T00:46:53.618097+0000 mon.a (mon.0) 2733 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:55.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:54 smithi080 bash[24237]: cluster 2024-02-13T00:46:53.613714+0000 mon.a (mon.0) 2732 : cluster [DBG] osdmap e527: 8 total, 8 up, 8 in 2024-02-13T00:46:55.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:54 smithi080 bash[24237]: audit 2024-02-13T00:46:53.617079+0000 mon.c (mon.2) 384 : audit [INF] from='client.? 172.21.15.80:0/1337989578' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:55.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:54 smithi080 bash[24237]: audit 2024-02-13T00:46:53.618097+0000 mon.a (mon.0) 2733 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:55 smithi106 bash[18459]: cluster 2024-02-13T00:46:54.414063+0000 mgr.y (mgr.24461) 665 : cluster [DBG] pgmap v967: 164 pgs: 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-13T00:46:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:55 smithi106 bash[18459]: cluster 2024-02-13T00:46:54.610670+0000 mon.a (mon.0) 2734 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:46:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:55 smithi106 bash[18459]: audit 2024-02-13T00:46:54.625460+0000 mon.a (mon.0) 2735 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94"}]': finished 2024-02-13T00:46:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:55 smithi106 bash[18459]: cluster 2024-02-13T00:46:54.625588+0000 mon.a (mon.0) 2736 : cluster [DBG] osdmap e528: 8 total, 8 up, 8 in 2024-02-13T00:46:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:55 smithi106 bash[18459]: audit 2024-02-13T00:46:54.628292+0000 mon.c (mon.2) 385 : audit [INF] from='client.? 172.21.15.80:0/1337989578' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:56.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:55 smithi106 bash[18459]: audit 2024-02-13T00:46:54.629153+0000 mon.a (mon.0) 2737 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:55 smithi080 bash[17386]: cluster 2024-02-13T00:46:54.414063+0000 mgr.y (mgr.24461) 665 : cluster [DBG] pgmap v967: 164 pgs: 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-13T00:46:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:55 smithi080 bash[17386]: cluster 2024-02-13T00:46:54.610670+0000 mon.a (mon.0) 2734 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:46:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:55 smithi080 bash[17386]: audit 2024-02-13T00:46:54.625460+0000 mon.a (mon.0) 2735 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94"}]': finished 2024-02-13T00:46:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:55 smithi080 bash[17386]: cluster 2024-02-13T00:46:54.625588+0000 mon.a (mon.0) 2736 : cluster [DBG] osdmap e528: 8 total, 8 up, 8 in 2024-02-13T00:46:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:55 smithi080 bash[17386]: audit 2024-02-13T00:46:54.628292+0000 mon.c (mon.2) 385 : audit [INF] from='client.? 172.21.15.80:0/1337989578' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:56.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:55 smithi080 bash[17386]: audit 2024-02-13T00:46:54.629153+0000 mon.a (mon.0) 2737 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:56.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:55 smithi080 bash[24237]: cluster 2024-02-13T00:46:54.414063+0000 mgr.y (mgr.24461) 665 : cluster [DBG] pgmap v967: 164 pgs: 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-13T00:46:56.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:55 smithi080 bash[24237]: cluster 2024-02-13T00:46:54.610670+0000 mon.a (mon.0) 2734 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:46:56.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:55 smithi080 bash[24237]: audit 2024-02-13T00:46:54.625460+0000 mon.a (mon.0) 2735 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi080-54255-94"}]': finished 2024-02-13T00:46:56.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:55 smithi080 bash[24237]: cluster 2024-02-13T00:46:54.625588+0000 mon.a (mon.0) 2736 : cluster [DBG] osdmap e528: 8 total, 8 up, 8 in 2024-02-13T00:46:56.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:55 smithi080 bash[24237]: audit 2024-02-13T00:46:54.628292+0000 mon.c (mon.2) 385 : audit [INF] from='client.? 172.21.15.80:0/1337989578' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:56.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:55 smithi080 bash[24237]: audit 2024-02-13T00:46:54.629153+0000 mon.a (mon.0) 2737 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi080-54255-94"}]: dispatch 2024-02-13T00:46:57.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:56 smithi106 bash[18459]: audit 2024-02-13T00:46:55.627672+0000 mon.a (mon.0) 2738 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi080-54255-94"}]': finished 2024-02-13T00:46:57.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:56 smithi106 bash[18459]: cluster 2024-02-13T00:46:55.627770+0000 mon.a (mon.0) 2739 : cluster [DBG] osdmap e529: 8 total, 8 up, 8 in 2024-02-13T00:46:57.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:56 smithi106 bash[18459]: audit 2024-02-13T00:46:55.658159+0000 mon.c (mon.2) 386 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:46:57.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:56 smithi106 bash[18459]: audit 2024-02-13T00:46:55.658721+0000 mon.a (mon.0) 2740 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:46:57.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:56 smithi106 bash[18459]: audit 2024-02-13T00:46:55.659672+0000 mon.c (mon.2) 387 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:46:57.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:56 smithi106 bash[18459]: audit 2024-02-13T00:46:55.660071+0000 mon.a (mon.0) 2741 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:46:57.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:56 smithi106 bash[18459]: audit 2024-02-13T00:46:55.660815+0000 mon.c (mon.2) 388 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54255-101", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:46:57.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:56 smithi106 bash[18459]: audit 2024-02-13T00:46:55.661332+0000 mon.a (mon.0) 2742 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54255-101", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:46:57.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:56 smithi080 bash[17386]: audit 2024-02-13T00:46:55.627672+0000 mon.a (mon.0) 2738 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi080-54255-94"}]': finished 2024-02-13T00:46:57.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:56 smithi080 bash[17386]: cluster 2024-02-13T00:46:55.627770+0000 mon.a (mon.0) 2739 : cluster [DBG] osdmap e529: 8 total, 8 up, 8 in 2024-02-13T00:46:57.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:56 smithi080 bash[17386]: audit 2024-02-13T00:46:55.658159+0000 mon.c (mon.2) 386 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:46:57.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:56 smithi080 bash[17386]: audit 2024-02-13T00:46:55.658721+0000 mon.a (mon.0) 2740 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:46:57.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:56 smithi080 bash[17386]: audit 2024-02-13T00:46:55.659672+0000 mon.c (mon.2) 387 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:46:57.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:56 smithi080 bash[17386]: audit 2024-02-13T00:46:55.660071+0000 mon.a (mon.0) 2741 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:46:57.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:56 smithi080 bash[17386]: audit 2024-02-13T00:46:55.660815+0000 mon.c (mon.2) 388 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54255-101", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:46:57.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:56 smithi080 bash[17386]: audit 2024-02-13T00:46:55.661332+0000 mon.a (mon.0) 2742 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54255-101", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:46:57.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:56 smithi080 bash[24237]: audit 2024-02-13T00:46:55.627672+0000 mon.a (mon.0) 2738 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi080-54255-94"}]': finished 2024-02-13T00:46:57.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:56 smithi080 bash[24237]: cluster 2024-02-13T00:46:55.627770+0000 mon.a (mon.0) 2739 : cluster [DBG] osdmap e529: 8 total, 8 up, 8 in 2024-02-13T00:46:57.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:56 smithi080 bash[24237]: audit 2024-02-13T00:46:55.658159+0000 mon.c (mon.2) 386 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:46:57.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:56 smithi080 bash[24237]: audit 2024-02-13T00:46:55.658721+0000 mon.a (mon.0) 2740 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:46:57.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:56 smithi080 bash[24237]: audit 2024-02-13T00:46:55.659672+0000 mon.c (mon.2) 387 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:46:57.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:56 smithi080 bash[24237]: audit 2024-02-13T00:46:55.660071+0000 mon.a (mon.0) 2741 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:46:57.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:56 smithi080 bash[24237]: audit 2024-02-13T00:46:55.660815+0000 mon.c (mon.2) 388 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54255-101", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:46:57.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:56 smithi080 bash[24237]: audit 2024-02-13T00:46:55.661332+0000 mon.a (mon.0) 2742 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54255-101", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T00:46:58.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:58 smithi106 bash[18459]: cluster 2024-02-13T00:46:56.414836+0000 mgr.y (mgr.24461) 666 : cluster [DBG] pgmap v970: 164 pgs: 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-13T00:46:58.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:58 smithi106 bash[18459]: audit 2024-02-13T00:46:56.642543+0000 mon.a (mon.0) 2743 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54255-101", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:46:58.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:58 smithi106 bash[18459]: cluster 2024-02-13T00:46:56.642656+0000 mon.a (mon.0) 2744 : cluster [DBG] osdmap e530: 8 total, 8 up, 8 in 2024-02-13T00:46:58.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:58 smithi106 bash[18459]: audit 2024-02-13T00:46:56.646638+0000 mon.c (mon.2) 389 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54255-101", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:46:58.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:58 smithi106 bash[18459]: audit 2024-02-13T00:46:56.647102+0000 mon.a (mon.0) 2745 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54255-101", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:46:58.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:58 smithi080 bash[17386]: cluster 2024-02-13T00:46:56.414836+0000 mgr.y (mgr.24461) 666 : cluster [DBG] pgmap v970: 164 pgs: 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-13T00:46:58.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:58 smithi080 bash[17386]: audit 2024-02-13T00:46:56.642543+0000 mon.a (mon.0) 2743 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54255-101", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:46:58.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:58 smithi080 bash[17386]: cluster 2024-02-13T00:46:56.642656+0000 mon.a (mon.0) 2744 : cluster [DBG] osdmap e530: 8 total, 8 up, 8 in 2024-02-13T00:46:58.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:58 smithi080 bash[17386]: audit 2024-02-13T00:46:56.646638+0000 mon.c (mon.2) 389 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54255-101", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:46:58.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:58 smithi080 bash[17386]: audit 2024-02-13T00:46:56.647102+0000 mon.a (mon.0) 2745 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54255-101", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:46:58.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:58 smithi080 bash[24237]: cluster 2024-02-13T00:46:56.414836+0000 mgr.y (mgr.24461) 666 : cluster [DBG] pgmap v970: 164 pgs: 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-13T00:46:58.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:58 smithi080 bash[24237]: audit 2024-02-13T00:46:56.642543+0000 mon.a (mon.0) 2743 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi080-54255-101", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T00:46:58.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:58 smithi080 bash[24237]: cluster 2024-02-13T00:46:56.642656+0000 mon.a (mon.0) 2744 : cluster [DBG] osdmap e530: 8 total, 8 up, 8 in 2024-02-13T00:46:58.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:58 smithi080 bash[24237]: audit 2024-02-13T00:46:56.646638+0000 mon.c (mon.2) 389 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54255-101", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:46:58.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:58 smithi080 bash[24237]: audit 2024-02-13T00:46:56.647102+0000 mon.a (mon.0) 2745 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54255-101", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:46:59.005 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:46:58 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:46:59.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:59 smithi106 bash[18459]: cluster 2024-02-13T00:46:58.079888+0000 mon.a (mon.0) 2746 : cluster [DBG] osdmap e531: 8 total, 8 up, 8 in 2024-02-13T00:46:59.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:59 smithi106 bash[18459]: audit 2024-02-13T00:46:58.648529+0000 mon.a (mon.0) 2747 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54255-101", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:46:59.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:46:59 smithi106 bash[18459]: cluster 2024-02-13T00:46:58.648673+0000 mon.a (mon.0) 2748 : cluster [DBG] osdmap e532: 8 total, 8 up, 8 in 2024-02-13T00:46:59.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:59 smithi080 bash[17386]: cluster 2024-02-13T00:46:58.079888+0000 mon.a (mon.0) 2746 : cluster [DBG] osdmap e531: 8 total, 8 up, 8 in 2024-02-13T00:46:59.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:59 smithi080 bash[17386]: audit 2024-02-13T00:46:58.648529+0000 mon.a (mon.0) 2747 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54255-101", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:46:59.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:46:59 smithi080 bash[17386]: cluster 2024-02-13T00:46:58.648673+0000 mon.a (mon.0) 2748 : cluster [DBG] osdmap e532: 8 total, 8 up, 8 in 2024-02-13T00:46:59.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:59 smithi080 bash[24237]: cluster 2024-02-13T00:46:58.079888+0000 mon.a (mon.0) 2746 : cluster [DBG] osdmap e531: 8 total, 8 up, 8 in 2024-02-13T00:46:59.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:59 smithi080 bash[24237]: audit 2024-02-13T00:46:58.648529+0000 mon.a (mon.0) 2747 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi080-54255-101", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:46:59.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:46:59 smithi080 bash[24237]: cluster 2024-02-13T00:46:58.648673+0000 mon.a (mon.0) 2748 : cluster [DBG] osdmap e532: 8 total, 8 up, 8 in 2024-02-13T00:47:00.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:47:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:47:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:47:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:00 smithi106 bash[18459]: cluster 2024-02-13T00:46:58.416412+0000 mgr.y (mgr.24461) 667 : cluster [DBG] pgmap v973: 164 pgs: 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:47:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:00 smithi106 bash[18459]: audit 2024-02-13T00:46:58.610130+0000 mgr.y (mgr.24461) 668 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:47:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:00 smithi106 bash[18459]: cluster 2024-02-13T00:46:59.652641+0000 mon.a (mon.0) 2749 : cluster [DBG] osdmap e533: 8 total, 8 up, 8 in 2024-02-13T00:47:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:00 smithi106 bash[18459]: audit 2024-02-13T00:46:59.658289+0000 mon.c (mon.2) 390 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:00 smithi106 bash[18459]: audit 2024-02-13T00:46:59.658952+0000 mon.a (mon.0) 2750 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:00.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:00 smithi080 bash[17386]: cluster 2024-02-13T00:46:58.416412+0000 mgr.y (mgr.24461) 667 : cluster [DBG] pgmap v973: 164 pgs: 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:47:00.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:00 smithi080 bash[17386]: audit 2024-02-13T00:46:58.610130+0000 mgr.y (mgr.24461) 668 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:47:00.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:00 smithi080 bash[17386]: cluster 2024-02-13T00:46:59.652641+0000 mon.a (mon.0) 2749 : cluster [DBG] osdmap e533: 8 total, 8 up, 8 in 2024-02-13T00:47:00.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:00 smithi080 bash[17386]: audit 2024-02-13T00:46:59.658289+0000 mon.c (mon.2) 390 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:00.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:00 smithi080 bash[17386]: audit 2024-02-13T00:46:59.658952+0000 mon.a (mon.0) 2750 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:00.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:00 smithi080 bash[24237]: cluster 2024-02-13T00:46:58.416412+0000 mgr.y (mgr.24461) 667 : cluster [DBG] pgmap v973: 164 pgs: 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:47:00.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:00 smithi080 bash[24237]: audit 2024-02-13T00:46:58.610130+0000 mgr.y (mgr.24461) 668 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:47:00.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:00 smithi080 bash[24237]: cluster 2024-02-13T00:46:59.652641+0000 mon.a (mon.0) 2749 : cluster [DBG] osdmap e533: 8 total, 8 up, 8 in 2024-02-13T00:47:00.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:00 smithi080 bash[24237]: audit 2024-02-13T00:46:59.658289+0000 mon.c (mon.2) 390 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:00.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:00 smithi080 bash[24237]: audit 2024-02-13T00:46:59.658952+0000 mon.a (mon.0) 2750 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:02.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:01 smithi106 bash[18459]: cluster 2024-02-13T00:47:00.417164+0000 mgr.y (mgr.24461) 669 : cluster [DBG] pgmap v976: 204 pgs: 40 unknown, 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:47:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:01 smithi106 bash[18459]: audit 2024-02-13T00:47:00.658026+0000 mon.a (mon.0) 2751 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:47:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:01 smithi106 bash[18459]: cluster 2024-02-13T00:47:00.658202+0000 mon.a (mon.0) 2752 : cluster [DBG] osdmap e534: 8 total, 8 up, 8 in 2024-02-13T00:47:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:01 smithi106 bash[18459]: audit 2024-02-13T00:47:00.684227+0000 mon.c (mon.2) 391 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-102", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:01 smithi106 bash[18459]: audit 2024-02-13T00:47:00.684626+0000 mon.a (mon.0) 2753 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-102", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:01 smithi080 bash[17386]: cluster 2024-02-13T00:47:00.417164+0000 mgr.y (mgr.24461) 669 : cluster [DBG] pgmap v976: 204 pgs: 40 unknown, 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:47:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:01 smithi080 bash[17386]: audit 2024-02-13T00:47:00.658026+0000 mon.a (mon.0) 2751 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:47:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:01 smithi080 bash[17386]: cluster 2024-02-13T00:47:00.658202+0000 mon.a (mon.0) 2752 : cluster [DBG] osdmap e534: 8 total, 8 up, 8 in 2024-02-13T00:47:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:01 smithi080 bash[17386]: audit 2024-02-13T00:47:00.684227+0000 mon.c (mon.2) 391 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-102", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:01 smithi080 bash[17386]: audit 2024-02-13T00:47:00.684626+0000 mon.a (mon.0) 2753 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-102", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:01 smithi080 bash[24237]: cluster 2024-02-13T00:47:00.417164+0000 mgr.y (mgr.24461) 669 : cluster [DBG] pgmap v976: 204 pgs: 40 unknown, 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:47:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:01 smithi080 bash[24237]: audit 2024-02-13T00:47:00.658026+0000 mon.a (mon.0) 2751 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:47:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:01 smithi080 bash[24237]: cluster 2024-02-13T00:47:00.658202+0000 mon.a (mon.0) 2752 : cluster [DBG] osdmap e534: 8 total, 8 up, 8 in 2024-02-13T00:47:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:01 smithi080 bash[24237]: audit 2024-02-13T00:47:00.684227+0000 mon.c (mon.2) 391 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-102", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:01 smithi080 bash[24237]: audit 2024-02-13T00:47:00.684626+0000 mon.a (mon.0) 2753 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-102", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:03.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:02 smithi106 bash[18459]: audit 2024-02-13T00:47:01.656863+0000 mon.a (mon.0) 2754 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-102", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:47:03.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:02 smithi106 bash[18459]: cluster 2024-02-13T00:47:01.657087+0000 mon.a (mon.0) 2755 : cluster [DBG] osdmap e535: 8 total, 8 up, 8 in 2024-02-13T00:47:03.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:02 smithi106 bash[18459]: audit 2024-02-13T00:47:01.661316+0000 mon.c (mon.2) 392 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-102"}]: dispatch 2024-02-13T00:47:03.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:02 smithi106 bash[18459]: audit 2024-02-13T00:47:01.669825+0000 mon.a (mon.0) 2756 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-102"}]: dispatch 2024-02-13T00:47:03.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:02 smithi080 bash[17386]: audit 2024-02-13T00:47:01.656863+0000 mon.a (mon.0) 2754 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-102", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:47:03.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:02 smithi080 bash[17386]: cluster 2024-02-13T00:47:01.657087+0000 mon.a (mon.0) 2755 : cluster [DBG] osdmap e535: 8 total, 8 up, 8 in 2024-02-13T00:47:03.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:02 smithi080 bash[17386]: audit 2024-02-13T00:47:01.661316+0000 mon.c (mon.2) 392 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-102"}]: dispatch 2024-02-13T00:47:03.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:02 smithi080 bash[17386]: audit 2024-02-13T00:47:01.669825+0000 mon.a (mon.0) 2756 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-102"}]: dispatch 2024-02-13T00:47:03.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:02 smithi080 bash[24237]: audit 2024-02-13T00:47:01.656863+0000 mon.a (mon.0) 2754 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-102", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:47:03.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:02 smithi080 bash[24237]: cluster 2024-02-13T00:47:01.657087+0000 mon.a (mon.0) 2755 : cluster [DBG] osdmap e535: 8 total, 8 up, 8 in 2024-02-13T00:47:03.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:02 smithi080 bash[24237]: audit 2024-02-13T00:47:01.661316+0000 mon.c (mon.2) 392 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-102"}]: dispatch 2024-02-13T00:47:03.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:02 smithi080 bash[24237]: audit 2024-02-13T00:47:01.669825+0000 mon.a (mon.0) 2756 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-102"}]: dispatch 2024-02-13T00:47:03.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:47:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:47:03] "GET /metrics HTTP/1.1" 200 189633 "" "Prometheus/2.33.4" 2024-02-13T00:47:04.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:03 smithi106 bash[18459]: cluster 2024-02-13T00:47:02.417903+0000 mgr.y (mgr.24461) 670 : cluster [DBG] pgmap v979: 204 pgs: 40 unknown, 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:47:04.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:03 smithi106 bash[18459]: audit 2024-02-13T00:47:02.669382+0000 mon.a (mon.0) 2757 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-102"}]': finished 2024-02-13T00:47:04.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:03 smithi106 bash[18459]: cluster 2024-02-13T00:47:02.669490+0000 mon.a (mon.0) 2758 : cluster [DBG] osdmap e536: 8 total, 8 up, 8 in 2024-02-13T00:47:04.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:03 smithi106 bash[18459]: audit 2024-02-13T00:47:02.718326+0000 mon.c (mon.2) 393 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:04.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:03 smithi106 bash[18459]: audit 2024-02-13T00:47:02.718981+0000 mon.a (mon.0) 2759 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:04.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:03 smithi080 bash[17386]: cluster 2024-02-13T00:47:02.417903+0000 mgr.y (mgr.24461) 670 : cluster [DBG] pgmap v979: 204 pgs: 40 unknown, 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:47:04.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:03 smithi080 bash[17386]: audit 2024-02-13T00:47:02.669382+0000 mon.a (mon.0) 2757 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-102"}]': finished 2024-02-13T00:47:04.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:03 smithi080 bash[17386]: cluster 2024-02-13T00:47:02.669490+0000 mon.a (mon.0) 2758 : cluster [DBG] osdmap e536: 8 total, 8 up, 8 in 2024-02-13T00:47:04.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:03 smithi080 bash[17386]: audit 2024-02-13T00:47:02.718326+0000 mon.c (mon.2) 393 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:04.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:03 smithi080 bash[17386]: audit 2024-02-13T00:47:02.718981+0000 mon.a (mon.0) 2759 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:04.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:03 smithi080 bash[24237]: cluster 2024-02-13T00:47:02.417903+0000 mgr.y (mgr.24461) 670 : cluster [DBG] pgmap v979: 204 pgs: 40 unknown, 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:47:04.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:03 smithi080 bash[24237]: audit 2024-02-13T00:47:02.669382+0000 mon.a (mon.0) 2757 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-102"}]': finished 2024-02-13T00:47:04.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:03 smithi080 bash[24237]: cluster 2024-02-13T00:47:02.669490+0000 mon.a (mon.0) 2758 : cluster [DBG] osdmap e536: 8 total, 8 up, 8 in 2024-02-13T00:47:04.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:03 smithi080 bash[24237]: audit 2024-02-13T00:47:02.718326+0000 mon.c (mon.2) 393 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:04.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:03 smithi080 bash[24237]: audit 2024-02-13T00:47:02.718981+0000 mon.a (mon.0) 2759 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:05.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:04 smithi106 bash[18459]: audit 2024-02-13T00:47:03.687027+0000 mon.a (mon.0) 2760 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:47:05.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:04 smithi106 bash[18459]: cluster 2024-02-13T00:47:03.687148+0000 mon.a (mon.0) 2761 : cluster [DBG] osdmap e537: 8 total, 8 up, 8 in 2024-02-13T00:47:05.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:04 smithi106 bash[18459]: audit 2024-02-13T00:47:03.692442+0000 mon.c (mon.2) 394 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-102"}]: dispatch 2024-02-13T00:47:05.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:04 smithi106 bash[18459]: audit 2024-02-13T00:47:03.692862+0000 mon.a (mon.0) 2762 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-102"}]: dispatch 2024-02-13T00:47:05.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:04 smithi080 bash[17386]: audit 2024-02-13T00:47:03.687027+0000 mon.a (mon.0) 2760 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:47:05.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:04 smithi080 bash[17386]: cluster 2024-02-13T00:47:03.687148+0000 mon.a (mon.0) 2761 : cluster [DBG] osdmap e537: 8 total, 8 up, 8 in 2024-02-13T00:47:05.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:04 smithi080 bash[17386]: audit 2024-02-13T00:47:03.692442+0000 mon.c (mon.2) 394 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-102"}]: dispatch 2024-02-13T00:47:05.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:04 smithi080 bash[17386]: audit 2024-02-13T00:47:03.692862+0000 mon.a (mon.0) 2762 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-102"}]: dispatch 2024-02-13T00:47:05.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:04 smithi080 bash[24237]: audit 2024-02-13T00:47:03.687027+0000 mon.a (mon.0) 2760 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:47:05.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:04 smithi080 bash[24237]: cluster 2024-02-13T00:47:03.687148+0000 mon.a (mon.0) 2761 : cluster [DBG] osdmap e537: 8 total, 8 up, 8 in 2024-02-13T00:47:05.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:04 smithi080 bash[24237]: audit 2024-02-13T00:47:03.692442+0000 mon.c (mon.2) 394 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-102"}]: dispatch 2024-02-13T00:47:05.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:04 smithi080 bash[24237]: audit 2024-02-13T00:47:03.692862+0000 mon.a (mon.0) 2762 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-102"}]: dispatch 2024-02-13T00:47:06.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:05 smithi106 bash[18459]: cluster 2024-02-13T00:47:04.418750+0000 mgr.y (mgr.24461) 671 : cluster [DBG] pgmap v982: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T00:47:06.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:05 smithi106 bash[18459]: cluster 2024-02-13T00:47:04.684360+0000 mon.a (mon.0) 2763 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:47:06.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:05 smithi106 bash[18459]: audit 2024-02-13T00:47:04.693577+0000 mon.a (mon.0) 2764 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-102"}]': finished 2024-02-13T00:47:06.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:05 smithi106 bash[18459]: cluster 2024-02-13T00:47:04.693683+0000 mon.a (mon.0) 2765 : cluster [DBG] osdmap e538: 8 total, 8 up, 8 in 2024-02-13T00:47:06.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:05 smithi080 bash[17386]: cluster 2024-02-13T00:47:04.418750+0000 mgr.y (mgr.24461) 671 : cluster [DBG] pgmap v982: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T00:47:06.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:05 smithi080 bash[17386]: cluster 2024-02-13T00:47:04.684360+0000 mon.a (mon.0) 2763 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:47:06.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:05 smithi080 bash[17386]: audit 2024-02-13T00:47:04.693577+0000 mon.a (mon.0) 2764 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-102"}]': finished 2024-02-13T00:47:06.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:05 smithi080 bash[17386]: cluster 2024-02-13T00:47:04.693683+0000 mon.a (mon.0) 2765 : cluster [DBG] osdmap e538: 8 total, 8 up, 8 in 2024-02-13T00:47:06.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:05 smithi080 bash[24237]: cluster 2024-02-13T00:47:04.418750+0000 mgr.y (mgr.24461) 671 : cluster [DBG] pgmap v982: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T00:47:06.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:05 smithi080 bash[24237]: cluster 2024-02-13T00:47:04.684360+0000 mon.a (mon.0) 2763 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:47:06.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:05 smithi080 bash[24237]: audit 2024-02-13T00:47:04.693577+0000 mon.a (mon.0) 2764 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-102"}]': finished 2024-02-13T00:47:06.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:05 smithi080 bash[24237]: cluster 2024-02-13T00:47:04.693683+0000 mon.a (mon.0) 2765 : cluster [DBG] osdmap e538: 8 total, 8 up, 8 in 2024-02-13T00:47:07.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:06 smithi106 bash[18459]: cluster 2024-02-13T00:47:05.719939+0000 mon.a (mon.0) 2766 : cluster [DBG] osdmap e539: 8 total, 8 up, 8 in 2024-02-13T00:47:07.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:06 smithi080 bash[17386]: cluster 2024-02-13T00:47:05.719939+0000 mon.a (mon.0) 2766 : cluster [DBG] osdmap e539: 8 total, 8 up, 8 in 2024-02-13T00:47:07.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:06 smithi080 bash[24237]: cluster 2024-02-13T00:47:05.719939+0000 mon.a (mon.0) 2766 : cluster [DBG] osdmap e539: 8 total, 8 up, 8 in 2024-02-13T00:47:08.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:07 smithi106 bash[18459]: cluster 2024-02-13T00:47:06.419492+0000 mgr.y (mgr.24461) 672 : cluster [DBG] pgmap v985: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:47:08.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:07 smithi106 bash[18459]: cluster 2024-02-13T00:47:06.727872+0000 mon.a (mon.0) 2767 : cluster [DBG] osdmap e540: 8 total, 8 up, 8 in 2024-02-13T00:47:08.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:07 smithi106 bash[18459]: audit 2024-02-13T00:47:06.735359+0000 mon.c (mon.2) 395 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-104","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:08.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:07 smithi106 bash[18459]: audit 2024-02-13T00:47:06.736250+0000 mon.a (mon.0) 2768 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-104","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:08.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:07 smithi080 bash[24237]: cluster 2024-02-13T00:47:06.419492+0000 mgr.y (mgr.24461) 672 : cluster [DBG] pgmap v985: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:47:08.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:07 smithi080 bash[24237]: cluster 2024-02-13T00:47:06.727872+0000 mon.a (mon.0) 2767 : cluster [DBG] osdmap e540: 8 total, 8 up, 8 in 2024-02-13T00:47:08.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:07 smithi080 bash[24237]: audit 2024-02-13T00:47:06.735359+0000 mon.c (mon.2) 395 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-104","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:08.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:07 smithi080 bash[24237]: audit 2024-02-13T00:47:06.736250+0000 mon.a (mon.0) 2768 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-104","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:08.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:07 smithi080 bash[17386]: cluster 2024-02-13T00:47:06.419492+0000 mgr.y (mgr.24461) 672 : cluster [DBG] pgmap v985: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:47:08.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:07 smithi080 bash[17386]: cluster 2024-02-13T00:47:06.727872+0000 mon.a (mon.0) 2767 : cluster [DBG] osdmap e540: 8 total, 8 up, 8 in 2024-02-13T00:47:08.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:07 smithi080 bash[17386]: audit 2024-02-13T00:47:06.735359+0000 mon.c (mon.2) 395 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-104","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:08.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:07 smithi080 bash[17386]: audit 2024-02-13T00:47:06.736250+0000 mon.a (mon.0) 2768 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-104","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:09.006 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:47:08 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:47:09.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:08 smithi106 bash[18459]: audit 2024-02-13T00:47:07.733694+0000 mon.a (mon.0) 2769 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-104","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:47:09.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:08 smithi106 bash[18459]: cluster 2024-02-13T00:47:07.733961+0000 mon.a (mon.0) 2770 : cluster [DBG] osdmap e541: 8 total, 8 up, 8 in 2024-02-13T00:47:09.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:08 smithi106 bash[18459]: audit 2024-02-13T00:47:07.758071+0000 mon.c (mon.2) 396 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-104", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:09.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:08 smithi106 bash[18459]: audit 2024-02-13T00:47:07.758618+0000 mon.a (mon.0) 2771 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-104", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:09.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:08 smithi106 bash[18459]: audit 2024-02-13T00:47:08.637491+0000 mon.c (mon.2) 397 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:47:09.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:08 smithi080 bash[17386]: audit 2024-02-13T00:47:07.733694+0000 mon.a (mon.0) 2769 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-104","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:47:09.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:08 smithi080 bash[17386]: cluster 2024-02-13T00:47:07.733961+0000 mon.a (mon.0) 2770 : cluster [DBG] osdmap e541: 8 total, 8 up, 8 in 2024-02-13T00:47:09.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:08 smithi080 bash[17386]: audit 2024-02-13T00:47:07.758071+0000 mon.c (mon.2) 396 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-104", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:09.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:08 smithi080 bash[17386]: audit 2024-02-13T00:47:07.758618+0000 mon.a (mon.0) 2771 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-104", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:09.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:08 smithi080 bash[17386]: audit 2024-02-13T00:47:08.637491+0000 mon.c (mon.2) 397 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:47:09.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:08 smithi080 bash[24237]: audit 2024-02-13T00:47:07.733694+0000 mon.a (mon.0) 2769 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-104","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:47:09.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:08 smithi080 bash[24237]: cluster 2024-02-13T00:47:07.733961+0000 mon.a (mon.0) 2770 : cluster [DBG] osdmap e541: 8 total, 8 up, 8 in 2024-02-13T00:47:09.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:08 smithi080 bash[24237]: audit 2024-02-13T00:47:07.758071+0000 mon.c (mon.2) 396 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-104", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:09.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:08 smithi080 bash[24237]: audit 2024-02-13T00:47:07.758618+0000 mon.a (mon.0) 2771 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-104", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:09.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:08 smithi080 bash[24237]: audit 2024-02-13T00:47:08.637491+0000 mon.c (mon.2) 397 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:47:10.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:09 smithi106 bash[18459]: cluster 2024-02-13T00:47:08.421480+0000 mgr.y (mgr.24461) 673 : cluster [DBG] pgmap v988: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T00:47:10.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:09 smithi106 bash[18459]: audit 2024-02-13T00:47:08.621717+0000 mgr.y (mgr.24461) 674 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:47:10.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:09 smithi106 bash[18459]: audit 2024-02-13T00:47:08.757876+0000 mon.a (mon.0) 2772 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-104", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:47:10.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:09 smithi106 bash[18459]: cluster 2024-02-13T00:47:08.758907+0000 mon.a (mon.0) 2773 : cluster [DBG] osdmap e542: 8 total, 8 up, 8 in 2024-02-13T00:47:10.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:09 smithi106 bash[18459]: audit 2024-02-13T00:47:08.760198+0000 mon.c (mon.2) 398 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-104"}]: dispatch 2024-02-13T00:47:10.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:09 smithi106 bash[18459]: audit 2024-02-13T00:47:08.760842+0000 mon.a (mon.0) 2774 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-104"}]: dispatch 2024-02-13T00:47:10.145 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:09 smithi106 bash[18459]: audit 2024-02-13T00:47:08.941075+0000 mon.c (mon.2) 399 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:47:10.145 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:09 smithi106 bash[18459]: audit 2024-02-13T00:47:08.942345+0000 mon.c (mon.2) 400 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:47:10.145 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:09 smithi106 bash[18459]: audit 2024-02-13T00:47:08.951001+0000 mon.a (mon.0) 2775 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:47:10.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:09 smithi080 bash[17386]: cluster 2024-02-13T00:47:08.421480+0000 mgr.y (mgr.24461) 673 : cluster [DBG] pgmap v988: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T00:47:10.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:09 smithi080 bash[17386]: audit 2024-02-13T00:47:08.621717+0000 mgr.y (mgr.24461) 674 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:47:10.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:09 smithi080 bash[17386]: audit 2024-02-13T00:47:08.757876+0000 mon.a (mon.0) 2772 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-104", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:47:10.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:09 smithi080 bash[17386]: cluster 2024-02-13T00:47:08.758907+0000 mon.a (mon.0) 2773 : cluster [DBG] osdmap e542: 8 total, 8 up, 8 in 2024-02-13T00:47:10.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:09 smithi080 bash[17386]: audit 2024-02-13T00:47:08.760198+0000 mon.c (mon.2) 398 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-104"}]: dispatch 2024-02-13T00:47:10.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:09 smithi080 bash[17386]: audit 2024-02-13T00:47:08.760842+0000 mon.a (mon.0) 2774 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-104"}]: dispatch 2024-02-13T00:47:10.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:09 smithi080 bash[17386]: audit 2024-02-13T00:47:08.941075+0000 mon.c (mon.2) 399 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:47:10.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:09 smithi080 bash[17386]: audit 2024-02-13T00:47:08.942345+0000 mon.c (mon.2) 400 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:47:10.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:09 smithi080 bash[17386]: audit 2024-02-13T00:47:08.951001+0000 mon.a (mon.0) 2775 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:47:10.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:09 smithi080 bash[24237]: cluster 2024-02-13T00:47:08.421480+0000 mgr.y (mgr.24461) 673 : cluster [DBG] pgmap v988: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T00:47:10.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:09 smithi080 bash[24237]: audit 2024-02-13T00:47:08.621717+0000 mgr.y (mgr.24461) 674 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:47:10.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:09 smithi080 bash[24237]: audit 2024-02-13T00:47:08.757876+0000 mon.a (mon.0) 2772 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-104", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:47:10.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:09 smithi080 bash[24237]: cluster 2024-02-13T00:47:08.758907+0000 mon.a (mon.0) 2773 : cluster [DBG] osdmap e542: 8 total, 8 up, 8 in 2024-02-13T00:47:10.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:09 smithi080 bash[24237]: audit 2024-02-13T00:47:08.760198+0000 mon.c (mon.2) 398 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-104"}]: dispatch 2024-02-13T00:47:10.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:09 smithi080 bash[24237]: audit 2024-02-13T00:47:08.760842+0000 mon.a (mon.0) 2774 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-104"}]: dispatch 2024-02-13T00:47:10.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:09 smithi080 bash[24237]: audit 2024-02-13T00:47:08.941075+0000 mon.c (mon.2) 399 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:47:10.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:09 smithi080 bash[24237]: audit 2024-02-13T00:47:08.942345+0000 mon.c (mon.2) 400 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:47:10.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:09 smithi080 bash[24237]: audit 2024-02-13T00:47:08.951001+0000 mon.a (mon.0) 2775 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:47:10.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:47:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:47:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:47:11.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:10 smithi106 bash[18459]: audit 2024-02-13T00:47:09.759154+0000 mon.a (mon.0) 2776 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-104"}]': finished 2024-02-13T00:47:11.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:10 smithi106 bash[18459]: cluster 2024-02-13T00:47:09.759266+0000 mon.a (mon.0) 2777 : cluster [DBG] osdmap e543: 8 total, 8 up, 8 in 2024-02-13T00:47:11.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:10 smithi106 bash[18459]: audit 2024-02-13T00:47:09.763071+0000 mon.c (mon.2) 401 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-104", "mode": "writeback"}]: dispatch 2024-02-13T00:47:11.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:10 smithi106 bash[18459]: audit 2024-02-13T00:47:09.770425+0000 mon.a (mon.0) 2778 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-104", "mode": "writeback"}]: dispatch 2024-02-13T00:47:11.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:10 smithi080 bash[24237]: audit 2024-02-13T00:47:09.759154+0000 mon.a (mon.0) 2776 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-104"}]': finished 2024-02-13T00:47:11.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:10 smithi080 bash[24237]: cluster 2024-02-13T00:47:09.759266+0000 mon.a (mon.0) 2777 : cluster [DBG] osdmap e543: 8 total, 8 up, 8 in 2024-02-13T00:47:11.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:10 smithi080 bash[24237]: audit 2024-02-13T00:47:09.763071+0000 mon.c (mon.2) 401 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-104", "mode": "writeback"}]: dispatch 2024-02-13T00:47:11.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:10 smithi080 bash[24237]: audit 2024-02-13T00:47:09.770425+0000 mon.a (mon.0) 2778 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-104", "mode": "writeback"}]: dispatch 2024-02-13T00:47:11.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:10 smithi080 bash[17386]: audit 2024-02-13T00:47:09.759154+0000 mon.a (mon.0) 2776 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-104"}]': finished 2024-02-13T00:47:11.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:10 smithi080 bash[17386]: cluster 2024-02-13T00:47:09.759266+0000 mon.a (mon.0) 2777 : cluster [DBG] osdmap e543: 8 total, 8 up, 8 in 2024-02-13T00:47:11.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:10 smithi080 bash[17386]: audit 2024-02-13T00:47:09.763071+0000 mon.c (mon.2) 401 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-104", "mode": "writeback"}]: dispatch 2024-02-13T00:47:11.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:10 smithi080 bash[17386]: audit 2024-02-13T00:47:09.770425+0000 mon.a (mon.0) 2778 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-104", "mode": "writeback"}]: dispatch 2024-02-13T00:47:12.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:11 smithi106 bash[18459]: cluster 2024-02-13T00:47:10.422448+0000 mgr.y (mgr.24461) 675 : cluster [DBG] pgmap v991: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:47:12.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:11 smithi106 bash[18459]: cluster 2024-02-13T00:47:10.767160+0000 mon.a (mon.0) 2779 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:47:12.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:11 smithi106 bash[18459]: audit 2024-02-13T00:47:10.781356+0000 mon.a (mon.0) 2780 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-104", "mode": "writeback"}]': finished 2024-02-13T00:47:12.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:11 smithi106 bash[18459]: cluster 2024-02-13T00:47:10.781433+0000 mon.a (mon.0) 2781 : cluster [DBG] osdmap e544: 8 total, 8 up, 8 in 2024-02-13T00:47:12.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:11 smithi106 bash[18459]: audit 2024-02-13T00:47:10.859062+0000 mon.c (mon.2) 402 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:12.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:11 smithi106 bash[18459]: audit 2024-02-13T00:47:10.859715+0000 mon.a (mon.0) 2782 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:12.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:11 smithi080 bash[17386]: cluster 2024-02-13T00:47:10.422448+0000 mgr.y (mgr.24461) 675 : cluster [DBG] pgmap v991: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:47:12.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:11 smithi080 bash[17386]: cluster 2024-02-13T00:47:10.767160+0000 mon.a (mon.0) 2779 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:47:12.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:11 smithi080 bash[17386]: audit 2024-02-13T00:47:10.781356+0000 mon.a (mon.0) 2780 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-104", "mode": "writeback"}]': finished 2024-02-13T00:47:12.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:11 smithi080 bash[17386]: cluster 2024-02-13T00:47:10.781433+0000 mon.a (mon.0) 2781 : cluster [DBG] osdmap e544: 8 total, 8 up, 8 in 2024-02-13T00:47:12.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:11 smithi080 bash[17386]: audit 2024-02-13T00:47:10.859062+0000 mon.c (mon.2) 402 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:12.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:11 smithi080 bash[17386]: audit 2024-02-13T00:47:10.859715+0000 mon.a (mon.0) 2782 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:12.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:11 smithi080 bash[24237]: cluster 2024-02-13T00:47:10.422448+0000 mgr.y (mgr.24461) 675 : cluster [DBG] pgmap v991: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:47:12.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:11 smithi080 bash[24237]: cluster 2024-02-13T00:47:10.767160+0000 mon.a (mon.0) 2779 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:47:12.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:11 smithi080 bash[24237]: audit 2024-02-13T00:47:10.781356+0000 mon.a (mon.0) 2780 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-104", "mode": "writeback"}]': finished 2024-02-13T00:47:12.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:11 smithi080 bash[24237]: cluster 2024-02-13T00:47:10.781433+0000 mon.a (mon.0) 2781 : cluster [DBG] osdmap e544: 8 total, 8 up, 8 in 2024-02-13T00:47:12.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:11 smithi080 bash[24237]: audit 2024-02-13T00:47:10.859062+0000 mon.c (mon.2) 402 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:12.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:11 smithi080 bash[24237]: audit 2024-02-13T00:47:10.859715+0000 mon.a (mon.0) 2782 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:13.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:12 smithi080 bash[24237]: audit 2024-02-13T00:47:11.787383+0000 mon.a (mon.0) 2783 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:47:13.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:12 smithi080 bash[24237]: cluster 2024-02-13T00:47:11.787481+0000 mon.a (mon.0) 2784 : cluster [DBG] osdmap e545: 8 total, 8 up, 8 in 2024-02-13T00:47:13.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:12 smithi080 bash[24237]: audit 2024-02-13T00:47:11.791073+0000 mon.c (mon.2) 403 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-104"}]: dispatch 2024-02-13T00:47:13.117 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:12 smithi080 bash[24237]: audit 2024-02-13T00:47:11.791844+0000 mon.a (mon.0) 2785 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-104"}]: dispatch 2024-02-13T00:47:13.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:12 smithi080 bash[17386]: audit 2024-02-13T00:47:11.787383+0000 mon.a (mon.0) 2783 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:47:13.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:12 smithi080 bash[17386]: cluster 2024-02-13T00:47:11.787481+0000 mon.a (mon.0) 2784 : cluster [DBG] osdmap e545: 8 total, 8 up, 8 in 2024-02-13T00:47:13.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:12 smithi080 bash[17386]: audit 2024-02-13T00:47:11.791073+0000 mon.c (mon.2) 403 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-104"}]: dispatch 2024-02-13T00:47:13.118 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:12 smithi080 bash[17386]: audit 2024-02-13T00:47:11.791844+0000 mon.a (mon.0) 2785 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-104"}]: dispatch 2024-02-13T00:47:13.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:12 smithi106 bash[18459]: audit 2024-02-13T00:47:11.787383+0000 mon.a (mon.0) 2783 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:47:13.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:12 smithi106 bash[18459]: cluster 2024-02-13T00:47:11.787481+0000 mon.a (mon.0) 2784 : cluster [DBG] osdmap e545: 8 total, 8 up, 8 in 2024-02-13T00:47:13.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:12 smithi106 bash[18459]: audit 2024-02-13T00:47:11.791073+0000 mon.c (mon.2) 403 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-104"}]: dispatch 2024-02-13T00:47:13.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:12 smithi106 bash[18459]: audit 2024-02-13T00:47:11.791844+0000 mon.a (mon.0) 2785 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-104"}]: dispatch 2024-02-13T00:47:13.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:47:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:47:13] "GET /metrics HTTP/1.1" 200 189633 "" "Prometheus/2.33.4" 2024-02-13T00:47:14.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:13 smithi106 bash[18459]: cluster 2024-02-13T00:47:12.423284+0000 mgr.y (mgr.24461) 676 : cluster [DBG] pgmap v994: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:47:14.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:13 smithi106 bash[18459]: cluster 2024-02-13T00:47:12.782698+0000 mon.a (mon.0) 2786 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:47:14.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:13 smithi106 bash[18459]: audit 2024-02-13T00:47:12.791188+0000 mon.a (mon.0) 2787 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-104"}]': finished 2024-02-13T00:47:14.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:13 smithi106 bash[18459]: cluster 2024-02-13T00:47:12.791378+0000 mon.a (mon.0) 2788 : cluster [DBG] osdmap e546: 8 total, 8 up, 8 in 2024-02-13T00:47:14.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:13 smithi080 bash[17386]: cluster 2024-02-13T00:47:12.423284+0000 mgr.y (mgr.24461) 676 : cluster [DBG] pgmap v994: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:47:14.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:13 smithi080 bash[17386]: cluster 2024-02-13T00:47:12.782698+0000 mon.a (mon.0) 2786 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:47:14.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:13 smithi080 bash[17386]: audit 2024-02-13T00:47:12.791188+0000 mon.a (mon.0) 2787 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-104"}]': finished 2024-02-13T00:47:14.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:13 smithi080 bash[17386]: cluster 2024-02-13T00:47:12.791378+0000 mon.a (mon.0) 2788 : cluster [DBG] osdmap e546: 8 total, 8 up, 8 in 2024-02-13T00:47:14.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:13 smithi080 bash[24237]: cluster 2024-02-13T00:47:12.423284+0000 mgr.y (mgr.24461) 676 : cluster [DBG] pgmap v994: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:47:14.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:13 smithi080 bash[24237]: cluster 2024-02-13T00:47:12.782698+0000 mon.a (mon.0) 2786 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:47:14.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:13 smithi080 bash[24237]: audit 2024-02-13T00:47:12.791188+0000 mon.a (mon.0) 2787 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-104"}]': finished 2024-02-13T00:47:14.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:13 smithi080 bash[24237]: cluster 2024-02-13T00:47:12.791378+0000 mon.a (mon.0) 2788 : cluster [DBG] osdmap e546: 8 total, 8 up, 8 in 2024-02-13T00:47:15.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:14 smithi106 bash[18459]: cluster 2024-02-13T00:47:13.808968+0000 mon.a (mon.0) 2789 : cluster [DBG] osdmap e547: 8 total, 8 up, 8 in 2024-02-13T00:47:15.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:14 smithi080 bash[17386]: cluster 2024-02-13T00:47:13.808968+0000 mon.a (mon.0) 2789 : cluster [DBG] osdmap e547: 8 total, 8 up, 8 in 2024-02-13T00:47:15.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:14 smithi080 bash[24237]: cluster 2024-02-13T00:47:13.808968+0000 mon.a (mon.0) 2789 : cluster [DBG] osdmap e547: 8 total, 8 up, 8 in 2024-02-13T00:47:16.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:15 smithi106 bash[18459]: cluster 2024-02-13T00:47:14.424084+0000 mgr.y (mgr.24461) 677 : cluster [DBG] pgmap v997: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:47:16.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:15 smithi106 bash[18459]: cluster 2024-02-13T00:47:14.823375+0000 mon.a (mon.0) 2790 : cluster [DBG] osdmap e548: 8 total, 8 up, 8 in 2024-02-13T00:47:16.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:15 smithi106 bash[18459]: audit 2024-02-13T00:47:14.827961+0000 mon.c (mon.2) 404 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-106","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:16.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:15 smithi106 bash[18459]: audit 2024-02-13T00:47:14.829095+0000 mon.a (mon.0) 2791 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-106","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:16.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:15 smithi080 bash[17386]: cluster 2024-02-13T00:47:14.424084+0000 mgr.y (mgr.24461) 677 : cluster [DBG] pgmap v997: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:47:16.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:15 smithi080 bash[17386]: cluster 2024-02-13T00:47:14.823375+0000 mon.a (mon.0) 2790 : cluster [DBG] osdmap e548: 8 total, 8 up, 8 in 2024-02-13T00:47:16.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:15 smithi080 bash[17386]: audit 2024-02-13T00:47:14.827961+0000 mon.c (mon.2) 404 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-106","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:16.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:15 smithi080 bash[17386]: audit 2024-02-13T00:47:14.829095+0000 mon.a (mon.0) 2791 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-106","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:16.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:15 smithi080 bash[24237]: cluster 2024-02-13T00:47:14.424084+0000 mgr.y (mgr.24461) 677 : cluster [DBG] pgmap v997: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:47:16.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:15 smithi080 bash[24237]: cluster 2024-02-13T00:47:14.823375+0000 mon.a (mon.0) 2790 : cluster [DBG] osdmap e548: 8 total, 8 up, 8 in 2024-02-13T00:47:16.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:15 smithi080 bash[24237]: audit 2024-02-13T00:47:14.827961+0000 mon.c (mon.2) 404 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-106","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:16.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:15 smithi080 bash[24237]: audit 2024-02-13T00:47:14.829095+0000 mon.a (mon.0) 2791 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-106","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:17.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:16 smithi106 bash[18459]: audit 2024-02-13T00:47:15.835476+0000 mon.a (mon.0) 2792 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-106","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:47:17.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:16 smithi106 bash[18459]: cluster 2024-02-13T00:47:15.835763+0000 mon.a (mon.0) 2793 : cluster [DBG] osdmap e549: 8 total, 8 up, 8 in 2024-02-13T00:47:17.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:16 smithi080 bash[17386]: audit 2024-02-13T00:47:15.835476+0000 mon.a (mon.0) 2792 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-106","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:47:17.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:16 smithi080 bash[17386]: cluster 2024-02-13T00:47:15.835763+0000 mon.a (mon.0) 2793 : cluster [DBG] osdmap e549: 8 total, 8 up, 8 in 2024-02-13T00:47:17.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:16 smithi080 bash[24237]: audit 2024-02-13T00:47:15.835476+0000 mon.a (mon.0) 2792 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-106","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:47:17.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:16 smithi080 bash[24237]: cluster 2024-02-13T00:47:15.835763+0000 mon.a (mon.0) 2793 : cluster [DBG] osdmap e549: 8 total, 8 up, 8 in 2024-02-13T00:47:18.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:17 smithi106 bash[18459]: cluster 2024-02-13T00:47:16.424934+0000 mgr.y (mgr.24461) 678 : cluster [DBG] pgmap v1000: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:47:18.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:17 smithi106 bash[18459]: cluster 2024-02-13T00:47:16.839259+0000 mon.a (mon.0) 2794 : cluster [DBG] osdmap e550: 8 total, 8 up, 8 in 2024-02-13T00:47:18.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:17 smithi106 bash[18459]: audit 2024-02-13T00:47:16.864538+0000 mon.c (mon.2) 405 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-106", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:18.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:17 smithi106 bash[18459]: audit 2024-02-13T00:47:16.865178+0000 mon.a (mon.0) 2795 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-106", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:17 smithi080 bash[17386]: cluster 2024-02-13T00:47:16.424934+0000 mgr.y (mgr.24461) 678 : cluster [DBG] pgmap v1000: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:47:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:17 smithi080 bash[17386]: cluster 2024-02-13T00:47:16.839259+0000 mon.a (mon.0) 2794 : cluster [DBG] osdmap e550: 8 total, 8 up, 8 in 2024-02-13T00:47:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:17 smithi080 bash[17386]: audit 2024-02-13T00:47:16.864538+0000 mon.c (mon.2) 405 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-106", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:17 smithi080 bash[17386]: audit 2024-02-13T00:47:16.865178+0000 mon.a (mon.0) 2795 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-106", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:18.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:17 smithi080 bash[24237]: cluster 2024-02-13T00:47:16.424934+0000 mgr.y (mgr.24461) 678 : cluster [DBG] pgmap v1000: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:47:18.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:17 smithi080 bash[24237]: cluster 2024-02-13T00:47:16.839259+0000 mon.a (mon.0) 2794 : cluster [DBG] osdmap e550: 8 total, 8 up, 8 in 2024-02-13T00:47:18.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:17 smithi080 bash[24237]: audit 2024-02-13T00:47:16.864538+0000 mon.c (mon.2) 405 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-106", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:18.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:17 smithi080 bash[24237]: audit 2024-02-13T00:47:16.865178+0000 mon.a (mon.0) 2795 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-106", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:19.006 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:47:18 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:47:19.015 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:18 smithi106 bash[18459]: audit 2024-02-13T00:47:17.852204+0000 mon.a (mon.0) 2796 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-106", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:47:19.015 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:18 smithi106 bash[18459]: cluster 2024-02-13T00:47:17.852309+0000 mon.a (mon.0) 2797 : cluster [DBG] osdmap e551: 8 total, 8 up, 8 in 2024-02-13T00:47:19.016 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:18 smithi106 bash[18459]: audit 2024-02-13T00:47:17.856575+0000 mon.c (mon.2) 406 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-106"}]: dispatch 2024-02-13T00:47:19.016 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:18 smithi106 bash[18459]: audit 2024-02-13T00:47:17.863794+0000 mon.a (mon.0) 2798 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-106"}]: dispatch 2024-02-13T00:47:19.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:18 smithi080 bash[24237]: audit 2024-02-13T00:47:17.852204+0000 mon.a (mon.0) 2796 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-106", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:47:19.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:18 smithi080 bash[24237]: cluster 2024-02-13T00:47:17.852309+0000 mon.a (mon.0) 2797 : cluster [DBG] osdmap e551: 8 total, 8 up, 8 in 2024-02-13T00:47:19.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:18 smithi080 bash[24237]: audit 2024-02-13T00:47:17.856575+0000 mon.c (mon.2) 406 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-106"}]: dispatch 2024-02-13T00:47:19.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:18 smithi080 bash[24237]: audit 2024-02-13T00:47:17.863794+0000 mon.a (mon.0) 2798 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-106"}]: dispatch 2024-02-13T00:47:19.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:18 smithi080 bash[17386]: audit 2024-02-13T00:47:17.852204+0000 mon.a (mon.0) 2796 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-106", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:47:19.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:18 smithi080 bash[17386]: cluster 2024-02-13T00:47:17.852309+0000 mon.a (mon.0) 2797 : cluster [DBG] osdmap e551: 8 total, 8 up, 8 in 2024-02-13T00:47:19.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:18 smithi080 bash[17386]: audit 2024-02-13T00:47:17.856575+0000 mon.c (mon.2) 406 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-106"}]: dispatch 2024-02-13T00:47:19.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:18 smithi080 bash[17386]: audit 2024-02-13T00:47:17.863794+0000 mon.a (mon.0) 2798 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-106"}]: dispatch 2024-02-13T00:47:20.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:19 smithi106 bash[18459]: cluster 2024-02-13T00:47:18.426409+0000 mgr.y (mgr.24461) 679 : cluster [DBG] pgmap v1003: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T00:47:20.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:19 smithi106 bash[18459]: audit 2024-02-13T00:47:18.633214+0000 mgr.y (mgr.24461) 680 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:47:20.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:19 smithi106 bash[18459]: audit 2024-02-13T00:47:18.872794+0000 mon.a (mon.0) 2799 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-106"}]': finished 2024-02-13T00:47:20.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:19 smithi106 bash[18459]: cluster 2024-02-13T00:47:18.872910+0000 mon.a (mon.0) 2800 : cluster [DBG] osdmap e552: 8 total, 8 up, 8 in 2024-02-13T00:47:20.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:19 smithi106 bash[18459]: audit 2024-02-13T00:47:18.875130+0000 mon.c (mon.2) 407 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-106", "mode": "writeback"}]: dispatch 2024-02-13T00:47:20.144 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:19 smithi106 bash[18459]: audit 2024-02-13T00:47:18.875774+0000 mon.a (mon.0) 2801 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-106", "mode": "writeback"}]: dispatch 2024-02-13T00:47:20.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:19 smithi080 bash[17386]: cluster 2024-02-13T00:47:18.426409+0000 mgr.y (mgr.24461) 679 : cluster [DBG] pgmap v1003: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T00:47:20.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:19 smithi080 bash[17386]: audit 2024-02-13T00:47:18.633214+0000 mgr.y (mgr.24461) 680 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:47:20.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:19 smithi080 bash[17386]: audit 2024-02-13T00:47:18.872794+0000 mon.a (mon.0) 2799 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-106"}]': finished 2024-02-13T00:47:20.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:19 smithi080 bash[17386]: cluster 2024-02-13T00:47:18.872910+0000 mon.a (mon.0) 2800 : cluster [DBG] osdmap e552: 8 total, 8 up, 8 in 2024-02-13T00:47:20.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:19 smithi080 bash[17386]: audit 2024-02-13T00:47:18.875130+0000 mon.c (mon.2) 407 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-106", "mode": "writeback"}]: dispatch 2024-02-13T00:47:20.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:19 smithi080 bash[17386]: audit 2024-02-13T00:47:18.875774+0000 mon.a (mon.0) 2801 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-106", "mode": "writeback"}]: dispatch 2024-02-13T00:47:20.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:19 smithi080 bash[24237]: cluster 2024-02-13T00:47:18.426409+0000 mgr.y (mgr.24461) 679 : cluster [DBG] pgmap v1003: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T00:47:20.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:19 smithi080 bash[24237]: audit 2024-02-13T00:47:18.633214+0000 mgr.y (mgr.24461) 680 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:47:20.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:19 smithi080 bash[24237]: audit 2024-02-13T00:47:18.872794+0000 mon.a (mon.0) 2799 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-106"}]': finished 2024-02-13T00:47:20.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:19 smithi080 bash[24237]: cluster 2024-02-13T00:47:18.872910+0000 mon.a (mon.0) 2800 : cluster [DBG] osdmap e552: 8 total, 8 up, 8 in 2024-02-13T00:47:20.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:19 smithi080 bash[24237]: audit 2024-02-13T00:47:18.875130+0000 mon.c (mon.2) 407 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-106", "mode": "writeback"}]: dispatch 2024-02-13T00:47:20.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:19 smithi080 bash[24237]: audit 2024-02-13T00:47:18.875774+0000 mon.a (mon.0) 2801 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-106", "mode": "writeback"}]: dispatch 2024-02-13T00:47:20.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:47:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:47:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:47:21.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:20 smithi106 bash[18459]: cluster 2024-02-13T00:47:19.869052+0000 mon.a (mon.0) 2802 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:47:21.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:20 smithi106 bash[18459]: audit 2024-02-13T00:47:19.878278+0000 mon.a (mon.0) 2803 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-106", "mode": "writeback"}]': finished 2024-02-13T00:47:21.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:20 smithi106 bash[18459]: cluster 2024-02-13T00:47:19.878403+0000 mon.a (mon.0) 2804 : cluster [DBG] osdmap e553: 8 total, 8 up, 8 in 2024-02-13T00:47:21.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:20 smithi106 bash[18459]: audit 2024-02-13T00:47:19.899964+0000 mon.c (mon.2) 408 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "237.4"}]: dispatch 2024-02-13T00:47:21.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:20 smithi106 bash[18459]: audit 2024-02-13T00:47:19.900249+0000 mgr.y (mgr.24461) 681 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "237.4"}]: dispatch 2024-02-13T00:47:21.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:20 smithi080 bash[17386]: cluster 2024-02-13T00:47:19.869052+0000 mon.a (mon.0) 2802 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:47:21.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:20 smithi080 bash[17386]: audit 2024-02-13T00:47:19.878278+0000 mon.a (mon.0) 2803 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-106", "mode": "writeback"}]': finished 2024-02-13T00:47:21.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:20 smithi080 bash[17386]: cluster 2024-02-13T00:47:19.878403+0000 mon.a (mon.0) 2804 : cluster [DBG] osdmap e553: 8 total, 8 up, 8 in 2024-02-13T00:47:21.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:20 smithi080 bash[17386]: audit 2024-02-13T00:47:19.899964+0000 mon.c (mon.2) 408 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "237.4"}]: dispatch 2024-02-13T00:47:21.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:20 smithi080 bash[17386]: audit 2024-02-13T00:47:19.900249+0000 mgr.y (mgr.24461) 681 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "237.4"}]: dispatch 2024-02-13T00:47:21.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:20 smithi080 bash[24237]: cluster 2024-02-13T00:47:19.869052+0000 mon.a (mon.0) 2802 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:47:21.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:20 smithi080 bash[24237]: audit 2024-02-13T00:47:19.878278+0000 mon.a (mon.0) 2803 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-106", "mode": "writeback"}]': finished 2024-02-13T00:47:21.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:20 smithi080 bash[24237]: cluster 2024-02-13T00:47:19.878403+0000 mon.a (mon.0) 2804 : cluster [DBG] osdmap e553: 8 total, 8 up, 8 in 2024-02-13T00:47:21.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:20 smithi080 bash[24237]: audit 2024-02-13T00:47:19.899964+0000 mon.c (mon.2) 408 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "237.4"}]: dispatch 2024-02-13T00:47:21.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:20 smithi080 bash[24237]: audit 2024-02-13T00:47:19.900249+0000 mgr.y (mgr.24461) 681 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "237.4"}]: dispatch 2024-02-13T00:47:22.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:21 smithi106 bash[18459]: cluster 2024-02-13T00:47:20.427231+0000 mgr.y (mgr.24461) 682 : cluster [DBG] pgmap v1006: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T00:47:22.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:21 smithi106 bash[18459]: cluster 2024-02-13T00:47:20.551436+0000 osd.2 (osd.2) 9 : cluster [DBG] 237.4 scrub starts 2024-02-13T00:47:22.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:21 smithi106 bash[18459]: cluster 2024-02-13T00:47:20.553658+0000 osd.2 (osd.2) 10 : cluster [DBG] 237.4 scrub ok 2024-02-13T00:47:22.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:21 smithi080 bash[17386]: cluster 2024-02-13T00:47:20.427231+0000 mgr.y (mgr.24461) 682 : cluster [DBG] pgmap v1006: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T00:47:22.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:21 smithi080 bash[17386]: cluster 2024-02-13T00:47:20.551436+0000 osd.2 (osd.2) 9 : cluster [DBG] 237.4 scrub starts 2024-02-13T00:47:22.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:21 smithi080 bash[17386]: cluster 2024-02-13T00:47:20.553658+0000 osd.2 (osd.2) 10 : cluster [DBG] 237.4 scrub ok 2024-02-13T00:47:22.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:21 smithi080 bash[24237]: cluster 2024-02-13T00:47:20.427231+0000 mgr.y (mgr.24461) 682 : cluster [DBG] pgmap v1006: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T00:47:22.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:21 smithi080 bash[24237]: cluster 2024-02-13T00:47:20.551436+0000 osd.2 (osd.2) 9 : cluster [DBG] 237.4 scrub starts 2024-02-13T00:47:22.260 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:21 smithi080 bash[24237]: cluster 2024-02-13T00:47:20.553658+0000 osd.2 (osd.2) 10 : cluster [DBG] 237.4 scrub ok 2024-02-13T00:47:23.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:47:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:47:23] "GET /metrics HTTP/1.1" 200 189788 "" "Prometheus/2.33.4" 2024-02-13T00:47:24.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:24 smithi106 bash[18459]: cluster 2024-02-13T00:47:22.427988+0000 mgr.y (mgr.24461) 683 : cluster [DBG] pgmap v1007: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 915 B/s rd, 1.3 KiB/s wr, 2 op/s 2024-02-13T00:47:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:24 smithi080 bash[17386]: cluster 2024-02-13T00:47:22.427988+0000 mgr.y (mgr.24461) 683 : cluster [DBG] pgmap v1007: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 915 B/s rd, 1.3 KiB/s wr, 2 op/s 2024-02-13T00:47:24.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:24 smithi080 bash[24237]: cluster 2024-02-13T00:47:22.427988+0000 mgr.y (mgr.24461) 683 : cluster [DBG] pgmap v1007: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 915 B/s rd, 1.3 KiB/s wr, 2 op/s 2024-02-13T00:47:26.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:26 smithi106 bash[18459]: cluster 2024-02-13T00:47:24.430020+0000 mgr.y (mgr.24461) 684 : cluster [DBG] pgmap v1008: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 467 B/s wr, 1 op/s 2024-02-13T00:47:26.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:26 smithi080 bash[17386]: cluster 2024-02-13T00:47:24.430020+0000 mgr.y (mgr.24461) 684 : cluster [DBG] pgmap v1008: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 467 B/s wr, 1 op/s 2024-02-13T00:47:26.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:26 smithi080 bash[24237]: cluster 2024-02-13T00:47:24.430020+0000 mgr.y (mgr.24461) 684 : cluster [DBG] pgmap v1008: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 467 B/s wr, 1 op/s 2024-02-13T00:47:28.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:28 smithi106 bash[18459]: cluster 2024-02-13T00:47:26.430812+0000 mgr.y (mgr.24461) 685 : cluster [DBG] pgmap v1009: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 895 B/s rd, 1 op/s 2024-02-13T00:47:28.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:28 smithi080 bash[17386]: cluster 2024-02-13T00:47:26.430812+0000 mgr.y (mgr.24461) 685 : cluster [DBG] pgmap v1009: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 895 B/s rd, 1 op/s 2024-02-13T00:47:28.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:28 smithi080 bash[24237]: cluster 2024-02-13T00:47:26.430812+0000 mgr.y (mgr.24461) 685 : cluster [DBG] pgmap v1009: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 895 B/s rd, 1 op/s 2024-02-13T00:47:29.005 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:47:28 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:47:30.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:47:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:47:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:47:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:30 smithi106 bash[18459]: cluster 2024-02-13T00:47:28.432926+0000 mgr.y (mgr.24461) 686 : cluster [DBG] pgmap v1010: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-13T00:47:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:30 smithi106 bash[18459]: audit 2024-02-13T00:47:28.644051+0000 mgr.y (mgr.24461) 687 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:47:30.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:30 smithi080 bash[17386]: cluster 2024-02-13T00:47:28.432926+0000 mgr.y (mgr.24461) 686 : cluster [DBG] pgmap v1010: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-13T00:47:30.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:30 smithi080 bash[17386]: audit 2024-02-13T00:47:28.644051+0000 mgr.y (mgr.24461) 687 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:47:30.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:30 smithi080 bash[24237]: cluster 2024-02-13T00:47:28.432926+0000 mgr.y (mgr.24461) 686 : cluster [DBG] pgmap v1010: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-13T00:47:30.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:30 smithi080 bash[24237]: audit 2024-02-13T00:47:28.644051+0000 mgr.y (mgr.24461) 687 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:47:32.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:32 smithi106 bash[18459]: cluster 2024-02-13T00:47:30.433900+0000 mgr.y (mgr.24461) 688 : cluster [DBG] pgmap v1011: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-13T00:47:32.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:32 smithi106 bash[18459]: audit 2024-02-13T00:47:31.928515+0000 mon.a (mon.0) 2805 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:47:32.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:32 smithi080 bash[17386]: cluster 2024-02-13T00:47:30.433900+0000 mgr.y (mgr.24461) 688 : cluster [DBG] pgmap v1011: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-13T00:47:32.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:32 smithi080 bash[17386]: audit 2024-02-13T00:47:31.928515+0000 mon.a (mon.0) 2805 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:47:32.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:32 smithi080 bash[24237]: cluster 2024-02-13T00:47:30.433900+0000 mgr.y (mgr.24461) 688 : cluster [DBG] pgmap v1011: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-13T00:47:32.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:32 smithi080 bash[24237]: audit 2024-02-13T00:47:31.928515+0000 mon.a (mon.0) 2805 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:47:33.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:47:33 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:47:33] "GET /metrics HTTP/1.1" 200 189827 "" "Prometheus/2.33.4" 2024-02-13T00:47:34.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:34 smithi106 bash[18459]: cluster 2024-02-13T00:47:32.434751+0000 mgr.y (mgr.24461) 689 : cluster [DBG] pgmap v1012: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-02-13T00:47:34.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:34 smithi080 bash[17386]: cluster 2024-02-13T00:47:32.434751+0000 mgr.y (mgr.24461) 689 : cluster [DBG] pgmap v1012: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-02-13T00:47:34.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:34 smithi080 bash[24237]: cluster 2024-02-13T00:47:32.434751+0000 mgr.y (mgr.24461) 689 : cluster [DBG] pgmap v1012: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-02-13T00:47:36.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:36 smithi106 bash[18459]: cluster 2024-02-13T00:47:34.436854+0000 mgr.y (mgr.24461) 690 : cluster [DBG] pgmap v1013: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-13T00:47:36.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:36 smithi106 bash[18459]: cluster 2024-02-13T00:47:35.137802+0000 mon.a (mon.0) 2806 : cluster [DBG] osdmap e554: 8 total, 8 up, 8 in 2024-02-13T00:47:36.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:36 smithi106 bash[18459]: audit 2024-02-13T00:47:35.174256+0000 mon.c (mon.2) 409 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:36.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:36 smithi106 bash[18459]: audit 2024-02-13T00:47:35.174832+0000 mon.a (mon.0) 2807 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:36.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:36 smithi080 bash[17386]: cluster 2024-02-13T00:47:34.436854+0000 mgr.y (mgr.24461) 690 : cluster [DBG] pgmap v1013: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-13T00:47:36.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:36 smithi080 bash[17386]: cluster 2024-02-13T00:47:35.137802+0000 mon.a (mon.0) 2806 : cluster [DBG] osdmap e554: 8 total, 8 up, 8 in 2024-02-13T00:47:36.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:36 smithi080 bash[17386]: audit 2024-02-13T00:47:35.174256+0000 mon.c (mon.2) 409 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:36.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:36 smithi080 bash[17386]: audit 2024-02-13T00:47:35.174832+0000 mon.a (mon.0) 2807 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:36.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:36 smithi080 bash[24237]: cluster 2024-02-13T00:47:34.436854+0000 mgr.y (mgr.24461) 690 : cluster [DBG] pgmap v1013: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-13T00:47:36.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:36 smithi080 bash[24237]: cluster 2024-02-13T00:47:35.137802+0000 mon.a (mon.0) 2806 : cluster [DBG] osdmap e554: 8 total, 8 up, 8 in 2024-02-13T00:47:36.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:36 smithi080 bash[24237]: audit 2024-02-13T00:47:35.174256+0000 mon.c (mon.2) 409 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:36.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:36 smithi080 bash[24237]: audit 2024-02-13T00:47:35.174832+0000 mon.a (mon.0) 2807 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:37 smithi106 bash[18459]: audit 2024-02-13T00:47:36.149160+0000 mon.a (mon.0) 2808 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:47:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:37 smithi106 bash[18459]: cluster 2024-02-13T00:47:36.149268+0000 mon.a (mon.0) 2809 : cluster [DBG] osdmap e555: 8 total, 8 up, 8 in 2024-02-13T00:47:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:37 smithi106 bash[18459]: audit 2024-02-13T00:47:36.153492+0000 mon.c (mon.2) 410 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-106"}]: dispatch 2024-02-13T00:47:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:37 smithi106 bash[18459]: audit 2024-02-13T00:47:36.154309+0000 mon.a (mon.0) 2810 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-106"}]: dispatch 2024-02-13T00:47:37.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:37 smithi080 bash[17386]: audit 2024-02-13T00:47:36.149160+0000 mon.a (mon.0) 2808 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:47:37.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:37 smithi080 bash[17386]: cluster 2024-02-13T00:47:36.149268+0000 mon.a (mon.0) 2809 : cluster [DBG] osdmap e555: 8 total, 8 up, 8 in 2024-02-13T00:47:37.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:37 smithi080 bash[17386]: audit 2024-02-13T00:47:36.153492+0000 mon.c (mon.2) 410 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-106"}]: dispatch 2024-02-13T00:47:37.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:37 smithi080 bash[17386]: audit 2024-02-13T00:47:36.154309+0000 mon.a (mon.0) 2810 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-106"}]: dispatch 2024-02-13T00:47:37.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:37 smithi080 bash[24237]: audit 2024-02-13T00:47:36.149160+0000 mon.a (mon.0) 2808 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:47:37.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:37 smithi080 bash[24237]: cluster 2024-02-13T00:47:36.149268+0000 mon.a (mon.0) 2809 : cluster [DBG] osdmap e555: 8 total, 8 up, 8 in 2024-02-13T00:47:37.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:37 smithi080 bash[24237]: audit 2024-02-13T00:47:36.153492+0000 mon.c (mon.2) 410 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-106"}]: dispatch 2024-02-13T00:47:37.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:37 smithi080 bash[24237]: audit 2024-02-13T00:47:36.154309+0000 mon.a (mon.0) 2810 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-106"}]: dispatch 2024-02-13T00:47:38.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:38 smithi106 bash[18459]: cluster 2024-02-13T00:47:36.437790+0000 mgr.y (mgr.24461) 691 : cluster [DBG] pgmap v1016: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:47:38.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:38 smithi106 bash[18459]: cluster 2024-02-13T00:47:37.145234+0000 mon.a (mon.0) 2811 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:47:38.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:38 smithi106 bash[18459]: audit 2024-02-13T00:47:37.153934+0000 mon.a (mon.0) 2812 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-106"}]': finished 2024-02-13T00:47:38.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:38 smithi106 bash[18459]: cluster 2024-02-13T00:47:37.154078+0000 mon.a (mon.0) 2813 : cluster [DBG] osdmap e556: 8 total, 8 up, 8 in 2024-02-13T00:47:38.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:38 smithi080 bash[17386]: cluster 2024-02-13T00:47:36.437790+0000 mgr.y (mgr.24461) 691 : cluster [DBG] pgmap v1016: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:47:38.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:38 smithi080 bash[17386]: cluster 2024-02-13T00:47:37.145234+0000 mon.a (mon.0) 2811 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:47:38.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:38 smithi080 bash[17386]: audit 2024-02-13T00:47:37.153934+0000 mon.a (mon.0) 2812 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-106"}]': finished 2024-02-13T00:47:38.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:38 smithi080 bash[17386]: cluster 2024-02-13T00:47:37.154078+0000 mon.a (mon.0) 2813 : cluster [DBG] osdmap e556: 8 total, 8 up, 8 in 2024-02-13T00:47:38.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:38 smithi080 bash[24237]: cluster 2024-02-13T00:47:36.437790+0000 mgr.y (mgr.24461) 691 : cluster [DBG] pgmap v1016: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:47:38.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:38 smithi080 bash[24237]: cluster 2024-02-13T00:47:37.145234+0000 mon.a (mon.0) 2811 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:47:38.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:38 smithi080 bash[24237]: audit 2024-02-13T00:47:37.153934+0000 mon.a (mon.0) 2812 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-106"}]': finished 2024-02-13T00:47:38.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:38 smithi080 bash[24237]: cluster 2024-02-13T00:47:37.154078+0000 mon.a (mon.0) 2813 : cluster [DBG] osdmap e556: 8 total, 8 up, 8 in 2024-02-13T00:47:39.006 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:47:38 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:47:39.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:39 smithi106 bash[18459]: cluster 2024-02-13T00:47:38.164889+0000 mon.a (mon.0) 2814 : cluster [DBG] osdmap e557: 8 total, 8 up, 8 in 2024-02-13T00:47:39.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:39 smithi080 bash[17386]: cluster 2024-02-13T00:47:38.164889+0000 mon.a (mon.0) 2814 : cluster [DBG] osdmap e557: 8 total, 8 up, 8 in 2024-02-13T00:47:39.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:39 smithi080 bash[24237]: cluster 2024-02-13T00:47:38.164889+0000 mon.a (mon.0) 2814 : cluster [DBG] osdmap e557: 8 total, 8 up, 8 in 2024-02-13T00:47:40.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:47:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:47:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:47:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:40 smithi106 bash[18459]: cluster 2024-02-13T00:47:38.438570+0000 mgr.y (mgr.24461) 692 : cluster [DBG] pgmap v1019: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-02-13T00:47:40.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:40 smithi106 bash[18459]: audit 2024-02-13T00:47:38.655489+0000 mgr.y (mgr.24461) 693 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:47:40.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:40 smithi106 bash[18459]: cluster 2024-02-13T00:47:39.190140+0000 mon.a (mon.0) 2815 : cluster [DBG] osdmap e558: 8 total, 8 up, 8 in 2024-02-13T00:47:40.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:40 smithi106 bash[18459]: audit 2024-02-13T00:47:39.194478+0000 mon.c (mon.2) 411 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-108","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:40.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:40 smithi106 bash[18459]: audit 2024-02-13T00:47:39.195558+0000 mon.a (mon.0) 2816 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-108","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:40.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:40 smithi080 bash[17386]: cluster 2024-02-13T00:47:38.438570+0000 mgr.y (mgr.24461) 692 : cluster [DBG] pgmap v1019: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-02-13T00:47:40.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:40 smithi080 bash[17386]: audit 2024-02-13T00:47:38.655489+0000 mgr.y (mgr.24461) 693 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:47:40.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:40 smithi080 bash[17386]: cluster 2024-02-13T00:47:39.190140+0000 mon.a (mon.0) 2815 : cluster [DBG] osdmap e558: 8 total, 8 up, 8 in 2024-02-13T00:47:40.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:40 smithi080 bash[17386]: audit 2024-02-13T00:47:39.194478+0000 mon.c (mon.2) 411 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-108","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:40.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:40 smithi080 bash[17386]: audit 2024-02-13T00:47:39.195558+0000 mon.a (mon.0) 2816 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-108","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:40.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:40 smithi080 bash[24237]: cluster 2024-02-13T00:47:38.438570+0000 mgr.y (mgr.24461) 692 : cluster [DBG] pgmap v1019: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-02-13T00:47:40.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:40 smithi080 bash[24237]: audit 2024-02-13T00:47:38.655489+0000 mgr.y (mgr.24461) 693 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:47:40.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:40 smithi080 bash[24237]: cluster 2024-02-13T00:47:39.190140+0000 mon.a (mon.0) 2815 : cluster [DBG] osdmap e558: 8 total, 8 up, 8 in 2024-02-13T00:47:40.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:40 smithi080 bash[24237]: audit 2024-02-13T00:47:39.194478+0000 mon.c (mon.2) 411 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-108","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:40.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:40 smithi080 bash[24237]: audit 2024-02-13T00:47:39.195558+0000 mon.a (mon.0) 2816 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-108","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:41.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:41 smithi106 bash[18459]: audit 2024-02-13T00:47:40.194001+0000 mon.a (mon.0) 2817 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-108","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:47:41.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:41 smithi106 bash[18459]: cluster 2024-02-13T00:47:40.194423+0000 mon.a (mon.0) 2818 : cluster [DBG] osdmap e559: 8 total, 8 up, 8 in 2024-02-13T00:47:41.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:41 smithi080 bash[17386]: audit 2024-02-13T00:47:40.194001+0000 mon.a (mon.0) 2817 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-108","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:47:41.511 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:41 smithi080 bash[17386]: cluster 2024-02-13T00:47:40.194423+0000 mon.a (mon.0) 2818 : cluster [DBG] osdmap e559: 8 total, 8 up, 8 in 2024-02-13T00:47:41.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:41 smithi080 bash[24237]: audit 2024-02-13T00:47:40.194001+0000 mon.a (mon.0) 2817 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-108","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:47:41.511 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:41 smithi080 bash[24237]: cluster 2024-02-13T00:47:40.194423+0000 mon.a (mon.0) 2818 : cluster [DBG] osdmap e559: 8 total, 8 up, 8 in 2024-02-13T00:47:42.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:42 smithi106 bash[18459]: cluster 2024-02-13T00:47:40.439339+0000 mgr.y (mgr.24461) 694 : cluster [DBG] pgmap v1022: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-02-13T00:47:42.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:42 smithi106 bash[18459]: cluster 2024-02-13T00:47:41.215312+0000 mon.a (mon.0) 2819 : cluster [DBG] osdmap e560: 8 total, 8 up, 8 in 2024-02-13T00:47:42.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:42 smithi106 bash[18459]: audit 2024-02-13T00:47:41.220522+0000 mon.c (mon.2) 412 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-108", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:42.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:42 smithi106 bash[18459]: audit 2024-02-13T00:47:41.220996+0000 mon.a (mon.0) 2820 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-108", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:42.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:42 smithi080 bash[24237]: cluster 2024-02-13T00:47:40.439339+0000 mgr.y (mgr.24461) 694 : cluster [DBG] pgmap v1022: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-02-13T00:47:42.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:42 smithi080 bash[24237]: cluster 2024-02-13T00:47:41.215312+0000 mon.a (mon.0) 2819 : cluster [DBG] osdmap e560: 8 total, 8 up, 8 in 2024-02-13T00:47:42.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:42 smithi080 bash[24237]: audit 2024-02-13T00:47:41.220522+0000 mon.c (mon.2) 412 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-108", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:42.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:42 smithi080 bash[24237]: audit 2024-02-13T00:47:41.220996+0000 mon.a (mon.0) 2820 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-108", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:42.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:42 smithi080 bash[17386]: cluster 2024-02-13T00:47:40.439339+0000 mgr.y (mgr.24461) 694 : cluster [DBG] pgmap v1022: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-02-13T00:47:42.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:42 smithi080 bash[17386]: cluster 2024-02-13T00:47:41.215312+0000 mon.a (mon.0) 2819 : cluster [DBG] osdmap e560: 8 total, 8 up, 8 in 2024-02-13T00:47:42.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:42 smithi080 bash[17386]: audit 2024-02-13T00:47:41.220522+0000 mon.c (mon.2) 412 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-108", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:42.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:42 smithi080 bash[17386]: audit 2024-02-13T00:47:41.220996+0000 mon.a (mon.0) 2820 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-108", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:43.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:43 smithi106 bash[18459]: audit 2024-02-13T00:47:42.220399+0000 mon.a (mon.0) 2821 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-108", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:47:43.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:43 smithi106 bash[18459]: cluster 2024-02-13T00:47:42.220954+0000 mon.a (mon.0) 2822 : cluster [DBG] osdmap e561: 8 total, 8 up, 8 in 2024-02-13T00:47:43.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:43 smithi106 bash[18459]: audit 2024-02-13T00:47:42.223530+0000 mon.c (mon.2) 413 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-108"}]: dispatch 2024-02-13T00:47:43.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:43 smithi106 bash[18459]: audit 2024-02-13T00:47:42.224311+0000 mon.a (mon.0) 2823 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-108"}]: dispatch 2024-02-13T00:47:43.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:43 smithi106 bash[18459]: audit 2024-02-13T00:47:43.105332+0000 mon.a (mon.0) 2824 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-108"}]': finished 2024-02-13T00:47:43.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:43 smithi106 bash[18459]: cluster 2024-02-13T00:47:43.105472+0000 mon.a (mon.0) 2825 : cluster [DBG] osdmap e562: 8 total, 8 up, 8 in 2024-02-13T00:47:43.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:43 smithi106 bash[18459]: audit 2024-02-13T00:47:43.106497+0000 mon.c (mon.2) 414 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-108", "mode": "writeback"}]: dispatch 2024-02-13T00:47:43.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:43 smithi106 bash[18459]: audit 2024-02-13T00:47:43.107173+0000 mon.a (mon.0) 2826 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-108", "mode": "writeback"}]: dispatch 2024-02-13T00:47:43.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:47:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:47:43] "GET /metrics HTTP/1.1" 200 189827 "" "Prometheus/2.33.4" 2024-02-13T00:47:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:43 smithi080 bash[17386]: audit 2024-02-13T00:47:42.220399+0000 mon.a (mon.0) 2821 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-108", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:47:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:43 smithi080 bash[17386]: cluster 2024-02-13T00:47:42.220954+0000 mon.a (mon.0) 2822 : cluster [DBG] osdmap e561: 8 total, 8 up, 8 in 2024-02-13T00:47:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:43 smithi080 bash[17386]: audit 2024-02-13T00:47:42.223530+0000 mon.c (mon.2) 413 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-108"}]: dispatch 2024-02-13T00:47:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:43 smithi080 bash[17386]: audit 2024-02-13T00:47:42.224311+0000 mon.a (mon.0) 2823 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-108"}]: dispatch 2024-02-13T00:47:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:43 smithi080 bash[17386]: audit 2024-02-13T00:47:43.105332+0000 mon.a (mon.0) 2824 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-108"}]': finished 2024-02-13T00:47:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:43 smithi080 bash[17386]: cluster 2024-02-13T00:47:43.105472+0000 mon.a (mon.0) 2825 : cluster [DBG] osdmap e562: 8 total, 8 up, 8 in 2024-02-13T00:47:43.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:43 smithi080 bash[17386]: audit 2024-02-13T00:47:43.106497+0000 mon.c (mon.2) 414 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-108", "mode": "writeback"}]: dispatch 2024-02-13T00:47:43.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:43 smithi080 bash[17386]: audit 2024-02-13T00:47:43.107173+0000 mon.a (mon.0) 2826 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-108", "mode": "writeback"}]: dispatch 2024-02-13T00:47:43.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:43 smithi080 bash[24237]: audit 2024-02-13T00:47:42.220399+0000 mon.a (mon.0) 2821 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-108", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:47:43.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:43 smithi080 bash[24237]: cluster 2024-02-13T00:47:42.220954+0000 mon.a (mon.0) 2822 : cluster [DBG] osdmap e561: 8 total, 8 up, 8 in 2024-02-13T00:47:43.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:43 smithi080 bash[24237]: audit 2024-02-13T00:47:42.223530+0000 mon.c (mon.2) 413 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-108"}]: dispatch 2024-02-13T00:47:43.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:43 smithi080 bash[24237]: audit 2024-02-13T00:47:42.224311+0000 mon.a (mon.0) 2823 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-108"}]: dispatch 2024-02-13T00:47:43.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:43 smithi080 bash[24237]: audit 2024-02-13T00:47:43.105332+0000 mon.a (mon.0) 2824 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-108"}]': finished 2024-02-13T00:47:43.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:43 smithi080 bash[24237]: cluster 2024-02-13T00:47:43.105472+0000 mon.a (mon.0) 2825 : cluster [DBG] osdmap e562: 8 total, 8 up, 8 in 2024-02-13T00:47:43.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:43 smithi080 bash[24237]: audit 2024-02-13T00:47:43.106497+0000 mon.c (mon.2) 414 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-108", "mode": "writeback"}]: dispatch 2024-02-13T00:47:43.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:43 smithi080 bash[24237]: audit 2024-02-13T00:47:43.107173+0000 mon.a (mon.0) 2826 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-108", "mode": "writeback"}]: dispatch 2024-02-13T00:47:44.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:44 smithi106 bash[18459]: cluster 2024-02-13T00:47:42.439984+0000 mgr.y (mgr.24461) 695 : cluster [DBG] pgmap v1025: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:47:44.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:44 smithi106 bash[18459]: cluster 2024-02-13T00:47:44.097945+0000 mon.a (mon.0) 2827 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:47:44.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:44 smithi106 bash[18459]: audit 2024-02-13T00:47:44.106578+0000 mon.a (mon.0) 2828 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-108", "mode": "writeback"}]': finished 2024-02-13T00:47:44.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:44 smithi106 bash[18459]: cluster 2024-02-13T00:47:44.106834+0000 mon.a (mon.0) 2829 : cluster [DBG] osdmap e563: 8 total, 8 up, 8 in 2024-02-13T00:47:44.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:44 smithi080 bash[17386]: cluster 2024-02-13T00:47:42.439984+0000 mgr.y (mgr.24461) 695 : cluster [DBG] pgmap v1025: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:47:44.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:44 smithi080 bash[17386]: cluster 2024-02-13T00:47:44.097945+0000 mon.a (mon.0) 2827 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:47:44.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:44 smithi080 bash[17386]: audit 2024-02-13T00:47:44.106578+0000 mon.a (mon.0) 2828 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-108", "mode": "writeback"}]': finished 2024-02-13T00:47:44.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:44 smithi080 bash[17386]: cluster 2024-02-13T00:47:44.106834+0000 mon.a (mon.0) 2829 : cluster [DBG] osdmap e563: 8 total, 8 up, 8 in 2024-02-13T00:47:44.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:44 smithi080 bash[24237]: cluster 2024-02-13T00:47:42.439984+0000 mgr.y (mgr.24461) 695 : cluster [DBG] pgmap v1025: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:47:44.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:44 smithi080 bash[24237]: cluster 2024-02-13T00:47:44.097945+0000 mon.a (mon.0) 2827 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:47:44.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:44 smithi080 bash[24237]: audit 2024-02-13T00:47:44.106578+0000 mon.a (mon.0) 2828 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-108", "mode": "writeback"}]': finished 2024-02-13T00:47:44.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:44 smithi080 bash[24237]: cluster 2024-02-13T00:47:44.106834+0000 mon.a (mon.0) 2829 : cluster [DBG] osdmap e563: 8 total, 8 up, 8 in 2024-02-13T00:47:46.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:46 smithi106 bash[18459]: cluster 2024-02-13T00:47:44.440919+0000 mgr.y (mgr.24461) 696 : cluster [DBG] pgmap v1028: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:47:46.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:46 smithi106 bash[18459]: cluster 2024-02-13T00:47:45.108774+0000 mon.a (mon.0) 2830 : cluster [DBG] osdmap e564: 8 total, 8 up, 8 in 2024-02-13T00:47:46.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:46 smithi106 bash[18459]: audit 2024-02-13T00:47:45.149888+0000 mon.c (mon.2) 415 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:46.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:46 smithi106 bash[18459]: audit 2024-02-13T00:47:45.150489+0000 mon.a (mon.0) 2831 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:46.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:46 smithi080 bash[24237]: cluster 2024-02-13T00:47:44.440919+0000 mgr.y (mgr.24461) 696 : cluster [DBG] pgmap v1028: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:47:46.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:46 smithi080 bash[24237]: cluster 2024-02-13T00:47:45.108774+0000 mon.a (mon.0) 2830 : cluster [DBG] osdmap e564: 8 total, 8 up, 8 in 2024-02-13T00:47:46.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:46 smithi080 bash[24237]: audit 2024-02-13T00:47:45.149888+0000 mon.c (mon.2) 415 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:46.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:46 smithi080 bash[24237]: audit 2024-02-13T00:47:45.150489+0000 mon.a (mon.0) 2831 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:46.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:46 smithi080 bash[17386]: cluster 2024-02-13T00:47:44.440919+0000 mgr.y (mgr.24461) 696 : cluster [DBG] pgmap v1028: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:47:46.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:46 smithi080 bash[17386]: cluster 2024-02-13T00:47:45.108774+0000 mon.a (mon.0) 2830 : cluster [DBG] osdmap e564: 8 total, 8 up, 8 in 2024-02-13T00:47:46.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:46 smithi080 bash[17386]: audit 2024-02-13T00:47:45.149888+0000 mon.c (mon.2) 415 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:46.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:46 smithi080 bash[17386]: audit 2024-02-13T00:47:45.150489+0000 mon.a (mon.0) 2831 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:47.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:47 smithi106 bash[18459]: audit 2024-02-13T00:47:46.113056+0000 mon.a (mon.0) 2832 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:47:47.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:47 smithi106 bash[18459]: cluster 2024-02-13T00:47:46.113230+0000 mon.a (mon.0) 2833 : cluster [DBG] osdmap e565: 8 total, 8 up, 8 in 2024-02-13T00:47:47.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:47 smithi106 bash[18459]: audit 2024-02-13T00:47:46.118099+0000 mon.c (mon.2) 416 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-108"}]: dispatch 2024-02-13T00:47:47.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:47 smithi106 bash[18459]: audit 2024-02-13T00:47:46.123454+0000 mon.a (mon.0) 2834 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-108"}]: dispatch 2024-02-13T00:47:47.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:47 smithi080 bash[17386]: audit 2024-02-13T00:47:46.113056+0000 mon.a (mon.0) 2832 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:47:47.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:47 smithi080 bash[17386]: cluster 2024-02-13T00:47:46.113230+0000 mon.a (mon.0) 2833 : cluster [DBG] osdmap e565: 8 total, 8 up, 8 in 2024-02-13T00:47:47.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:47 smithi080 bash[17386]: audit 2024-02-13T00:47:46.118099+0000 mon.c (mon.2) 416 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-108"}]: dispatch 2024-02-13T00:47:47.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:47 smithi080 bash[17386]: audit 2024-02-13T00:47:46.123454+0000 mon.a (mon.0) 2834 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-108"}]: dispatch 2024-02-13T00:47:47.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:47 smithi080 bash[24237]: audit 2024-02-13T00:47:46.113056+0000 mon.a (mon.0) 2832 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:47:47.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:47 smithi080 bash[24237]: cluster 2024-02-13T00:47:46.113230+0000 mon.a (mon.0) 2833 : cluster [DBG] osdmap e565: 8 total, 8 up, 8 in 2024-02-13T00:47:47.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:47 smithi080 bash[24237]: audit 2024-02-13T00:47:46.118099+0000 mon.c (mon.2) 416 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-108"}]: dispatch 2024-02-13T00:47:47.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:47 smithi080 bash[24237]: audit 2024-02-13T00:47:46.123454+0000 mon.a (mon.0) 2834 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-108"}]: dispatch 2024-02-13T00:47:48.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:48 smithi106 bash[18459]: cluster 2024-02-13T00:47:46.441750+0000 mgr.y (mgr.24461) 697 : cluster [DBG] pgmap v1031: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:47:48.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:48 smithi106 bash[18459]: cluster 2024-02-13T00:47:47.119154+0000 mon.a (mon.0) 2835 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:47:48.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:48 smithi106 bash[18459]: audit 2024-02-13T00:47:47.127426+0000 mon.a (mon.0) 2836 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-108"}]': finished 2024-02-13T00:47:48.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:48 smithi106 bash[18459]: cluster 2024-02-13T00:47:47.127717+0000 mon.a (mon.0) 2837 : cluster [DBG] osdmap e566: 8 total, 8 up, 8 in 2024-02-13T00:47:48.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:48 smithi080 bash[17386]: cluster 2024-02-13T00:47:46.441750+0000 mgr.y (mgr.24461) 697 : cluster [DBG] pgmap v1031: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:47:48.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:48 smithi080 bash[17386]: cluster 2024-02-13T00:47:47.119154+0000 mon.a (mon.0) 2835 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:47:48.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:48 smithi080 bash[17386]: audit 2024-02-13T00:47:47.127426+0000 mon.a (mon.0) 2836 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-108"}]': finished 2024-02-13T00:47:48.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:48 smithi080 bash[17386]: cluster 2024-02-13T00:47:47.127717+0000 mon.a (mon.0) 2837 : cluster [DBG] osdmap e566: 8 total, 8 up, 8 in 2024-02-13T00:47:48.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:48 smithi080 bash[24237]: cluster 2024-02-13T00:47:46.441750+0000 mgr.y (mgr.24461) 697 : cluster [DBG] pgmap v1031: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:47:48.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:48 smithi080 bash[24237]: cluster 2024-02-13T00:47:47.119154+0000 mon.a (mon.0) 2835 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:47:48.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:48 smithi080 bash[24237]: audit 2024-02-13T00:47:47.127426+0000 mon.a (mon.0) 2836 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-108"}]': finished 2024-02-13T00:47:48.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:48 smithi080 bash[24237]: cluster 2024-02-13T00:47:47.127717+0000 mon.a (mon.0) 2837 : cluster [DBG] osdmap e566: 8 total, 8 up, 8 in 2024-02-13T00:47:49.005 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:47:48 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:47:49.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:49 smithi106 bash[18459]: cluster 2024-02-13T00:47:48.152473+0000 mon.a (mon.0) 2838 : cluster [DBG] osdmap e567: 8 total, 8 up, 8 in 2024-02-13T00:47:49.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:49 smithi080 bash[17386]: cluster 2024-02-13T00:47:48.152473+0000 mon.a (mon.0) 2838 : cluster [DBG] osdmap e567: 8 total, 8 up, 8 in 2024-02-13T00:47:49.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:49 smithi080 bash[24237]: cluster 2024-02-13T00:47:48.152473+0000 mon.a (mon.0) 2838 : cluster [DBG] osdmap e567: 8 total, 8 up, 8 in 2024-02-13T00:47:50.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:47:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:47:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:47:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:50 smithi106 bash[18459]: cluster 2024-02-13T00:47:48.442389+0000 mgr.y (mgr.24461) 698 : cluster [DBG] pgmap v1034: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:47:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:50 smithi106 bash[18459]: audit 2024-02-13T00:47:48.666780+0000 mgr.y (mgr.24461) 699 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:47:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:50 smithi106 bash[18459]: cluster 2024-02-13T00:47:49.163293+0000 mon.a (mon.0) 2839 : cluster [DBG] osdmap e568: 8 total, 8 up, 8 in 2024-02-13T00:47:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:50 smithi106 bash[18459]: audit 2024-02-13T00:47:49.169736+0000 mon.c (mon.2) 417 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-110","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:50 smithi106 bash[18459]: audit 2024-02-13T00:47:49.170512+0000 mon.a (mon.0) 2840 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-110","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:50.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:50 smithi080 bash[17386]: cluster 2024-02-13T00:47:48.442389+0000 mgr.y (mgr.24461) 698 : cluster [DBG] pgmap v1034: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:47:50.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:50 smithi080 bash[17386]: audit 2024-02-13T00:47:48.666780+0000 mgr.y (mgr.24461) 699 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:47:50.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:50 smithi080 bash[17386]: cluster 2024-02-13T00:47:49.163293+0000 mon.a (mon.0) 2839 : cluster [DBG] osdmap e568: 8 total, 8 up, 8 in 2024-02-13T00:47:50.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:50 smithi080 bash[17386]: audit 2024-02-13T00:47:49.169736+0000 mon.c (mon.2) 417 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-110","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:50.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:50 smithi080 bash[17386]: audit 2024-02-13T00:47:49.170512+0000 mon.a (mon.0) 2840 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-110","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:50.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:50 smithi080 bash[24237]: cluster 2024-02-13T00:47:48.442389+0000 mgr.y (mgr.24461) 698 : cluster [DBG] pgmap v1034: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:47:50.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:50 smithi080 bash[24237]: audit 2024-02-13T00:47:48.666780+0000 mgr.y (mgr.24461) 699 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:47:50.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:50 smithi080 bash[24237]: cluster 2024-02-13T00:47:49.163293+0000 mon.a (mon.0) 2839 : cluster [DBG] osdmap e568: 8 total, 8 up, 8 in 2024-02-13T00:47:50.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:50 smithi080 bash[24237]: audit 2024-02-13T00:47:49.169736+0000 mon.c (mon.2) 417 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-110","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:50.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:50 smithi080 bash[24237]: audit 2024-02-13T00:47:49.170512+0000 mon.a (mon.0) 2840 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-110","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:51.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:51 smithi106 bash[18459]: audit 2024-02-13T00:47:50.174015+0000 mon.a (mon.0) 2841 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-110","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:47:51.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:51 smithi106 bash[18459]: cluster 2024-02-13T00:47:50.174275+0000 mon.a (mon.0) 2842 : cluster [DBG] osdmap e569: 8 total, 8 up, 8 in 2024-02-13T00:47:51.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:51 smithi106 bash[18459]: audit 2024-02-13T00:47:50.194238+0000 mon.c (mon.2) 418 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-110", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:51.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:51 smithi106 bash[18459]: audit 2024-02-13T00:47:50.195904+0000 mon.a (mon.0) 2843 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-110", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:51.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:51 smithi080 bash[24237]: audit 2024-02-13T00:47:50.174015+0000 mon.a (mon.0) 2841 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-110","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:47:51.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:51 smithi080 bash[24237]: cluster 2024-02-13T00:47:50.174275+0000 mon.a (mon.0) 2842 : cluster [DBG] osdmap e569: 8 total, 8 up, 8 in 2024-02-13T00:47:51.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:51 smithi080 bash[24237]: audit 2024-02-13T00:47:50.194238+0000 mon.c (mon.2) 418 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-110", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:51.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:51 smithi080 bash[24237]: audit 2024-02-13T00:47:50.195904+0000 mon.a (mon.0) 2843 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-110", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:51 smithi080 bash[17386]: audit 2024-02-13T00:47:50.174015+0000 mon.a (mon.0) 2841 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-110","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:47:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:51 smithi080 bash[17386]: cluster 2024-02-13T00:47:50.174275+0000 mon.a (mon.0) 2842 : cluster [DBG] osdmap e569: 8 total, 8 up, 8 in 2024-02-13T00:47:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:51 smithi080 bash[17386]: audit 2024-02-13T00:47:50.194238+0000 mon.c (mon.2) 418 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-110", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:51 smithi080 bash[17386]: audit 2024-02-13T00:47:50.195904+0000 mon.a (mon.0) 2843 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-110", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:52.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:52 smithi106 bash[18459]: cluster 2024-02-13T00:47:50.443200+0000 mgr.y (mgr.24461) 700 : cluster [DBG] pgmap v1037: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:47:52.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:52 smithi106 bash[18459]: audit 2024-02-13T00:47:51.178785+0000 mon.a (mon.0) 2844 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-110", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:47:52.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:52 smithi106 bash[18459]: cluster 2024-02-13T00:47:51.178960+0000 mon.a (mon.0) 2845 : cluster [DBG] osdmap e570: 8 total, 8 up, 8 in 2024-02-13T00:47:52.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:52 smithi106 bash[18459]: audit 2024-02-13T00:47:51.182831+0000 mon.c (mon.2) 419 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-110"}]: dispatch 2024-02-13T00:47:52.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:52 smithi106 bash[18459]: audit 2024-02-13T00:47:51.187393+0000 mon.a (mon.0) 2846 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-110"}]: dispatch 2024-02-13T00:47:52.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:52 smithi080 bash[24237]: cluster 2024-02-13T00:47:50.443200+0000 mgr.y (mgr.24461) 700 : cluster [DBG] pgmap v1037: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:47:52.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:52 smithi080 bash[24237]: audit 2024-02-13T00:47:51.178785+0000 mon.a (mon.0) 2844 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-110", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:47:52.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:52 smithi080 bash[24237]: cluster 2024-02-13T00:47:51.178960+0000 mon.a (mon.0) 2845 : cluster [DBG] osdmap e570: 8 total, 8 up, 8 in 2024-02-13T00:47:52.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:52 smithi080 bash[24237]: audit 2024-02-13T00:47:51.182831+0000 mon.c (mon.2) 419 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-110"}]: dispatch 2024-02-13T00:47:52.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:52 smithi080 bash[24237]: audit 2024-02-13T00:47:51.187393+0000 mon.a (mon.0) 2846 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-110"}]: dispatch 2024-02-13T00:47:52.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:52 smithi080 bash[17386]: cluster 2024-02-13T00:47:50.443200+0000 mgr.y (mgr.24461) 700 : cluster [DBG] pgmap v1037: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:47:52.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:52 smithi080 bash[17386]: audit 2024-02-13T00:47:51.178785+0000 mon.a (mon.0) 2844 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-110", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:47:52.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:52 smithi080 bash[17386]: cluster 2024-02-13T00:47:51.178960+0000 mon.a (mon.0) 2845 : cluster [DBG] osdmap e570: 8 total, 8 up, 8 in 2024-02-13T00:47:52.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:52 smithi080 bash[17386]: audit 2024-02-13T00:47:51.182831+0000 mon.c (mon.2) 419 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-110"}]: dispatch 2024-02-13T00:47:52.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:52 smithi080 bash[17386]: audit 2024-02-13T00:47:51.187393+0000 mon.a (mon.0) 2846 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-110"}]: dispatch 2024-02-13T00:47:53.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:53 smithi106 bash[18459]: audit 2024-02-13T00:47:52.192631+0000 mon.a (mon.0) 2847 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-110"}]': finished 2024-02-13T00:47:53.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:53 smithi106 bash[18459]: cluster 2024-02-13T00:47:52.192824+0000 mon.a (mon.0) 2848 : cluster [DBG] osdmap e571: 8 total, 8 up, 8 in 2024-02-13T00:47:53.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:53 smithi106 bash[18459]: audit 2024-02-13T00:47:52.196851+0000 mon.c (mon.2) 420 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-110", "mode": "writeback"}]: dispatch 2024-02-13T00:47:53.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:53 smithi106 bash[18459]: audit 2024-02-13T00:47:52.201493+0000 mon.a (mon.0) 2849 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-110", "mode": "writeback"}]: dispatch 2024-02-13T00:47:53.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:53 smithi106 bash[18459]: cluster 2024-02-13T00:47:53.099264+0000 mon.a (mon.0) 2850 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:47:53.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:53 smithi106 bash[18459]: audit 2024-02-13T00:47:53.107690+0000 mon.a (mon.0) 2851 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-110", "mode": "writeback"}]': finished 2024-02-13T00:47:53.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:53 smithi106 bash[18459]: cluster 2024-02-13T00:47:53.107873+0000 mon.a (mon.0) 2852 : cluster [DBG] osdmap e572: 8 total, 8 up, 8 in 2024-02-13T00:47:53.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:47:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:47:53] "GET /metrics HTTP/1.1" 200 189912 "" "Prometheus/2.33.4" 2024-02-13T00:47:53.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:53 smithi080 bash[17386]: audit 2024-02-13T00:47:52.192631+0000 mon.a (mon.0) 2847 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-110"}]': finished 2024-02-13T00:47:53.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:53 smithi080 bash[17386]: cluster 2024-02-13T00:47:52.192824+0000 mon.a (mon.0) 2848 : cluster [DBG] osdmap e571: 8 total, 8 up, 8 in 2024-02-13T00:47:53.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:53 smithi080 bash[17386]: audit 2024-02-13T00:47:52.196851+0000 mon.c (mon.2) 420 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-110", "mode": "writeback"}]: dispatch 2024-02-13T00:47:53.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:53 smithi080 bash[17386]: audit 2024-02-13T00:47:52.201493+0000 mon.a (mon.0) 2849 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-110", "mode": "writeback"}]: dispatch 2024-02-13T00:47:53.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:53 smithi080 bash[17386]: cluster 2024-02-13T00:47:53.099264+0000 mon.a (mon.0) 2850 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:47:53.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:53 smithi080 bash[17386]: audit 2024-02-13T00:47:53.107690+0000 mon.a (mon.0) 2851 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-110", "mode": "writeback"}]': finished 2024-02-13T00:47:53.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:53 smithi080 bash[17386]: cluster 2024-02-13T00:47:53.107873+0000 mon.a (mon.0) 2852 : cluster [DBG] osdmap e572: 8 total, 8 up, 8 in 2024-02-13T00:47:53.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:53 smithi080 bash[24237]: audit 2024-02-13T00:47:52.192631+0000 mon.a (mon.0) 2847 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-110"}]': finished 2024-02-13T00:47:53.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:53 smithi080 bash[24237]: cluster 2024-02-13T00:47:52.192824+0000 mon.a (mon.0) 2848 : cluster [DBG] osdmap e571: 8 total, 8 up, 8 in 2024-02-13T00:47:53.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:53 smithi080 bash[24237]: audit 2024-02-13T00:47:52.196851+0000 mon.c (mon.2) 420 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-110", "mode": "writeback"}]: dispatch 2024-02-13T00:47:53.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:53 smithi080 bash[24237]: audit 2024-02-13T00:47:52.201493+0000 mon.a (mon.0) 2849 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-110", "mode": "writeback"}]: dispatch 2024-02-13T00:47:53.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:53 smithi080 bash[24237]: cluster 2024-02-13T00:47:53.099264+0000 mon.a (mon.0) 2850 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:47:53.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:53 smithi080 bash[24237]: audit 2024-02-13T00:47:53.107690+0000 mon.a (mon.0) 2851 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-110", "mode": "writeback"}]': finished 2024-02-13T00:47:53.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:53 smithi080 bash[24237]: cluster 2024-02-13T00:47:53.107873+0000 mon.a (mon.0) 2852 : cluster [DBG] osdmap e572: 8 total, 8 up, 8 in 2024-02-13T00:47:54.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:54 smithi106 bash[18459]: cluster 2024-02-13T00:47:52.444017+0000 mgr.y (mgr.24461) 701 : cluster [DBG] pgmap v1040: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:47:54.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:54 smithi106 bash[18459]: audit 2024-02-13T00:47:53.206441+0000 mon.c (mon.2) 421 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:54.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:54 smithi106 bash[18459]: audit 2024-02-13T00:47:53.211186+0000 mon.a (mon.0) 2853 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:54.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:54 smithi080 bash[24237]: cluster 2024-02-13T00:47:52.444017+0000 mgr.y (mgr.24461) 701 : cluster [DBG] pgmap v1040: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:47:54.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:54 smithi080 bash[24237]: audit 2024-02-13T00:47:53.206441+0000 mon.c (mon.2) 421 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:54.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:54 smithi080 bash[24237]: audit 2024-02-13T00:47:53.211186+0000 mon.a (mon.0) 2853 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:54.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:54 smithi080 bash[17386]: cluster 2024-02-13T00:47:52.444017+0000 mgr.y (mgr.24461) 701 : cluster [DBG] pgmap v1040: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:47:54.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:54 smithi080 bash[17386]: audit 2024-02-13T00:47:53.206441+0000 mon.c (mon.2) 421 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:54.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:54 smithi080 bash[17386]: audit 2024-02-13T00:47:53.211186+0000 mon.a (mon.0) 2853 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:47:55.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:55 smithi106 bash[18459]: audit 2024-02-13T00:47:54.224421+0000 mon.a (mon.0) 2854 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:47:55.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:55 smithi106 bash[18459]: cluster 2024-02-13T00:47:54.224531+0000 mon.a (mon.0) 2855 : cluster [DBG] osdmap e573: 8 total, 8 up, 8 in 2024-02-13T00:47:55.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:55 smithi106 bash[18459]: audit 2024-02-13T00:47:54.229103+0000 mon.c (mon.2) 422 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-110"}]: dispatch 2024-02-13T00:47:55.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:55 smithi106 bash[18459]: audit 2024-02-13T00:47:54.229609+0000 mon.a (mon.0) 2856 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-110"}]: dispatch 2024-02-13T00:47:55.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:55 smithi080 bash[17386]: audit 2024-02-13T00:47:54.224421+0000 mon.a (mon.0) 2854 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:47:55.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:55 smithi080 bash[17386]: cluster 2024-02-13T00:47:54.224531+0000 mon.a (mon.0) 2855 : cluster [DBG] osdmap e573: 8 total, 8 up, 8 in 2024-02-13T00:47:55.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:55 smithi080 bash[17386]: audit 2024-02-13T00:47:54.229103+0000 mon.c (mon.2) 422 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-110"}]: dispatch 2024-02-13T00:47:55.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:55 smithi080 bash[17386]: audit 2024-02-13T00:47:54.229609+0000 mon.a (mon.0) 2856 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-110"}]: dispatch 2024-02-13T00:47:55.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:55 smithi080 bash[24237]: audit 2024-02-13T00:47:54.224421+0000 mon.a (mon.0) 2854 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:47:55.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:55 smithi080 bash[24237]: cluster 2024-02-13T00:47:54.224531+0000 mon.a (mon.0) 2855 : cluster [DBG] osdmap e573: 8 total, 8 up, 8 in 2024-02-13T00:47:55.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:55 smithi080 bash[24237]: audit 2024-02-13T00:47:54.229103+0000 mon.c (mon.2) 422 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-110"}]: dispatch 2024-02-13T00:47:55.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:55 smithi080 bash[24237]: audit 2024-02-13T00:47:54.229609+0000 mon.a (mon.0) 2856 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-110"}]: dispatch 2024-02-13T00:47:56.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:56 smithi106 bash[18459]: cluster 2024-02-13T00:47:54.444857+0000 mgr.y (mgr.24461) 702 : cluster [DBG] pgmap v1043: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:47:56.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:56 smithi106 bash[18459]: cluster 2024-02-13T00:47:55.219003+0000 mon.a (mon.0) 2857 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:47:56.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:56 smithi106 bash[18459]: audit 2024-02-13T00:47:55.224591+0000 mon.a (mon.0) 2858 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-110"}]': finished 2024-02-13T00:47:56.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:56 smithi106 bash[18459]: cluster 2024-02-13T00:47:55.224707+0000 mon.a (mon.0) 2859 : cluster [DBG] osdmap e574: 8 total, 8 up, 8 in 2024-02-13T00:47:56.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:56 smithi080 bash[17386]: cluster 2024-02-13T00:47:54.444857+0000 mgr.y (mgr.24461) 702 : cluster [DBG] pgmap v1043: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:47:56.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:56 smithi080 bash[17386]: cluster 2024-02-13T00:47:55.219003+0000 mon.a (mon.0) 2857 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:47:56.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:56 smithi080 bash[17386]: audit 2024-02-13T00:47:55.224591+0000 mon.a (mon.0) 2858 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-110"}]': finished 2024-02-13T00:47:56.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:56 smithi080 bash[17386]: cluster 2024-02-13T00:47:55.224707+0000 mon.a (mon.0) 2859 : cluster [DBG] osdmap e574: 8 total, 8 up, 8 in 2024-02-13T00:47:56.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:56 smithi080 bash[24237]: cluster 2024-02-13T00:47:54.444857+0000 mgr.y (mgr.24461) 702 : cluster [DBG] pgmap v1043: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:47:56.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:56 smithi080 bash[24237]: cluster 2024-02-13T00:47:55.219003+0000 mon.a (mon.0) 2857 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:47:56.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:56 smithi080 bash[24237]: audit 2024-02-13T00:47:55.224591+0000 mon.a (mon.0) 2858 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-110"}]': finished 2024-02-13T00:47:56.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:56 smithi080 bash[24237]: cluster 2024-02-13T00:47:55.224707+0000 mon.a (mon.0) 2859 : cluster [DBG] osdmap e574: 8 total, 8 up, 8 in 2024-02-13T00:47:57.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:57 smithi080 bash[17386]: cluster 2024-02-13T00:47:56.246853+0000 mon.a (mon.0) 2860 : cluster [DBG] osdmap e575: 8 total, 8 up, 8 in 2024-02-13T00:47:57.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:57 smithi080 bash[24237]: cluster 2024-02-13T00:47:56.246853+0000 mon.a (mon.0) 2860 : cluster [DBG] osdmap e575: 8 total, 8 up, 8 in 2024-02-13T00:47:57.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:57 smithi106 bash[18459]: cluster 2024-02-13T00:47:56.246853+0000 mon.a (mon.0) 2860 : cluster [DBG] osdmap e575: 8 total, 8 up, 8 in 2024-02-13T00:47:58.681 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:58 smithi106 bash[18459]: cluster 2024-02-13T00:47:56.445504+0000 mgr.y (mgr.24461) 703 : cluster [DBG] pgmap v1046: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:47:58.681 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:58 smithi106 bash[18459]: cluster 2024-02-13T00:47:57.257611+0000 mon.a (mon.0) 2861 : cluster [DBG] osdmap e576: 8 total, 8 up, 8 in 2024-02-13T00:47:58.681 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:58 smithi106 bash[18459]: audit 2024-02-13T00:47:57.263233+0000 mon.c (mon.2) 423 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:58.682 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:58 smithi106 bash[18459]: audit 2024-02-13T00:47:57.264804+0000 mon.a (mon.0) 2862 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:58.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:58 smithi080 bash[17386]: cluster 2024-02-13T00:47:56.445504+0000 mgr.y (mgr.24461) 703 : cluster [DBG] pgmap v1046: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:47:58.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:58 smithi080 bash[17386]: cluster 2024-02-13T00:47:57.257611+0000 mon.a (mon.0) 2861 : cluster [DBG] osdmap e576: 8 total, 8 up, 8 in 2024-02-13T00:47:58.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:58 smithi080 bash[17386]: audit 2024-02-13T00:47:57.263233+0000 mon.c (mon.2) 423 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:58.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:58 smithi080 bash[17386]: audit 2024-02-13T00:47:57.264804+0000 mon.a (mon.0) 2862 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:58.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:58 smithi080 bash[24237]: cluster 2024-02-13T00:47:56.445504+0000 mgr.y (mgr.24461) 703 : cluster [DBG] pgmap v1046: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:47:58.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:58 smithi080 bash[24237]: cluster 2024-02-13T00:47:57.257611+0000 mon.a (mon.0) 2861 : cluster [DBG] osdmap e576: 8 total, 8 up, 8 in 2024-02-13T00:47:58.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:58 smithi080 bash[24237]: audit 2024-02-13T00:47:57.263233+0000 mon.c (mon.2) 423 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:58.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:58 smithi080 bash[24237]: audit 2024-02-13T00:47:57.264804+0000 mon.a (mon.0) 2862 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:47:59.005 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:47:58 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:47:59.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:59 smithi106 bash[18459]: audit 2024-02-13T00:47:58.269164+0000 mon.a (mon.0) 2863 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:47:59.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:59 smithi106 bash[18459]: cluster 2024-02-13T00:47:58.269338+0000 mon.a (mon.0) 2864 : cluster [DBG] osdmap e577: 8 total, 8 up, 8 in 2024-02-13T00:47:59.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:59 smithi106 bash[18459]: audit 2024-02-13T00:47:58.293615+0000 mon.c (mon.2) 424 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:59.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:47:59 smithi106 bash[18459]: audit 2024-02-13T00:47:58.294223+0000 mon.a (mon.0) 2865 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:59.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:59 smithi080 bash[17386]: audit 2024-02-13T00:47:58.269164+0000 mon.a (mon.0) 2863 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:47:59.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:59 smithi080 bash[17386]: cluster 2024-02-13T00:47:58.269338+0000 mon.a (mon.0) 2864 : cluster [DBG] osdmap e577: 8 total, 8 up, 8 in 2024-02-13T00:47:59.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:59 smithi080 bash[17386]: audit 2024-02-13T00:47:58.293615+0000 mon.c (mon.2) 424 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:59.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:47:59 smithi080 bash[17386]: audit 2024-02-13T00:47:58.294223+0000 mon.a (mon.0) 2865 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:59.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:59 smithi080 bash[24237]: audit 2024-02-13T00:47:58.269164+0000 mon.a (mon.0) 2863 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:47:59.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:59 smithi080 bash[24237]: cluster 2024-02-13T00:47:58.269338+0000 mon.a (mon.0) 2864 : cluster [DBG] osdmap e577: 8 total, 8 up, 8 in 2024-02-13T00:47:59.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:59 smithi080 bash[24237]: audit 2024-02-13T00:47:58.293615+0000 mon.c (mon.2) 424 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:47:59.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:47:59 smithi080 bash[24237]: audit 2024-02-13T00:47:58.294223+0000 mon.a (mon.0) 2865 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:00.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:48:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:48:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:48:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:00 smithi106 bash[18459]: cluster 2024-02-13T00:47:58.446432+0000 mgr.y (mgr.24461) 704 : cluster [DBG] pgmap v1049: 204 pgs: 32 creating+peering, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:48:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:00 smithi106 bash[18459]: audit 2024-02-13T00:47:58.677685+0000 mgr.y (mgr.24461) 705 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:48:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:00 smithi106 bash[18459]: audit 2024-02-13T00:47:59.273881+0000 mon.a (mon.0) 2866 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-112", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:48:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:00 smithi106 bash[18459]: cluster 2024-02-13T00:47:59.274030+0000 mon.a (mon.0) 2867 : cluster [DBG] osdmap e578: 8 total, 8 up, 8 in 2024-02-13T00:48:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:00 smithi106 bash[18459]: audit 2024-02-13T00:47:59.277063+0000 mon.c (mon.2) 425 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-112"}]: dispatch 2024-02-13T00:48:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:00 smithi106 bash[18459]: audit 2024-02-13T00:47:59.282512+0000 mon.a (mon.0) 2868 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-112"}]: dispatch 2024-02-13T00:48:00.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:00 smithi080 bash[17386]: cluster 2024-02-13T00:47:58.446432+0000 mgr.y (mgr.24461) 704 : cluster [DBG] pgmap v1049: 204 pgs: 32 creating+peering, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:48:00.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:00 smithi080 bash[17386]: audit 2024-02-13T00:47:58.677685+0000 mgr.y (mgr.24461) 705 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:48:00.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:00 smithi080 bash[17386]: audit 2024-02-13T00:47:59.273881+0000 mon.a (mon.0) 2866 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-112", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:48:00.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:00 smithi080 bash[17386]: cluster 2024-02-13T00:47:59.274030+0000 mon.a (mon.0) 2867 : cluster [DBG] osdmap e578: 8 total, 8 up, 8 in 2024-02-13T00:48:00.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:00 smithi080 bash[17386]: audit 2024-02-13T00:47:59.277063+0000 mon.c (mon.2) 425 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-112"}]: dispatch 2024-02-13T00:48:00.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:00 smithi080 bash[17386]: audit 2024-02-13T00:47:59.282512+0000 mon.a (mon.0) 2868 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-112"}]: dispatch 2024-02-13T00:48:00.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:00 smithi080 bash[24237]: cluster 2024-02-13T00:47:58.446432+0000 mgr.y (mgr.24461) 704 : cluster [DBG] pgmap v1049: 204 pgs: 32 creating+peering, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:48:00.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:00 smithi080 bash[24237]: audit 2024-02-13T00:47:58.677685+0000 mgr.y (mgr.24461) 705 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:48:00.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:00 smithi080 bash[24237]: audit 2024-02-13T00:47:59.273881+0000 mon.a (mon.0) 2866 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-112", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:48:00.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:00 smithi080 bash[24237]: cluster 2024-02-13T00:47:59.274030+0000 mon.a (mon.0) 2867 : cluster [DBG] osdmap e578: 8 total, 8 up, 8 in 2024-02-13T00:48:00.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:00 smithi080 bash[24237]: audit 2024-02-13T00:47:59.277063+0000 mon.c (mon.2) 425 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-112"}]: dispatch 2024-02-13T00:48:00.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:00 smithi080 bash[24237]: audit 2024-02-13T00:47:59.282512+0000 mon.a (mon.0) 2868 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-112"}]: dispatch 2024-02-13T00:48:01.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:01 smithi106 bash[18459]: audit 2024-02-13T00:48:00.291999+0000 mon.a (mon.0) 2869 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-112"}]': finished 2024-02-13T00:48:01.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:01 smithi106 bash[18459]: cluster 2024-02-13T00:48:00.292156+0000 mon.a (mon.0) 2870 : cluster [DBG] osdmap e579: 8 total, 8 up, 8 in 2024-02-13T00:48:01.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:01 smithi106 bash[18459]: audit 2024-02-13T00:48:00.296887+0000 mon.c (mon.2) 426 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-112", "mode": "writeback"}]: dispatch 2024-02-13T00:48:01.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:01 smithi106 bash[18459]: audit 2024-02-13T00:48:00.298916+0000 mon.a (mon.0) 2871 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-112", "mode": "writeback"}]: dispatch 2024-02-13T00:48:01.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:01 smithi106 bash[18459]: cluster 2024-02-13T00:48:00.447413+0000 mgr.y (mgr.24461) 706 : cluster [DBG] pgmap v1052: 204 pgs: 32 creating+peering, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:48:01.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:01 smithi080 bash[17386]: audit 2024-02-13T00:48:00.291999+0000 mon.a (mon.0) 2869 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-112"}]': finished 2024-02-13T00:48:01.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:01 smithi080 bash[17386]: cluster 2024-02-13T00:48:00.292156+0000 mon.a (mon.0) 2870 : cluster [DBG] osdmap e579: 8 total, 8 up, 8 in 2024-02-13T00:48:01.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:01 smithi080 bash[17386]: audit 2024-02-13T00:48:00.296887+0000 mon.c (mon.2) 426 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-112", "mode": "writeback"}]: dispatch 2024-02-13T00:48:01.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:01 smithi080 bash[17386]: audit 2024-02-13T00:48:00.298916+0000 mon.a (mon.0) 2871 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-112", "mode": "writeback"}]: dispatch 2024-02-13T00:48:01.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:01 smithi080 bash[17386]: cluster 2024-02-13T00:48:00.447413+0000 mgr.y (mgr.24461) 706 : cluster [DBG] pgmap v1052: 204 pgs: 32 creating+peering, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:48:01.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:01 smithi080 bash[24237]: audit 2024-02-13T00:48:00.291999+0000 mon.a (mon.0) 2869 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-112"}]': finished 2024-02-13T00:48:01.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:01 smithi080 bash[24237]: cluster 2024-02-13T00:48:00.292156+0000 mon.a (mon.0) 2870 : cluster [DBG] osdmap e579: 8 total, 8 up, 8 in 2024-02-13T00:48:01.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:01 smithi080 bash[24237]: audit 2024-02-13T00:48:00.296887+0000 mon.c (mon.2) 426 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-112", "mode": "writeback"}]: dispatch 2024-02-13T00:48:01.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:01 smithi080 bash[24237]: audit 2024-02-13T00:48:00.298916+0000 mon.a (mon.0) 2871 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-112", "mode": "writeback"}]: dispatch 2024-02-13T00:48:01.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:01 smithi080 bash[24237]: cluster 2024-02-13T00:48:00.447413+0000 mgr.y (mgr.24461) 706 : cluster [DBG] pgmap v1052: 204 pgs: 32 creating+peering, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:48:02.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:02 smithi106 bash[18459]: cluster 2024-02-13T00:48:01.288750+0000 mon.a (mon.0) 2872 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:48:02.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:02 smithi106 bash[18459]: audit 2024-02-13T00:48:01.298482+0000 mon.a (mon.0) 2873 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-112", "mode": "writeback"}]': finished 2024-02-13T00:48:02.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:02 smithi106 bash[18459]: cluster 2024-02-13T00:48:01.298628+0000 mon.a (mon.0) 2874 : cluster [DBG] osdmap e580: 8 total, 8 up, 8 in 2024-02-13T00:48:02.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:02 smithi106 bash[18459]: audit 2024-02-13T00:48:01.389639+0000 mon.c (mon.2) 427 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:02.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:02 smithi106 bash[18459]: audit 2024-02-13T00:48:01.390214+0000 mon.a (mon.0) 2875 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:02.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:02 smithi080 bash[17386]: cluster 2024-02-13T00:48:01.288750+0000 mon.a (mon.0) 2872 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:48:02.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:02 smithi080 bash[17386]: audit 2024-02-13T00:48:01.298482+0000 mon.a (mon.0) 2873 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-112", "mode": "writeback"}]': finished 2024-02-13T00:48:02.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:02 smithi080 bash[17386]: cluster 2024-02-13T00:48:01.298628+0000 mon.a (mon.0) 2874 : cluster [DBG] osdmap e580: 8 total, 8 up, 8 in 2024-02-13T00:48:02.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:02 smithi080 bash[17386]: audit 2024-02-13T00:48:01.389639+0000 mon.c (mon.2) 427 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:02.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:02 smithi080 bash[17386]: audit 2024-02-13T00:48:01.390214+0000 mon.a (mon.0) 2875 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:02.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:02 smithi080 bash[24237]: cluster 2024-02-13T00:48:01.288750+0000 mon.a (mon.0) 2872 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:48:02.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:02 smithi080 bash[24237]: audit 2024-02-13T00:48:01.298482+0000 mon.a (mon.0) 2873 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-112", "mode": "writeback"}]': finished 2024-02-13T00:48:02.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:02 smithi080 bash[24237]: cluster 2024-02-13T00:48:01.298628+0000 mon.a (mon.0) 2874 : cluster [DBG] osdmap e580: 8 total, 8 up, 8 in 2024-02-13T00:48:02.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:02 smithi080 bash[24237]: audit 2024-02-13T00:48:01.389639+0000 mon.c (mon.2) 427 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:02.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:02 smithi080 bash[24237]: audit 2024-02-13T00:48:01.390214+0000 mon.a (mon.0) 2875 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:03.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:48:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:48:03] "GET /metrics HTTP/1.1" 200 190033 "" "Prometheus/2.33.4" 2024-02-13T00:48:03.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:03 smithi080 bash[17386]: audit 2024-02-13T00:48:02.315027+0000 mon.a (mon.0) 2876 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:48:03.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:03 smithi080 bash[17386]: cluster 2024-02-13T00:48:02.315150+0000 mon.a (mon.0) 2877 : cluster [DBG] osdmap e581: 8 total, 8 up, 8 in 2024-02-13T00:48:03.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:03 smithi080 bash[17386]: audit 2024-02-13T00:48:02.316617+0000 mon.c (mon.2) 428 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-112"}]: dispatch 2024-02-13T00:48:03.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:03 smithi080 bash[17386]: audit 2024-02-13T00:48:02.317229+0000 mon.a (mon.0) 2878 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-112"}]: dispatch 2024-02-13T00:48:03.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:03 smithi080 bash[17386]: cluster 2024-02-13T00:48:02.448393+0000 mgr.y (mgr.24461) 707 : cluster [DBG] pgmap v1055: 204 pgs: 32 creating+peering, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:48:03.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:03 smithi080 bash[24237]: audit 2024-02-13T00:48:02.315027+0000 mon.a (mon.0) 2876 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:48:03.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:03 smithi080 bash[24237]: cluster 2024-02-13T00:48:02.315150+0000 mon.a (mon.0) 2877 : cluster [DBG] osdmap e581: 8 total, 8 up, 8 in 2024-02-13T00:48:03.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:03 smithi080 bash[24237]: audit 2024-02-13T00:48:02.316617+0000 mon.c (mon.2) 428 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-112"}]: dispatch 2024-02-13T00:48:03.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:03 smithi080 bash[24237]: audit 2024-02-13T00:48:02.317229+0000 mon.a (mon.0) 2878 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-112"}]: dispatch 2024-02-13T00:48:03.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:03 smithi080 bash[24237]: cluster 2024-02-13T00:48:02.448393+0000 mgr.y (mgr.24461) 707 : cluster [DBG] pgmap v1055: 204 pgs: 32 creating+peering, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:48:03.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:03 smithi106 bash[18459]: audit 2024-02-13T00:48:02.315027+0000 mon.a (mon.0) 2876 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:48:03.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:03 smithi106 bash[18459]: cluster 2024-02-13T00:48:02.315150+0000 mon.a (mon.0) 2877 : cluster [DBG] osdmap e581: 8 total, 8 up, 8 in 2024-02-13T00:48:03.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:03 smithi106 bash[18459]: audit 2024-02-13T00:48:02.316617+0000 mon.c (mon.2) 428 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-112"}]: dispatch 2024-02-13T00:48:03.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:03 smithi106 bash[18459]: audit 2024-02-13T00:48:02.317229+0000 mon.a (mon.0) 2878 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-112"}]: dispatch 2024-02-13T00:48:03.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:03 smithi106 bash[18459]: cluster 2024-02-13T00:48:02.448393+0000 mgr.y (mgr.24461) 707 : cluster [DBG] pgmap v1055: 204 pgs: 32 creating+peering, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:48:04.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:04 smithi106 bash[18459]: cluster 2024-02-13T00:48:03.312314+0000 mon.a (mon.0) 2879 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:48:04.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:04 smithi106 bash[18459]: audit 2024-02-13T00:48:03.322884+0000 mon.a (mon.0) 2880 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-112"}]': finished 2024-02-13T00:48:04.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:04 smithi106 bash[18459]: cluster 2024-02-13T00:48:03.323010+0000 mon.a (mon.0) 2881 : cluster [DBG] osdmap e582: 8 total, 8 up, 8 in 2024-02-13T00:48:04.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:04 smithi080 bash[24237]: cluster 2024-02-13T00:48:03.312314+0000 mon.a (mon.0) 2879 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:48:04.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:04 smithi080 bash[24237]: audit 2024-02-13T00:48:03.322884+0000 mon.a (mon.0) 2880 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-112"}]': finished 2024-02-13T00:48:04.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:04 smithi080 bash[24237]: cluster 2024-02-13T00:48:03.323010+0000 mon.a (mon.0) 2881 : cluster [DBG] osdmap e582: 8 total, 8 up, 8 in 2024-02-13T00:48:04.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:04 smithi080 bash[17386]: cluster 2024-02-13T00:48:03.312314+0000 mon.a (mon.0) 2879 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:48:04.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:04 smithi080 bash[17386]: audit 2024-02-13T00:48:03.322884+0000 mon.a (mon.0) 2880 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-112"}]': finished 2024-02-13T00:48:04.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:04 smithi080 bash[17386]: cluster 2024-02-13T00:48:03.323010+0000 mon.a (mon.0) 2881 : cluster [DBG] osdmap e582: 8 total, 8 up, 8 in 2024-02-13T00:48:05.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:05 smithi106 bash[18459]: cluster 2024-02-13T00:48:04.337699+0000 mon.a (mon.0) 2882 : cluster [DBG] osdmap e583: 8 total, 8 up, 8 in 2024-02-13T00:48:05.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:05 smithi106 bash[18459]: cluster 2024-02-13T00:48:04.449082+0000 mgr.y (mgr.24461) 708 : cluster [DBG] pgmap v1058: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T00:48:05.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:05 smithi080 bash[17386]: cluster 2024-02-13T00:48:04.337699+0000 mon.a (mon.0) 2882 : cluster [DBG] osdmap e583: 8 total, 8 up, 8 in 2024-02-13T00:48:05.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:05 smithi080 bash[17386]: cluster 2024-02-13T00:48:04.449082+0000 mgr.y (mgr.24461) 708 : cluster [DBG] pgmap v1058: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T00:48:05.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:05 smithi080 bash[24237]: cluster 2024-02-13T00:48:04.337699+0000 mon.a (mon.0) 2882 : cluster [DBG] osdmap e583: 8 total, 8 up, 8 in 2024-02-13T00:48:05.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:05 smithi080 bash[24237]: cluster 2024-02-13T00:48:04.449082+0000 mgr.y (mgr.24461) 708 : cluster [DBG] pgmap v1058: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T00:48:06.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:06 smithi106 bash[18459]: cluster 2024-02-13T00:48:05.355572+0000 mon.a (mon.0) 2883 : cluster [DBG] osdmap e584: 8 total, 8 up, 8 in 2024-02-13T00:48:06.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:06 smithi106 bash[18459]: audit 2024-02-13T00:48:05.361746+0000 mon.c (mon.2) 429 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:06.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:06 smithi106 bash[18459]: audit 2024-02-13T00:48:05.364543+0000 mon.a (mon.0) 2884 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:06.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:06 smithi080 bash[17386]: cluster 2024-02-13T00:48:05.355572+0000 mon.a (mon.0) 2883 : cluster [DBG] osdmap e584: 8 total, 8 up, 8 in 2024-02-13T00:48:06.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:06 smithi080 bash[17386]: audit 2024-02-13T00:48:05.361746+0000 mon.c (mon.2) 429 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:06.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:06 smithi080 bash[17386]: audit 2024-02-13T00:48:05.364543+0000 mon.a (mon.0) 2884 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:06.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:06 smithi080 bash[24237]: cluster 2024-02-13T00:48:05.355572+0000 mon.a (mon.0) 2883 : cluster [DBG] osdmap e584: 8 total, 8 up, 8 in 2024-02-13T00:48:06.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:06 smithi080 bash[24237]: audit 2024-02-13T00:48:05.361746+0000 mon.c (mon.2) 429 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:06.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:06 smithi080 bash[24237]: audit 2024-02-13T00:48:05.364543+0000 mon.a (mon.0) 2884 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:07.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:07 smithi106 bash[18459]: audit 2024-02-13T00:48:06.358278+0000 mon.a (mon.0) 2885 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:48:07.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:07 smithi106 bash[18459]: cluster 2024-02-13T00:48:06.358521+0000 mon.a (mon.0) 2886 : cluster [DBG] osdmap e585: 8 total, 8 up, 8 in 2024-02-13T00:48:07.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:07 smithi106 bash[18459]: cluster 2024-02-13T00:48:06.449902+0000 mgr.y (mgr.24461) 709 : cluster [DBG] pgmap v1061: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T00:48:07.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:07 smithi106 bash[18459]: cluster 2024-02-13T00:48:07.360658+0000 mon.a (mon.0) 2887 : cluster [DBG] osdmap e586: 8 total, 8 up, 8 in 2024-02-13T00:48:07.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:07 smithi080 bash[17386]: audit 2024-02-13T00:48:06.358278+0000 mon.a (mon.0) 2885 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:48:07.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:07 smithi080 bash[17386]: cluster 2024-02-13T00:48:06.358521+0000 mon.a (mon.0) 2886 : cluster [DBG] osdmap e585: 8 total, 8 up, 8 in 2024-02-13T00:48:07.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:07 smithi080 bash[17386]: cluster 2024-02-13T00:48:06.449902+0000 mgr.y (mgr.24461) 709 : cluster [DBG] pgmap v1061: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T00:48:07.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:07 smithi080 bash[17386]: cluster 2024-02-13T00:48:07.360658+0000 mon.a (mon.0) 2887 : cluster [DBG] osdmap e586: 8 total, 8 up, 8 in 2024-02-13T00:48:07.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:07 smithi080 bash[24237]: audit 2024-02-13T00:48:06.358278+0000 mon.a (mon.0) 2885 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:48:07.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:07 smithi080 bash[24237]: cluster 2024-02-13T00:48:06.358521+0000 mon.a (mon.0) 2886 : cluster [DBG] osdmap e585: 8 total, 8 up, 8 in 2024-02-13T00:48:07.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:07 smithi080 bash[24237]: cluster 2024-02-13T00:48:06.449902+0000 mgr.y (mgr.24461) 709 : cluster [DBG] pgmap v1061: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T00:48:07.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:07 smithi080 bash[24237]: cluster 2024-02-13T00:48:07.360658+0000 mon.a (mon.0) 2887 : cluster [DBG] osdmap e586: 8 total, 8 up, 8 in 2024-02-13T00:48:08.688 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:08 smithi106 bash[18459]: audit 2024-02-13T00:48:07.378294+0000 mon.c (mon.2) 430 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:08.688 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:08 smithi106 bash[18459]: audit 2024-02-13T00:48:07.382736+0000 mon.a (mon.0) 2888 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:08.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:08 smithi080 bash[17386]: audit 2024-02-13T00:48:07.378294+0000 mon.c (mon.2) 430 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:08.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:08 smithi080 bash[17386]: audit 2024-02-13T00:48:07.382736+0000 mon.a (mon.0) 2888 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:08.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:08 smithi080 bash[24237]: audit 2024-02-13T00:48:07.378294+0000 mon.c (mon.2) 430 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:08.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:08 smithi080 bash[24237]: audit 2024-02-13T00:48:07.382736+0000 mon.a (mon.0) 2888 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:09.005 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:48:08 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:48:09.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:09 smithi106 bash[18459]: audit 2024-02-13T00:48:08.393156+0000 mon.a (mon.0) 2889 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-114", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:48:09.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:09 smithi106 bash[18459]: cluster 2024-02-13T00:48:08.393295+0000 mon.a (mon.0) 2890 : cluster [DBG] osdmap e587: 8 total, 8 up, 8 in 2024-02-13T00:48:09.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:09 smithi106 bash[18459]: audit 2024-02-13T00:48:08.394948+0000 mon.c (mon.2) 431 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-114"}]: dispatch 2024-02-13T00:48:09.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:09 smithi106 bash[18459]: audit 2024-02-13T00:48:08.395670+0000 mon.a (mon.0) 2891 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-114"}]: dispatch 2024-02-13T00:48:09.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:09 smithi106 bash[18459]: cluster 2024-02-13T00:48:08.450811+0000 mgr.y (mgr.24461) 710 : cluster [DBG] pgmap v1064: 204 pgs: 204 active+clean; 5.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T00:48:09.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:09 smithi106 bash[18459]: audit 2024-02-13T00:48:08.685450+0000 mgr.y (mgr.24461) 711 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:48:09.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:09 smithi106 bash[18459]: audit 2024-02-13T00:48:08.962523+0000 mon.c (mon.2) 432 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:48:09.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:09 smithi106 bash[18459]: audit 2024-02-13T00:48:09.270440+0000 mon.c (mon.2) 433 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:48:09.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:09 smithi106 bash[18459]: audit 2024-02-13T00:48:09.272203+0000 mon.c (mon.2) 434 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:48:09.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:09 smithi106 bash[18459]: audit 2024-02-13T00:48:09.280626+0000 mon.a (mon.0) 2892 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:48:09.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:09 smithi080 bash[17386]: audit 2024-02-13T00:48:08.393156+0000 mon.a (mon.0) 2889 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-114", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:48:09.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:09 smithi080 bash[17386]: cluster 2024-02-13T00:48:08.393295+0000 mon.a (mon.0) 2890 : cluster [DBG] osdmap e587: 8 total, 8 up, 8 in 2024-02-13T00:48:09.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:09 smithi080 bash[17386]: audit 2024-02-13T00:48:08.394948+0000 mon.c (mon.2) 431 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-114"}]: dispatch 2024-02-13T00:48:09.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:09 smithi080 bash[17386]: audit 2024-02-13T00:48:08.395670+0000 mon.a (mon.0) 2891 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-114"}]: dispatch 2024-02-13T00:48:09.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:09 smithi080 bash[17386]: cluster 2024-02-13T00:48:08.450811+0000 mgr.y (mgr.24461) 710 : cluster [DBG] pgmap v1064: 204 pgs: 204 active+clean; 5.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T00:48:09.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:09 smithi080 bash[17386]: audit 2024-02-13T00:48:08.685450+0000 mgr.y (mgr.24461) 711 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:48:09.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:09 smithi080 bash[17386]: audit 2024-02-13T00:48:08.962523+0000 mon.c (mon.2) 432 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:48:09.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:09 smithi080 bash[17386]: audit 2024-02-13T00:48:09.270440+0000 mon.c (mon.2) 433 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:48:09.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:09 smithi080 bash[17386]: audit 2024-02-13T00:48:09.272203+0000 mon.c (mon.2) 434 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:48:09.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:09 smithi080 bash[17386]: audit 2024-02-13T00:48:09.280626+0000 mon.a (mon.0) 2892 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:48:09.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:09 smithi080 bash[24237]: audit 2024-02-13T00:48:08.393156+0000 mon.a (mon.0) 2889 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-114", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:48:09.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:09 smithi080 bash[24237]: cluster 2024-02-13T00:48:08.393295+0000 mon.a (mon.0) 2890 : cluster [DBG] osdmap e587: 8 total, 8 up, 8 in 2024-02-13T00:48:09.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:09 smithi080 bash[24237]: audit 2024-02-13T00:48:08.394948+0000 mon.c (mon.2) 431 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-114"}]: dispatch 2024-02-13T00:48:09.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:09 smithi080 bash[24237]: audit 2024-02-13T00:48:08.395670+0000 mon.a (mon.0) 2891 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-114"}]: dispatch 2024-02-13T00:48:09.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:09 smithi080 bash[24237]: cluster 2024-02-13T00:48:08.450811+0000 mgr.y (mgr.24461) 710 : cluster [DBG] pgmap v1064: 204 pgs: 204 active+clean; 5.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T00:48:09.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:09 smithi080 bash[24237]: audit 2024-02-13T00:48:08.685450+0000 mgr.y (mgr.24461) 711 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:48:09.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:09 smithi080 bash[24237]: audit 2024-02-13T00:48:08.962523+0000 mon.c (mon.2) 432 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:48:09.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:09 smithi080 bash[24237]: audit 2024-02-13T00:48:09.270440+0000 mon.c (mon.2) 433 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:48:09.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:09 smithi080 bash[24237]: audit 2024-02-13T00:48:09.272203+0000 mon.c (mon.2) 434 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:48:09.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:09 smithi080 bash[24237]: audit 2024-02-13T00:48:09.280626+0000 mon.a (mon.0) 2892 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:48:10.419 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:48:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:48:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:48:10.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:10 smithi106 bash[18459]: audit 2024-02-13T00:48:09.398445+0000 mon.a (mon.0) 2893 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-114"}]': finished 2024-02-13T00:48:10.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:10 smithi106 bash[18459]: cluster 2024-02-13T00:48:09.398703+0000 mon.a (mon.0) 2894 : cluster [DBG] osdmap e588: 8 total, 8 up, 8 in 2024-02-13T00:48:10.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:10 smithi106 bash[18459]: audit 2024-02-13T00:48:09.400576+0000 mon.c (mon.2) 435 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-114", "mode": "writeback"}]: dispatch 2024-02-13T00:48:10.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:10 smithi106 bash[18459]: audit 2024-02-13T00:48:09.404924+0000 mon.a (mon.0) 2895 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-114", "mode": "writeback"}]: dispatch 2024-02-13T00:48:10.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:10 smithi080 bash[17386]: audit 2024-02-13T00:48:09.398445+0000 mon.a (mon.0) 2893 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-114"}]': finished 2024-02-13T00:48:10.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:10 smithi080 bash[17386]: cluster 2024-02-13T00:48:09.398703+0000 mon.a (mon.0) 2894 : cluster [DBG] osdmap e588: 8 total, 8 up, 8 in 2024-02-13T00:48:10.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:10 smithi080 bash[17386]: audit 2024-02-13T00:48:09.400576+0000 mon.c (mon.2) 435 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-114", "mode": "writeback"}]: dispatch 2024-02-13T00:48:10.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:10 smithi080 bash[17386]: audit 2024-02-13T00:48:09.404924+0000 mon.a (mon.0) 2895 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-114", "mode": "writeback"}]: dispatch 2024-02-13T00:48:10.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:10 smithi080 bash[24237]: audit 2024-02-13T00:48:09.398445+0000 mon.a (mon.0) 2893 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-114"}]': finished 2024-02-13T00:48:10.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:10 smithi080 bash[24237]: cluster 2024-02-13T00:48:09.398703+0000 mon.a (mon.0) 2894 : cluster [DBG] osdmap e588: 8 total, 8 up, 8 in 2024-02-13T00:48:10.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:10 smithi080 bash[24237]: audit 2024-02-13T00:48:09.400576+0000 mon.c (mon.2) 435 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-114", "mode": "writeback"}]: dispatch 2024-02-13T00:48:10.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:10 smithi080 bash[24237]: audit 2024-02-13T00:48:09.404924+0000 mon.a (mon.0) 2895 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-114", "mode": "writeback"}]: dispatch 2024-02-13T00:48:11.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:11 smithi106 bash[18459]: cluster 2024-02-13T00:48:10.401106+0000 mon.a (mon.0) 2896 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:48:11.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:11 smithi106 bash[18459]: audit 2024-02-13T00:48:10.409668+0000 mon.a (mon.0) 2897 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-114", "mode": "writeback"}]': finished 2024-02-13T00:48:11.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:11 smithi106 bash[18459]: cluster 2024-02-13T00:48:10.409894+0000 mon.a (mon.0) 2898 : cluster [DBG] osdmap e589: 8 total, 8 up, 8 in 2024-02-13T00:48:11.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:11 smithi106 bash[18459]: cluster 2024-02-13T00:48:10.451574+0000 mgr.y (mgr.24461) 712 : cluster [DBG] pgmap v1067: 204 pgs: 204 active+clean; 5.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T00:48:11.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:11 smithi080 bash[17386]: cluster 2024-02-13T00:48:10.401106+0000 mon.a (mon.0) 2896 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:48:11.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:11 smithi080 bash[17386]: audit 2024-02-13T00:48:10.409668+0000 mon.a (mon.0) 2897 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-114", "mode": "writeback"}]': finished 2024-02-13T00:48:11.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:11 smithi080 bash[17386]: cluster 2024-02-13T00:48:10.409894+0000 mon.a (mon.0) 2898 : cluster [DBG] osdmap e589: 8 total, 8 up, 8 in 2024-02-13T00:48:11.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:11 smithi080 bash[17386]: cluster 2024-02-13T00:48:10.451574+0000 mgr.y (mgr.24461) 712 : cluster [DBG] pgmap v1067: 204 pgs: 204 active+clean; 5.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T00:48:11.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:11 smithi080 bash[24237]: cluster 2024-02-13T00:48:10.401106+0000 mon.a (mon.0) 2896 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:48:11.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:11 smithi080 bash[24237]: audit 2024-02-13T00:48:10.409668+0000 mon.a (mon.0) 2897 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-114", "mode": "writeback"}]': finished 2024-02-13T00:48:11.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:11 smithi080 bash[24237]: cluster 2024-02-13T00:48:10.409894+0000 mon.a (mon.0) 2898 : cluster [DBG] osdmap e589: 8 total, 8 up, 8 in 2024-02-13T00:48:11.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:11 smithi080 bash[24237]: cluster 2024-02-13T00:48:10.451574+0000 mgr.y (mgr.24461) 712 : cluster [DBG] pgmap v1067: 204 pgs: 204 active+clean; 5.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T00:48:12.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:12 smithi106 bash[18459]: cluster 2024-02-13T00:48:11.431362+0000 mon.a (mon.0) 2899 : cluster [DBG] osdmap e590: 8 total, 8 up, 8 in 2024-02-13T00:48:12.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:12 smithi106 bash[18459]: audit 2024-02-13T00:48:11.467626+0000 mon.c (mon.2) 436 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:12.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:12 smithi106 bash[18459]: audit 2024-02-13T00:48:11.468292+0000 mon.a (mon.0) 2900 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:12.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:12 smithi080 bash[17386]: cluster 2024-02-13T00:48:11.431362+0000 mon.a (mon.0) 2899 : cluster [DBG] osdmap e590: 8 total, 8 up, 8 in 2024-02-13T00:48:12.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:12 smithi080 bash[17386]: audit 2024-02-13T00:48:11.467626+0000 mon.c (mon.2) 436 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:12.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:12 smithi080 bash[17386]: audit 2024-02-13T00:48:11.468292+0000 mon.a (mon.0) 2900 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:12.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:12 smithi080 bash[24237]: cluster 2024-02-13T00:48:11.431362+0000 mon.a (mon.0) 2899 : cluster [DBG] osdmap e590: 8 total, 8 up, 8 in 2024-02-13T00:48:12.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:12 smithi080 bash[24237]: audit 2024-02-13T00:48:11.467626+0000 mon.c (mon.2) 436 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:12.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:12 smithi080 bash[24237]: audit 2024-02-13T00:48:11.468292+0000 mon.a (mon.0) 2900 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:13.446 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:48:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:48:13] "GET /metrics HTTP/1.1" 200 190033 "" "Prometheus/2.33.4" 2024-02-13T00:48:13.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:13 smithi106 bash[18459]: audit 2024-02-13T00:48:12.434380+0000 mon.a (mon.0) 2901 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:48:13.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:13 smithi106 bash[18459]: cluster 2024-02-13T00:48:12.434486+0000 mon.a (mon.0) 2902 : cluster [DBG] osdmap e591: 8 total, 8 up, 8 in 2024-02-13T00:48:13.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:13 smithi106 bash[18459]: audit 2024-02-13T00:48:12.436100+0000 mon.c (mon.2) 437 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-114"}]: dispatch 2024-02-13T00:48:13.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:13 smithi106 bash[18459]: audit 2024-02-13T00:48:12.436662+0000 mon.a (mon.0) 2903 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-114"}]: dispatch 2024-02-13T00:48:13.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:13 smithi106 bash[18459]: cluster 2024-02-13T00:48:12.452320+0000 mgr.y (mgr.24461) 713 : cluster [DBG] pgmap v1070: 204 pgs: 204 active+clean; 5.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:48:13.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:13 smithi106 bash[18459]: cluster 2024-02-13T00:48:13.427405+0000 mon.a (mon.0) 2904 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:48:13.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:13 smithi106 bash[18459]: audit 2024-02-13T00:48:13.435739+0000 mon.a (mon.0) 2905 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-114"}]': finished 2024-02-13T00:48:13.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:13 smithi106 bash[18459]: cluster 2024-02-13T00:48:13.435851+0000 mon.a (mon.0) 2906 : cluster [DBG] osdmap e592: 8 total, 8 up, 8 in 2024-02-13T00:48:13.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:13 smithi080 bash[24237]: audit 2024-02-13T00:48:12.434380+0000 mon.a (mon.0) 2901 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:48:13.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:13 smithi080 bash[24237]: cluster 2024-02-13T00:48:12.434486+0000 mon.a (mon.0) 2902 : cluster [DBG] osdmap e591: 8 total, 8 up, 8 in 2024-02-13T00:48:13.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:13 smithi080 bash[24237]: audit 2024-02-13T00:48:12.436100+0000 mon.c (mon.2) 437 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-114"}]: dispatch 2024-02-13T00:48:13.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:13 smithi080 bash[24237]: audit 2024-02-13T00:48:12.436662+0000 mon.a (mon.0) 2903 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-114"}]: dispatch 2024-02-13T00:48:13.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:13 smithi080 bash[24237]: cluster 2024-02-13T00:48:12.452320+0000 mgr.y (mgr.24461) 713 : cluster [DBG] pgmap v1070: 204 pgs: 204 active+clean; 5.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:48:13.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:13 smithi080 bash[24237]: cluster 2024-02-13T00:48:13.427405+0000 mon.a (mon.0) 2904 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:48:13.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:13 smithi080 bash[24237]: audit 2024-02-13T00:48:13.435739+0000 mon.a (mon.0) 2905 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-114"}]': finished 2024-02-13T00:48:13.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:13 smithi080 bash[24237]: cluster 2024-02-13T00:48:13.435851+0000 mon.a (mon.0) 2906 : cluster [DBG] osdmap e592: 8 total, 8 up, 8 in 2024-02-13T00:48:13.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:13 smithi080 bash[17386]: audit 2024-02-13T00:48:12.434380+0000 mon.a (mon.0) 2901 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:48:13.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:13 smithi080 bash[17386]: cluster 2024-02-13T00:48:12.434486+0000 mon.a (mon.0) 2902 : cluster [DBG] osdmap e591: 8 total, 8 up, 8 in 2024-02-13T00:48:13.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:13 smithi080 bash[17386]: audit 2024-02-13T00:48:12.436100+0000 mon.c (mon.2) 437 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-114"}]: dispatch 2024-02-13T00:48:13.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:13 smithi080 bash[17386]: audit 2024-02-13T00:48:12.436662+0000 mon.a (mon.0) 2903 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-114"}]: dispatch 2024-02-13T00:48:13.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:13 smithi080 bash[17386]: cluster 2024-02-13T00:48:12.452320+0000 mgr.y (mgr.24461) 713 : cluster [DBG] pgmap v1070: 204 pgs: 204 active+clean; 5.8 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:48:13.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:13 smithi080 bash[17386]: cluster 2024-02-13T00:48:13.427405+0000 mon.a (mon.0) 2904 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:48:13.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:13 smithi080 bash[17386]: audit 2024-02-13T00:48:13.435739+0000 mon.a (mon.0) 2905 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-114"}]': finished 2024-02-13T00:48:13.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:13 smithi080 bash[17386]: cluster 2024-02-13T00:48:13.435851+0000 mon.a (mon.0) 2906 : cluster [DBG] osdmap e592: 8 total, 8 up, 8 in 2024-02-13T00:48:15.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:15 smithi106 bash[18459]: cluster 2024-02-13T00:48:14.453255+0000 mgr.y (mgr.24461) 714 : cluster [DBG] pgmap v1073: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:48:15.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:15 smithi106 bash[18459]: cluster 2024-02-13T00:48:14.455196+0000 mon.a (mon.0) 2907 : cluster [DBG] osdmap e593: 8 total, 8 up, 8 in 2024-02-13T00:48:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:15 smithi080 bash[17386]: cluster 2024-02-13T00:48:14.453255+0000 mgr.y (mgr.24461) 714 : cluster [DBG] pgmap v1073: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:48:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:15 smithi080 bash[17386]: cluster 2024-02-13T00:48:14.455196+0000 mon.a (mon.0) 2907 : cluster [DBG] osdmap e593: 8 total, 8 up, 8 in 2024-02-13T00:48:15.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:15 smithi080 bash[24237]: cluster 2024-02-13T00:48:14.453255+0000 mgr.y (mgr.24461) 714 : cluster [DBG] pgmap v1073: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:48:15.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:15 smithi080 bash[24237]: cluster 2024-02-13T00:48:14.455196+0000 mon.a (mon.0) 2907 : cluster [DBG] osdmap e593: 8 total, 8 up, 8 in 2024-02-13T00:48:16.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:16 smithi106 bash[18459]: cluster 2024-02-13T00:48:15.464303+0000 mon.a (mon.0) 2908 : cluster [DBG] osdmap e594: 8 total, 8 up, 8 in 2024-02-13T00:48:16.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:16 smithi106 bash[18459]: audit 2024-02-13T00:48:15.467573+0000 mon.c (mon.2) 438 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:16.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:16 smithi106 bash[18459]: audit 2024-02-13T00:48:15.472345+0000 mon.a (mon.0) 2909 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:16.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:16 smithi080 bash[17386]: cluster 2024-02-13T00:48:15.464303+0000 mon.a (mon.0) 2908 : cluster [DBG] osdmap e594: 8 total, 8 up, 8 in 2024-02-13T00:48:16.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:16 smithi080 bash[17386]: audit 2024-02-13T00:48:15.467573+0000 mon.c (mon.2) 438 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:16.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:16 smithi080 bash[17386]: audit 2024-02-13T00:48:15.472345+0000 mon.a (mon.0) 2909 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:16.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:16 smithi080 bash[24237]: cluster 2024-02-13T00:48:15.464303+0000 mon.a (mon.0) 2908 : cluster [DBG] osdmap e594: 8 total, 8 up, 8 in 2024-02-13T00:48:16.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:16 smithi080 bash[24237]: audit 2024-02-13T00:48:15.467573+0000 mon.c (mon.2) 438 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:16.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:16 smithi080 bash[24237]: audit 2024-02-13T00:48:15.472345+0000 mon.a (mon.0) 2909 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:17 smithi106 bash[18459]: cluster 2024-02-13T00:48:16.454145+0000 mgr.y (mgr.24461) 715 : cluster [DBG] pgmap v1075: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:48:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:17 smithi106 bash[18459]: audit 2024-02-13T00:48:16.470629+0000 mon.a (mon.0) 2910 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:48:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:17 smithi106 bash[18459]: cluster 2024-02-13T00:48:16.471238+0000 mon.a (mon.0) 2911 : cluster [DBG] osdmap e595: 8 total, 8 up, 8 in 2024-02-13T00:48:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:17 smithi106 bash[18459]: audit 2024-02-13T00:48:16.474339+0000 mon.c (mon.2) 439 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:17 smithi106 bash[18459]: audit 2024-02-13T00:48:16.475573+0000 mon.a (mon.0) 2912 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:17.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:17 smithi106 bash[18459]: audit 2024-02-13T00:48:16.928835+0000 mon.a (mon.0) 2913 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:48:17.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:17 smithi106 bash[18459]: audit 2024-02-13T00:48:17.472518+0000 mon.a (mon.0) 2914 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-116", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:48:17.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:17 smithi106 bash[18459]: cluster 2024-02-13T00:48:17.472660+0000 mon.a (mon.0) 2915 : cluster [DBG] osdmap e596: 8 total, 8 up, 8 in 2024-02-13T00:48:17.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:17 smithi106 bash[18459]: audit 2024-02-13T00:48:17.475001+0000 mon.c (mon.2) 440 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-116"}]: dispatch 2024-02-13T00:48:17.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:17 smithi106 bash[18459]: audit 2024-02-13T00:48:17.475543+0000 mon.a (mon.0) 2916 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-116"}]: dispatch 2024-02-13T00:48:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:17 smithi080 bash[17386]: cluster 2024-02-13T00:48:16.454145+0000 mgr.y (mgr.24461) 715 : cluster [DBG] pgmap v1075: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:48:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:17 smithi080 bash[17386]: audit 2024-02-13T00:48:16.470629+0000 mon.a (mon.0) 2910 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:48:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:17 smithi080 bash[17386]: cluster 2024-02-13T00:48:16.471238+0000 mon.a (mon.0) 2911 : cluster [DBG] osdmap e595: 8 total, 8 up, 8 in 2024-02-13T00:48:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:17 smithi080 bash[17386]: audit 2024-02-13T00:48:16.474339+0000 mon.c (mon.2) 439 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:17 smithi080 bash[17386]: audit 2024-02-13T00:48:16.475573+0000 mon.a (mon.0) 2912 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:17 smithi080 bash[17386]: audit 2024-02-13T00:48:16.928835+0000 mon.a (mon.0) 2913 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:48:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:17 smithi080 bash[17386]: audit 2024-02-13T00:48:17.472518+0000 mon.a (mon.0) 2914 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-116", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:48:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:17 smithi080 bash[17386]: cluster 2024-02-13T00:48:17.472660+0000 mon.a (mon.0) 2915 : cluster [DBG] osdmap e596: 8 total, 8 up, 8 in 2024-02-13T00:48:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:17 smithi080 bash[17386]: audit 2024-02-13T00:48:17.475001+0000 mon.c (mon.2) 440 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-116"}]: dispatch 2024-02-13T00:48:17.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:17 smithi080 bash[17386]: audit 2024-02-13T00:48:17.475543+0000 mon.a (mon.0) 2916 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-116"}]: dispatch 2024-02-13T00:48:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:17 smithi080 bash[24237]: cluster 2024-02-13T00:48:16.454145+0000 mgr.y (mgr.24461) 715 : cluster [DBG] pgmap v1075: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:48:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:17 smithi080 bash[24237]: audit 2024-02-13T00:48:16.470629+0000 mon.a (mon.0) 2910 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:48:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:17 smithi080 bash[24237]: cluster 2024-02-13T00:48:16.471238+0000 mon.a (mon.0) 2911 : cluster [DBG] osdmap e595: 8 total, 8 up, 8 in 2024-02-13T00:48:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:17 smithi080 bash[24237]: audit 2024-02-13T00:48:16.474339+0000 mon.c (mon.2) 439 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:17 smithi080 bash[24237]: audit 2024-02-13T00:48:16.475573+0000 mon.a (mon.0) 2912 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:17 smithi080 bash[24237]: audit 2024-02-13T00:48:16.928835+0000 mon.a (mon.0) 2913 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:48:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:17 smithi080 bash[24237]: audit 2024-02-13T00:48:17.472518+0000 mon.a (mon.0) 2914 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-116", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:48:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:17 smithi080 bash[24237]: cluster 2024-02-13T00:48:17.472660+0000 mon.a (mon.0) 2915 : cluster [DBG] osdmap e596: 8 total, 8 up, 8 in 2024-02-13T00:48:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:17 smithi080 bash[24237]: audit 2024-02-13T00:48:17.475001+0000 mon.c (mon.2) 440 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-116"}]: dispatch 2024-02-13T00:48:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:17 smithi080 bash[24237]: audit 2024-02-13T00:48:17.475543+0000 mon.a (mon.0) 2916 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-116"}]: dispatch 2024-02-13T00:48:19.006 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:48:18 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:48:19.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:19 smithi106 bash[18459]: audit 2024-02-13T00:48:18.119360+0000 mon.a (mon.0) 2917 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-116"}]': finished 2024-02-13T00:48:19.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:19 smithi106 bash[18459]: cluster 2024-02-13T00:48:18.119453+0000 mon.a (mon.0) 2918 : cluster [DBG] osdmap e597: 8 total, 8 up, 8 in 2024-02-13T00:48:19.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:19 smithi106 bash[18459]: audit 2024-02-13T00:48:18.124091+0000 mon.c (mon.2) 441 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-116", "mode": "writeback"}]: dispatch 2024-02-13T00:48:19.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:19 smithi106 bash[18459]: audit 2024-02-13T00:48:18.129852+0000 mon.a (mon.0) 2919 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-116", "mode": "writeback"}]: dispatch 2024-02-13T00:48:19.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:19 smithi080 bash[17386]: audit 2024-02-13T00:48:18.119360+0000 mon.a (mon.0) 2917 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-116"}]': finished 2024-02-13T00:48:19.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:19 smithi080 bash[17386]: cluster 2024-02-13T00:48:18.119453+0000 mon.a (mon.0) 2918 : cluster [DBG] osdmap e597: 8 total, 8 up, 8 in 2024-02-13T00:48:19.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:19 smithi080 bash[17386]: audit 2024-02-13T00:48:18.124091+0000 mon.c (mon.2) 441 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-116", "mode": "writeback"}]: dispatch 2024-02-13T00:48:19.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:19 smithi080 bash[17386]: audit 2024-02-13T00:48:18.129852+0000 mon.a (mon.0) 2919 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-116", "mode": "writeback"}]: dispatch 2024-02-13T00:48:19.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:19 smithi080 bash[24237]: audit 2024-02-13T00:48:18.119360+0000 mon.a (mon.0) 2917 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-116"}]': finished 2024-02-13T00:48:19.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:19 smithi080 bash[24237]: cluster 2024-02-13T00:48:18.119453+0000 mon.a (mon.0) 2918 : cluster [DBG] osdmap e597: 8 total, 8 up, 8 in 2024-02-13T00:48:19.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:19 smithi080 bash[24237]: audit 2024-02-13T00:48:18.124091+0000 mon.c (mon.2) 441 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-116", "mode": "writeback"}]: dispatch 2024-02-13T00:48:19.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:19 smithi080 bash[24237]: audit 2024-02-13T00:48:18.129852+0000 mon.a (mon.0) 2919 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-116", "mode": "writeback"}]: dispatch 2024-02-13T00:48:20.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:48:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:48:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:48:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:20 smithi106 bash[18459]: cluster 2024-02-13T00:48:18.454981+0000 mgr.y (mgr.24461) 716 : cluster [DBG] pgmap v1079: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:48:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:20 smithi106 bash[18459]: audit 2024-02-13T00:48:18.696575+0000 mgr.y (mgr.24461) 717 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:48:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:20 smithi106 bash[18459]: cluster 2024-02-13T00:48:19.126231+0000 mon.a (mon.0) 2920 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:48:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:20 smithi106 bash[18459]: audit 2024-02-13T00:48:19.131297+0000 mon.a (mon.0) 2921 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-116", "mode": "writeback"}]': finished 2024-02-13T00:48:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:20 smithi106 bash[18459]: cluster 2024-02-13T00:48:19.131405+0000 mon.a (mon.0) 2922 : cluster [DBG] osdmap e598: 8 total, 8 up, 8 in 2024-02-13T00:48:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:20 smithi106 bash[18459]: audit 2024-02-13T00:48:19.246234+0000 mon.c (mon.2) 442 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:20 smithi106 bash[18459]: audit 2024-02-13T00:48:19.246928+0000 mon.a (mon.0) 2923 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:20 smithi080 bash[17386]: cluster 2024-02-13T00:48:18.454981+0000 mgr.y (mgr.24461) 716 : cluster [DBG] pgmap v1079: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:48:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:20 smithi080 bash[17386]: audit 2024-02-13T00:48:18.696575+0000 mgr.y (mgr.24461) 717 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:48:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:20 smithi080 bash[17386]: cluster 2024-02-13T00:48:19.126231+0000 mon.a (mon.0) 2920 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:48:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:20 smithi080 bash[17386]: audit 2024-02-13T00:48:19.131297+0000 mon.a (mon.0) 2921 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-116", "mode": "writeback"}]': finished 2024-02-13T00:48:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:20 smithi080 bash[17386]: cluster 2024-02-13T00:48:19.131405+0000 mon.a (mon.0) 2922 : cluster [DBG] osdmap e598: 8 total, 8 up, 8 in 2024-02-13T00:48:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:20 smithi080 bash[17386]: audit 2024-02-13T00:48:19.246234+0000 mon.c (mon.2) 442 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:20 smithi080 bash[17386]: audit 2024-02-13T00:48:19.246928+0000 mon.a (mon.0) 2923 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:20.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:20 smithi080 bash[24237]: cluster 2024-02-13T00:48:18.454981+0000 mgr.y (mgr.24461) 716 : cluster [DBG] pgmap v1079: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:48:20.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:20 smithi080 bash[24237]: audit 2024-02-13T00:48:18.696575+0000 mgr.y (mgr.24461) 717 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:48:20.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:20 smithi080 bash[24237]: cluster 2024-02-13T00:48:19.126231+0000 mon.a (mon.0) 2920 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:48:20.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:20 smithi080 bash[24237]: audit 2024-02-13T00:48:19.131297+0000 mon.a (mon.0) 2921 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-116", "mode": "writeback"}]': finished 2024-02-13T00:48:20.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:20 smithi080 bash[24237]: cluster 2024-02-13T00:48:19.131405+0000 mon.a (mon.0) 2922 : cluster [DBG] osdmap e598: 8 total, 8 up, 8 in 2024-02-13T00:48:20.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:20 smithi080 bash[24237]: audit 2024-02-13T00:48:19.246234+0000 mon.c (mon.2) 442 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:20.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:20 smithi080 bash[24237]: audit 2024-02-13T00:48:19.246928+0000 mon.a (mon.0) 2923 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:21.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:21 smithi106 bash[18459]: audit 2024-02-13T00:48:20.145845+0000 mon.a (mon.0) 2924 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:48:21.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:21 smithi106 bash[18459]: cluster 2024-02-13T00:48:20.145991+0000 mon.a (mon.0) 2925 : cluster [DBG] osdmap e599: 8 total, 8 up, 8 in 2024-02-13T00:48:21.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:21 smithi106 bash[18459]: audit 2024-02-13T00:48:20.147137+0000 mon.c (mon.2) 443 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-116"}]: dispatch 2024-02-13T00:48:21.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:21 smithi106 bash[18459]: audit 2024-02-13T00:48:20.151352+0000 mon.a (mon.0) 2926 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-116"}]: dispatch 2024-02-13T00:48:21.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:21 smithi080 bash[17386]: audit 2024-02-13T00:48:20.145845+0000 mon.a (mon.0) 2924 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:48:21.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:21 smithi080 bash[17386]: cluster 2024-02-13T00:48:20.145991+0000 mon.a (mon.0) 2925 : cluster [DBG] osdmap e599: 8 total, 8 up, 8 in 2024-02-13T00:48:21.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:21 smithi080 bash[17386]: audit 2024-02-13T00:48:20.147137+0000 mon.c (mon.2) 443 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-116"}]: dispatch 2024-02-13T00:48:21.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:21 smithi080 bash[17386]: audit 2024-02-13T00:48:20.151352+0000 mon.a (mon.0) 2926 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-116"}]: dispatch 2024-02-13T00:48:21.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:21 smithi080 bash[24237]: audit 2024-02-13T00:48:20.145845+0000 mon.a (mon.0) 2924 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:48:21.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:21 smithi080 bash[24237]: cluster 2024-02-13T00:48:20.145991+0000 mon.a (mon.0) 2925 : cluster [DBG] osdmap e599: 8 total, 8 up, 8 in 2024-02-13T00:48:21.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:21 smithi080 bash[24237]: audit 2024-02-13T00:48:20.147137+0000 mon.c (mon.2) 443 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-116"}]: dispatch 2024-02-13T00:48:21.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:21 smithi080 bash[24237]: audit 2024-02-13T00:48:20.151352+0000 mon.a (mon.0) 2926 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-116"}]: dispatch 2024-02-13T00:48:22.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:22 smithi106 bash[18459]: cluster 2024-02-13T00:48:20.455730+0000 mgr.y (mgr.24461) 718 : cluster [DBG] pgmap v1082: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-13T00:48:22.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:22 smithi106 bash[18459]: cluster 2024-02-13T00:48:21.140989+0000 mon.a (mon.0) 2927 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:48:22.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:22 smithi106 bash[18459]: audit 2024-02-13T00:48:21.153505+0000 mon.a (mon.0) 2928 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-116"}]': finished 2024-02-13T00:48:22.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:22 smithi106 bash[18459]: cluster 2024-02-13T00:48:21.153844+0000 mon.a (mon.0) 2929 : cluster [DBG] osdmap e600: 8 total, 8 up, 8 in 2024-02-13T00:48:22.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:22 smithi080 bash[17386]: cluster 2024-02-13T00:48:20.455730+0000 mgr.y (mgr.24461) 718 : cluster [DBG] pgmap v1082: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-13T00:48:22.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:22 smithi080 bash[17386]: cluster 2024-02-13T00:48:21.140989+0000 mon.a (mon.0) 2927 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:48:22.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:22 smithi080 bash[17386]: audit 2024-02-13T00:48:21.153505+0000 mon.a (mon.0) 2928 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-116"}]': finished 2024-02-13T00:48:22.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:22 smithi080 bash[17386]: cluster 2024-02-13T00:48:21.153844+0000 mon.a (mon.0) 2929 : cluster [DBG] osdmap e600: 8 total, 8 up, 8 in 2024-02-13T00:48:22.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:22 smithi080 bash[24237]: cluster 2024-02-13T00:48:20.455730+0000 mgr.y (mgr.24461) 718 : cluster [DBG] pgmap v1082: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-13T00:48:22.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:22 smithi080 bash[24237]: cluster 2024-02-13T00:48:21.140989+0000 mon.a (mon.0) 2927 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:48:22.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:22 smithi080 bash[24237]: audit 2024-02-13T00:48:21.153505+0000 mon.a (mon.0) 2928 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-116"}]': finished 2024-02-13T00:48:22.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:22 smithi080 bash[24237]: cluster 2024-02-13T00:48:21.153844+0000 mon.a (mon.0) 2929 : cluster [DBG] osdmap e600: 8 total, 8 up, 8 in 2024-02-13T00:48:23.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:23 smithi106 bash[18459]: cluster 2024-02-13T00:48:22.175561+0000 mon.a (mon.0) 2930 : cluster [DBG] osdmap e601: 8 total, 8 up, 8 in 2024-02-13T00:48:23.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:23 smithi080 bash[17386]: cluster 2024-02-13T00:48:22.175561+0000 mon.a (mon.0) 2930 : cluster [DBG] osdmap e601: 8 total, 8 up, 8 in 2024-02-13T00:48:23.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:48:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:48:23] "GET /metrics HTTP/1.1" 200 190155 "" "Prometheus/2.33.4" 2024-02-13T00:48:23.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:23 smithi080 bash[24237]: cluster 2024-02-13T00:48:22.175561+0000 mon.a (mon.0) 2930 : cluster [DBG] osdmap e601: 8 total, 8 up, 8 in 2024-02-13T00:48:24.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:24 smithi106 bash[18459]: cluster 2024-02-13T00:48:22.456448+0000 mgr.y (mgr.24461) 719 : cluster [DBG] pgmap v1085: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:48:24.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:24 smithi106 bash[18459]: cluster 2024-02-13T00:48:23.186217+0000 mon.a (mon.0) 2931 : cluster [DBG] osdmap e602: 8 total, 8 up, 8 in 2024-02-13T00:48:24.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:24 smithi106 bash[18459]: audit 2024-02-13T00:48:23.189289+0000 mon.c (mon.2) 444 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:24.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:24 smithi106 bash[18459]: audit 2024-02-13T00:48:23.189984+0000 mon.a (mon.0) 2932 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:24 smithi080 bash[17386]: cluster 2024-02-13T00:48:22.456448+0000 mgr.y (mgr.24461) 719 : cluster [DBG] pgmap v1085: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:48:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:24 smithi080 bash[17386]: cluster 2024-02-13T00:48:23.186217+0000 mon.a (mon.0) 2931 : cluster [DBG] osdmap e602: 8 total, 8 up, 8 in 2024-02-13T00:48:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:24 smithi080 bash[17386]: audit 2024-02-13T00:48:23.189289+0000 mon.c (mon.2) 444 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:24 smithi080 bash[17386]: audit 2024-02-13T00:48:23.189984+0000 mon.a (mon.0) 2932 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:24.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:24 smithi080 bash[24237]: cluster 2024-02-13T00:48:22.456448+0000 mgr.y (mgr.24461) 719 : cluster [DBG] pgmap v1085: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:48:24.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:24 smithi080 bash[24237]: cluster 2024-02-13T00:48:23.186217+0000 mon.a (mon.0) 2931 : cluster [DBG] osdmap e602: 8 total, 8 up, 8 in 2024-02-13T00:48:24.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:24 smithi080 bash[24237]: audit 2024-02-13T00:48:23.189289+0000 mon.c (mon.2) 444 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:24.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:24 smithi080 bash[24237]: audit 2024-02-13T00:48:23.189984+0000 mon.a (mon.0) 2932 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:25.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:25 smithi106 bash[18459]: audit 2024-02-13T00:48:24.191060+0000 mon.a (mon.0) 2933 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:48:25.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:25 smithi106 bash[18459]: cluster 2024-02-13T00:48:24.191555+0000 mon.a (mon.0) 2934 : cluster [DBG] osdmap e603: 8 total, 8 up, 8 in 2024-02-13T00:48:25.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:25 smithi106 bash[18459]: audit 2024-02-13T00:48:24.206488+0000 mon.c (mon.2) 445 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:25.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:25 smithi106 bash[18459]: audit 2024-02-13T00:48:24.210555+0000 mon.a (mon.0) 2935 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:25.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:25 smithi080 bash[17386]: audit 2024-02-13T00:48:24.191060+0000 mon.a (mon.0) 2933 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:48:25.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:25 smithi080 bash[17386]: cluster 2024-02-13T00:48:24.191555+0000 mon.a (mon.0) 2934 : cluster [DBG] osdmap e603: 8 total, 8 up, 8 in 2024-02-13T00:48:25.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:25 smithi080 bash[17386]: audit 2024-02-13T00:48:24.206488+0000 mon.c (mon.2) 445 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:25.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:25 smithi080 bash[17386]: audit 2024-02-13T00:48:24.210555+0000 mon.a (mon.0) 2935 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:25.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:25 smithi080 bash[24237]: audit 2024-02-13T00:48:24.191060+0000 mon.a (mon.0) 2933 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:48:25.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:25 smithi080 bash[24237]: cluster 2024-02-13T00:48:24.191555+0000 mon.a (mon.0) 2934 : cluster [DBG] osdmap e603: 8 total, 8 up, 8 in 2024-02-13T00:48:25.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:25 smithi080 bash[24237]: audit 2024-02-13T00:48:24.206488+0000 mon.c (mon.2) 445 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:25.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:25 smithi080 bash[24237]: audit 2024-02-13T00:48:24.210555+0000 mon.a (mon.0) 2935 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:26.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:26 smithi106 bash[18459]: cluster 2024-02-13T00:48:24.457283+0000 mgr.y (mgr.24461) 720 : cluster [DBG] pgmap v1088: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:48:26.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:26 smithi106 bash[18459]: audit 2024-02-13T00:48:25.213613+0000 mon.a (mon.0) 2936 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-118", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:48:26.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:26 smithi106 bash[18459]: cluster 2024-02-13T00:48:25.213721+0000 mon.a (mon.0) 2937 : cluster [DBG] osdmap e604: 8 total, 8 up, 8 in 2024-02-13T00:48:26.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:26 smithi106 bash[18459]: audit 2024-02-13T00:48:25.215821+0000 mon.c (mon.2) 446 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-118"}]: dispatch 2024-02-13T00:48:26.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:26 smithi106 bash[18459]: audit 2024-02-13T00:48:25.216439+0000 mon.a (mon.0) 2938 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-118"}]: dispatch 2024-02-13T00:48:26.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:26 smithi080 bash[17386]: cluster 2024-02-13T00:48:24.457283+0000 mgr.y (mgr.24461) 720 : cluster [DBG] pgmap v1088: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:48:26.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:26 smithi080 bash[17386]: audit 2024-02-13T00:48:25.213613+0000 mon.a (mon.0) 2936 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-118", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:48:26.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:26 smithi080 bash[17386]: cluster 2024-02-13T00:48:25.213721+0000 mon.a (mon.0) 2937 : cluster [DBG] osdmap e604: 8 total, 8 up, 8 in 2024-02-13T00:48:26.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:26 smithi080 bash[17386]: audit 2024-02-13T00:48:25.215821+0000 mon.c (mon.2) 446 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-118"}]: dispatch 2024-02-13T00:48:26.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:26 smithi080 bash[17386]: audit 2024-02-13T00:48:25.216439+0000 mon.a (mon.0) 2938 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-118"}]: dispatch 2024-02-13T00:48:26.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:26 smithi080 bash[24237]: cluster 2024-02-13T00:48:24.457283+0000 mgr.y (mgr.24461) 720 : cluster [DBG] pgmap v1088: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:48:26.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:26 smithi080 bash[24237]: audit 2024-02-13T00:48:25.213613+0000 mon.a (mon.0) 2936 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-118", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:48:26.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:26 smithi080 bash[24237]: cluster 2024-02-13T00:48:25.213721+0000 mon.a (mon.0) 2937 : cluster [DBG] osdmap e604: 8 total, 8 up, 8 in 2024-02-13T00:48:26.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:26 smithi080 bash[24237]: audit 2024-02-13T00:48:25.215821+0000 mon.c (mon.2) 446 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-118"}]: dispatch 2024-02-13T00:48:26.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:26 smithi080 bash[24237]: audit 2024-02-13T00:48:25.216439+0000 mon.a (mon.0) 2938 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-118"}]: dispatch 2024-02-13T00:48:27.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:27 smithi106 bash[18459]: audit 2024-02-13T00:48:26.219431+0000 mon.a (mon.0) 2939 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-118"}]': finished 2024-02-13T00:48:27.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:27 smithi106 bash[18459]: cluster 2024-02-13T00:48:26.219568+0000 mon.a (mon.0) 2940 : cluster [DBG] osdmap e605: 8 total, 8 up, 8 in 2024-02-13T00:48:27.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:27 smithi106 bash[18459]: audit 2024-02-13T00:48:26.221280+0000 mon.c (mon.2) 447 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-118", "mode": "writeback"}]: dispatch 2024-02-13T00:48:27.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:27 smithi106 bash[18459]: audit 2024-02-13T00:48:26.226233+0000 mon.a (mon.0) 2941 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-118", "mode": "writeback"}]: dispatch 2024-02-13T00:48:27.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:27 smithi080 bash[17386]: audit 2024-02-13T00:48:26.219431+0000 mon.a (mon.0) 2939 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-118"}]': finished 2024-02-13T00:48:27.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:27 smithi080 bash[17386]: cluster 2024-02-13T00:48:26.219568+0000 mon.a (mon.0) 2940 : cluster [DBG] osdmap e605: 8 total, 8 up, 8 in 2024-02-13T00:48:27.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:27 smithi080 bash[17386]: audit 2024-02-13T00:48:26.221280+0000 mon.c (mon.2) 447 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-118", "mode": "writeback"}]: dispatch 2024-02-13T00:48:27.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:27 smithi080 bash[17386]: audit 2024-02-13T00:48:26.226233+0000 mon.a (mon.0) 2941 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-118", "mode": "writeback"}]: dispatch 2024-02-13T00:48:27.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:27 smithi080 bash[24237]: audit 2024-02-13T00:48:26.219431+0000 mon.a (mon.0) 2939 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-118"}]': finished 2024-02-13T00:48:27.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:27 smithi080 bash[24237]: cluster 2024-02-13T00:48:26.219568+0000 mon.a (mon.0) 2940 : cluster [DBG] osdmap e605: 8 total, 8 up, 8 in 2024-02-13T00:48:27.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:27 smithi080 bash[24237]: audit 2024-02-13T00:48:26.221280+0000 mon.c (mon.2) 447 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-118", "mode": "writeback"}]: dispatch 2024-02-13T00:48:27.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:27 smithi080 bash[24237]: audit 2024-02-13T00:48:26.226233+0000 mon.a (mon.0) 2941 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-118", "mode": "writeback"}]: dispatch 2024-02-13T00:48:28.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:28 smithi106 bash[18459]: cluster 2024-02-13T00:48:26.458175+0000 mgr.y (mgr.24461) 721 : cluster [DBG] pgmap v1091: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:48:28.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:28 smithi106 bash[18459]: cluster 2024-02-13T00:48:27.223050+0000 mon.a (mon.0) 2942 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:48:28.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:28 smithi106 bash[18459]: audit 2024-02-13T00:48:27.234757+0000 mon.a (mon.0) 2943 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-118", "mode": "writeback"}]': finished 2024-02-13T00:48:28.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:28 smithi106 bash[18459]: cluster 2024-02-13T00:48:27.234868+0000 mon.a (mon.0) 2944 : cluster [DBG] osdmap e606: 8 total, 8 up, 8 in 2024-02-13T00:48:28.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:28 smithi080 bash[17386]: cluster 2024-02-13T00:48:26.458175+0000 mgr.y (mgr.24461) 721 : cluster [DBG] pgmap v1091: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:48:28.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:28 smithi080 bash[17386]: cluster 2024-02-13T00:48:27.223050+0000 mon.a (mon.0) 2942 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:48:28.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:28 smithi080 bash[17386]: audit 2024-02-13T00:48:27.234757+0000 mon.a (mon.0) 2943 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-118", "mode": "writeback"}]': finished 2024-02-13T00:48:28.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:28 smithi080 bash[17386]: cluster 2024-02-13T00:48:27.234868+0000 mon.a (mon.0) 2944 : cluster [DBG] osdmap e606: 8 total, 8 up, 8 in 2024-02-13T00:48:28.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:28 smithi080 bash[24237]: cluster 2024-02-13T00:48:26.458175+0000 mgr.y (mgr.24461) 721 : cluster [DBG] pgmap v1091: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:48:28.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:28 smithi080 bash[24237]: cluster 2024-02-13T00:48:27.223050+0000 mon.a (mon.0) 2942 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:48:28.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:28 smithi080 bash[24237]: audit 2024-02-13T00:48:27.234757+0000 mon.a (mon.0) 2943 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-118", "mode": "writeback"}]': finished 2024-02-13T00:48:28.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:28 smithi080 bash[24237]: cluster 2024-02-13T00:48:27.234868+0000 mon.a (mon.0) 2944 : cluster [DBG] osdmap e606: 8 total, 8 up, 8 in 2024-02-13T00:48:29.005 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:48:28 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:48:30.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:48:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:48:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:48:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:30 smithi106 bash[18459]: cluster 2024-02-13T00:48:28.460026+0000 mgr.y (mgr.24461) 722 : cluster [DBG] pgmap v1093: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 479 B/s wr, 1 op/s 2024-02-13T00:48:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:30 smithi106 bash[18459]: audit 2024-02-13T00:48:28.705756+0000 mgr.y (mgr.24461) 723 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:48:30.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:30 smithi080 bash[17386]: cluster 2024-02-13T00:48:28.460026+0000 mgr.y (mgr.24461) 722 : cluster [DBG] pgmap v1093: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 479 B/s wr, 1 op/s 2024-02-13T00:48:30.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:30 smithi080 bash[17386]: audit 2024-02-13T00:48:28.705756+0000 mgr.y (mgr.24461) 723 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:48:30.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:30 smithi080 bash[24237]: cluster 2024-02-13T00:48:28.460026+0000 mgr.y (mgr.24461) 722 : cluster [DBG] pgmap v1093: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 479 B/s wr, 1 op/s 2024-02-13T00:48:30.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:30 smithi080 bash[24237]: audit 2024-02-13T00:48:28.705756+0000 mgr.y (mgr.24461) 723 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:48:32.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:32 smithi106 bash[18459]: cluster 2024-02-13T00:48:30.460864+0000 mgr.y (mgr.24461) 724 : cluster [DBG] pgmap v1094: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 341 B/s wr, 1 op/s 2024-02-13T00:48:32.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:32 smithi106 bash[18459]: audit 2024-02-13T00:48:31.928487+0000 mon.a (mon.0) 2945 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:48:32.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:32 smithi080 bash[17386]: cluster 2024-02-13T00:48:30.460864+0000 mgr.y (mgr.24461) 724 : cluster [DBG] pgmap v1094: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 341 B/s wr, 1 op/s 2024-02-13T00:48:32.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:32 smithi080 bash[17386]: audit 2024-02-13T00:48:31.928487+0000 mon.a (mon.0) 2945 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:48:32.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:32 smithi080 bash[24237]: cluster 2024-02-13T00:48:30.460864+0000 mgr.y (mgr.24461) 724 : cluster [DBG] pgmap v1094: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 341 B/s wr, 1 op/s 2024-02-13T00:48:32.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:32 smithi080 bash[24237]: audit 2024-02-13T00:48:31.928487+0000 mon.a (mon.0) 2945 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:48:33.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:33 smithi106 bash[18459]: audit 2024-02-13T00:48:32.341209+0000 mon.c (mon.2) 448 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:33.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:33 smithi106 bash[18459]: audit 2024-02-13T00:48:32.341809+0000 mon.a (mon.0) 2946 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:33.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:33 smithi080 bash[17386]: audit 2024-02-13T00:48:32.341209+0000 mon.c (mon.2) 448 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:33.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:33 smithi080 bash[17386]: audit 2024-02-13T00:48:32.341809+0000 mon.a (mon.0) 2946 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:33.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:33 smithi080 bash[24237]: audit 2024-02-13T00:48:32.341209+0000 mon.c (mon.2) 448 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:33.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:33 smithi080 bash[24237]: audit 2024-02-13T00:48:32.341809+0000 mon.a (mon.0) 2946 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:33.509 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:48:33 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:48:33] "GET /metrics HTTP/1.1" 200 190311 "" "Prometheus/2.33.4" 2024-02-13T00:48:34.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:34 smithi106 bash[18459]: cluster 2024-02-13T00:48:32.461704+0000 mgr.y (mgr.24461) 725 : cluster [DBG] pgmap v1095: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 847 B/s rd, 282 B/s wr, 1 op/s 2024-02-13T00:48:34.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:34 smithi106 bash[18459]: audit 2024-02-13T00:48:33.260923+0000 mon.a (mon.0) 2947 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:48:34.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:34 smithi106 bash[18459]: cluster 2024-02-13T00:48:33.261021+0000 mon.a (mon.0) 2948 : cluster [DBG] osdmap e607: 8 total, 8 up, 8 in 2024-02-13T00:48:34.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:34 smithi106 bash[18459]: audit 2024-02-13T00:48:33.267029+0000 mon.c (mon.2) 449 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-118"}]: dispatch 2024-02-13T00:48:34.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:34 smithi106 bash[18459]: audit 2024-02-13T00:48:33.267434+0000 mon.a (mon.0) 2949 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-118"}]: dispatch 2024-02-13T00:48:34.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:34 smithi080 bash[17386]: cluster 2024-02-13T00:48:32.461704+0000 mgr.y (mgr.24461) 725 : cluster [DBG] pgmap v1095: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 847 B/s rd, 282 B/s wr, 1 op/s 2024-02-13T00:48:34.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:34 smithi080 bash[17386]: audit 2024-02-13T00:48:33.260923+0000 mon.a (mon.0) 2947 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:48:34.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:34 smithi080 bash[17386]: cluster 2024-02-13T00:48:33.261021+0000 mon.a (mon.0) 2948 : cluster [DBG] osdmap e607: 8 total, 8 up, 8 in 2024-02-13T00:48:34.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:34 smithi080 bash[17386]: audit 2024-02-13T00:48:33.267029+0000 mon.c (mon.2) 449 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-118"}]: dispatch 2024-02-13T00:48:34.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:34 smithi080 bash[17386]: audit 2024-02-13T00:48:33.267434+0000 mon.a (mon.0) 2949 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-118"}]: dispatch 2024-02-13T00:48:34.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:34 smithi080 bash[24237]: cluster 2024-02-13T00:48:32.461704+0000 mgr.y (mgr.24461) 725 : cluster [DBG] pgmap v1095: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 847 B/s rd, 282 B/s wr, 1 op/s 2024-02-13T00:48:34.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:34 smithi080 bash[24237]: audit 2024-02-13T00:48:33.260923+0000 mon.a (mon.0) 2947 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:48:34.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:34 smithi080 bash[24237]: cluster 2024-02-13T00:48:33.261021+0000 mon.a (mon.0) 2948 : cluster [DBG] osdmap e607: 8 total, 8 up, 8 in 2024-02-13T00:48:34.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:34 smithi080 bash[24237]: audit 2024-02-13T00:48:33.267029+0000 mon.c (mon.2) 449 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-118"}]: dispatch 2024-02-13T00:48:34.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:34 smithi080 bash[24237]: audit 2024-02-13T00:48:33.267434+0000 mon.a (mon.0) 2949 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-118"}]: dispatch 2024-02-13T00:48:35.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:35 smithi106 bash[18459]: cluster 2024-02-13T00:48:34.258076+0000 mon.a (mon.0) 2950 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:48:35.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:35 smithi106 bash[18459]: audit 2024-02-13T00:48:34.266065+0000 mon.a (mon.0) 2951 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-118"}]': finished 2024-02-13T00:48:35.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:35 smithi106 bash[18459]: cluster 2024-02-13T00:48:34.266191+0000 mon.a (mon.0) 2952 : cluster [DBG] osdmap e608: 8 total, 8 up, 8 in 2024-02-13T00:48:35.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:35 smithi080 bash[17386]: cluster 2024-02-13T00:48:34.258076+0000 mon.a (mon.0) 2950 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:48:35.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:35 smithi080 bash[17386]: audit 2024-02-13T00:48:34.266065+0000 mon.a (mon.0) 2951 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-118"}]': finished 2024-02-13T00:48:35.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:35 smithi080 bash[17386]: cluster 2024-02-13T00:48:34.266191+0000 mon.a (mon.0) 2952 : cluster [DBG] osdmap e608: 8 total, 8 up, 8 in 2024-02-13T00:48:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:35 smithi080 bash[24237]: cluster 2024-02-13T00:48:34.258076+0000 mon.a (mon.0) 2950 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:48:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:35 smithi080 bash[24237]: audit 2024-02-13T00:48:34.266065+0000 mon.a (mon.0) 2951 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-118"}]': finished 2024-02-13T00:48:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:35 smithi080 bash[24237]: cluster 2024-02-13T00:48:34.266191+0000 mon.a (mon.0) 2952 : cluster [DBG] osdmap e608: 8 total, 8 up, 8 in 2024-02-13T00:48:36.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:36 smithi106 bash[18459]: cluster 2024-02-13T00:48:34.462464+0000 mgr.y (mgr.24461) 726 : cluster [DBG] pgmap v1098: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 283 B/s wr, 2 op/s 2024-02-13T00:48:36.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:36 smithi106 bash[18459]: cluster 2024-02-13T00:48:35.283653+0000 mon.a (mon.0) 2953 : cluster [DBG] osdmap e609: 8 total, 8 up, 8 in 2024-02-13T00:48:36.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:36 smithi080 bash[24237]: cluster 2024-02-13T00:48:34.462464+0000 mgr.y (mgr.24461) 726 : cluster [DBG] pgmap v1098: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 283 B/s wr, 2 op/s 2024-02-13T00:48:36.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:36 smithi080 bash[24237]: cluster 2024-02-13T00:48:35.283653+0000 mon.a (mon.0) 2953 : cluster [DBG] osdmap e609: 8 total, 8 up, 8 in 2024-02-13T00:48:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:36 smithi080 bash[17386]: cluster 2024-02-13T00:48:34.462464+0000 mgr.y (mgr.24461) 726 : cluster [DBG] pgmap v1098: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.5 KiB/s rd, 283 B/s wr, 2 op/s 2024-02-13T00:48:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:36 smithi080 bash[17386]: cluster 2024-02-13T00:48:35.283653+0000 mon.a (mon.0) 2953 : cluster [DBG] osdmap e609: 8 total, 8 up, 8 in 2024-02-13T00:48:37.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:37 smithi106 bash[18459]: cluster 2024-02-13T00:48:36.293739+0000 mon.a (mon.0) 2954 : cluster [DBG] osdmap e610: 8 total, 8 up, 8 in 2024-02-13T00:48:37.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:37 smithi106 bash[18459]: audit 2024-02-13T00:48:36.296312+0000 mon.c (mon.2) 450 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:37.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:37 smithi106 bash[18459]: audit 2024-02-13T00:48:36.296918+0000 mon.a (mon.0) 2955 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:37.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:37 smithi106 bash[18459]: cluster 2024-02-13T00:48:36.463314+0000 mgr.y (mgr.24461) 727 : cluster [DBG] pgmap v1101: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:48:37.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:37 smithi080 bash[24237]: cluster 2024-02-13T00:48:36.293739+0000 mon.a (mon.0) 2954 : cluster [DBG] osdmap e610: 8 total, 8 up, 8 in 2024-02-13T00:48:37.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:37 smithi080 bash[24237]: audit 2024-02-13T00:48:36.296312+0000 mon.c (mon.2) 450 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:37.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:37 smithi080 bash[24237]: audit 2024-02-13T00:48:36.296918+0000 mon.a (mon.0) 2955 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:37.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:37 smithi080 bash[24237]: cluster 2024-02-13T00:48:36.463314+0000 mgr.y (mgr.24461) 727 : cluster [DBG] pgmap v1101: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:48:37.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:37 smithi080 bash[17386]: cluster 2024-02-13T00:48:36.293739+0000 mon.a (mon.0) 2954 : cluster [DBG] osdmap e610: 8 total, 8 up, 8 in 2024-02-13T00:48:37.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:37 smithi080 bash[17386]: audit 2024-02-13T00:48:36.296312+0000 mon.c (mon.2) 450 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:37.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:37 smithi080 bash[17386]: audit 2024-02-13T00:48:36.296918+0000 mon.a (mon.0) 2955 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:37.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:37 smithi080 bash[17386]: cluster 2024-02-13T00:48:36.463314+0000 mgr.y (mgr.24461) 727 : cluster [DBG] pgmap v1101: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:48:38.721 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:38 smithi106 bash[18459]: audit 2024-02-13T00:48:37.305108+0000 mon.a (mon.0) 2956 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:48:38.721 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:38 smithi106 bash[18459]: cluster 2024-02-13T00:48:37.305491+0000 mon.a (mon.0) 2957 : cluster [DBG] osdmap e611: 8 total, 8 up, 8 in 2024-02-13T00:48:38.721 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:38 smithi106 bash[18459]: audit 2024-02-13T00:48:37.311234+0000 mon.c (mon.2) 451 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:38.721 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:38 smithi106 bash[18459]: audit 2024-02-13T00:48:37.315579+0000 mon.a (mon.0) 2958 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:38.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:38 smithi080 bash[17386]: audit 2024-02-13T00:48:37.305108+0000 mon.a (mon.0) 2956 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:48:38.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:38 smithi080 bash[17386]: cluster 2024-02-13T00:48:37.305491+0000 mon.a (mon.0) 2957 : cluster [DBG] osdmap e611: 8 total, 8 up, 8 in 2024-02-13T00:48:38.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:38 smithi080 bash[17386]: audit 2024-02-13T00:48:37.311234+0000 mon.c (mon.2) 451 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:38.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:38 smithi080 bash[17386]: audit 2024-02-13T00:48:37.315579+0000 mon.a (mon.0) 2958 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:38.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:38 smithi080 bash[24237]: audit 2024-02-13T00:48:37.305108+0000 mon.a (mon.0) 2956 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:48:38.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:38 smithi080 bash[24237]: cluster 2024-02-13T00:48:37.305491+0000 mon.a (mon.0) 2957 : cluster [DBG] osdmap e611: 8 total, 8 up, 8 in 2024-02-13T00:48:38.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:38 smithi080 bash[24237]: audit 2024-02-13T00:48:37.311234+0000 mon.c (mon.2) 451 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:38.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:38 smithi080 bash[24237]: audit 2024-02-13T00:48:37.315579+0000 mon.a (mon.0) 2958 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:39.006 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:48:38 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:48:39.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:39 smithi106 bash[18459]: audit 2024-02-13T00:48:38.308475+0000 mon.a (mon.0) 2959 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-120", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:48:39.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:39 smithi106 bash[18459]: cluster 2024-02-13T00:48:38.308593+0000 mon.a (mon.0) 2960 : cluster [DBG] osdmap e612: 8 total, 8 up, 8 in 2024-02-13T00:48:39.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:39 smithi106 bash[18459]: audit 2024-02-13T00:48:38.310655+0000 mon.c (mon.2) 452 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-120"}]: dispatch 2024-02-13T00:48:39.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:39 smithi106 bash[18459]: audit 2024-02-13T00:48:38.317475+0000 mon.a (mon.0) 2961 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-120"}]: dispatch 2024-02-13T00:48:39.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:39 smithi106 bash[18459]: cluster 2024-02-13T00:48:38.464123+0000 mgr.y (mgr.24461) 728 : cluster [DBG] pgmap v1104: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:48:39.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:39 smithi106 bash[18459]: audit 2024-02-13T00:48:38.717241+0000 mgr.y (mgr.24461) 729 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:48:39.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:39 smithi080 bash[17386]: audit 2024-02-13T00:48:38.308475+0000 mon.a (mon.0) 2959 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-120", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:48:39.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:39 smithi080 bash[17386]: cluster 2024-02-13T00:48:38.308593+0000 mon.a (mon.0) 2960 : cluster [DBG] osdmap e612: 8 total, 8 up, 8 in 2024-02-13T00:48:39.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:39 smithi080 bash[17386]: audit 2024-02-13T00:48:38.310655+0000 mon.c (mon.2) 452 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-120"}]: dispatch 2024-02-13T00:48:39.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:39 smithi080 bash[17386]: audit 2024-02-13T00:48:38.317475+0000 mon.a (mon.0) 2961 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-120"}]: dispatch 2024-02-13T00:48:39.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:39 smithi080 bash[17386]: cluster 2024-02-13T00:48:38.464123+0000 mgr.y (mgr.24461) 728 : cluster [DBG] pgmap v1104: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:48:39.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:39 smithi080 bash[17386]: audit 2024-02-13T00:48:38.717241+0000 mgr.y (mgr.24461) 729 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:48:39.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:39 smithi080 bash[24237]: audit 2024-02-13T00:48:38.308475+0000 mon.a (mon.0) 2959 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-120", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:48:39.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:39 smithi080 bash[24237]: cluster 2024-02-13T00:48:38.308593+0000 mon.a (mon.0) 2960 : cluster [DBG] osdmap e612: 8 total, 8 up, 8 in 2024-02-13T00:48:39.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:39 smithi080 bash[24237]: audit 2024-02-13T00:48:38.310655+0000 mon.c (mon.2) 452 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-120"}]: dispatch 2024-02-13T00:48:39.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:39 smithi080 bash[24237]: audit 2024-02-13T00:48:38.317475+0000 mon.a (mon.0) 2961 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-120"}]: dispatch 2024-02-13T00:48:39.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:39 smithi080 bash[24237]: cluster 2024-02-13T00:48:38.464123+0000 mgr.y (mgr.24461) 728 : cluster [DBG] pgmap v1104: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:48:39.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:39 smithi080 bash[24237]: audit 2024-02-13T00:48:38.717241+0000 mgr.y (mgr.24461) 729 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:48:40.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:48:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:48:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:48:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:40 smithi106 bash[18459]: audit 2024-02-13T00:48:39.321982+0000 mon.a (mon.0) 2962 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-120"}]': finished 2024-02-13T00:48:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:40 smithi106 bash[18459]: cluster 2024-02-13T00:48:39.322372+0000 mon.a (mon.0) 2963 : cluster [DBG] osdmap e613: 8 total, 8 up, 8 in 2024-02-13T00:48:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:40 smithi106 bash[18459]: audit 2024-02-13T00:48:39.323451+0000 mon.c (mon.2) 453 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-120", "mode": "writeback"}]: dispatch 2024-02-13T00:48:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:40 smithi106 bash[18459]: audit 2024-02-13T00:48:39.324311+0000 mon.a (mon.0) 2964 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-120", "mode": "writeback"}]: dispatch 2024-02-13T00:48:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:40 smithi106 bash[18459]: cluster 2024-02-13T00:48:40.314900+0000 mon.a (mon.0) 2965 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:48:40.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:40 smithi080 bash[17386]: audit 2024-02-13T00:48:39.321982+0000 mon.a (mon.0) 2962 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-120"}]': finished 2024-02-13T00:48:40.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:40 smithi080 bash[17386]: cluster 2024-02-13T00:48:39.322372+0000 mon.a (mon.0) 2963 : cluster [DBG] osdmap e613: 8 total, 8 up, 8 in 2024-02-13T00:48:40.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:40 smithi080 bash[17386]: audit 2024-02-13T00:48:39.323451+0000 mon.c (mon.2) 453 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-120", "mode": "writeback"}]: dispatch 2024-02-13T00:48:40.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:40 smithi080 bash[17386]: audit 2024-02-13T00:48:39.324311+0000 mon.a (mon.0) 2964 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-120", "mode": "writeback"}]: dispatch 2024-02-13T00:48:40.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:40 smithi080 bash[17386]: cluster 2024-02-13T00:48:40.314900+0000 mon.a (mon.0) 2965 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:48:40.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:40 smithi080 bash[24237]: audit 2024-02-13T00:48:39.321982+0000 mon.a (mon.0) 2962 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-120"}]': finished 2024-02-13T00:48:40.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:40 smithi080 bash[24237]: cluster 2024-02-13T00:48:39.322372+0000 mon.a (mon.0) 2963 : cluster [DBG] osdmap e613: 8 total, 8 up, 8 in 2024-02-13T00:48:40.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:40 smithi080 bash[24237]: audit 2024-02-13T00:48:39.323451+0000 mon.c (mon.2) 453 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-120", "mode": "writeback"}]: dispatch 2024-02-13T00:48:40.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:40 smithi080 bash[24237]: audit 2024-02-13T00:48:39.324311+0000 mon.a (mon.0) 2964 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-120", "mode": "writeback"}]: dispatch 2024-02-13T00:48:40.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:40 smithi080 bash[24237]: cluster 2024-02-13T00:48:40.314900+0000 mon.a (mon.0) 2965 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:48:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:41 smithi106 bash[18459]: audit 2024-02-13T00:48:40.327121+0000 mon.a (mon.0) 2966 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-120", "mode": "writeback"}]': finished 2024-02-13T00:48:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:41 smithi106 bash[18459]: cluster 2024-02-13T00:48:40.327276+0000 mon.a (mon.0) 2967 : cluster [DBG] osdmap e614: 8 total, 8 up, 8 in 2024-02-13T00:48:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:41 smithi106 bash[18459]: audit 2024-02-13T00:48:40.461555+0000 mon.c (mon.2) 454 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:41 smithi106 bash[18459]: audit 2024-02-13T00:48:40.462266+0000 mon.a (mon.0) 2968 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:41 smithi106 bash[18459]: cluster 2024-02-13T00:48:40.464830+0000 mgr.y (mgr.24461) 730 : cluster [DBG] pgmap v1107: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:48:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:41 smithi080 bash[17386]: audit 2024-02-13T00:48:40.327121+0000 mon.a (mon.0) 2966 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-120", "mode": "writeback"}]': finished 2024-02-13T00:48:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:41 smithi080 bash[17386]: cluster 2024-02-13T00:48:40.327276+0000 mon.a (mon.0) 2967 : cluster [DBG] osdmap e614: 8 total, 8 up, 8 in 2024-02-13T00:48:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:41 smithi080 bash[17386]: audit 2024-02-13T00:48:40.461555+0000 mon.c (mon.2) 454 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:41 smithi080 bash[17386]: audit 2024-02-13T00:48:40.462266+0000 mon.a (mon.0) 2968 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:41 smithi080 bash[17386]: cluster 2024-02-13T00:48:40.464830+0000 mgr.y (mgr.24461) 730 : cluster [DBG] pgmap v1107: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:48:41.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:41 smithi080 bash[24237]: audit 2024-02-13T00:48:40.327121+0000 mon.a (mon.0) 2966 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-120", "mode": "writeback"}]': finished 2024-02-13T00:48:41.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:41 smithi080 bash[24237]: cluster 2024-02-13T00:48:40.327276+0000 mon.a (mon.0) 2967 : cluster [DBG] osdmap e614: 8 total, 8 up, 8 in 2024-02-13T00:48:41.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:41 smithi080 bash[24237]: audit 2024-02-13T00:48:40.461555+0000 mon.c (mon.2) 454 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:41.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:41 smithi080 bash[24237]: audit 2024-02-13T00:48:40.462266+0000 mon.a (mon.0) 2968 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:41.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:41 smithi080 bash[24237]: cluster 2024-02-13T00:48:40.464830+0000 mgr.y (mgr.24461) 730 : cluster [DBG] pgmap v1107: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:48:42.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:42 smithi106 bash[18459]: audit 2024-02-13T00:48:41.346890+0000 mon.a (mon.0) 2969 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:48:42.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:42 smithi106 bash[18459]: cluster 2024-02-13T00:48:41.346985+0000 mon.a (mon.0) 2970 : cluster [DBG] osdmap e615: 8 total, 8 up, 8 in 2024-02-13T00:48:42.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:42 smithi106 bash[18459]: audit 2024-02-13T00:48:41.352092+0000 mon.c (mon.2) 455 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-120"}]: dispatch 2024-02-13T00:48:42.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:42 smithi106 bash[18459]: audit 2024-02-13T00:48:41.352609+0000 mon.a (mon.0) 2971 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-120"}]: dispatch 2024-02-13T00:48:42.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:42 smithi080 bash[17386]: audit 2024-02-13T00:48:41.346890+0000 mon.a (mon.0) 2969 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:48:42.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:42 smithi080 bash[17386]: cluster 2024-02-13T00:48:41.346985+0000 mon.a (mon.0) 2970 : cluster [DBG] osdmap e615: 8 total, 8 up, 8 in 2024-02-13T00:48:42.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:42 smithi080 bash[17386]: audit 2024-02-13T00:48:41.352092+0000 mon.c (mon.2) 455 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-120"}]: dispatch 2024-02-13T00:48:42.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:42 smithi080 bash[17386]: audit 2024-02-13T00:48:41.352609+0000 mon.a (mon.0) 2971 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-120"}]: dispatch 2024-02-13T00:48:42.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:42 smithi080 bash[24237]: audit 2024-02-13T00:48:41.346890+0000 mon.a (mon.0) 2969 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:48:42.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:42 smithi080 bash[24237]: cluster 2024-02-13T00:48:41.346985+0000 mon.a (mon.0) 2970 : cluster [DBG] osdmap e615: 8 total, 8 up, 8 in 2024-02-13T00:48:42.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:42 smithi080 bash[24237]: audit 2024-02-13T00:48:41.352092+0000 mon.c (mon.2) 455 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-120"}]: dispatch 2024-02-13T00:48:42.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:42 smithi080 bash[24237]: audit 2024-02-13T00:48:41.352609+0000 mon.a (mon.0) 2971 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-120"}]: dispatch 2024-02-13T00:48:43.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:43 smithi080 bash[17386]: cluster 2024-02-13T00:48:42.343357+0000 mon.a (mon.0) 2972 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:48:43.368 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:43 smithi080 bash[17386]: audit 2024-02-13T00:48:42.350599+0000 mon.a (mon.0) 2973 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-120"}]': finished 2024-02-13T00:48:43.368 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:48:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:48:43] "GET /metrics HTTP/1.1" 200 190311 "" "Prometheus/2.33.4" 2024-02-13T00:48:43.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:43 smithi106 bash[18459]: cluster 2024-02-13T00:48:42.343357+0000 mon.a (mon.0) 2972 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:48:43.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:43 smithi106 bash[18459]: audit 2024-02-13T00:48:42.350599+0000 mon.a (mon.0) 2973 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-120"}]': finished 2024-02-13T00:48:43.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:43 smithi106 bash[18459]: cluster 2024-02-13T00:48:42.350759+0000 mon.a (mon.0) 2974 : cluster [DBG] osdmap e616: 8 total, 8 up, 8 in 2024-02-13T00:48:43.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:43 smithi106 bash[18459]: cluster 2024-02-13T00:48:42.465565+0000 mgr.y (mgr.24461) 731 : cluster [DBG] pgmap v1110: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:48:43.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:43 smithi080 bash[17386]: cluster 2024-02-13T00:48:42.350759+0000 mon.a (mon.0) 2974 : cluster [DBG] osdmap e616: 8 total, 8 up, 8 in 2024-02-13T00:48:43.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:43 smithi080 bash[17386]: cluster 2024-02-13T00:48:42.465565+0000 mgr.y (mgr.24461) 731 : cluster [DBG] pgmap v1110: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:48:43.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:43 smithi080 bash[24237]: cluster 2024-02-13T00:48:42.343357+0000 mon.a (mon.0) 2972 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:48:43.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:43 smithi080 bash[24237]: audit 2024-02-13T00:48:42.350599+0000 mon.a (mon.0) 2973 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-120"}]': finished 2024-02-13T00:48:43.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:43 smithi080 bash[24237]: cluster 2024-02-13T00:48:42.350759+0000 mon.a (mon.0) 2974 : cluster [DBG] osdmap e616: 8 total, 8 up, 8 in 2024-02-13T00:48:43.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:43 smithi080 bash[24237]: cluster 2024-02-13T00:48:42.465565+0000 mgr.y (mgr.24461) 731 : cluster [DBG] pgmap v1110: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:48:44.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:44 smithi106 bash[18459]: cluster 2024-02-13T00:48:43.374520+0000 mon.a (mon.0) 2975 : cluster [DBG] osdmap e617: 8 total, 8 up, 8 in 2024-02-13T00:48:44.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:44 smithi080 bash[17386]: cluster 2024-02-13T00:48:43.374520+0000 mon.a (mon.0) 2975 : cluster [DBG] osdmap e617: 8 total, 8 up, 8 in 2024-02-13T00:48:44.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:44 smithi080 bash[24237]: cluster 2024-02-13T00:48:43.374520+0000 mon.a (mon.0) 2975 : cluster [DBG] osdmap e617: 8 total, 8 up, 8 in 2024-02-13T00:48:45.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:45 smithi106 bash[18459]: cluster 2024-02-13T00:48:44.384930+0000 mon.a (mon.0) 2976 : cluster [DBG] osdmap e618: 8 total, 8 up, 8 in 2024-02-13T00:48:45.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:45 smithi106 bash[18459]: audit 2024-02-13T00:48:44.387401+0000 mon.c (mon.2) 456 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:45.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:45 smithi106 bash[18459]: audit 2024-02-13T00:48:44.388398+0000 mon.a (mon.0) 2977 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:45.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:45 smithi106 bash[18459]: cluster 2024-02-13T00:48:44.466342+0000 mgr.y (mgr.24461) 732 : cluster [DBG] pgmap v1113: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:48:45.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:45 smithi080 bash[24237]: cluster 2024-02-13T00:48:44.384930+0000 mon.a (mon.0) 2976 : cluster [DBG] osdmap e618: 8 total, 8 up, 8 in 2024-02-13T00:48:45.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:45 smithi080 bash[24237]: audit 2024-02-13T00:48:44.387401+0000 mon.c (mon.2) 456 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:45.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:45 smithi080 bash[24237]: audit 2024-02-13T00:48:44.388398+0000 mon.a (mon.0) 2977 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:45.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:45 smithi080 bash[24237]: cluster 2024-02-13T00:48:44.466342+0000 mgr.y (mgr.24461) 732 : cluster [DBG] pgmap v1113: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:48:45.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:45 smithi080 bash[17386]: cluster 2024-02-13T00:48:44.384930+0000 mon.a (mon.0) 2976 : cluster [DBG] osdmap e618: 8 total, 8 up, 8 in 2024-02-13T00:48:45.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:45 smithi080 bash[17386]: audit 2024-02-13T00:48:44.387401+0000 mon.c (mon.2) 456 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:45.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:45 smithi080 bash[17386]: audit 2024-02-13T00:48:44.388398+0000 mon.a (mon.0) 2977 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:45.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:45 smithi080 bash[17386]: cluster 2024-02-13T00:48:44.466342+0000 mgr.y (mgr.24461) 732 : cluster [DBG] pgmap v1113: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:48:46.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:46 smithi106 bash[18459]: audit 2024-02-13T00:48:45.388495+0000 mon.a (mon.0) 2978 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:48:46.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:46 smithi106 bash[18459]: cluster 2024-02-13T00:48:45.389079+0000 mon.a (mon.0) 2979 : cluster [DBG] osdmap e619: 8 total, 8 up, 8 in 2024-02-13T00:48:46.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:46 smithi106 bash[18459]: audit 2024-02-13T00:48:45.392758+0000 mon.c (mon.2) 457 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:46.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:46 smithi106 bash[18459]: audit 2024-02-13T00:48:45.396398+0000 mon.a (mon.0) 2980 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:46.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:46 smithi106 bash[18459]: audit 2024-02-13T00:48:46.391015+0000 mon.a (mon.0) 2981 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-122", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:48:46.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:46 smithi106 bash[18459]: cluster 2024-02-13T00:48:46.391215+0000 mon.a (mon.0) 2982 : cluster [DBG] osdmap e620: 8 total, 8 up, 8 in 2024-02-13T00:48:46.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:46 smithi106 bash[18459]: audit 2024-02-13T00:48:46.393187+0000 mon.c (mon.2) 458 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-122"}]: dispatch 2024-02-13T00:48:46.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:46 smithi106 bash[18459]: audit 2024-02-13T00:48:46.393867+0000 mon.a (mon.0) 2983 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-122"}]: dispatch 2024-02-13T00:48:46.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:46 smithi080 bash[17386]: audit 2024-02-13T00:48:45.388495+0000 mon.a (mon.0) 2978 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:48:46.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:46 smithi080 bash[17386]: cluster 2024-02-13T00:48:45.389079+0000 mon.a (mon.0) 2979 : cluster [DBG] osdmap e619: 8 total, 8 up, 8 in 2024-02-13T00:48:46.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:46 smithi080 bash[17386]: audit 2024-02-13T00:48:45.392758+0000 mon.c (mon.2) 457 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:46.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:46 smithi080 bash[17386]: audit 2024-02-13T00:48:45.396398+0000 mon.a (mon.0) 2980 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:46.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:46 smithi080 bash[17386]: audit 2024-02-13T00:48:46.391015+0000 mon.a (mon.0) 2981 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-122", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:48:46.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:46 smithi080 bash[17386]: cluster 2024-02-13T00:48:46.391215+0000 mon.a (mon.0) 2982 : cluster [DBG] osdmap e620: 8 total, 8 up, 8 in 2024-02-13T00:48:46.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:46 smithi080 bash[17386]: audit 2024-02-13T00:48:46.393187+0000 mon.c (mon.2) 458 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-122"}]: dispatch 2024-02-13T00:48:46.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:46 smithi080 bash[17386]: audit 2024-02-13T00:48:46.393867+0000 mon.a (mon.0) 2983 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-122"}]: dispatch 2024-02-13T00:48:46.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:46 smithi080 bash[24237]: audit 2024-02-13T00:48:45.388495+0000 mon.a (mon.0) 2978 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:48:46.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:46 smithi080 bash[24237]: cluster 2024-02-13T00:48:45.389079+0000 mon.a (mon.0) 2979 : cluster [DBG] osdmap e619: 8 total, 8 up, 8 in 2024-02-13T00:48:46.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:46 smithi080 bash[24237]: audit 2024-02-13T00:48:45.392758+0000 mon.c (mon.2) 457 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:46.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:46 smithi080 bash[24237]: audit 2024-02-13T00:48:45.396398+0000 mon.a (mon.0) 2980 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:48:46.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:46 smithi080 bash[24237]: audit 2024-02-13T00:48:46.391015+0000 mon.a (mon.0) 2981 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-122", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:48:46.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:46 smithi080 bash[24237]: cluster 2024-02-13T00:48:46.391215+0000 mon.a (mon.0) 2982 : cluster [DBG] osdmap e620: 8 total, 8 up, 8 in 2024-02-13T00:48:46.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:46 smithi080 bash[24237]: audit 2024-02-13T00:48:46.393187+0000 mon.c (mon.2) 458 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-122"}]: dispatch 2024-02-13T00:48:46.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:46 smithi080 bash[24237]: audit 2024-02-13T00:48:46.393867+0000 mon.a (mon.0) 2983 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-122"}]: dispatch 2024-02-13T00:48:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:47 smithi106 bash[18459]: cluster 2024-02-13T00:48:46.467178+0000 mgr.y (mgr.24461) 733 : cluster [DBG] pgmap v1116: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:48:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:47 smithi106 bash[18459]: audit 2024-02-13T00:48:46.928891+0000 mon.a (mon.0) 2984 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:48:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:47 smithi106 bash[18459]: audit 2024-02-13T00:48:47.395511+0000 mon.a (mon.0) 2985 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-122"}]': finished 2024-02-13T00:48:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:47 smithi106 bash[18459]: cluster 2024-02-13T00:48:47.395758+0000 mon.a (mon.0) 2986 : cluster [DBG] osdmap e621: 8 total, 8 up, 8 in 2024-02-13T00:48:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:47 smithi106 bash[18459]: audit 2024-02-13T00:48:47.397153+0000 mon.c (mon.2) 459 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-122", "mode": "writeback"}]: dispatch 2024-02-13T00:48:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:47 smithi106 bash[18459]: audit 2024-02-13T00:48:47.397763+0000 mon.a (mon.0) 2987 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-122", "mode": "writeback"}]: dispatch 2024-02-13T00:48:48.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:47 smithi080 bash[17386]: cluster 2024-02-13T00:48:46.467178+0000 mgr.y (mgr.24461) 733 : cluster [DBG] pgmap v1116: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:48:48.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:47 smithi080 bash[17386]: audit 2024-02-13T00:48:46.928891+0000 mon.a (mon.0) 2984 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:48:48.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:47 smithi080 bash[17386]: audit 2024-02-13T00:48:47.395511+0000 mon.a (mon.0) 2985 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-122"}]': finished 2024-02-13T00:48:48.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:47 smithi080 bash[17386]: cluster 2024-02-13T00:48:47.395758+0000 mon.a (mon.0) 2986 : cluster [DBG] osdmap e621: 8 total, 8 up, 8 in 2024-02-13T00:48:48.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:47 smithi080 bash[17386]: audit 2024-02-13T00:48:47.397153+0000 mon.c (mon.2) 459 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-122", "mode": "writeback"}]: dispatch 2024-02-13T00:48:48.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:47 smithi080 bash[17386]: audit 2024-02-13T00:48:47.397763+0000 mon.a (mon.0) 2987 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-122", "mode": "writeback"}]: dispatch 2024-02-13T00:48:48.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:47 smithi080 bash[24237]: cluster 2024-02-13T00:48:46.467178+0000 mgr.y (mgr.24461) 733 : cluster [DBG] pgmap v1116: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T00:48:48.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:47 smithi080 bash[24237]: audit 2024-02-13T00:48:46.928891+0000 mon.a (mon.0) 2984 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:48:48.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:47 smithi080 bash[24237]: audit 2024-02-13T00:48:47.395511+0000 mon.a (mon.0) 2985 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-122"}]': finished 2024-02-13T00:48:48.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:47 smithi080 bash[24237]: cluster 2024-02-13T00:48:47.395758+0000 mon.a (mon.0) 2986 : cluster [DBG] osdmap e621: 8 total, 8 up, 8 in 2024-02-13T00:48:48.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:47 smithi080 bash[24237]: audit 2024-02-13T00:48:47.397153+0000 mon.c (mon.2) 459 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-122", "mode": "writeback"}]: dispatch 2024-02-13T00:48:48.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:47 smithi080 bash[24237]: audit 2024-02-13T00:48:47.397763+0000 mon.a (mon.0) 2987 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-122", "mode": "writeback"}]: dispatch 2024-02-13T00:48:49.005 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:48:48 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:48:49.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:49 smithi106 bash[18459]: cluster 2024-02-13T00:48:48.388518+0000 mon.a (mon.0) 2988 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:48:49.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:49 smithi106 bash[18459]: audit 2024-02-13T00:48:48.396965+0000 mon.a (mon.0) 2989 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-122", "mode": "writeback"}]': finished 2024-02-13T00:48:49.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:49 smithi106 bash[18459]: cluster 2024-02-13T00:48:48.397086+0000 mon.a (mon.0) 2990 : cluster [DBG] osdmap e622: 8 total, 8 up, 8 in 2024-02-13T00:48:49.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:49 smithi080 bash[17386]: cluster 2024-02-13T00:48:48.388518+0000 mon.a (mon.0) 2988 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:48:49.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:49 smithi080 bash[17386]: audit 2024-02-13T00:48:48.396965+0000 mon.a (mon.0) 2989 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-122", "mode": "writeback"}]': finished 2024-02-13T00:48:49.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:49 smithi080 bash[17386]: cluster 2024-02-13T00:48:48.397086+0000 mon.a (mon.0) 2990 : cluster [DBG] osdmap e622: 8 total, 8 up, 8 in 2024-02-13T00:48:49.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:49 smithi080 bash[24237]: cluster 2024-02-13T00:48:48.388518+0000 mon.a (mon.0) 2988 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:48:49.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:49 smithi080 bash[24237]: audit 2024-02-13T00:48:48.396965+0000 mon.a (mon.0) 2989 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-122", "mode": "writeback"}]': finished 2024-02-13T00:48:49.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:49 smithi080 bash[24237]: cluster 2024-02-13T00:48:48.397086+0000 mon.a (mon.0) 2990 : cluster [DBG] osdmap e622: 8 total, 8 up, 8 in 2024-02-13T00:48:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:50 smithi106 bash[18459]: cluster 2024-02-13T00:48:48.468005+0000 mgr.y (mgr.24461) 734 : cluster [DBG] pgmap v1119: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:48:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:50 smithi106 bash[18459]: audit 2024-02-13T00:48:48.727043+0000 mgr.y (mgr.24461) 735 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:48:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:50 smithi106 bash[18459]: cluster 2024-02-13T00:48:49.400744+0000 mon.a (mon.0) 2991 : cluster [DBG] osdmap e623: 8 total, 8 up, 8 in 2024-02-13T00:48:50.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:48:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:48:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:48:50.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:50 smithi080 bash[17386]: cluster 2024-02-13T00:48:48.468005+0000 mgr.y (mgr.24461) 734 : cluster [DBG] pgmap v1119: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:48:50.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:50 smithi080 bash[17386]: audit 2024-02-13T00:48:48.727043+0000 mgr.y (mgr.24461) 735 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:48:50.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:50 smithi080 bash[17386]: cluster 2024-02-13T00:48:49.400744+0000 mon.a (mon.0) 2991 : cluster [DBG] osdmap e623: 8 total, 8 up, 8 in 2024-02-13T00:48:50.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:50 smithi080 bash[24237]: cluster 2024-02-13T00:48:48.468005+0000 mgr.y (mgr.24461) 734 : cluster [DBG] pgmap v1119: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:48:50.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:50 smithi080 bash[24237]: audit 2024-02-13T00:48:48.727043+0000 mgr.y (mgr.24461) 735 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:48:50.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:50 smithi080 bash[24237]: cluster 2024-02-13T00:48:49.400744+0000 mon.a (mon.0) 2991 : cluster [DBG] osdmap e623: 8 total, 8 up, 8 in 2024-02-13T00:48:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:51 smithi106 bash[18459]: cluster 2024-02-13T00:48:50.416110+0000 mon.a (mon.0) 2992 : cluster [DBG] osdmap e624: 8 total, 8 up, 8 in 2024-02-13T00:48:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:51 smithi106 bash[18459]: cluster 2024-02-13T00:48:50.468621+0000 mgr.y (mgr.24461) 736 : cluster [DBG] pgmap v1122: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:48:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:51 smithi106 bash[18459]: audit 2024-02-13T00:48:50.478606+0000 mon.c (mon.2) 460 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:51 smithi106 bash[18459]: audit 2024-02-13T00:48:50.479250+0000 mon.a (mon.0) 2993 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:51.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:51 smithi080 bash[17386]: cluster 2024-02-13T00:48:50.416110+0000 mon.a (mon.0) 2992 : cluster [DBG] osdmap e624: 8 total, 8 up, 8 in 2024-02-13T00:48:51.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:51 smithi080 bash[17386]: cluster 2024-02-13T00:48:50.468621+0000 mgr.y (mgr.24461) 736 : cluster [DBG] pgmap v1122: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:48:51.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:51 smithi080 bash[17386]: audit 2024-02-13T00:48:50.478606+0000 mon.c (mon.2) 460 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:51.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:51 smithi080 bash[17386]: audit 2024-02-13T00:48:50.479250+0000 mon.a (mon.0) 2993 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:51.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:51 smithi080 bash[24237]: cluster 2024-02-13T00:48:50.416110+0000 mon.a (mon.0) 2992 : cluster [DBG] osdmap e624: 8 total, 8 up, 8 in 2024-02-13T00:48:51.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:51 smithi080 bash[24237]: cluster 2024-02-13T00:48:50.468621+0000 mgr.y (mgr.24461) 736 : cluster [DBG] pgmap v1122: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:48:51.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:51 smithi080 bash[24237]: audit 2024-02-13T00:48:50.478606+0000 mon.c (mon.2) 460 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:51.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:51 smithi080 bash[24237]: audit 2024-02-13T00:48:50.479250+0000 mon.a (mon.0) 2993 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:52 smithi106 bash[18459]: audit 2024-02-13T00:48:51.427550+0000 mon.a (mon.0) 2994 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:48:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:52 smithi106 bash[18459]: cluster 2024-02-13T00:48:51.427636+0000 mon.a (mon.0) 2995 : cluster [DBG] osdmap e625: 8 total, 8 up, 8 in 2024-02-13T00:48:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:52 smithi106 bash[18459]: audit 2024-02-13T00:48:51.444374+0000 mon.c (mon.2) 461 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-122"}]: dispatch 2024-02-13T00:48:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:52 smithi106 bash[18459]: audit 2024-02-13T00:48:51.444835+0000 mon.a (mon.0) 2996 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-122"}]: dispatch 2024-02-13T00:48:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:52 smithi080 bash[17386]: audit 2024-02-13T00:48:51.427550+0000 mon.a (mon.0) 2994 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:48:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:52 smithi080 bash[17386]: cluster 2024-02-13T00:48:51.427636+0000 mon.a (mon.0) 2995 : cluster [DBG] osdmap e625: 8 total, 8 up, 8 in 2024-02-13T00:48:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:52 smithi080 bash[17386]: audit 2024-02-13T00:48:51.444374+0000 mon.c (mon.2) 461 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-122"}]: dispatch 2024-02-13T00:48:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:52 smithi080 bash[17386]: audit 2024-02-13T00:48:51.444835+0000 mon.a (mon.0) 2996 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-122"}]: dispatch 2024-02-13T00:48:52.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:52 smithi080 bash[24237]: audit 2024-02-13T00:48:51.427550+0000 mon.a (mon.0) 2994 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:48:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:52 smithi080 bash[24237]: cluster 2024-02-13T00:48:51.427636+0000 mon.a (mon.0) 2995 : cluster [DBG] osdmap e625: 8 total, 8 up, 8 in 2024-02-13T00:48:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:52 smithi080 bash[24237]: audit 2024-02-13T00:48:51.444374+0000 mon.c (mon.2) 461 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-122"}]: dispatch 2024-02-13T00:48:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:52 smithi080 bash[24237]: audit 2024-02-13T00:48:51.444835+0000 mon.a (mon.0) 2996 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-122"}]: dispatch 2024-02-13T00:48:53.456 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:48:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:48:53] "GET /metrics HTTP/1.1" 200 190398 "" "Prometheus/2.33.4" 2024-02-13T00:48:53.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:53 smithi106 bash[18459]: audit 2024-02-13T00:48:52.440319+0000 mon.a (mon.0) 2997 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-122"}]': finished 2024-02-13T00:48:53.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:53 smithi106 bash[18459]: cluster 2024-02-13T00:48:52.440434+0000 mon.a (mon.0) 2998 : cluster [DBG] osdmap e626: 8 total, 8 up, 8 in 2024-02-13T00:48:53.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:53 smithi106 bash[18459]: cluster 2024-02-13T00:48:52.469368+0000 mgr.y (mgr.24461) 737 : cluster [DBG] pgmap v1125: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:48:53.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:53 smithi080 bash[17386]: audit 2024-02-13T00:48:52.440319+0000 mon.a (mon.0) 2997 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-122"}]': finished 2024-02-13T00:48:53.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:53 smithi080 bash[17386]: cluster 2024-02-13T00:48:52.440434+0000 mon.a (mon.0) 2998 : cluster [DBG] osdmap e626: 8 total, 8 up, 8 in 2024-02-13T00:48:53.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:53 smithi080 bash[17386]: cluster 2024-02-13T00:48:52.469368+0000 mgr.y (mgr.24461) 737 : cluster [DBG] pgmap v1125: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:48:53.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:53 smithi080 bash[24237]: audit 2024-02-13T00:48:52.440319+0000 mon.a (mon.0) 2997 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-122"}]': finished 2024-02-13T00:48:53.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:53 smithi080 bash[24237]: cluster 2024-02-13T00:48:52.440434+0000 mon.a (mon.0) 2998 : cluster [DBG] osdmap e626: 8 total, 8 up, 8 in 2024-02-13T00:48:53.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:53 smithi080 bash[24237]: cluster 2024-02-13T00:48:52.469368+0000 mgr.y (mgr.24461) 737 : cluster [DBG] pgmap v1125: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:48:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:54 smithi106 bash[18459]: cluster 2024-02-13T00:48:53.447924+0000 mon.a (mon.0) 2999 : cluster [DBG] osdmap e627: 8 total, 8 up, 8 in 2024-02-13T00:48:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:54 smithi106 bash[18459]: audit 2024-02-13T00:48:53.478030+0000 mon.c (mon.2) 462 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:54 smithi106 bash[18459]: audit 2024-02-13T00:48:53.478492+0000 mon.a (mon.0) 3000 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:54 smithi080 bash[17386]: cluster 2024-02-13T00:48:53.447924+0000 mon.a (mon.0) 2999 : cluster [DBG] osdmap e627: 8 total, 8 up, 8 in 2024-02-13T00:48:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:54 smithi080 bash[17386]: audit 2024-02-13T00:48:53.478030+0000 mon.c (mon.2) 462 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:54 smithi080 bash[17386]: audit 2024-02-13T00:48:53.478492+0000 mon.a (mon.0) 3000 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:54.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:54 smithi080 bash[24237]: cluster 2024-02-13T00:48:53.447924+0000 mon.a (mon.0) 2999 : cluster [DBG] osdmap e627: 8 total, 8 up, 8 in 2024-02-13T00:48:54.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:54 smithi080 bash[24237]: audit 2024-02-13T00:48:53.478030+0000 mon.c (mon.2) 462 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:54.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:54 smithi080 bash[24237]: audit 2024-02-13T00:48:53.478492+0000 mon.a (mon.0) 3000 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:48:55.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:55 smithi106 bash[18459]: audit 2024-02-13T00:48:54.466571+0000 mon.a (mon.0) 3001 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:48:55.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:55 smithi106 bash[18459]: cluster 2024-02-13T00:48:54.466673+0000 mon.a (mon.0) 3002 : cluster [DBG] osdmap e628: 8 total, 8 up, 8 in 2024-02-13T00:48:55.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:55 smithi106 bash[18459]: audit 2024-02-13T00:48:54.468279+0000 mon.c (mon.2) 463 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-122"}]: dispatch 2024-02-13T00:48:55.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:55 smithi106 bash[18459]: audit 2024-02-13T00:48:54.469113+0000 mon.a (mon.0) 3003 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-122"}]: dispatch 2024-02-13T00:48:55.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:55 smithi106 bash[18459]: cluster 2024-02-13T00:48:54.470041+0000 mgr.y (mgr.24461) 738 : cluster [DBG] pgmap v1128: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-13T00:48:55.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:55 smithi106 bash[18459]: cluster 2024-02-13T00:48:55.455944+0000 mon.a (mon.0) 3004 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:48:55.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:55 smithi106 bash[18459]: audit 2024-02-13T00:48:55.463371+0000 mon.a (mon.0) 3005 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-122"}]': finished 2024-02-13T00:48:55.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:55 smithi106 bash[18459]: cluster 2024-02-13T00:48:55.463499+0000 mon.a (mon.0) 3006 : cluster [DBG] osdmap e629: 8 total, 8 up, 8 in 2024-02-13T00:48:55.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:55 smithi080 bash[24237]: audit 2024-02-13T00:48:54.466571+0000 mon.a (mon.0) 3001 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:48:55.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:55 smithi080 bash[24237]: cluster 2024-02-13T00:48:54.466673+0000 mon.a (mon.0) 3002 : cluster [DBG] osdmap e628: 8 total, 8 up, 8 in 2024-02-13T00:48:55.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:55 smithi080 bash[24237]: audit 2024-02-13T00:48:54.468279+0000 mon.c (mon.2) 463 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-122"}]: dispatch 2024-02-13T00:48:55.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:55 smithi080 bash[24237]: audit 2024-02-13T00:48:54.469113+0000 mon.a (mon.0) 3003 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-122"}]: dispatch 2024-02-13T00:48:55.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:55 smithi080 bash[24237]: cluster 2024-02-13T00:48:54.470041+0000 mgr.y (mgr.24461) 738 : cluster [DBG] pgmap v1128: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-13T00:48:55.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:55 smithi080 bash[24237]: cluster 2024-02-13T00:48:55.455944+0000 mon.a (mon.0) 3004 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:48:55.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:55 smithi080 bash[24237]: audit 2024-02-13T00:48:55.463371+0000 mon.a (mon.0) 3005 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-122"}]': finished 2024-02-13T00:48:55.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:55 smithi080 bash[24237]: cluster 2024-02-13T00:48:55.463499+0000 mon.a (mon.0) 3006 : cluster [DBG] osdmap e629: 8 total, 8 up, 8 in 2024-02-13T00:48:55.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:55 smithi080 bash[17386]: audit 2024-02-13T00:48:54.466571+0000 mon.a (mon.0) 3001 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:48:55.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:55 smithi080 bash[17386]: cluster 2024-02-13T00:48:54.466673+0000 mon.a (mon.0) 3002 : cluster [DBG] osdmap e628: 8 total, 8 up, 8 in 2024-02-13T00:48:55.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:55 smithi080 bash[17386]: audit 2024-02-13T00:48:54.468279+0000 mon.c (mon.2) 463 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-122"}]: dispatch 2024-02-13T00:48:55.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:55 smithi080 bash[17386]: audit 2024-02-13T00:48:54.469113+0000 mon.a (mon.0) 3003 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-122"}]: dispatch 2024-02-13T00:48:55.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:55 smithi080 bash[17386]: cluster 2024-02-13T00:48:54.470041+0000 mgr.y (mgr.24461) 738 : cluster [DBG] pgmap v1128: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-13T00:48:55.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:55 smithi080 bash[17386]: cluster 2024-02-13T00:48:55.455944+0000 mon.a (mon.0) 3004 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:48:55.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:55 smithi080 bash[17386]: audit 2024-02-13T00:48:55.463371+0000 mon.a (mon.0) 3005 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-122"}]': finished 2024-02-13T00:48:55.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:55 smithi080 bash[17386]: cluster 2024-02-13T00:48:55.463499+0000 mon.a (mon.0) 3006 : cluster [DBG] osdmap e629: 8 total, 8 up, 8 in 2024-02-13T00:48:57.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:56 smithi106 bash[18459]: cluster 2024-02-13T00:48:56.481118+0000 mon.a (mon.0) 3007 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:48:57.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:56 smithi106 bash[18459]: cluster 2024-02-13T00:48:56.488338+0000 mon.a (mon.0) 3008 : cluster [DBG] osdmap e630: 8 total, 8 up, 8 in 2024-02-13T00:48:57.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:56 smithi080 bash[17386]: cluster 2024-02-13T00:48:56.481118+0000 mon.a (mon.0) 3007 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:48:57.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:56 smithi080 bash[17386]: cluster 2024-02-13T00:48:56.488338+0000 mon.a (mon.0) 3008 : cluster [DBG] osdmap e630: 8 total, 8 up, 8 in 2024-02-13T00:48:57.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:56 smithi080 bash[24237]: cluster 2024-02-13T00:48:56.481118+0000 mon.a (mon.0) 3007 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:48:57.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:56 smithi080 bash[24237]: cluster 2024-02-13T00:48:56.488338+0000 mon.a (mon.0) 3008 : cluster [DBG] osdmap e630: 8 total, 8 up, 8 in 2024-02-13T00:48:58.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:57 smithi106 bash[18459]: cluster 2024-02-13T00:48:56.470787+0000 mgr.y (mgr.24461) 739 : cluster [DBG] pgmap v1130: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-13T00:48:58.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:57 smithi106 bash[18459]: cluster 2024-02-13T00:48:57.507027+0000 mon.a (mon.0) 3009 : cluster [DBG] osdmap e631: 8 total, 8 up, 8 in 2024-02-13T00:48:58.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:57 smithi106 bash[18459]: audit 2024-02-13T00:48:57.509716+0000 mon.c (mon.2) 464 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:58.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:57 smithi106 bash[18459]: audit 2024-02-13T00:48:57.510759+0000 mon.a (mon.0) 3010 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:58.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:57 smithi080 bash[17386]: cluster 2024-02-13T00:48:56.470787+0000 mgr.y (mgr.24461) 739 : cluster [DBG] pgmap v1130: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-13T00:48:58.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:57 smithi080 bash[17386]: cluster 2024-02-13T00:48:57.507027+0000 mon.a (mon.0) 3009 : cluster [DBG] osdmap e631: 8 total, 8 up, 8 in 2024-02-13T00:48:58.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:57 smithi080 bash[17386]: audit 2024-02-13T00:48:57.509716+0000 mon.c (mon.2) 464 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:58.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:57 smithi080 bash[17386]: audit 2024-02-13T00:48:57.510759+0000 mon.a (mon.0) 3010 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:58.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:57 smithi080 bash[24237]: cluster 2024-02-13T00:48:56.470787+0000 mgr.y (mgr.24461) 739 : cluster [DBG] pgmap v1130: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-13T00:48:58.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:57 smithi080 bash[24237]: cluster 2024-02-13T00:48:57.507027+0000 mon.a (mon.0) 3009 : cluster [DBG] osdmap e631: 8 total, 8 up, 8 in 2024-02-13T00:48:58.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:57 smithi080 bash[24237]: audit 2024-02-13T00:48:57.509716+0000 mon.c (mon.2) 464 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:58.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:57 smithi080 bash[24237]: audit 2024-02-13T00:48:57.510759+0000 mon.a (mon.0) 3010 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:48:59.005 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:48:58 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:49:00.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:59 smithi106 bash[18459]: cluster 2024-02-13T00:48:58.472896+0000 mgr.y (mgr.24461) 740 : cluster [DBG] pgmap v1133: 204 pgs: 32 creating+peering, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 510 B/s rd, 0 op/s 2024-02-13T00:49:00.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:59 smithi106 bash[18459]: audit 2024-02-13T00:48:58.509165+0000 mon.a (mon.0) 3011 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:49:00.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:59 smithi106 bash[18459]: cluster 2024-02-13T00:48:58.509373+0000 mon.a (mon.0) 3012 : cluster [DBG] osdmap e632: 8 total, 8 up, 8 in 2024-02-13T00:49:00.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:59 smithi106 bash[18459]: audit 2024-02-13T00:48:58.513295+0000 mon.c (mon.2) 465 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:00.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:59 smithi106 bash[18459]: audit 2024-02-13T00:48:58.514186+0000 mon.a (mon.0) 3013 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:00.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:48:59 smithi106 bash[18459]: audit 2024-02-13T00:48:58.737719+0000 mgr.y (mgr.24461) 741 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:49:00.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:59 smithi080 bash[17386]: cluster 2024-02-13T00:48:58.472896+0000 mgr.y (mgr.24461) 740 : cluster [DBG] pgmap v1133: 204 pgs: 32 creating+peering, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 510 B/s rd, 0 op/s 2024-02-13T00:49:00.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:59 smithi080 bash[17386]: audit 2024-02-13T00:48:58.509165+0000 mon.a (mon.0) 3011 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:49:00.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:59 smithi080 bash[17386]: cluster 2024-02-13T00:48:58.509373+0000 mon.a (mon.0) 3012 : cluster [DBG] osdmap e632: 8 total, 8 up, 8 in 2024-02-13T00:49:00.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:59 smithi080 bash[17386]: audit 2024-02-13T00:48:58.513295+0000 mon.c (mon.2) 465 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:00.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:59 smithi080 bash[17386]: audit 2024-02-13T00:48:58.514186+0000 mon.a (mon.0) 3013 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:00.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:48:59 smithi080 bash[17386]: audit 2024-02-13T00:48:58.737719+0000 mgr.y (mgr.24461) 741 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:49:00.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:59 smithi080 bash[24237]: cluster 2024-02-13T00:48:58.472896+0000 mgr.y (mgr.24461) 740 : cluster [DBG] pgmap v1133: 204 pgs: 32 creating+peering, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 510 B/s rd, 0 op/s 2024-02-13T00:49:00.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:59 smithi080 bash[24237]: audit 2024-02-13T00:48:58.509165+0000 mon.a (mon.0) 3011 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:49:00.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:59 smithi080 bash[24237]: cluster 2024-02-13T00:48:58.509373+0000 mon.a (mon.0) 3012 : cluster [DBG] osdmap e632: 8 total, 8 up, 8 in 2024-02-13T00:49:00.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:59 smithi080 bash[24237]: audit 2024-02-13T00:48:58.513295+0000 mon.c (mon.2) 465 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:00.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:59 smithi080 bash[24237]: audit 2024-02-13T00:48:58.514186+0000 mon.a (mon.0) 3013 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:00.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:48:59 smithi080 bash[24237]: audit 2024-02-13T00:48:58.737719+0000 mgr.y (mgr.24461) 741 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:49:00.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:49:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:49:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:49:01.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:00 smithi106 bash[18459]: audit 2024-02-13T00:48:59.508618+0000 mon.a (mon.0) 3014 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-124", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:49:01.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:00 smithi106 bash[18459]: cluster 2024-02-13T00:48:59.508805+0000 mon.a (mon.0) 3015 : cluster [DBG] osdmap e633: 8 total, 8 up, 8 in 2024-02-13T00:49:01.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:00 smithi106 bash[18459]: audit 2024-02-13T00:48:59.513471+0000 mon.c (mon.2) 466 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-124"}]: dispatch 2024-02-13T00:49:01.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:00 smithi106 bash[18459]: audit 2024-02-13T00:48:59.521084+0000 mon.a (mon.0) 3016 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-124"}]: dispatch 2024-02-13T00:49:01.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:00 smithi080 bash[17386]: audit 2024-02-13T00:48:59.508618+0000 mon.a (mon.0) 3014 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-124", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:49:01.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:00 smithi080 bash[17386]: cluster 2024-02-13T00:48:59.508805+0000 mon.a (mon.0) 3015 : cluster [DBG] osdmap e633: 8 total, 8 up, 8 in 2024-02-13T00:49:01.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:00 smithi080 bash[17386]: audit 2024-02-13T00:48:59.513471+0000 mon.c (mon.2) 466 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-124"}]: dispatch 2024-02-13T00:49:01.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:00 smithi080 bash[17386]: audit 2024-02-13T00:48:59.521084+0000 mon.a (mon.0) 3016 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-124"}]: dispatch 2024-02-13T00:49:01.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:00 smithi080 bash[24237]: audit 2024-02-13T00:48:59.508618+0000 mon.a (mon.0) 3014 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-124", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:49:01.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:00 smithi080 bash[24237]: cluster 2024-02-13T00:48:59.508805+0000 mon.a (mon.0) 3015 : cluster [DBG] osdmap e633: 8 total, 8 up, 8 in 2024-02-13T00:49:01.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:00 smithi080 bash[24237]: audit 2024-02-13T00:48:59.513471+0000 mon.c (mon.2) 466 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-124"}]: dispatch 2024-02-13T00:49:01.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:00 smithi080 bash[24237]: audit 2024-02-13T00:48:59.521084+0000 mon.a (mon.0) 3016 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-124"}]: dispatch 2024-02-13T00:49:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:01 smithi106 bash[18459]: cluster 2024-02-13T00:49:00.473845+0000 mgr.y (mgr.24461) 742 : cluster [DBG] pgmap v1136: 204 pgs: 32 creating+peering, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-02-13T00:49:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:01 smithi106 bash[18459]: audit 2024-02-13T00:49:00.524528+0000 mon.a (mon.0) 3017 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-124"}]': finished 2024-02-13T00:49:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:01 smithi106 bash[18459]: cluster 2024-02-13T00:49:00.524646+0000 mon.a (mon.0) 3018 : cluster [DBG] osdmap e634: 8 total, 8 up, 8 in 2024-02-13T00:49:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:01 smithi106 bash[18459]: audit 2024-02-13T00:49:00.525764+0000 mon.c (mon.2) 467 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-124", "mode": "writeback"}]: dispatch 2024-02-13T00:49:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:01 smithi106 bash[18459]: audit 2024-02-13T00:49:00.526766+0000 mon.a (mon.0) 3019 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-124", "mode": "writeback"}]: dispatch 2024-02-13T00:49:02.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:01 smithi106 bash[18459]: cluster 2024-02-13T00:49:01.518609+0000 mon.a (mon.0) 3020 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:49:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:01 smithi080 bash[17386]: cluster 2024-02-13T00:49:00.473845+0000 mgr.y (mgr.24461) 742 : cluster [DBG] pgmap v1136: 204 pgs: 32 creating+peering, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-02-13T00:49:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:01 smithi080 bash[17386]: audit 2024-02-13T00:49:00.524528+0000 mon.a (mon.0) 3017 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-124"}]': finished 2024-02-13T00:49:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:01 smithi080 bash[17386]: cluster 2024-02-13T00:49:00.524646+0000 mon.a (mon.0) 3018 : cluster [DBG] osdmap e634: 8 total, 8 up, 8 in 2024-02-13T00:49:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:01 smithi080 bash[17386]: audit 2024-02-13T00:49:00.525764+0000 mon.c (mon.2) 467 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-124", "mode": "writeback"}]: dispatch 2024-02-13T00:49:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:01 smithi080 bash[17386]: audit 2024-02-13T00:49:00.526766+0000 mon.a (mon.0) 3019 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-124", "mode": "writeback"}]: dispatch 2024-02-13T00:49:02.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:01 smithi080 bash[17386]: cluster 2024-02-13T00:49:01.518609+0000 mon.a (mon.0) 3020 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:49:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:01 smithi080 bash[24237]: cluster 2024-02-13T00:49:00.473845+0000 mgr.y (mgr.24461) 742 : cluster [DBG] pgmap v1136: 204 pgs: 32 creating+peering, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-02-13T00:49:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:01 smithi080 bash[24237]: audit 2024-02-13T00:49:00.524528+0000 mon.a (mon.0) 3017 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-124"}]': finished 2024-02-13T00:49:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:01 smithi080 bash[24237]: cluster 2024-02-13T00:49:00.524646+0000 mon.a (mon.0) 3018 : cluster [DBG] osdmap e634: 8 total, 8 up, 8 in 2024-02-13T00:49:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:01 smithi080 bash[24237]: audit 2024-02-13T00:49:00.525764+0000 mon.c (mon.2) 467 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-124", "mode": "writeback"}]: dispatch 2024-02-13T00:49:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:01 smithi080 bash[24237]: audit 2024-02-13T00:49:00.526766+0000 mon.a (mon.0) 3019 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-124", "mode": "writeback"}]: dispatch 2024-02-13T00:49:02.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:01 smithi080 bash[24237]: cluster 2024-02-13T00:49:01.518609+0000 mon.a (mon.0) 3020 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:49:03.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:02 smithi106 bash[18459]: audit 2024-02-13T00:49:01.527251+0000 mon.a (mon.0) 3021 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-124", "mode": "writeback"}]': finished 2024-02-13T00:49:03.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:02 smithi106 bash[18459]: cluster 2024-02-13T00:49:01.527457+0000 mon.a (mon.0) 3022 : cluster [DBG] osdmap e635: 8 total, 8 up, 8 in 2024-02-13T00:49:03.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:02 smithi106 bash[18459]: audit 2024-02-13T00:49:01.595479+0000 mon.c (mon.2) 468 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:03.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:02 smithi106 bash[18459]: audit 2024-02-13T00:49:01.596020+0000 mon.a (mon.0) 3023 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:03.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:02 smithi106 bash[18459]: audit 2024-02-13T00:49:01.930352+0000 mon.a (mon.0) 3024 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:49:03.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:02 smithi080 bash[17386]: audit 2024-02-13T00:49:01.527251+0000 mon.a (mon.0) 3021 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-124", "mode": "writeback"}]': finished 2024-02-13T00:49:03.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:02 smithi080 bash[17386]: cluster 2024-02-13T00:49:01.527457+0000 mon.a (mon.0) 3022 : cluster [DBG] osdmap e635: 8 total, 8 up, 8 in 2024-02-13T00:49:03.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:02 smithi080 bash[17386]: audit 2024-02-13T00:49:01.595479+0000 mon.c (mon.2) 468 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:03.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:02 smithi080 bash[17386]: audit 2024-02-13T00:49:01.596020+0000 mon.a (mon.0) 3023 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:03.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:02 smithi080 bash[17386]: audit 2024-02-13T00:49:01.930352+0000 mon.a (mon.0) 3024 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:49:03.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:02 smithi080 bash[24237]: audit 2024-02-13T00:49:01.527251+0000 mon.a (mon.0) 3021 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-124", "mode": "writeback"}]': finished 2024-02-13T00:49:03.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:02 smithi080 bash[24237]: cluster 2024-02-13T00:49:01.527457+0000 mon.a (mon.0) 3022 : cluster [DBG] osdmap e635: 8 total, 8 up, 8 in 2024-02-13T00:49:03.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:02 smithi080 bash[24237]: audit 2024-02-13T00:49:01.595479+0000 mon.c (mon.2) 468 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:03.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:02 smithi080 bash[24237]: audit 2024-02-13T00:49:01.596020+0000 mon.a (mon.0) 3023 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:03.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:02 smithi080 bash[24237]: audit 2024-02-13T00:49:01.930352+0000 mon.a (mon.0) 3024 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:49:03.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:49:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:49:03] "GET /metrics HTTP/1.1" 200 190513 "" "Prometheus/2.33.4" 2024-02-13T00:49:04.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:03 smithi106 bash[18459]: cluster 2024-02-13T00:49:02.474693+0000 mgr.y (mgr.24461) 743 : cluster [DBG] pgmap v1139: 204 pgs: 32 creating+peering, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:49:04.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:03 smithi106 bash[18459]: audit 2024-02-13T00:49:02.548615+0000 mon.a (mon.0) 3025 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:49:04.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:03 smithi106 bash[18459]: cluster 2024-02-13T00:49:02.548668+0000 mon.a (mon.0) 3026 : cluster [DBG] osdmap e636: 8 total, 8 up, 8 in 2024-02-13T00:49:04.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:03 smithi106 bash[18459]: audit 2024-02-13T00:49:02.553500+0000 mon.c (mon.2) 469 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-124"}]: dispatch 2024-02-13T00:49:04.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:03 smithi106 bash[18459]: audit 2024-02-13T00:49:02.554733+0000 mon.a (mon.0) 3027 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-124"}]: dispatch 2024-02-13T00:49:04.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:03 smithi106 bash[18459]: cluster 2024-02-13T00:49:03.126487+0000 mon.a (mon.0) 3028 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:49:04.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:03 smithi106 bash[18459]: cluster 2024-02-13T00:49:03.127284+0000 mon.a (mon.0) 3029 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:49:04.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:03 smithi106 bash[18459]: audit 2024-02-13T00:49:03.136043+0000 mon.a (mon.0) 3030 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-124"}]': finished 2024-02-13T00:49:04.006 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:03 smithi106 bash[18459]: cluster 2024-02-13T00:49:03.136140+0000 mon.a (mon.0) 3031 : cluster [DBG] osdmap e637: 8 total, 8 up, 8 in 2024-02-13T00:49:04.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:03 smithi080 bash[17386]: cluster 2024-02-13T00:49:02.474693+0000 mgr.y (mgr.24461) 743 : cluster [DBG] pgmap v1139: 204 pgs: 32 creating+peering, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:49:04.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:03 smithi080 bash[17386]: audit 2024-02-13T00:49:02.548615+0000 mon.a (mon.0) 3025 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:49:04.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:03 smithi080 bash[17386]: cluster 2024-02-13T00:49:02.548668+0000 mon.a (mon.0) 3026 : cluster [DBG] osdmap e636: 8 total, 8 up, 8 in 2024-02-13T00:49:04.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:03 smithi080 bash[17386]: audit 2024-02-13T00:49:02.553500+0000 mon.c (mon.2) 469 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-124"}]: dispatch 2024-02-13T00:49:04.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:03 smithi080 bash[17386]: audit 2024-02-13T00:49:02.554733+0000 mon.a (mon.0) 3027 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-124"}]: dispatch 2024-02-13T00:49:04.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:03 smithi080 bash[17386]: cluster 2024-02-13T00:49:03.126487+0000 mon.a (mon.0) 3028 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:49:04.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:03 smithi080 bash[17386]: cluster 2024-02-13T00:49:03.127284+0000 mon.a (mon.0) 3029 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:49:04.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:03 smithi080 bash[17386]: audit 2024-02-13T00:49:03.136043+0000 mon.a (mon.0) 3030 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-124"}]': finished 2024-02-13T00:49:04.009 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:03 smithi080 bash[17386]: cluster 2024-02-13T00:49:03.136140+0000 mon.a (mon.0) 3031 : cluster [DBG] osdmap e637: 8 total, 8 up, 8 in 2024-02-13T00:49:04.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:03 smithi080 bash[24237]: cluster 2024-02-13T00:49:02.474693+0000 mgr.y (mgr.24461) 743 : cluster [DBG] pgmap v1139: 204 pgs: 32 creating+peering, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:49:04.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:03 smithi080 bash[24237]: audit 2024-02-13T00:49:02.548615+0000 mon.a (mon.0) 3025 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:49:04.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:03 smithi080 bash[24237]: cluster 2024-02-13T00:49:02.548668+0000 mon.a (mon.0) 3026 : cluster [DBG] osdmap e636: 8 total, 8 up, 8 in 2024-02-13T00:49:04.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:03 smithi080 bash[24237]: audit 2024-02-13T00:49:02.553500+0000 mon.c (mon.2) 469 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-124"}]: dispatch 2024-02-13T00:49:04.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:03 smithi080 bash[24237]: audit 2024-02-13T00:49:02.554733+0000 mon.a (mon.0) 3027 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-124"}]: dispatch 2024-02-13T00:49:04.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:03 smithi080 bash[24237]: cluster 2024-02-13T00:49:03.126487+0000 mon.a (mon.0) 3028 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:49:04.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:03 smithi080 bash[24237]: cluster 2024-02-13T00:49:03.127284+0000 mon.a (mon.0) 3029 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:49:04.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:03 smithi080 bash[24237]: audit 2024-02-13T00:49:03.136043+0000 mon.a (mon.0) 3030 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-124"}]': finished 2024-02-13T00:49:04.009 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:03 smithi080 bash[24237]: cluster 2024-02-13T00:49:03.136140+0000 mon.a (mon.0) 3031 : cluster [DBG] osdmap e637: 8 total, 8 up, 8 in 2024-02-13T00:49:05.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:05 smithi106 bash[18459]: cluster 2024-02-13T00:49:04.149026+0000 mon.a (mon.0) 3032 : cluster [DBG] osdmap e638: 8 total, 8 up, 8 in 2024-02-13T00:49:05.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:05 smithi080 bash[17386]: cluster 2024-02-13T00:49:04.149026+0000 mon.a (mon.0) 3032 : cluster [DBG] osdmap e638: 8 total, 8 up, 8 in 2024-02-13T00:49:05.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:05 smithi080 bash[24237]: cluster 2024-02-13T00:49:04.149026+0000 mon.a (mon.0) 3032 : cluster [DBG] osdmap e638: 8 total, 8 up, 8 in 2024-02-13T00:49:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:06 smithi106 bash[18459]: cluster 2024-02-13T00:49:04.475342+0000 mgr.y (mgr.24461) 744 : cluster [DBG] pgmap v1143: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2024-02-13T00:49:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:06 smithi106 bash[18459]: cluster 2024-02-13T00:49:05.157805+0000 mon.a (mon.0) 3033 : cluster [DBG] osdmap e639: 8 total, 8 up, 8 in 2024-02-13T00:49:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:06 smithi106 bash[18459]: audit 2024-02-13T00:49:05.162155+0000 mon.c (mon.2) 470 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:06 smithi106 bash[18459]: audit 2024-02-13T00:49:05.168903+0000 mon.a (mon.0) 3034 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:06 smithi080 bash[17386]: cluster 2024-02-13T00:49:04.475342+0000 mgr.y (mgr.24461) 744 : cluster [DBG] pgmap v1143: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2024-02-13T00:49:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:06 smithi080 bash[17386]: cluster 2024-02-13T00:49:05.157805+0000 mon.a (mon.0) 3033 : cluster [DBG] osdmap e639: 8 total, 8 up, 8 in 2024-02-13T00:49:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:06 smithi080 bash[17386]: audit 2024-02-13T00:49:05.162155+0000 mon.c (mon.2) 470 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:06 smithi080 bash[17386]: audit 2024-02-13T00:49:05.168903+0000 mon.a (mon.0) 3034 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:06.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:06 smithi080 bash[24237]: cluster 2024-02-13T00:49:04.475342+0000 mgr.y (mgr.24461) 744 : cluster [DBG] pgmap v1143: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2024-02-13T00:49:06.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:06 smithi080 bash[24237]: cluster 2024-02-13T00:49:05.157805+0000 mon.a (mon.0) 3033 : cluster [DBG] osdmap e639: 8 total, 8 up, 8 in 2024-02-13T00:49:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:06 smithi080 bash[24237]: audit 2024-02-13T00:49:05.162155+0000 mon.c (mon.2) 470 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:06.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:06 smithi080 bash[24237]: audit 2024-02-13T00:49:05.168903+0000 mon.a (mon.0) 3034 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:07.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:07 smithi106 bash[18459]: audit 2024-02-13T00:49:06.162621+0000 mon.a (mon.0) 3035 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:49:07.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:07 smithi106 bash[18459]: cluster 2024-02-13T00:49:06.162886+0000 mon.a (mon.0) 3036 : cluster [DBG] osdmap e640: 8 total, 8 up, 8 in 2024-02-13T00:49:07.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:07 smithi106 bash[18459]: audit 2024-02-13T00:49:06.186631+0000 mon.c (mon.2) 471 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:07.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:07 smithi106 bash[18459]: audit 2024-02-13T00:49:06.189478+0000 mon.a (mon.0) 3037 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:07 smithi080 bash[17386]: audit 2024-02-13T00:49:06.162621+0000 mon.a (mon.0) 3035 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:49:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:07 smithi080 bash[17386]: cluster 2024-02-13T00:49:06.162886+0000 mon.a (mon.0) 3036 : cluster [DBG] osdmap e640: 8 total, 8 up, 8 in 2024-02-13T00:49:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:07 smithi080 bash[17386]: audit 2024-02-13T00:49:06.186631+0000 mon.c (mon.2) 471 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:07 smithi080 bash[17386]: audit 2024-02-13T00:49:06.189478+0000 mon.a (mon.0) 3037 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:07.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:07 smithi080 bash[24237]: audit 2024-02-13T00:49:06.162621+0000 mon.a (mon.0) 3035 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:49:07.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:07 smithi080 bash[24237]: cluster 2024-02-13T00:49:06.162886+0000 mon.a (mon.0) 3036 : cluster [DBG] osdmap e640: 8 total, 8 up, 8 in 2024-02-13T00:49:07.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:07 smithi080 bash[24237]: audit 2024-02-13T00:49:06.186631+0000 mon.c (mon.2) 471 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:07.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:07 smithi080 bash[24237]: audit 2024-02-13T00:49:06.189478+0000 mon.a (mon.0) 3037 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:08 smithi106 bash[18459]: cluster 2024-02-13T00:49:06.476118+0000 mgr.y (mgr.24461) 745 : cluster [DBG] pgmap v1146: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2024-02-13T00:49:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:08 smithi106 bash[18459]: audit 2024-02-13T00:49:07.181997+0000 mon.a (mon.0) 3038 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-126", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:49:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:08 smithi106 bash[18459]: cluster 2024-02-13T00:49:07.182909+0000 mon.a (mon.0) 3039 : cluster [DBG] osdmap e641: 8 total, 8 up, 8 in 2024-02-13T00:49:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:08 smithi106 bash[18459]: audit 2024-02-13T00:49:07.184089+0000 mon.c (mon.2) 472 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-126"}]: dispatch 2024-02-13T00:49:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:08 smithi106 bash[18459]: audit 2024-02-13T00:49:07.185227+0000 mon.a (mon.0) 3040 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-126"}]: dispatch 2024-02-13T00:49:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:08 smithi106 bash[18459]: audit 2024-02-13T00:49:08.184578+0000 mon.a (mon.0) 3041 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-126"}]': finished 2024-02-13T00:49:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:08 smithi106 bash[18459]: cluster 2024-02-13T00:49:08.184691+0000 mon.a (mon.0) 3042 : cluster [DBG] osdmap e642: 8 total, 8 up, 8 in 2024-02-13T00:49:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:08 smithi080 bash[17386]: cluster 2024-02-13T00:49:06.476118+0000 mgr.y (mgr.24461) 745 : cluster [DBG] pgmap v1146: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2024-02-13T00:49:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:08 smithi080 bash[17386]: audit 2024-02-13T00:49:07.181997+0000 mon.a (mon.0) 3038 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-126", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:49:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:08 smithi080 bash[17386]: cluster 2024-02-13T00:49:07.182909+0000 mon.a (mon.0) 3039 : cluster [DBG] osdmap e641: 8 total, 8 up, 8 in 2024-02-13T00:49:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:08 smithi080 bash[17386]: audit 2024-02-13T00:49:07.184089+0000 mon.c (mon.2) 472 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-126"}]: dispatch 2024-02-13T00:49:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:08 smithi080 bash[17386]: audit 2024-02-13T00:49:07.185227+0000 mon.a (mon.0) 3040 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-126"}]: dispatch 2024-02-13T00:49:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:08 smithi080 bash[17386]: audit 2024-02-13T00:49:08.184578+0000 mon.a (mon.0) 3041 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-126"}]': finished 2024-02-13T00:49:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:08 smithi080 bash[17386]: cluster 2024-02-13T00:49:08.184691+0000 mon.a (mon.0) 3042 : cluster [DBG] osdmap e642: 8 total, 8 up, 8 in 2024-02-13T00:49:08.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:08 smithi080 bash[24237]: cluster 2024-02-13T00:49:06.476118+0000 mgr.y (mgr.24461) 745 : cluster [DBG] pgmap v1146: 204 pgs: 32 unknown, 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2024-02-13T00:49:08.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:08 smithi080 bash[24237]: audit 2024-02-13T00:49:07.181997+0000 mon.a (mon.0) 3038 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-126", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:49:08.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:08 smithi080 bash[24237]: cluster 2024-02-13T00:49:07.182909+0000 mon.a (mon.0) 3039 : cluster [DBG] osdmap e641: 8 total, 8 up, 8 in 2024-02-13T00:49:08.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:08 smithi080 bash[24237]: audit 2024-02-13T00:49:07.184089+0000 mon.c (mon.2) 472 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-126"}]: dispatch 2024-02-13T00:49:08.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:08 smithi080 bash[24237]: audit 2024-02-13T00:49:07.185227+0000 mon.a (mon.0) 3040 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-126"}]: dispatch 2024-02-13T00:49:08.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:08 smithi080 bash[24237]: audit 2024-02-13T00:49:08.184578+0000 mon.a (mon.0) 3041 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-126"}]': finished 2024-02-13T00:49:08.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:08 smithi080 bash[24237]: cluster 2024-02-13T00:49:08.184691+0000 mon.a (mon.0) 3042 : cluster [DBG] osdmap e642: 8 total, 8 up, 8 in 2024-02-13T00:49:09.005 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:49:08 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:49:09.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:09 smithi106 bash[18459]: audit 2024-02-13T00:49:08.185979+0000 mon.c (mon.2) 473 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-126", "mode": "writeback"}]: dispatch 2024-02-13T00:49:09.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:09 smithi106 bash[18459]: audit 2024-02-13T00:49:08.187111+0000 mon.a (mon.0) 3043 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-126", "mode": "writeback"}]: dispatch 2024-02-13T00:49:09.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:09 smithi106 bash[18459]: cluster 2024-02-13T00:49:09.178551+0000 mon.a (mon.0) 3044 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:49:09.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:09 smithi106 bash[18459]: audit 2024-02-13T00:49:09.185917+0000 mon.a (mon.0) 3045 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-126", "mode": "writeback"}]': finished 2024-02-13T00:49:09.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:09 smithi106 bash[18459]: cluster 2024-02-13T00:49:09.186049+0000 mon.a (mon.0) 3046 : cluster [DBG] osdmap e643: 8 total, 8 up, 8 in 2024-02-13T00:49:09.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:09 smithi080 bash[24237]: audit 2024-02-13T00:49:08.185979+0000 mon.c (mon.2) 473 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-126", "mode": "writeback"}]: dispatch 2024-02-13T00:49:09.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:09 smithi080 bash[24237]: audit 2024-02-13T00:49:08.187111+0000 mon.a (mon.0) 3043 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-126", "mode": "writeback"}]: dispatch 2024-02-13T00:49:09.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:09 smithi080 bash[24237]: cluster 2024-02-13T00:49:09.178551+0000 mon.a (mon.0) 3044 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:49:09.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:09 smithi080 bash[24237]: audit 2024-02-13T00:49:09.185917+0000 mon.a (mon.0) 3045 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-126", "mode": "writeback"}]': finished 2024-02-13T00:49:09.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:09 smithi080 bash[24237]: cluster 2024-02-13T00:49:09.186049+0000 mon.a (mon.0) 3046 : cluster [DBG] osdmap e643: 8 total, 8 up, 8 in 2024-02-13T00:49:09.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:09 smithi080 bash[17386]: audit 2024-02-13T00:49:08.185979+0000 mon.c (mon.2) 473 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-126", "mode": "writeback"}]: dispatch 2024-02-13T00:49:09.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:09 smithi080 bash[17386]: audit 2024-02-13T00:49:08.187111+0000 mon.a (mon.0) 3043 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-126", "mode": "writeback"}]: dispatch 2024-02-13T00:49:09.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:09 smithi080 bash[17386]: cluster 2024-02-13T00:49:09.178551+0000 mon.a (mon.0) 3044 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:49:09.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:09 smithi080 bash[17386]: audit 2024-02-13T00:49:09.185917+0000 mon.a (mon.0) 3045 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-126", "mode": "writeback"}]': finished 2024-02-13T00:49:09.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:09 smithi080 bash[17386]: cluster 2024-02-13T00:49:09.186049+0000 mon.a (mon.0) 3046 : cluster [DBG] osdmap e643: 8 total, 8 up, 8 in 2024-02-13T00:49:10.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:49:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:49:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:49:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:10 smithi106 bash[18459]: cluster 2024-02-13T00:49:08.477025+0000 mgr.y (mgr.24461) 746 : cluster [DBG] pgmap v1149: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:10 smithi106 bash[18459]: audit 2024-02-13T00:49:08.749225+0000 mgr.y (mgr.24461) 747 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:49:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:10 smithi106 bash[18459]: audit 2024-02-13T00:49:09.281755+0000 mon.c (mon.2) 474 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:10 smithi106 bash[18459]: audit 2024-02-13T00:49:09.282488+0000 mon.a (mon.0) 3047 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:10 smithi106 bash[18459]: audit 2024-02-13T00:49:09.290375+0000 mon.c (mon.2) 475 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:49:10.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:10 smithi106 bash[18459]: audit 2024-02-13T00:49:09.589287+0000 mon.c (mon.2) 476 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:49:10.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:10 smithi106 bash[18459]: audit 2024-02-13T00:49:09.590762+0000 mon.c (mon.2) 477 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:49:10.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:10 smithi106 bash[18459]: audit 2024-02-13T00:49:09.598330+0000 mon.a (mon.0) 3048 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:49:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:10 smithi080 bash[17386]: cluster 2024-02-13T00:49:08.477025+0000 mgr.y (mgr.24461) 746 : cluster [DBG] pgmap v1149: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:10 smithi080 bash[17386]: audit 2024-02-13T00:49:08.749225+0000 mgr.y (mgr.24461) 747 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:49:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:10 smithi080 bash[17386]: audit 2024-02-13T00:49:09.281755+0000 mon.c (mon.2) 474 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:10 smithi080 bash[17386]: audit 2024-02-13T00:49:09.282488+0000 mon.a (mon.0) 3047 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:10 smithi080 bash[17386]: audit 2024-02-13T00:49:09.290375+0000 mon.c (mon.2) 475 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:49:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:10 smithi080 bash[17386]: audit 2024-02-13T00:49:09.589287+0000 mon.c (mon.2) 476 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:49:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:10 smithi080 bash[17386]: audit 2024-02-13T00:49:09.590762+0000 mon.c (mon.2) 477 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:49:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:10 smithi080 bash[17386]: audit 2024-02-13T00:49:09.598330+0000 mon.a (mon.0) 3048 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:49:10.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:10 smithi080 bash[24237]: cluster 2024-02-13T00:49:08.477025+0000 mgr.y (mgr.24461) 746 : cluster [DBG] pgmap v1149: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:10.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:10 smithi080 bash[24237]: audit 2024-02-13T00:49:08.749225+0000 mgr.y (mgr.24461) 747 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:49:10.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:10 smithi080 bash[24237]: audit 2024-02-13T00:49:09.281755+0000 mon.c (mon.2) 474 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:10.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:10 smithi080 bash[24237]: audit 2024-02-13T00:49:09.282488+0000 mon.a (mon.0) 3047 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:10.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:10 smithi080 bash[24237]: audit 2024-02-13T00:49:09.290375+0000 mon.c (mon.2) 475 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:49:10.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:10 smithi080 bash[24237]: audit 2024-02-13T00:49:09.589287+0000 mon.c (mon.2) 476 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:49:10.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:10 smithi080 bash[24237]: audit 2024-02-13T00:49:09.590762+0000 mon.c (mon.2) 477 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:49:10.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:10 smithi080 bash[24237]: audit 2024-02-13T00:49:09.598330+0000 mon.a (mon.0) 3048 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:49:11.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:11 smithi106 bash[18459]: audit 2024-02-13T00:49:10.216327+0000 mon.a (mon.0) 3049 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:49:11.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:11 smithi106 bash[18459]: cluster 2024-02-13T00:49:10.216425+0000 mon.a (mon.0) 3050 : cluster [DBG] osdmap e644: 8 total, 8 up, 8 in 2024-02-13T00:49:11.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:11 smithi106 bash[18459]: audit 2024-02-13T00:49:10.224025+0000 mon.c (mon.2) 478 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-126"}]: dispatch 2024-02-13T00:49:11.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:11 smithi106 bash[18459]: audit 2024-02-13T00:49:10.224614+0000 mon.a (mon.0) 3051 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-126"}]: dispatch 2024-02-13T00:49:11.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:11 smithi080 bash[17386]: audit 2024-02-13T00:49:10.216327+0000 mon.a (mon.0) 3049 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:49:11.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:11 smithi080 bash[17386]: cluster 2024-02-13T00:49:10.216425+0000 mon.a (mon.0) 3050 : cluster [DBG] osdmap e644: 8 total, 8 up, 8 in 2024-02-13T00:49:11.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:11 smithi080 bash[17386]: audit 2024-02-13T00:49:10.224025+0000 mon.c (mon.2) 478 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-126"}]: dispatch 2024-02-13T00:49:11.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:11 smithi080 bash[17386]: audit 2024-02-13T00:49:10.224614+0000 mon.a (mon.0) 3051 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-126"}]: dispatch 2024-02-13T00:49:11.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:11 smithi080 bash[24237]: audit 2024-02-13T00:49:10.216327+0000 mon.a (mon.0) 3049 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:49:11.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:11 smithi080 bash[24237]: cluster 2024-02-13T00:49:10.216425+0000 mon.a (mon.0) 3050 : cluster [DBG] osdmap e644: 8 total, 8 up, 8 in 2024-02-13T00:49:11.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:11 smithi080 bash[24237]: audit 2024-02-13T00:49:10.224025+0000 mon.c (mon.2) 478 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-126"}]: dispatch 2024-02-13T00:49:11.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:11 smithi080 bash[24237]: audit 2024-02-13T00:49:10.224614+0000 mon.a (mon.0) 3051 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-126"}]: dispatch 2024-02-13T00:49:12.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:12 smithi106 bash[18459]: cluster 2024-02-13T00:49:10.477818+0000 mgr.y (mgr.24461) 748 : cluster [DBG] pgmap v1152: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:12.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:12 smithi106 bash[18459]: cluster 2024-02-13T00:49:11.215039+0000 mon.a (mon.0) 3052 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:49:12.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:12 smithi106 bash[18459]: audit 2024-02-13T00:49:11.227895+0000 mon.a (mon.0) 3053 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-126"}]': finished 2024-02-13T00:49:12.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:12 smithi106 bash[18459]: cluster 2024-02-13T00:49:11.227977+0000 mon.a (mon.0) 3054 : cluster [DBG] osdmap e645: 8 total, 8 up, 8 in 2024-02-13T00:49:12.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:12 smithi080 bash[17386]: cluster 2024-02-13T00:49:10.477818+0000 mgr.y (mgr.24461) 748 : cluster [DBG] pgmap v1152: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:12.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:12 smithi080 bash[17386]: cluster 2024-02-13T00:49:11.215039+0000 mon.a (mon.0) 3052 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:49:12.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:12 smithi080 bash[17386]: audit 2024-02-13T00:49:11.227895+0000 mon.a (mon.0) 3053 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-126"}]': finished 2024-02-13T00:49:12.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:12 smithi080 bash[17386]: cluster 2024-02-13T00:49:11.227977+0000 mon.a (mon.0) 3054 : cluster [DBG] osdmap e645: 8 total, 8 up, 8 in 2024-02-13T00:49:12.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:12 smithi080 bash[24237]: cluster 2024-02-13T00:49:10.477818+0000 mgr.y (mgr.24461) 748 : cluster [DBG] pgmap v1152: 204 pgs: 204 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:12.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:12 smithi080 bash[24237]: cluster 2024-02-13T00:49:11.215039+0000 mon.a (mon.0) 3052 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:49:12.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:12 smithi080 bash[24237]: audit 2024-02-13T00:49:11.227895+0000 mon.a (mon.0) 3053 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-126"}]': finished 2024-02-13T00:49:12.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:12 smithi080 bash[24237]: cluster 2024-02-13T00:49:11.227977+0000 mon.a (mon.0) 3054 : cluster [DBG] osdmap e645: 8 total, 8 up, 8 in 2024-02-13T00:49:13.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:13 smithi106 bash[18459]: cluster 2024-02-13T00:49:12.243688+0000 mon.a (mon.0) 3055 : cluster [DBG] osdmap e646: 8 total, 8 up, 8 in 2024-02-13T00:49:13.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:13 smithi080 bash[17386]: cluster 2024-02-13T00:49:12.243688+0000 mon.a (mon.0) 3055 : cluster [DBG] osdmap e646: 8 total, 8 up, 8 in 2024-02-13T00:49:13.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:49:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:49:13] "GET /metrics HTTP/1.1" 200 190513 "" "Prometheus/2.33.4" 2024-02-13T00:49:13.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:13 smithi080 bash[24237]: cluster 2024-02-13T00:49:12.243688+0000 mon.a (mon.0) 3055 : cluster [DBG] osdmap e646: 8 total, 8 up, 8 in 2024-02-13T00:49:14.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:14 smithi106 bash[18459]: cluster 2024-02-13T00:49:12.478609+0000 mgr.y (mgr.24461) 749 : cluster [DBG] pgmap v1155: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:49:14.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:14 smithi106 bash[18459]: cluster 2024-02-13T00:49:13.250657+0000 mon.a (mon.0) 3056 : cluster [DBG] osdmap e647: 8 total, 8 up, 8 in 2024-02-13T00:49:14.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:14 smithi106 bash[18459]: audit 2024-02-13T00:49:13.258692+0000 mon.c (mon.2) 479 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:14.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:14 smithi106 bash[18459]: audit 2024-02-13T00:49:13.259387+0000 mon.a (mon.0) 3057 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:14 smithi080 bash[17386]: cluster 2024-02-13T00:49:12.478609+0000 mgr.y (mgr.24461) 749 : cluster [DBG] pgmap v1155: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:49:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:14 smithi080 bash[17386]: cluster 2024-02-13T00:49:13.250657+0000 mon.a (mon.0) 3056 : cluster [DBG] osdmap e647: 8 total, 8 up, 8 in 2024-02-13T00:49:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:14 smithi080 bash[17386]: audit 2024-02-13T00:49:13.258692+0000 mon.c (mon.2) 479 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:14 smithi080 bash[17386]: audit 2024-02-13T00:49:13.259387+0000 mon.a (mon.0) 3057 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:14.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:14 smithi080 bash[24237]: cluster 2024-02-13T00:49:12.478609+0000 mgr.y (mgr.24461) 749 : cluster [DBG] pgmap v1155: 172 pgs: 172 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:49:14.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:14 smithi080 bash[24237]: cluster 2024-02-13T00:49:13.250657+0000 mon.a (mon.0) 3056 : cluster [DBG] osdmap e647: 8 total, 8 up, 8 in 2024-02-13T00:49:14.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:14 smithi080 bash[24237]: audit 2024-02-13T00:49:13.258692+0000 mon.c (mon.2) 479 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:14.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:14 smithi080 bash[24237]: audit 2024-02-13T00:49:13.259387+0000 mon.a (mon.0) 3057 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:15.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:15 smithi106 bash[18459]: audit 2024-02-13T00:49:14.268799+0000 mon.a (mon.0) 3058 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:49:15.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:15 smithi106 bash[18459]: cluster 2024-02-13T00:49:14.269026+0000 mon.a (mon.0) 3059 : cluster [DBG] osdmap e648: 8 total, 8 up, 8 in 2024-02-13T00:49:15.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:15 smithi106 bash[18459]: audit 2024-02-13T00:49:14.274409+0000 mon.c (mon.2) 480 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:15.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:15 smithi106 bash[18459]: audit 2024-02-13T00:49:14.276180+0000 mon.a (mon.0) 3060 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:15 smithi080 bash[17386]: audit 2024-02-13T00:49:14.268799+0000 mon.a (mon.0) 3058 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:49:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:15 smithi080 bash[17386]: cluster 2024-02-13T00:49:14.269026+0000 mon.a (mon.0) 3059 : cluster [DBG] osdmap e648: 8 total, 8 up, 8 in 2024-02-13T00:49:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:15 smithi080 bash[17386]: audit 2024-02-13T00:49:14.274409+0000 mon.c (mon.2) 480 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:15 smithi080 bash[17386]: audit 2024-02-13T00:49:14.276180+0000 mon.a (mon.0) 3060 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:15.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:15 smithi080 bash[24237]: audit 2024-02-13T00:49:14.268799+0000 mon.a (mon.0) 3058 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:49:15.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:15 smithi080 bash[24237]: cluster 2024-02-13T00:49:14.269026+0000 mon.a (mon.0) 3059 : cluster [DBG] osdmap e648: 8 total, 8 up, 8 in 2024-02-13T00:49:15.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:15 smithi080 bash[24237]: audit 2024-02-13T00:49:14.274409+0000 mon.c (mon.2) 480 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:15.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:15 smithi080 bash[24237]: audit 2024-02-13T00:49:14.276180+0000 mon.a (mon.0) 3060 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:16.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:16 smithi106 bash[18459]: cluster 2024-02-13T00:49:14.479456+0000 mgr.y (mgr.24461) 750 : cluster [DBG] pgmap v1158: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-13T00:49:16.762 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:16 smithi106 bash[18459]: audit 2024-02-13T00:49:15.270766+0000 mon.a (mon.0) 3061 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-128", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:49:16.762 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:16 smithi106 bash[18459]: cluster 2024-02-13T00:49:15.270862+0000 mon.a (mon.0) 3062 : cluster [DBG] osdmap e649: 8 total, 8 up, 8 in 2024-02-13T00:49:16.762 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:16 smithi106 bash[18459]: audit 2024-02-13T00:49:15.273548+0000 mon.c (mon.2) 481 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:49:16.762 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:16 smithi106 bash[18459]: audit 2024-02-13T00:49:15.278349+0000 mon.a (mon.0) 3063 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:49:16.763 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:16 smithi080 bash[17386]: cluster 2024-02-13T00:49:14.479456+0000 mgr.y (mgr.24461) 750 : cluster [DBG] pgmap v1158: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-13T00:49:16.763 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:16 smithi080 bash[17386]: audit 2024-02-13T00:49:15.270766+0000 mon.a (mon.0) 3061 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-128", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:49:16.763 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:16 smithi080 bash[17386]: cluster 2024-02-13T00:49:15.270862+0000 mon.a (mon.0) 3062 : cluster [DBG] osdmap e649: 8 total, 8 up, 8 in 2024-02-13T00:49:16.763 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:16 smithi080 bash[17386]: audit 2024-02-13T00:49:15.273548+0000 mon.c (mon.2) 481 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:49:16.763 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:16 smithi080 bash[17386]: audit 2024-02-13T00:49:15.278349+0000 mon.a (mon.0) 3063 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:49:16.764 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:16 smithi080 bash[24237]: cluster 2024-02-13T00:49:14.479456+0000 mgr.y (mgr.24461) 750 : cluster [DBG] pgmap v1158: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-13T00:49:16.764 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:16 smithi080 bash[24237]: audit 2024-02-13T00:49:15.270766+0000 mon.a (mon.0) 3061 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-128", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:49:16.764 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:16 smithi080 bash[24237]: cluster 2024-02-13T00:49:15.270862+0000 mon.a (mon.0) 3062 : cluster [DBG] osdmap e649: 8 total, 8 up, 8 in 2024-02-13T00:49:16.764 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:16 smithi080 bash[24237]: audit 2024-02-13T00:49:15.273548+0000 mon.c (mon.2) 481 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:49:16.764 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:16 smithi080 bash[24237]: audit 2024-02-13T00:49:15.278349+0000 mon.a (mon.0) 3063 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:49:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:17 smithi106 bash[18459]: audit 2024-02-13T00:49:16.282606+0000 mon.a (mon.0) 3064 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:49:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:17 smithi106 bash[18459]: cluster 2024-02-13T00:49:16.282814+0000 mon.a (mon.0) 3065 : cluster [DBG] osdmap e650: 8 total, 8 up, 8 in 2024-02-13T00:49:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:17 smithi106 bash[18459]: audit 2024-02-13T00:49:16.284491+0000 mon.c (mon.2) 482 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:49:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:17 smithi106 bash[18459]: audit 2024-02-13T00:49:16.290228+0000 mon.a (mon.0) 3066 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:49:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:17 smithi106 bash[18459]: audit 2024-02-13T00:49:16.930024+0000 mon.a (mon.0) 3067 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:49:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:17 smithi080 bash[17386]: audit 2024-02-13T00:49:16.282606+0000 mon.a (mon.0) 3064 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:49:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:17 smithi080 bash[17386]: cluster 2024-02-13T00:49:16.282814+0000 mon.a (mon.0) 3065 : cluster [DBG] osdmap e650: 8 total, 8 up, 8 in 2024-02-13T00:49:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:17 smithi080 bash[17386]: audit 2024-02-13T00:49:16.284491+0000 mon.c (mon.2) 482 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:49:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:17 smithi080 bash[17386]: audit 2024-02-13T00:49:16.290228+0000 mon.a (mon.0) 3066 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:49:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:17 smithi080 bash[17386]: audit 2024-02-13T00:49:16.930024+0000 mon.a (mon.0) 3067 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:49:17.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:17 smithi080 bash[24237]: audit 2024-02-13T00:49:16.282606+0000 mon.a (mon.0) 3064 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:49:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:17 smithi080 bash[24237]: cluster 2024-02-13T00:49:16.282814+0000 mon.a (mon.0) 3065 : cluster [DBG] osdmap e650: 8 total, 8 up, 8 in 2024-02-13T00:49:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:17 smithi080 bash[24237]: audit 2024-02-13T00:49:16.284491+0000 mon.c (mon.2) 482 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:49:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:17 smithi080 bash[24237]: audit 2024-02-13T00:49:16.290228+0000 mon.a (mon.0) 3066 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:49:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:17 smithi080 bash[24237]: audit 2024-02-13T00:49:16.930024+0000 mon.a (mon.0) 3067 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:49:18.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:18 smithi106 bash[18459]: cluster 2024-02-13T00:49:16.480324+0000 mgr.y (mgr.24461) 751 : cluster [DBG] pgmap v1161: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-13T00:49:18.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:18 smithi106 bash[18459]: audit 2024-02-13T00:49:17.293671+0000 mon.a (mon.0) 3068 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:49:18.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:18 smithi106 bash[18459]: cluster 2024-02-13T00:49:17.293880+0000 mon.a (mon.0) 3069 : cluster [DBG] osdmap e651: 8 total, 8 up, 8 in 2024-02-13T00:49:18.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:18 smithi106 bash[18459]: audit 2024-02-13T00:49:17.296503+0000 mon.c (mon.2) 483 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T00:49:18.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:18 smithi106 bash[18459]: audit 2024-02-13T00:49:17.305832+0000 mon.a (mon.0) 3070 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T00:49:18.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:18 smithi080 bash[17386]: cluster 2024-02-13T00:49:16.480324+0000 mgr.y (mgr.24461) 751 : cluster [DBG] pgmap v1161: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-13T00:49:18.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:18 smithi080 bash[17386]: audit 2024-02-13T00:49:17.293671+0000 mon.a (mon.0) 3068 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:49:18.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:18 smithi080 bash[17386]: cluster 2024-02-13T00:49:17.293880+0000 mon.a (mon.0) 3069 : cluster [DBG] osdmap e651: 8 total, 8 up, 8 in 2024-02-13T00:49:18.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:18 smithi080 bash[17386]: audit 2024-02-13T00:49:17.296503+0000 mon.c (mon.2) 483 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T00:49:18.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:18 smithi080 bash[17386]: audit 2024-02-13T00:49:17.305832+0000 mon.a (mon.0) 3070 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T00:49:18.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:18 smithi080 bash[24237]: cluster 2024-02-13T00:49:16.480324+0000 mgr.y (mgr.24461) 751 : cluster [DBG] pgmap v1161: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-13T00:49:18.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:18 smithi080 bash[24237]: audit 2024-02-13T00:49:17.293671+0000 mon.a (mon.0) 3068 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:49:18.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:18 smithi080 bash[24237]: cluster 2024-02-13T00:49:17.293880+0000 mon.a (mon.0) 3069 : cluster [DBG] osdmap e651: 8 total, 8 up, 8 in 2024-02-13T00:49:18.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:18 smithi080 bash[24237]: audit 2024-02-13T00:49:17.296503+0000 mon.c (mon.2) 483 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T00:49:18.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:18 smithi080 bash[24237]: audit 2024-02-13T00:49:17.305832+0000 mon.a (mon.0) 3070 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T00:49:19.256 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:49:18 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:49:19.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:19 smithi106 bash[18459]: audit 2024-02-13T00:49:18.321225+0000 mon.a (mon.0) 3071 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T00:49:19.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:19 smithi106 bash[18459]: cluster 2024-02-13T00:49:18.321333+0000 mon.a (mon.0) 3072 : cluster [DBG] osdmap e652: 8 total, 8 up, 8 in 2024-02-13T00:49:19.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:19 smithi106 bash[18459]: cluster 2024-02-13T00:49:18.481087+0000 mgr.y (mgr.24461) 752 : cluster [DBG] pgmap v1164: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:19.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:19 smithi106 bash[18459]: audit 2024-02-13T00:49:18.757642+0000 mgr.y (mgr.24461) 753 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:49:19.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:19 smithi080 bash[17386]: audit 2024-02-13T00:49:18.321225+0000 mon.a (mon.0) 3071 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T00:49:19.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:19 smithi080 bash[17386]: cluster 2024-02-13T00:49:18.321333+0000 mon.a (mon.0) 3072 : cluster [DBG] osdmap e652: 8 total, 8 up, 8 in 2024-02-13T00:49:19.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:19 smithi080 bash[17386]: cluster 2024-02-13T00:49:18.481087+0000 mgr.y (mgr.24461) 752 : cluster [DBG] pgmap v1164: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:19.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:19 smithi080 bash[17386]: audit 2024-02-13T00:49:18.757642+0000 mgr.y (mgr.24461) 753 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:49:19.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:19 smithi080 bash[24237]: audit 2024-02-13T00:49:18.321225+0000 mon.a (mon.0) 3071 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-128","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T00:49:19.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:19 smithi080 bash[24237]: cluster 2024-02-13T00:49:18.321333+0000 mon.a (mon.0) 3072 : cluster [DBG] osdmap e652: 8 total, 8 up, 8 in 2024-02-13T00:49:19.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:19 smithi080 bash[24237]: cluster 2024-02-13T00:49:18.481087+0000 mgr.y (mgr.24461) 752 : cluster [DBG] pgmap v1164: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:19.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:19 smithi080 bash[24237]: audit 2024-02-13T00:49:18.757642+0000 mgr.y (mgr.24461) 753 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:49:20.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:49:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:49:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:49:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:20 smithi106 bash[18459]: audit 2024-02-13T00:49:19.348731+0000 mon.c (mon.2) 484 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:20.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:20 smithi106 bash[18459]: audit 2024-02-13T00:49:19.349328+0000 mon.a (mon.0) 3073 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:20.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:20 smithi106 bash[18459]: audit 2024-02-13T00:49:19.350433+0000 mon.c (mon.2) 485 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-128"}]: dispatch 2024-02-13T00:49:20.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:20 smithi106 bash[18459]: audit 2024-02-13T00:49:19.350918+0000 mon.a (mon.0) 3074 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-128"}]: dispatch 2024-02-13T00:49:20.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:20 smithi080 bash[17386]: audit 2024-02-13T00:49:19.348731+0000 mon.c (mon.2) 484 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:20.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:20 smithi080 bash[17386]: audit 2024-02-13T00:49:19.349328+0000 mon.a (mon.0) 3073 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:20.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:20 smithi080 bash[17386]: audit 2024-02-13T00:49:19.350433+0000 mon.c (mon.2) 485 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-128"}]: dispatch 2024-02-13T00:49:20.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:20 smithi080 bash[17386]: audit 2024-02-13T00:49:19.350918+0000 mon.a (mon.0) 3074 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-128"}]: dispatch 2024-02-13T00:49:20.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:20 smithi080 bash[24237]: audit 2024-02-13T00:49:19.348731+0000 mon.c (mon.2) 484 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:20.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:20 smithi080 bash[24237]: audit 2024-02-13T00:49:19.349328+0000 mon.a (mon.0) 3073 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:20.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:20 smithi080 bash[24237]: audit 2024-02-13T00:49:19.350433+0000 mon.c (mon.2) 485 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-128"}]: dispatch 2024-02-13T00:49:20.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:20 smithi080 bash[24237]: audit 2024-02-13T00:49:19.350918+0000 mon.a (mon.0) 3074 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-128"}]: dispatch 2024-02-13T00:49:21.359 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-02-13T00:49:21.359 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PropagateBaseTierError (12078 ms) 2024-02-13T00:49:21.359 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-02-13T00:49:21.359 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: 00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2024-02-13T00:49:21.359 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: 00000010 69 73 |is| 2024-02-13T00:49:21.359 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: 00000012 2024-02-13T00:49:21.360 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HelloWriteReturn (12073 ms) 2024-02-13T00:49:21.360 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-02-13T00:49:21.360 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: require_osd_release = pacific 2024-02-13T00:49:21.360 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (6057 ms) 2024-02-13T00:49:21.360 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [----------] 43 tests from LibRadosTwoPoolsPP (497797 ms total) 2024-02-13T00:49:21.360 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: 2024-02-13T00:49:21.360 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2024-02-13T00:49:21.360 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2024-02-13T00:49:21.360 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.Dirty (1021 ms) 2024-02-13T00:49:21.360 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-02-13T00:49:21.360 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.FlushWriteRaces (11079 ms) 2024-02-13T00:49:21.360 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2024-02-13T00:49:21.360 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.CallForcesPromote (18118 ms) 2024-02-13T00:49:21.360 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2024-02-13T00:49:21.360 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.HitSetNone (3 ms) 2024-02-13T00:49:21.361 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (30222 ms total) 2024-02-13T00:49:21.361 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: 2024-02-13T00:49:21.361 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2024-02-13T00:49:21.361 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-02-13T00:49:21.361 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Overlay (7074 ms) 2024-02-13T00:49:21.361 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2024-02-13T00:49:21.361 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Promote (8092 ms) 2024-02-13T00:49:21.361 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-02-13T00:49:21.361 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: waiting for scrub... 2024-02-13T00:49:21.361 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: done waiting 2024-02-13T00:49:21.361 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnap (24352 ms) 2024-02-13T00:49:21.361 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-02-13T00:49:21.361 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (9989 ms) 2024-02-13T00:49:21.361 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-02-13T00:49:21.361 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Whiteout (8091 ms) 2024-02-13T00:49:21.361 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2024-02-13T00:49:21.362 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Evict (8094 ms) 2024-02-13T00:49:21.362 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-02-13T00:49:21.362 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.EvictSnap (10115 ms) 2024-02-13T00:49:21.362 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-02-13T00:49:21.362 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlush (7720 ms) 2024-02-13T00:49:21.362 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-02-13T00:49:21.362 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FailedFlush (13108 ms) 2024-02-13T00:49:21.362 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2024-02-13T00:49:21.362 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Flush (8091 ms) 2024-02-13T00:49:21.362 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-02-13T00:49:21.362 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushSnap (13113 ms) 2024-02-13T00:49:21.362 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-02-13T00:49:21.362 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (7666 ms) 2024-02-13T00:49:21.362 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-02-13T00:49:21.362 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlushReadRace (8090 ms) 2024-02-13T00:49:21.362 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-02-13T00:49:21.363 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: hmm, no HitSet yet 2024-02-13T00:49:21.363 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: ok, hit_set contains 248:602f83fe:::foo:head 2024-02-13T00:49:21.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:21 smithi106 bash[18459]: audit 2024-02-13T00:49:20.330460+0000 mon.a (mon.0) 3075 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-128"}]': finished 2024-02-13T00:49:21.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:21 smithi106 bash[18459]: cluster 2024-02-13T00:49:20.330583+0000 mon.a (mon.0) 3076 : cluster [DBG] osdmap e653: 8 total, 8 up, 8 in 2024-02-13T00:49:21.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:21 smithi106 bash[18459]: cluster 2024-02-13T00:49:20.481956+0000 mgr.y (mgr.24461) 754 : cluster [DBG] pgmap v1166: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:21.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:21 smithi080 bash[17386]: audit 2024-02-13T00:49:20.330460+0000 mon.a (mon.0) 3075 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-128"}]': finished 2024-02-13T00:49:21.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:21 smithi080 bash[17386]: cluster 2024-02-13T00:49:20.330583+0000 mon.a (mon.0) 3076 : cluster [DBG] osdmap e653: 8 total, 8 up, 8 in 2024-02-13T00:49:21.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:21 smithi080 bash[17386]: cluster 2024-02-13T00:49:20.481956+0000 mgr.y (mgr.24461) 754 : cluster [DBG] pgmap v1166: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:21.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:21 smithi080 bash[24237]: audit 2024-02-13T00:49:20.330460+0000 mon.a (mon.0) 3075 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-128"}]': finished 2024-02-13T00:49:21.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:21 smithi080 bash[24237]: cluster 2024-02-13T00:49:20.330583+0000 mon.a (mon.0) 3076 : cluster [DBG] osdmap e653: 8 total, 8 up, 8 in 2024-02-13T00:49:21.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:21 smithi080 bash[24237]: cluster 2024-02-13T00:49:20.481956+0000 mgr.y (mgr.24461) 754 : cluster [DBG] pgmap v1166: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:22.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:22 smithi106 bash[18459]: cluster 2024-02-13T00:49:21.351431+0000 mon.a (mon.0) 3077 : cluster [DBG] osdmap e654: 8 total, 8 up, 8 in 2024-02-13T00:49:22.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:22 smithi080 bash[17386]: cluster 2024-02-13T00:49:21.351431+0000 mon.a (mon.0) 3077 : cluster [DBG] osdmap e654: 8 total, 8 up, 8 in 2024-02-13T00:49:22.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:22 smithi080 bash[24237]: cluster 2024-02-13T00:49:21.351431+0000 mon.a (mon.0) 3077 : cluster [DBG] osdmap e654: 8 total, 8 up, 8 in 2024-02-13T00:49:23.368 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:49:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:49:23] "GET /metrics HTTP/1.1" 200 190642 "" "Prometheus/2.33.4" 2024-02-13T00:49:23.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:23 smithi106 bash[18459]: cluster 2024-02-13T00:49:22.365414+0000 mon.a (mon.0) 3078 : cluster [DBG] osdmap e655: 8 total, 8 up, 8 in 2024-02-13T00:49:23.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:23 smithi106 bash[18459]: audit 2024-02-13T00:49:22.367943+0000 mon.c (mon.2) 486 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:23.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:23 smithi106 bash[18459]: audit 2024-02-13T00:49:22.368594+0000 mon.a (mon.0) 3079 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:23.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:23 smithi106 bash[18459]: cluster 2024-02-13T00:49:22.482936+0000 mgr.y (mgr.24461) 755 : cluster [DBG] pgmap v1169: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:49:23.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:23 smithi080 bash[17386]: cluster 2024-02-13T00:49:22.365414+0000 mon.a (mon.0) 3078 : cluster [DBG] osdmap e655: 8 total, 8 up, 8 in 2024-02-13T00:49:23.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:23 smithi080 bash[17386]: audit 2024-02-13T00:49:22.367943+0000 mon.c (mon.2) 486 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:23.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:23 smithi080 bash[17386]: audit 2024-02-13T00:49:22.368594+0000 mon.a (mon.0) 3079 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:23.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:23 smithi080 bash[17386]: cluster 2024-02-13T00:49:22.482936+0000 mgr.y (mgr.24461) 755 : cluster [DBG] pgmap v1169: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:49:23.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:23 smithi080 bash[24237]: cluster 2024-02-13T00:49:22.365414+0000 mon.a (mon.0) 3078 : cluster [DBG] osdmap e655: 8 total, 8 up, 8 in 2024-02-13T00:49:23.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:23 smithi080 bash[24237]: audit 2024-02-13T00:49:22.367943+0000 mon.c (mon.2) 486 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:23.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:23 smithi080 bash[24237]: audit 2024-02-13T00:49:22.368594+0000 mon.a (mon.0) 3079 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:23.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:23 smithi080 bash[24237]: cluster 2024-02-13T00:49:22.482936+0000 mgr.y (mgr.24461) 755 : cluster [DBG] pgmap v1169: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:49:24.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:24 smithi106 bash[18459]: audit 2024-02-13T00:49:23.376584+0000 mon.a (mon.0) 3080 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:49:24.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:24 smithi106 bash[18459]: cluster 2024-02-13T00:49:23.376851+0000 mon.a (mon.0) 3081 : cluster [DBG] osdmap e656: 8 total, 8 up, 8 in 2024-02-13T00:49:24.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:24 smithi106 bash[18459]: audit 2024-02-13T00:49:23.379831+0000 mon.c (mon.2) 487 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:24.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:24 smithi106 bash[18459]: audit 2024-02-13T00:49:23.380458+0000 mon.a (mon.0) 3082 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:24.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:24 smithi080 bash[24237]: audit 2024-02-13T00:49:23.376584+0000 mon.a (mon.0) 3080 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:49:24.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:24 smithi080 bash[24237]: cluster 2024-02-13T00:49:23.376851+0000 mon.a (mon.0) 3081 : cluster [DBG] osdmap e656: 8 total, 8 up, 8 in 2024-02-13T00:49:24.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:24 smithi080 bash[24237]: audit 2024-02-13T00:49:23.379831+0000 mon.c (mon.2) 487 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:24.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:24 smithi080 bash[24237]: audit 2024-02-13T00:49:23.380458+0000 mon.a (mon.0) 3082 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:24.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:24 smithi080 bash[17386]: audit 2024-02-13T00:49:23.376584+0000 mon.a (mon.0) 3080 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:49:24.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:24 smithi080 bash[17386]: cluster 2024-02-13T00:49:23.376851+0000 mon.a (mon.0) 3081 : cluster [DBG] osdmap e656: 8 total, 8 up, 8 in 2024-02-13T00:49:24.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:24 smithi080 bash[17386]: audit 2024-02-13T00:49:23.379831+0000 mon.c (mon.2) 487 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:24.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:24 smithi080 bash[17386]: audit 2024-02-13T00:49:23.380458+0000 mon.a (mon.0) 3082 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:25.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:25 smithi106 bash[18459]: audit 2024-02-13T00:49:24.384853+0000 mon.a (mon.0) 3083 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-130", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:49:25.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:25 smithi106 bash[18459]: cluster 2024-02-13T00:49:24.384968+0000 mon.a (mon.0) 3084 : cluster [DBG] osdmap e657: 8 total, 8 up, 8 in 2024-02-13T00:49:25.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:25 smithi106 bash[18459]: audit 2024-02-13T00:49:24.386756+0000 mon.c (mon.2) 488 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_count","val": "3"}]: dispatch 2024-02-13T00:49:25.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:25 smithi106 bash[18459]: audit 2024-02-13T00:49:24.387338+0000 mon.a (mon.0) 3085 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_count","val": "3"}]: dispatch 2024-02-13T00:49:25.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:25 smithi106 bash[18459]: cluster 2024-02-13T00:49:24.483899+0000 mgr.y (mgr.24461) 756 : cluster [DBG] pgmap v1172: 204 pgs: 32 creating+peering, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:25.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:25 smithi080 bash[24237]: audit 2024-02-13T00:49:24.384853+0000 mon.a (mon.0) 3083 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-130", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:49:25.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:25 smithi080 bash[24237]: cluster 2024-02-13T00:49:24.384968+0000 mon.a (mon.0) 3084 : cluster [DBG] osdmap e657: 8 total, 8 up, 8 in 2024-02-13T00:49:25.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:25 smithi080 bash[24237]: audit 2024-02-13T00:49:24.386756+0000 mon.c (mon.2) 488 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_count","val": "3"}]: dispatch 2024-02-13T00:49:25.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:25 smithi080 bash[24237]: audit 2024-02-13T00:49:24.387338+0000 mon.a (mon.0) 3085 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_count","val": "3"}]: dispatch 2024-02-13T00:49:25.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:25 smithi080 bash[24237]: cluster 2024-02-13T00:49:24.483899+0000 mgr.y (mgr.24461) 756 : cluster [DBG] pgmap v1172: 204 pgs: 32 creating+peering, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:25.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:25 smithi080 bash[17386]: audit 2024-02-13T00:49:24.384853+0000 mon.a (mon.0) 3083 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-130", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:49:25.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:25 smithi080 bash[17386]: cluster 2024-02-13T00:49:24.384968+0000 mon.a (mon.0) 3084 : cluster [DBG] osdmap e657: 8 total, 8 up, 8 in 2024-02-13T00:49:25.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:25 smithi080 bash[17386]: audit 2024-02-13T00:49:24.386756+0000 mon.c (mon.2) 488 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_count","val": "3"}]: dispatch 2024-02-13T00:49:25.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:25 smithi080 bash[17386]: audit 2024-02-13T00:49:24.387338+0000 mon.a (mon.0) 3085 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_count","val": "3"}]: dispatch 2024-02-13T00:49:25.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:25 smithi080 bash[17386]: cluster 2024-02-13T00:49:24.483899+0000 mgr.y (mgr.24461) 756 : cluster [DBG] pgmap v1172: 204 pgs: 32 creating+peering, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:26.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:26 smithi106 bash[18459]: audit 2024-02-13T00:49:25.389310+0000 mon.a (mon.0) 3086 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_count","val": "3"}]': finished 2024-02-13T00:49:26.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:26 smithi106 bash[18459]: cluster 2024-02-13T00:49:25.389509+0000 mon.a (mon.0) 3087 : cluster [DBG] osdmap e658: 8 total, 8 up, 8 in 2024-02-13T00:49:26.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:26 smithi106 bash[18459]: audit 2024-02-13T00:49:25.391245+0000 mon.c (mon.2) 489 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_period","val": "3"}]: dispatch 2024-02-13T00:49:26.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:26 smithi106 bash[18459]: audit 2024-02-13T00:49:25.391960+0000 mon.a (mon.0) 3088 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_period","val": "3"}]: dispatch 2024-02-13T00:49:26.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:26 smithi080 bash[24237]: audit 2024-02-13T00:49:25.389310+0000 mon.a (mon.0) 3086 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_count","val": "3"}]': finished 2024-02-13T00:49:26.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:26 smithi080 bash[24237]: cluster 2024-02-13T00:49:25.389509+0000 mon.a (mon.0) 3087 : cluster [DBG] osdmap e658: 8 total, 8 up, 8 in 2024-02-13T00:49:26.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:26 smithi080 bash[24237]: audit 2024-02-13T00:49:25.391245+0000 mon.c (mon.2) 489 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_period","val": "3"}]: dispatch 2024-02-13T00:49:26.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:26 smithi080 bash[24237]: audit 2024-02-13T00:49:25.391960+0000 mon.a (mon.0) 3088 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_period","val": "3"}]: dispatch 2024-02-13T00:49:26.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:26 smithi080 bash[17386]: audit 2024-02-13T00:49:25.389310+0000 mon.a (mon.0) 3086 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_count","val": "3"}]': finished 2024-02-13T00:49:26.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:26 smithi080 bash[17386]: cluster 2024-02-13T00:49:25.389509+0000 mon.a (mon.0) 3087 : cluster [DBG] osdmap e658: 8 total, 8 up, 8 in 2024-02-13T00:49:26.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:26 smithi080 bash[17386]: audit 2024-02-13T00:49:25.391245+0000 mon.c (mon.2) 489 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_period","val": "3"}]: dispatch 2024-02-13T00:49:26.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:26 smithi080 bash[17386]: audit 2024-02-13T00:49:25.391960+0000 mon.a (mon.0) 3088 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_period","val": "3"}]: dispatch 2024-02-13T00:49:27.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:27 smithi106 bash[18459]: audit 2024-02-13T00:49:26.391409+0000 mon.a (mon.0) 3089 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_period","val": "3"}]': finished 2024-02-13T00:49:27.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:27 smithi106 bash[18459]: cluster 2024-02-13T00:49:26.391531+0000 mon.a (mon.0) 3090 : cluster [DBG] osdmap e659: 8 total, 8 up, 8 in 2024-02-13T00:49:27.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:27 smithi106 bash[18459]: audit 2024-02-13T00:49:26.394207+0000 mon.c (mon.2) 490 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:49:27.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:27 smithi106 bash[18459]: audit 2024-02-13T00:49:26.394671+0000 mon.a (mon.0) 3091 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:49:27.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:27 smithi106 bash[18459]: cluster 2024-02-13T00:49:26.484793+0000 mgr.y (mgr.24461) 757 : cluster [DBG] pgmap v1175: 204 pgs: 32 creating+peering, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:27.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:27 smithi106 bash[18459]: audit 2024-02-13T00:49:27.394313+0000 mon.a (mon.0) 3092 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T00:49:27.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:27 smithi080 bash[17386]: audit 2024-02-13T00:49:26.391409+0000 mon.a (mon.0) 3089 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_period","val": "3"}]': finished 2024-02-13T00:49:27.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:27 smithi080 bash[17386]: cluster 2024-02-13T00:49:26.391531+0000 mon.a (mon.0) 3090 : cluster [DBG] osdmap e659: 8 total, 8 up, 8 in 2024-02-13T00:49:27.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:27 smithi080 bash[17386]: audit 2024-02-13T00:49:26.394207+0000 mon.c (mon.2) 490 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:49:27.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:27 smithi080 bash[17386]: audit 2024-02-13T00:49:26.394671+0000 mon.a (mon.0) 3091 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:49:27.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:27 smithi080 bash[17386]: cluster 2024-02-13T00:49:26.484793+0000 mgr.y (mgr.24461) 757 : cluster [DBG] pgmap v1175: 204 pgs: 32 creating+peering, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:27.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:27 smithi080 bash[17386]: audit 2024-02-13T00:49:27.394313+0000 mon.a (mon.0) 3092 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T00:49:27.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:27 smithi080 bash[24237]: audit 2024-02-13T00:49:26.391409+0000 mon.a (mon.0) 3089 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_period","val": "3"}]': finished 2024-02-13T00:49:27.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:27 smithi080 bash[24237]: cluster 2024-02-13T00:49:26.391531+0000 mon.a (mon.0) 3090 : cluster [DBG] osdmap e659: 8 total, 8 up, 8 in 2024-02-13T00:49:27.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:27 smithi080 bash[24237]: audit 2024-02-13T00:49:26.394207+0000 mon.c (mon.2) 490 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:49:27.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:27 smithi080 bash[24237]: audit 2024-02-13T00:49:26.394671+0000 mon.a (mon.0) 3091 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:49:27.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:27 smithi080 bash[24237]: cluster 2024-02-13T00:49:26.484793+0000 mgr.y (mgr.24461) 757 : cluster [DBG] pgmap v1175: 204 pgs: 32 creating+peering, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:27.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:27 smithi080 bash[24237]: audit 2024-02-13T00:49:27.394313+0000 mon.a (mon.0) 3092 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T00:49:28.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:28 smithi106 bash[18459]: cluster 2024-02-13T00:49:27.394539+0000 mon.a (mon.0) 3093 : cluster [DBG] osdmap e660: 8 total, 8 up, 8 in 2024-02-13T00:49:28.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:28 smithi106 bash[18459]: audit 2024-02-13T00:49:27.396375+0000 mon.c (mon.2) 491 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-13T00:49:28.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:28 smithi106 bash[18459]: audit 2024-02-13T00:49:27.397479+0000 mon.a (mon.0) 3094 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-13T00:49:28.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:28 smithi106 bash[18459]: audit 2024-02-13T00:49:28.396855+0000 mon.a (mon.0) 3095 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_fpp","val": ".01"}]': finished 2024-02-13T00:49:28.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:28 smithi106 bash[18459]: cluster 2024-02-13T00:49:28.396959+0000 mon.a (mon.0) 3096 : cluster [DBG] osdmap e661: 8 total, 8 up, 8 in 2024-02-13T00:49:28.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:28 smithi080 bash[17386]: cluster 2024-02-13T00:49:27.394539+0000 mon.a (mon.0) 3093 : cluster [DBG] osdmap e660: 8 total, 8 up, 8 in 2024-02-13T00:49:28.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:28 smithi080 bash[17386]: audit 2024-02-13T00:49:27.396375+0000 mon.c (mon.2) 491 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-13T00:49:28.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:28 smithi080 bash[17386]: audit 2024-02-13T00:49:27.397479+0000 mon.a (mon.0) 3094 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-13T00:49:28.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:28 smithi080 bash[17386]: audit 2024-02-13T00:49:28.396855+0000 mon.a (mon.0) 3095 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_fpp","val": ".01"}]': finished 2024-02-13T00:49:28.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:28 smithi080 bash[17386]: cluster 2024-02-13T00:49:28.396959+0000 mon.a (mon.0) 3096 : cluster [DBG] osdmap e661: 8 total, 8 up, 8 in 2024-02-13T00:49:28.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:28 smithi080 bash[24237]: cluster 2024-02-13T00:49:27.394539+0000 mon.a (mon.0) 3093 : cluster [DBG] osdmap e660: 8 total, 8 up, 8 in 2024-02-13T00:49:28.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:28 smithi080 bash[24237]: audit 2024-02-13T00:49:27.396375+0000 mon.c (mon.2) 491 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-13T00:49:28.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:28 smithi080 bash[24237]: audit 2024-02-13T00:49:27.397479+0000 mon.a (mon.0) 3094 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-13T00:49:28.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:28 smithi080 bash[24237]: audit 2024-02-13T00:49:28.396855+0000 mon.a (mon.0) 3095 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-130","var": "hit_set_fpp","val": ".01"}]': finished 2024-02-13T00:49:28.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:28 smithi080 bash[24237]: cluster 2024-02-13T00:49:28.396959+0000 mon.a (mon.0) 3096 : cluster [DBG] osdmap e661: 8 total, 8 up, 8 in 2024-02-13T00:49:29.256 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:49:28 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:49:29.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:29 smithi106 bash[18459]: cluster 2024-02-13T00:49:28.485634+0000 mgr.y (mgr.24461) 758 : cluster [DBG] pgmap v1178: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:29.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:29 smithi106 bash[18459]: audit 2024-02-13T00:49:28.765716+0000 mgr.y (mgr.24461) 759 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:49:29.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:29 smithi080 bash[17386]: cluster 2024-02-13T00:49:28.485634+0000 mgr.y (mgr.24461) 758 : cluster [DBG] pgmap v1178: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:29.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:29 smithi080 bash[17386]: audit 2024-02-13T00:49:28.765716+0000 mgr.y (mgr.24461) 759 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:49:29.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:29 smithi080 bash[24237]: cluster 2024-02-13T00:49:28.485634+0000 mgr.y (mgr.24461) 758 : cluster [DBG] pgmap v1178: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:29.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:29 smithi080 bash[24237]: audit 2024-02-13T00:49:28.765716+0000 mgr.y (mgr.24461) 759 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:49:30.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:49:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:49:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:49:32.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:31 smithi106 bash[18459]: cluster 2024-02-13T00:49:30.486442+0000 mgr.y (mgr.24461) 760 : cluster [DBG] pgmap v1179: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1003 B/s rd, 0 op/s 2024-02-13T00:49:32.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:31 smithi080 bash[17386]: cluster 2024-02-13T00:49:30.486442+0000 mgr.y (mgr.24461) 760 : cluster [DBG] pgmap v1179: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1003 B/s rd, 0 op/s 2024-02-13T00:49:32.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:31 smithi080 bash[24237]: cluster 2024-02-13T00:49:30.486442+0000 mgr.y (mgr.24461) 760 : cluster [DBG] pgmap v1179: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1003 B/s rd, 0 op/s 2024-02-13T00:49:33.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:49:33 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:49:33] "GET /metrics HTTP/1.1" 200 190778 "" "Prometheus/2.33.4" 2024-02-13T00:49:34.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:34 smithi106 bash[18459]: cluster 2024-02-13T00:49:32.487209+0000 mgr.y (mgr.24461) 761 : cluster [DBG] pgmap v1180: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 839 B/s rd, 0 op/s 2024-02-13T00:49:34.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:34 smithi080 bash[17386]: cluster 2024-02-13T00:49:32.487209+0000 mgr.y (mgr.24461) 761 : cluster [DBG] pgmap v1180: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 839 B/s rd, 0 op/s 2024-02-13T00:49:34.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:34 smithi080 bash[24237]: cluster 2024-02-13T00:49:32.487209+0000 mgr.y (mgr.24461) 761 : cluster [DBG] pgmap v1180: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 839 B/s rd, 0 op/s 2024-02-13T00:49:36.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:36 smithi106 bash[18459]: cluster 2024-02-13T00:49:34.489121+0000 mgr.y (mgr.24461) 762 : cluster [DBG] pgmap v1181: 204 pgs: 204 active+clean; 3.9 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.1 KiB/s wr, 1 op/s 2024-02-13T00:49:36.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:36 smithi080 bash[24237]: cluster 2024-02-13T00:49:34.489121+0000 mgr.y (mgr.24461) 762 : cluster [DBG] pgmap v1181: 204 pgs: 204 active+clean; 3.9 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.1 KiB/s wr, 1 op/s 2024-02-13T00:49:36.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:36 smithi080 bash[17386]: cluster 2024-02-13T00:49:34.489121+0000 mgr.y (mgr.24461) 762 : cluster [DBG] pgmap v1181: 204 pgs: 204 active+clean; 3.9 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.1 KiB/s wr, 1 op/s 2024-02-13T00:49:38.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:38 smithi106 bash[18459]: cluster 2024-02-13T00:49:36.489916+0000 mgr.y (mgr.24461) 763 : cluster [DBG] pgmap v1182: 204 pgs: 204 active+clean; 3.9 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 4.5 KiB/s wr, 1 op/s 2024-02-13T00:49:38.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:38 smithi080 bash[24237]: cluster 2024-02-13T00:49:36.489916+0000 mgr.y (mgr.24461) 763 : cluster [DBG] pgmap v1182: 204 pgs: 204 active+clean; 3.9 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 4.5 KiB/s wr, 1 op/s 2024-02-13T00:49:38.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:38 smithi080 bash[17386]: cluster 2024-02-13T00:49:36.489916+0000 mgr.y (mgr.24461) 763 : cluster [DBG] pgmap v1182: 204 pgs: 204 active+clean; 3.9 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 4.5 KiB/s wr, 1 op/s 2024-02-13T00:49:39.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:49:38 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:49:40.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:40 smithi106 bash[18459]: cluster 2024-02-13T00:49:38.492005+0000 mgr.y (mgr.24461) 764 : cluster [DBG] pgmap v1183: 204 pgs: 204 active+clean; 3.9 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1014 B/s rd, 8.2 KiB/s wr, 2 op/s 2024-02-13T00:49:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:40 smithi106 bash[18459]: audit 2024-02-13T00:49:38.777256+0000 mgr.y (mgr.24461) 765 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:49:40.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:49:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:49:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:49:40.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:40 smithi080 bash[24237]: cluster 2024-02-13T00:49:38.492005+0000 mgr.y (mgr.24461) 764 : cluster [DBG] pgmap v1183: 204 pgs: 204 active+clean; 3.9 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1014 B/s rd, 8.2 KiB/s wr, 2 op/s 2024-02-13T00:49:40.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:40 smithi080 bash[24237]: audit 2024-02-13T00:49:38.777256+0000 mgr.y (mgr.24461) 765 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:49:40.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:40 smithi080 bash[17386]: cluster 2024-02-13T00:49:38.492005+0000 mgr.y (mgr.24461) 764 : cluster [DBG] pgmap v1183: 204 pgs: 204 active+clean; 3.9 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1014 B/s rd, 8.2 KiB/s wr, 2 op/s 2024-02-13T00:49:40.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:40 smithi080 bash[17386]: audit 2024-02-13T00:49:38.777256+0000 mgr.y (mgr.24461) 765 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:49:41.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:41 smithi106 bash[18459]: audit 2024-02-13T00:49:40.485746+0000 mon.c (mon.2) 492 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:41.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:41 smithi106 bash[18459]: audit 2024-02-13T00:49:40.486501+0000 mon.a (mon.0) 3097 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:41.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:41 smithi106 bash[18459]: audit 2024-02-13T00:49:40.487624+0000 mon.c (mon.2) 493 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-130"}]: dispatch 2024-02-13T00:49:41.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:41 smithi106 bash[18459]: audit 2024-02-13T00:49:40.488184+0000 mon.a (mon.0) 3098 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-130"}]: dispatch 2024-02-13T00:49:41.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:41 smithi080 bash[17386]: audit 2024-02-13T00:49:40.485746+0000 mon.c (mon.2) 492 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:41.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:41 smithi080 bash[17386]: audit 2024-02-13T00:49:40.486501+0000 mon.a (mon.0) 3097 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:41.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:41 smithi080 bash[17386]: audit 2024-02-13T00:49:40.487624+0000 mon.c (mon.2) 493 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-130"}]: dispatch 2024-02-13T00:49:41.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:41 smithi080 bash[17386]: audit 2024-02-13T00:49:40.488184+0000 mon.a (mon.0) 3098 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-130"}]: dispatch 2024-02-13T00:49:41.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:41 smithi080 bash[24237]: audit 2024-02-13T00:49:40.485746+0000 mon.c (mon.2) 492 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:41.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:41 smithi080 bash[24237]: audit 2024-02-13T00:49:40.486501+0000 mon.a (mon.0) 3097 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:41.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:41 smithi080 bash[24237]: audit 2024-02-13T00:49:40.487624+0000 mon.c (mon.2) 493 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-130"}]: dispatch 2024-02-13T00:49:41.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:41 smithi080 bash[24237]: audit 2024-02-13T00:49:40.488184+0000 mon.a (mon.0) 3098 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-130"}]: dispatch 2024-02-13T00:49:42.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:42 smithi106 bash[18459]: cluster 2024-02-13T00:49:40.492727+0000 mgr.y (mgr.24461) 766 : cluster [DBG] pgmap v1184: 204 pgs: 204 active+clean; 3.9 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 6.9 KiB/s wr, 1 op/s 2024-02-13T00:49:42.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:42 smithi106 bash[18459]: audit 2024-02-13T00:49:41.182654+0000 mon.a (mon.0) 3099 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-130"}]': finished 2024-02-13T00:49:42.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:42 smithi106 bash[18459]: cluster 2024-02-13T00:49:41.182760+0000 mon.a (mon.0) 3100 : cluster [DBG] osdmap e662: 8 total, 8 up, 8 in 2024-02-13T00:49:42.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:42 smithi080 bash[17386]: cluster 2024-02-13T00:49:40.492727+0000 mgr.y (mgr.24461) 766 : cluster [DBG] pgmap v1184: 204 pgs: 204 active+clean; 3.9 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 6.9 KiB/s wr, 1 op/s 2024-02-13T00:49:42.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:42 smithi080 bash[17386]: audit 2024-02-13T00:49:41.182654+0000 mon.a (mon.0) 3099 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-130"}]': finished 2024-02-13T00:49:42.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:42 smithi080 bash[17386]: cluster 2024-02-13T00:49:41.182760+0000 mon.a (mon.0) 3100 : cluster [DBG] osdmap e662: 8 total, 8 up, 8 in 2024-02-13T00:49:42.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:42 smithi080 bash[24237]: cluster 2024-02-13T00:49:40.492727+0000 mgr.y (mgr.24461) 766 : cluster [DBG] pgmap v1184: 204 pgs: 204 active+clean; 3.9 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 6.9 KiB/s wr, 1 op/s 2024-02-13T00:49:42.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:42 smithi080 bash[24237]: audit 2024-02-13T00:49:41.182654+0000 mon.a (mon.0) 3099 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-130"}]': finished 2024-02-13T00:49:42.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:42 smithi080 bash[24237]: cluster 2024-02-13T00:49:41.182760+0000 mon.a (mon.0) 3100 : cluster [DBG] osdmap e662: 8 total, 8 up, 8 in 2024-02-13T00:49:43.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:43 smithi106 bash[18459]: cluster 2024-02-13T00:49:42.185498+0000 mon.a (mon.0) 3101 : cluster [DBG] osdmap e663: 8 total, 8 up, 8 in 2024-02-13T00:49:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:43 smithi080 bash[17386]: cluster 2024-02-13T00:49:42.185498+0000 mon.a (mon.0) 3101 : cluster [DBG] osdmap e663: 8 total, 8 up, 8 in 2024-02-13T00:49:43.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:49:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:49:43] "GET /metrics HTTP/1.1" 200 190778 "" "Prometheus/2.33.4" 2024-02-13T00:49:43.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:43 smithi080 bash[24237]: cluster 2024-02-13T00:49:42.185498+0000 mon.a (mon.0) 3101 : cluster [DBG] osdmap e663: 8 total, 8 up, 8 in 2024-02-13T00:49:44.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:44 smithi106 bash[18459]: cluster 2024-02-13T00:49:42.493520+0000 mgr.y (mgr.24461) 767 : cluster [DBG] pgmap v1187: 172 pgs: 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:49:44.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:44 smithi106 bash[18459]: cluster 2024-02-13T00:49:43.203953+0000 mon.a (mon.0) 3102 : cluster [DBG] osdmap e664: 8 total, 8 up, 8 in 2024-02-13T00:49:44.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:44 smithi106 bash[18459]: audit 2024-02-13T00:49:43.206954+0000 mon.c (mon.2) 494 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:44.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:44 smithi106 bash[18459]: audit 2024-02-13T00:49:43.208063+0000 mon.a (mon.0) 3103 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:44.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:44 smithi080 bash[17386]: cluster 2024-02-13T00:49:42.493520+0000 mgr.y (mgr.24461) 767 : cluster [DBG] pgmap v1187: 172 pgs: 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:49:44.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:44 smithi080 bash[17386]: cluster 2024-02-13T00:49:43.203953+0000 mon.a (mon.0) 3102 : cluster [DBG] osdmap e664: 8 total, 8 up, 8 in 2024-02-13T00:49:44.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:44 smithi080 bash[17386]: audit 2024-02-13T00:49:43.206954+0000 mon.c (mon.2) 494 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:44.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:44 smithi080 bash[17386]: audit 2024-02-13T00:49:43.208063+0000 mon.a (mon.0) 3103 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:44.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:44 smithi080 bash[24237]: cluster 2024-02-13T00:49:42.493520+0000 mgr.y (mgr.24461) 767 : cluster [DBG] pgmap v1187: 172 pgs: 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:49:44.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:44 smithi080 bash[24237]: cluster 2024-02-13T00:49:43.203953+0000 mon.a (mon.0) 3102 : cluster [DBG] osdmap e664: 8 total, 8 up, 8 in 2024-02-13T00:49:44.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:44 smithi080 bash[24237]: audit 2024-02-13T00:49:43.206954+0000 mon.c (mon.2) 494 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:44.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:44 smithi080 bash[24237]: audit 2024-02-13T00:49:43.208063+0000 mon.a (mon.0) 3103 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:45.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:45 smithi106 bash[18459]: audit 2024-02-13T00:49:44.209145+0000 mon.a (mon.0) 3104 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:49:45.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:45 smithi106 bash[18459]: cluster 2024-02-13T00:49:44.210145+0000 mon.a (mon.0) 3105 : cluster [DBG] osdmap e665: 8 total, 8 up, 8 in 2024-02-13T00:49:45.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:45 smithi106 bash[18459]: audit 2024-02-13T00:49:44.266425+0000 mon.c (mon.2) 495 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:45.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:45 smithi106 bash[18459]: audit 2024-02-13T00:49:44.267044+0000 mon.a (mon.0) 3106 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:45.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:45 smithi080 bash[17386]: audit 2024-02-13T00:49:44.209145+0000 mon.a (mon.0) 3104 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:49:45.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:45 smithi080 bash[17386]: cluster 2024-02-13T00:49:44.210145+0000 mon.a (mon.0) 3105 : cluster [DBG] osdmap e665: 8 total, 8 up, 8 in 2024-02-13T00:49:45.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:45 smithi080 bash[17386]: audit 2024-02-13T00:49:44.266425+0000 mon.c (mon.2) 495 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:45.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:45 smithi080 bash[17386]: audit 2024-02-13T00:49:44.267044+0000 mon.a (mon.0) 3106 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:45.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:45 smithi080 bash[24237]: audit 2024-02-13T00:49:44.209145+0000 mon.a (mon.0) 3104 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:49:45.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:45 smithi080 bash[24237]: cluster 2024-02-13T00:49:44.210145+0000 mon.a (mon.0) 3105 : cluster [DBG] osdmap e665: 8 total, 8 up, 8 in 2024-02-13T00:49:45.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:45 smithi080 bash[24237]: audit 2024-02-13T00:49:44.266425+0000 mon.c (mon.2) 495 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:45.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:45 smithi080 bash[24237]: audit 2024-02-13T00:49:44.267044+0000 mon.a (mon.0) 3106 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:46.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:46 smithi106 bash[18459]: cluster 2024-02-13T00:49:44.494326+0000 mgr.y (mgr.24461) 768 : cluster [DBG] pgmap v1190: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:49:46.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:46 smithi106 bash[18459]: audit 2024-02-13T00:49:45.229606+0000 mon.a (mon.0) 3107 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:49:46.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:46 smithi106 bash[18459]: cluster 2024-02-13T00:49:45.229703+0000 mon.a (mon.0) 3108 : cluster [DBG] osdmap e666: 8 total, 8 up, 8 in 2024-02-13T00:49:46.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:46 smithi106 bash[18459]: audit 2024-02-13T00:49:45.232190+0000 mon.c (mon.2) 496 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-132"}]: dispatch 2024-02-13T00:49:46.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:46 smithi106 bash[18459]: audit 2024-02-13T00:49:45.233050+0000 mon.a (mon.0) 3109 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-132"}]: dispatch 2024-02-13T00:49:46.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:46 smithi080 bash[17386]: cluster 2024-02-13T00:49:44.494326+0000 mgr.y (mgr.24461) 768 : cluster [DBG] pgmap v1190: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:49:46.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:46 smithi080 bash[17386]: audit 2024-02-13T00:49:45.229606+0000 mon.a (mon.0) 3107 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:49:46.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:46 smithi080 bash[17386]: cluster 2024-02-13T00:49:45.229703+0000 mon.a (mon.0) 3108 : cluster [DBG] osdmap e666: 8 total, 8 up, 8 in 2024-02-13T00:49:46.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:46 smithi080 bash[17386]: audit 2024-02-13T00:49:45.232190+0000 mon.c (mon.2) 496 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-132"}]: dispatch 2024-02-13T00:49:46.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:46 smithi080 bash[17386]: audit 2024-02-13T00:49:45.233050+0000 mon.a (mon.0) 3109 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-132"}]: dispatch 2024-02-13T00:49:46.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:46 smithi080 bash[24237]: cluster 2024-02-13T00:49:44.494326+0000 mgr.y (mgr.24461) 768 : cluster [DBG] pgmap v1190: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:49:46.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:46 smithi080 bash[24237]: audit 2024-02-13T00:49:45.229606+0000 mon.a (mon.0) 3107 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:49:46.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:46 smithi080 bash[24237]: cluster 2024-02-13T00:49:45.229703+0000 mon.a (mon.0) 3108 : cluster [DBG] osdmap e666: 8 total, 8 up, 8 in 2024-02-13T00:49:46.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:46 smithi080 bash[24237]: audit 2024-02-13T00:49:45.232190+0000 mon.c (mon.2) 496 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-132"}]: dispatch 2024-02-13T00:49:46.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:46 smithi080 bash[24237]: audit 2024-02-13T00:49:45.233050+0000 mon.a (mon.0) 3109 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-132"}]: dispatch 2024-02-13T00:49:47.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:47 smithi106 bash[18459]: audit 2024-02-13T00:49:46.234834+0000 mon.a (mon.0) 3110 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-132"}]': finished 2024-02-13T00:49:47.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:47 smithi106 bash[18459]: cluster 2024-02-13T00:49:46.234996+0000 mon.a (mon.0) 3111 : cluster [DBG] osdmap e667: 8 total, 8 up, 8 in 2024-02-13T00:49:47.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:47 smithi106 bash[18459]: audit 2024-02-13T00:49:46.236158+0000 mon.c (mon.2) 497 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-132", "mode": "writeback"}]: dispatch 2024-02-13T00:49:47.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:47 smithi106 bash[18459]: audit 2024-02-13T00:49:46.239463+0000 mon.a (mon.0) 3112 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-132", "mode": "writeback"}]: dispatch 2024-02-13T00:49:47.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:47 smithi106 bash[18459]: cluster 2024-02-13T00:49:47.229249+0000 mon.a (mon.0) 3113 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:49:47.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:47 smithi106 bash[18459]: audit 2024-02-13T00:49:47.238547+0000 mon.a (mon.0) 3114 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-132", "mode": "writeback"}]': finished 2024-02-13T00:49:47.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:47 smithi106 bash[18459]: cluster 2024-02-13T00:49:47.238668+0000 mon.a (mon.0) 3115 : cluster [DBG] osdmap e668: 8 total, 8 up, 8 in 2024-02-13T00:49:47.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:47 smithi106 bash[18459]: audit 2024-02-13T00:49:47.239898+0000 mon.c (mon.2) 498 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:49:47.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:47 smithi106 bash[18459]: audit 2024-02-13T00:49:47.240539+0000 mon.a (mon.0) 3116 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:49:47.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:47 smithi080 bash[17386]: audit 2024-02-13T00:49:46.234834+0000 mon.a (mon.0) 3110 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-132"}]': finished 2024-02-13T00:49:47.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:47 smithi080 bash[17386]: cluster 2024-02-13T00:49:46.234996+0000 mon.a (mon.0) 3111 : cluster [DBG] osdmap e667: 8 total, 8 up, 8 in 2024-02-13T00:49:47.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:47 smithi080 bash[17386]: audit 2024-02-13T00:49:46.236158+0000 mon.c (mon.2) 497 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-132", "mode": "writeback"}]: dispatch 2024-02-13T00:49:47.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:47 smithi080 bash[17386]: audit 2024-02-13T00:49:46.239463+0000 mon.a (mon.0) 3112 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-132", "mode": "writeback"}]: dispatch 2024-02-13T00:49:47.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:47 smithi080 bash[17386]: cluster 2024-02-13T00:49:47.229249+0000 mon.a (mon.0) 3113 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:49:47.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:47 smithi080 bash[17386]: audit 2024-02-13T00:49:47.238547+0000 mon.a (mon.0) 3114 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-132", "mode": "writeback"}]': finished 2024-02-13T00:49:47.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:47 smithi080 bash[17386]: cluster 2024-02-13T00:49:47.238668+0000 mon.a (mon.0) 3115 : cluster [DBG] osdmap e668: 8 total, 8 up, 8 in 2024-02-13T00:49:47.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:47 smithi080 bash[17386]: audit 2024-02-13T00:49:47.239898+0000 mon.c (mon.2) 498 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:49:47.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:47 smithi080 bash[17386]: audit 2024-02-13T00:49:47.240539+0000 mon.a (mon.0) 3116 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:49:47.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:47 smithi080 bash[24237]: audit 2024-02-13T00:49:46.234834+0000 mon.a (mon.0) 3110 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-132"}]': finished 2024-02-13T00:49:47.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:47 smithi080 bash[24237]: cluster 2024-02-13T00:49:46.234996+0000 mon.a (mon.0) 3111 : cluster [DBG] osdmap e667: 8 total, 8 up, 8 in 2024-02-13T00:49:47.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:47 smithi080 bash[24237]: audit 2024-02-13T00:49:46.236158+0000 mon.c (mon.2) 497 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-132", "mode": "writeback"}]: dispatch 2024-02-13T00:49:47.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:47 smithi080 bash[24237]: audit 2024-02-13T00:49:46.239463+0000 mon.a (mon.0) 3112 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-132", "mode": "writeback"}]: dispatch 2024-02-13T00:49:47.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:47 smithi080 bash[24237]: cluster 2024-02-13T00:49:47.229249+0000 mon.a (mon.0) 3113 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:49:47.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:47 smithi080 bash[24237]: audit 2024-02-13T00:49:47.238547+0000 mon.a (mon.0) 3114 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-132", "mode": "writeback"}]': finished 2024-02-13T00:49:47.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:47 smithi080 bash[24237]: cluster 2024-02-13T00:49:47.238668+0000 mon.a (mon.0) 3115 : cluster [DBG] osdmap e668: 8 total, 8 up, 8 in 2024-02-13T00:49:47.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:47 smithi080 bash[24237]: audit 2024-02-13T00:49:47.239898+0000 mon.c (mon.2) 498 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:49:47.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:47 smithi080 bash[24237]: audit 2024-02-13T00:49:47.240539+0000 mon.a (mon.0) 3116 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:49:48.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:48 smithi106 bash[18459]: cluster 2024-02-13T00:49:46.495111+0000 mgr.y (mgr.24461) 769 : cluster [DBG] pgmap v1193: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:49:48.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:48 smithi106 bash[18459]: audit 2024-02-13T00:49:48.241817+0000 mon.a (mon.0) 3117 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:49:48.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:48 smithi106 bash[18459]: cluster 2024-02-13T00:49:48.242136+0000 mon.a (mon.0) 3118 : cluster [DBG] osdmap e669: 8 total, 8 up, 8 in 2024-02-13T00:49:48.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:48 smithi106 bash[18459]: audit 2024-02-13T00:49:48.243149+0000 mon.c (mon.2) 499 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:49:48.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:48 smithi106 bash[18459]: audit 2024-02-13T00:49:48.243852+0000 mon.a (mon.0) 3119 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:49:48.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:48 smithi080 bash[17386]: cluster 2024-02-13T00:49:46.495111+0000 mgr.y (mgr.24461) 769 : cluster [DBG] pgmap v1193: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:49:48.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:48 smithi080 bash[17386]: audit 2024-02-13T00:49:48.241817+0000 mon.a (mon.0) 3117 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:49:48.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:48 smithi080 bash[17386]: cluster 2024-02-13T00:49:48.242136+0000 mon.a (mon.0) 3118 : cluster [DBG] osdmap e669: 8 total, 8 up, 8 in 2024-02-13T00:49:48.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:48 smithi080 bash[17386]: audit 2024-02-13T00:49:48.243149+0000 mon.c (mon.2) 499 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:49:48.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:48 smithi080 bash[17386]: audit 2024-02-13T00:49:48.243852+0000 mon.a (mon.0) 3119 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:49:48.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:48 smithi080 bash[24237]: cluster 2024-02-13T00:49:46.495111+0000 mgr.y (mgr.24461) 769 : cluster [DBG] pgmap v1193: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:49:48.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:48 smithi080 bash[24237]: audit 2024-02-13T00:49:48.241817+0000 mon.a (mon.0) 3117 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:49:48.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:48 smithi080 bash[24237]: cluster 2024-02-13T00:49:48.242136+0000 mon.a (mon.0) 3118 : cluster [DBG] osdmap e669: 8 total, 8 up, 8 in 2024-02-13T00:49:48.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:48 smithi080 bash[24237]: audit 2024-02-13T00:49:48.243149+0000 mon.c (mon.2) 499 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:49:48.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:48 smithi080 bash[24237]: audit 2024-02-13T00:49:48.243852+0000 mon.a (mon.0) 3119 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:49:49.256 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:49:48 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:49:50.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:49:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:49:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:49:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:50 smithi106 bash[18459]: cluster 2024-02-13T00:49:48.495837+0000 mgr.y (mgr.24461) 770 : cluster [DBG] pgmap v1196: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-13T00:49:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:50 smithi106 bash[18459]: audit 2024-02-13T00:49:48.788772+0000 mgr.y (mgr.24461) 771 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:49:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:50 smithi106 bash[18459]: audit 2024-02-13T00:49:49.242844+0000 mon.a (mon.0) 3120 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:49:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:50 smithi106 bash[18459]: cluster 2024-02-13T00:49:49.242970+0000 mon.a (mon.0) 3121 : cluster [DBG] osdmap e670: 8 total, 8 up, 8 in 2024-02-13T00:49:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:50 smithi106 bash[18459]: audit 2024-02-13T00:49:49.244944+0000 mon.c (mon.2) 500 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:49:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:50 smithi106 bash[18459]: audit 2024-02-13T00:49:49.246114+0000 mon.a (mon.0) 3122 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:49:50.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:50 smithi080 bash[17386]: cluster 2024-02-13T00:49:48.495837+0000 mgr.y (mgr.24461) 770 : cluster [DBG] pgmap v1196: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-13T00:49:50.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:50 smithi080 bash[17386]: audit 2024-02-13T00:49:48.788772+0000 mgr.y (mgr.24461) 771 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:49:50.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:50 smithi080 bash[17386]: audit 2024-02-13T00:49:49.242844+0000 mon.a (mon.0) 3120 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:49:50.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:50 smithi080 bash[17386]: cluster 2024-02-13T00:49:49.242970+0000 mon.a (mon.0) 3121 : cluster [DBG] osdmap e670: 8 total, 8 up, 8 in 2024-02-13T00:49:50.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:50 smithi080 bash[17386]: audit 2024-02-13T00:49:49.244944+0000 mon.c (mon.2) 500 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:49:50.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:50 smithi080 bash[17386]: audit 2024-02-13T00:49:49.246114+0000 mon.a (mon.0) 3122 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:49:50.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:50 smithi080 bash[24237]: cluster 2024-02-13T00:49:48.495837+0000 mgr.y (mgr.24461) 770 : cluster [DBG] pgmap v1196: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-13T00:49:50.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:50 smithi080 bash[24237]: audit 2024-02-13T00:49:48.788772+0000 mgr.y (mgr.24461) 771 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:49:50.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:50 smithi080 bash[24237]: audit 2024-02-13T00:49:49.242844+0000 mon.a (mon.0) 3120 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:49:50.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:50 smithi080 bash[24237]: cluster 2024-02-13T00:49:49.242970+0000 mon.a (mon.0) 3121 : cluster [DBG] osdmap e670: 8 total, 8 up, 8 in 2024-02-13T00:49:50.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:50 smithi080 bash[24237]: audit 2024-02-13T00:49:49.244944+0000 mon.c (mon.2) 500 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:49:50.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:50 smithi080 bash[24237]: audit 2024-02-13T00:49:49.246114+0000 mon.a (mon.0) 3122 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:49:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:51 smithi080 bash[17386]: cluster 2024-02-13T00:49:50.237366+0000 mon.a (mon.0) 3123 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:49:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:51 smithi080 bash[17386]: audit 2024-02-13T00:49:50.246673+0000 mon.a (mon.0) 3124 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T00:49:51.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:51 smithi080 bash[17386]: cluster 2024-02-13T00:49:50.246867+0000 mon.a (mon.0) 3125 : cluster [DBG] osdmap e671: 8 total, 8 up, 8 in 2024-02-13T00:49:51.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:51 smithi080 bash[17386]: audit 2024-02-13T00:49:50.254541+0000 mon.c (mon.2) 501 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T00:49:51.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:51 smithi080 bash[17386]: audit 2024-02-13T00:49:50.254917+0000 mon.a (mon.0) 3126 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T00:49:51.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:51 smithi080 bash[24237]: cluster 2024-02-13T00:49:50.237366+0000 mon.a (mon.0) 3123 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:49:51.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:51 smithi080 bash[24237]: audit 2024-02-13T00:49:50.246673+0000 mon.a (mon.0) 3124 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T00:49:51.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:51 smithi080 bash[24237]: cluster 2024-02-13T00:49:50.246867+0000 mon.a (mon.0) 3125 : cluster [DBG] osdmap e671: 8 total, 8 up, 8 in 2024-02-13T00:49:51.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:51 smithi080 bash[24237]: audit 2024-02-13T00:49:50.254541+0000 mon.c (mon.2) 501 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T00:49:51.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:51 smithi080 bash[24237]: audit 2024-02-13T00:49:50.254917+0000 mon.a (mon.0) 3126 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T00:49:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:51 smithi106 bash[18459]: cluster 2024-02-13T00:49:50.237366+0000 mon.a (mon.0) 3123 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:49:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:51 smithi106 bash[18459]: audit 2024-02-13T00:49:50.246673+0000 mon.a (mon.0) 3124 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T00:49:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:51 smithi106 bash[18459]: cluster 2024-02-13T00:49:50.246867+0000 mon.a (mon.0) 3125 : cluster [DBG] osdmap e671: 8 total, 8 up, 8 in 2024-02-13T00:49:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:51 smithi106 bash[18459]: audit 2024-02-13T00:49:50.254541+0000 mon.c (mon.2) 501 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T00:49:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:51 smithi106 bash[18459]: audit 2024-02-13T00:49:50.254917+0000 mon.a (mon.0) 3126 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T00:49:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:52 smithi106 bash[18459]: cluster 2024-02-13T00:49:50.496702+0000 mgr.y (mgr.24461) 772 : cluster [DBG] pgmap v1199: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-13T00:49:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:52 smithi106 bash[18459]: audit 2024-02-13T00:49:51.263553+0000 mon.a (mon.0) 3127 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T00:49:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:52 smithi106 bash[18459]: cluster 2024-02-13T00:49:51.263659+0000 mon.a (mon.0) 3128 : cluster [DBG] osdmap e672: 8 total, 8 up, 8 in 2024-02-13T00:49:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:52 smithi106 bash[18459]: audit 2024-02-13T00:49:51.266248+0000 mon.c (mon.2) 502 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-13T00:49:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:52 smithi106 bash[18459]: audit 2024-02-13T00:49:51.266952+0000 mon.a (mon.0) 3129 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-13T00:49:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:52 smithi080 bash[17386]: cluster 2024-02-13T00:49:50.496702+0000 mgr.y (mgr.24461) 772 : cluster [DBG] pgmap v1199: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-13T00:49:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:52 smithi080 bash[17386]: audit 2024-02-13T00:49:51.263553+0000 mon.a (mon.0) 3127 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T00:49:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:52 smithi080 bash[17386]: cluster 2024-02-13T00:49:51.263659+0000 mon.a (mon.0) 3128 : cluster [DBG] osdmap e672: 8 total, 8 up, 8 in 2024-02-13T00:49:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:52 smithi080 bash[17386]: audit 2024-02-13T00:49:51.266248+0000 mon.c (mon.2) 502 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-13T00:49:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:52 smithi080 bash[17386]: audit 2024-02-13T00:49:51.266952+0000 mon.a (mon.0) 3129 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-13T00:49:52.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:52 smithi080 bash[24237]: cluster 2024-02-13T00:49:50.496702+0000 mgr.y (mgr.24461) 772 : cluster [DBG] pgmap v1199: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-13T00:49:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:52 smithi080 bash[24237]: audit 2024-02-13T00:49:51.263553+0000 mon.a (mon.0) 3127 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T00:49:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:52 smithi080 bash[24237]: cluster 2024-02-13T00:49:51.263659+0000 mon.a (mon.0) 3128 : cluster [DBG] osdmap e672: 8 total, 8 up, 8 in 2024-02-13T00:49:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:52 smithi080 bash[24237]: audit 2024-02-13T00:49:51.266248+0000 mon.c (mon.2) 502 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-13T00:49:52.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:52 smithi080 bash[24237]: audit 2024-02-13T00:49:51.266952+0000 mon.a (mon.0) 3129 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-13T00:49:53.509 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:49:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:49:53] "GET /metrics HTTP/1.1" 200 190888 "" "Prometheus/2.33.4" 2024-02-13T00:49:53.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:53 smithi080 bash[17386]: audit 2024-02-13T00:49:52.270533+0000 mon.a (mon.0) 3130 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-02-13T00:49:53.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:53 smithi080 bash[17386]: cluster 2024-02-13T00:49:52.270708+0000 mon.a (mon.0) 3131 : cluster [DBG] osdmap e673: 8 total, 8 up, 8 in 2024-02-13T00:49:53.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:53 smithi080 bash[17386]: audit 2024-02-13T00:49:52.272619+0000 mon.c (mon.2) 503 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-13T00:49:53.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:53 smithi080 bash[17386]: audit 2024-02-13T00:49:52.273891+0000 mon.a (mon.0) 3132 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-13T00:49:53.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:53 smithi080 bash[17386]: audit 2024-02-13T00:49:53.272163+0000 mon.a (mon.0) 3133 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_search_last_n","val": "1"}]': finished 2024-02-13T00:49:53.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:53 smithi080 bash[17386]: cluster 2024-02-13T00:49:53.272334+0000 mon.a (mon.0) 3134 : cluster [DBG] osdmap e674: 8 total, 8 up, 8 in 2024-02-13T00:49:53.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:53 smithi080 bash[24237]: audit 2024-02-13T00:49:52.270533+0000 mon.a (mon.0) 3130 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-02-13T00:49:53.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:53 smithi080 bash[24237]: cluster 2024-02-13T00:49:52.270708+0000 mon.a (mon.0) 3131 : cluster [DBG] osdmap e673: 8 total, 8 up, 8 in 2024-02-13T00:49:53.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:53 smithi080 bash[24237]: audit 2024-02-13T00:49:52.272619+0000 mon.c (mon.2) 503 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-13T00:49:53.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:53 smithi080 bash[24237]: audit 2024-02-13T00:49:52.273891+0000 mon.a (mon.0) 3132 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-13T00:49:53.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:53 smithi080 bash[24237]: audit 2024-02-13T00:49:53.272163+0000 mon.a (mon.0) 3133 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_search_last_n","val": "1"}]': finished 2024-02-13T00:49:53.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:53 smithi080 bash[24237]: cluster 2024-02-13T00:49:53.272334+0000 mon.a (mon.0) 3134 : cluster [DBG] osdmap e674: 8 total, 8 up, 8 in 2024-02-13T00:49:53.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:53 smithi106 bash[18459]: audit 2024-02-13T00:49:52.270533+0000 mon.a (mon.0) 3130 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-02-13T00:49:53.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:53 smithi106 bash[18459]: cluster 2024-02-13T00:49:52.270708+0000 mon.a (mon.0) 3131 : cluster [DBG] osdmap e673: 8 total, 8 up, 8 in 2024-02-13T00:49:53.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:53 smithi106 bash[18459]: audit 2024-02-13T00:49:52.272619+0000 mon.c (mon.2) 503 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-13T00:49:53.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:53 smithi106 bash[18459]: audit 2024-02-13T00:49:52.273891+0000 mon.a (mon.0) 3132 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-13T00:49:53.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:53 smithi106 bash[18459]: audit 2024-02-13T00:49:53.272163+0000 mon.a (mon.0) 3133 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-132","var": "hit_set_search_last_n","val": "1"}]': finished 2024-02-13T00:49:53.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:53 smithi106 bash[18459]: cluster 2024-02-13T00:49:53.272334+0000 mon.a (mon.0) 3134 : cluster [DBG] osdmap e674: 8 total, 8 up, 8 in 2024-02-13T00:49:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:54 smithi106 bash[18459]: cluster 2024-02-13T00:49:52.497499+0000 mgr.y (mgr.24461) 773 : cluster [DBG] pgmap v1202: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:49:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:54 smithi106 bash[18459]: audit 2024-02-13T00:49:53.330637+0000 mon.c (mon.2) 504 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:54 smithi106 bash[18459]: audit 2024-02-13T00:49:53.331399+0000 mon.a (mon.0) 3135 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:54 smithi080 bash[17386]: cluster 2024-02-13T00:49:52.497499+0000 mgr.y (mgr.24461) 773 : cluster [DBG] pgmap v1202: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:49:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:54 smithi080 bash[17386]: audit 2024-02-13T00:49:53.330637+0000 mon.c (mon.2) 504 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:54 smithi080 bash[17386]: audit 2024-02-13T00:49:53.331399+0000 mon.a (mon.0) 3135 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:54.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:54 smithi080 bash[24237]: cluster 2024-02-13T00:49:52.497499+0000 mgr.y (mgr.24461) 773 : cluster [DBG] pgmap v1202: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:49:54.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:54 smithi080 bash[24237]: audit 2024-02-13T00:49:53.330637+0000 mon.c (mon.2) 504 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:54.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:54 smithi080 bash[24237]: audit 2024-02-13T00:49:53.331399+0000 mon.a (mon.0) 3135 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:55.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:55 smithi106 bash[18459]: audit 2024-02-13T00:49:54.295708+0000 mon.a (mon.0) 3136 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:49:55.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:55 smithi106 bash[18459]: cluster 2024-02-13T00:49:54.295838+0000 mon.a (mon.0) 3137 : cluster [DBG] osdmap e675: 8 total, 8 up, 8 in 2024-02-13T00:49:55.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:55 smithi106 bash[18459]: audit 2024-02-13T00:49:54.301050+0000 mon.c (mon.2) 505 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132"}]: dispatch 2024-02-13T00:49:55.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:55 smithi106 bash[18459]: audit 2024-02-13T00:49:54.301527+0000 mon.a (mon.0) 3138 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132"}]: dispatch 2024-02-13T00:49:55.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:55 smithi080 bash[17386]: audit 2024-02-13T00:49:54.295708+0000 mon.a (mon.0) 3136 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:49:55.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:55 smithi080 bash[17386]: cluster 2024-02-13T00:49:54.295838+0000 mon.a (mon.0) 3137 : cluster [DBG] osdmap e675: 8 total, 8 up, 8 in 2024-02-13T00:49:55.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:55 smithi080 bash[17386]: audit 2024-02-13T00:49:54.301050+0000 mon.c (mon.2) 505 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132"}]: dispatch 2024-02-13T00:49:55.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:55 smithi080 bash[17386]: audit 2024-02-13T00:49:54.301527+0000 mon.a (mon.0) 3138 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132"}]: dispatch 2024-02-13T00:49:55.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:55 smithi080 bash[24237]: audit 2024-02-13T00:49:54.295708+0000 mon.a (mon.0) 3136 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:49:55.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:55 smithi080 bash[24237]: cluster 2024-02-13T00:49:54.295838+0000 mon.a (mon.0) 3137 : cluster [DBG] osdmap e675: 8 total, 8 up, 8 in 2024-02-13T00:49:55.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:55 smithi080 bash[24237]: audit 2024-02-13T00:49:54.301050+0000 mon.c (mon.2) 505 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132"}]: dispatch 2024-02-13T00:49:55.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:55 smithi080 bash[24237]: audit 2024-02-13T00:49:54.301527+0000 mon.a (mon.0) 3138 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132"}]: dispatch 2024-02-13T00:49:56.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:56 smithi106 bash[18459]: cluster 2024-02-13T00:49:54.498325+0000 mgr.y (mgr.24461) 774 : cluster [DBG] pgmap v1205: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:56.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:56 smithi106 bash[18459]: audit 2024-02-13T00:49:55.303050+0000 mon.a (mon.0) 3139 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132"}]': finished 2024-02-13T00:49:56.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:56 smithi106 bash[18459]: cluster 2024-02-13T00:49:55.303178+0000 mon.a (mon.0) 3140 : cluster [DBG] osdmap e676: 8 total, 8 up, 8 in 2024-02-13T00:49:56.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:56 smithi106 bash[18459]: audit 2024-02-13T00:49:55.341372+0000 mon.c (mon.2) 506 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:56.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:56 smithi106 bash[18459]: audit 2024-02-13T00:49:55.341926+0000 mon.a (mon.0) 3141 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:56.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:56 smithi106 bash[18459]: audit 2024-02-13T00:49:55.342887+0000 mon.c (mon.2) 507 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132"}]: dispatch 2024-02-13T00:49:56.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:56 smithi106 bash[18459]: audit 2024-02-13T00:49:55.343292+0000 mon.a (mon.0) 3142 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132"}]: dispatch 2024-02-13T00:49:56.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:56 smithi080 bash[24237]: cluster 2024-02-13T00:49:54.498325+0000 mgr.y (mgr.24461) 774 : cluster [DBG] pgmap v1205: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:56.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:56 smithi080 bash[24237]: audit 2024-02-13T00:49:55.303050+0000 mon.a (mon.0) 3139 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132"}]': finished 2024-02-13T00:49:56.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:56 smithi080 bash[24237]: cluster 2024-02-13T00:49:55.303178+0000 mon.a (mon.0) 3140 : cluster [DBG] osdmap e676: 8 total, 8 up, 8 in 2024-02-13T00:49:56.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:56 smithi080 bash[24237]: audit 2024-02-13T00:49:55.341372+0000 mon.c (mon.2) 506 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:56.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:56 smithi080 bash[24237]: audit 2024-02-13T00:49:55.341926+0000 mon.a (mon.0) 3141 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:56.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:56 smithi080 bash[24237]: audit 2024-02-13T00:49:55.342887+0000 mon.c (mon.2) 507 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132"}]: dispatch 2024-02-13T00:49:56.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:56 smithi080 bash[24237]: audit 2024-02-13T00:49:55.343292+0000 mon.a (mon.0) 3142 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132"}]: dispatch 2024-02-13T00:49:56.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:56 smithi080 bash[17386]: cluster 2024-02-13T00:49:54.498325+0000 mgr.y (mgr.24461) 774 : cluster [DBG] pgmap v1205: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:56.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:56 smithi080 bash[17386]: audit 2024-02-13T00:49:55.303050+0000 mon.a (mon.0) 3139 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132"}]': finished 2024-02-13T00:49:56.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:56 smithi080 bash[17386]: cluster 2024-02-13T00:49:55.303178+0000 mon.a (mon.0) 3140 : cluster [DBG] osdmap e676: 8 total, 8 up, 8 in 2024-02-13T00:49:56.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:56 smithi080 bash[17386]: audit 2024-02-13T00:49:55.341372+0000 mon.c (mon.2) 506 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:56.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:56 smithi080 bash[17386]: audit 2024-02-13T00:49:55.341926+0000 mon.a (mon.0) 3141 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:49:56.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:56 smithi080 bash[17386]: audit 2024-02-13T00:49:55.342887+0000 mon.c (mon.2) 507 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132"}]: dispatch 2024-02-13T00:49:56.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:56 smithi080 bash[17386]: audit 2024-02-13T00:49:55.343292+0000 mon.a (mon.0) 3142 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-132"}]: dispatch 2024-02-13T00:49:57.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:57 smithi106 bash[18459]: cluster 2024-02-13T00:49:56.323135+0000 mon.a (mon.0) 3143 : cluster [DBG] osdmap e677: 8 total, 8 up, 8 in 2024-02-13T00:49:57.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:57 smithi106 bash[18459]: cluster 2024-02-13T00:49:56.499003+0000 mgr.y (mgr.24461) 775 : cluster [DBG] pgmap v1208: 172 pgs: 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:57.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:57 smithi080 bash[17386]: cluster 2024-02-13T00:49:56.323135+0000 mon.a (mon.0) 3143 : cluster [DBG] osdmap e677: 8 total, 8 up, 8 in 2024-02-13T00:49:57.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:57 smithi080 bash[17386]: cluster 2024-02-13T00:49:56.499003+0000 mgr.y (mgr.24461) 775 : cluster [DBG] pgmap v1208: 172 pgs: 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:57.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:57 smithi080 bash[24237]: cluster 2024-02-13T00:49:56.323135+0000 mon.a (mon.0) 3143 : cluster [DBG] osdmap e677: 8 total, 8 up, 8 in 2024-02-13T00:49:57.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:57 smithi080 bash[24237]: cluster 2024-02-13T00:49:56.499003+0000 mgr.y (mgr.24461) 775 : cluster [DBG] pgmap v1208: 172 pgs: 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:49:58.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:58 smithi106 bash[18459]: cluster 2024-02-13T00:49:57.333507+0000 mon.a (mon.0) 3144 : cluster [DBG] osdmap e678: 8 total, 8 up, 8 in 2024-02-13T00:49:58.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:58 smithi106 bash[18459]: audit 2024-02-13T00:49:57.335414+0000 mon.c (mon.2) 508 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:58.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:58 smithi106 bash[18459]: audit 2024-02-13T00:49:57.339562+0000 mon.a (mon.0) 3145 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:58.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:58 smithi080 bash[17386]: cluster 2024-02-13T00:49:57.333507+0000 mon.a (mon.0) 3144 : cluster [DBG] osdmap e678: 8 total, 8 up, 8 in 2024-02-13T00:49:58.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:58 smithi080 bash[17386]: audit 2024-02-13T00:49:57.335414+0000 mon.c (mon.2) 508 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:58.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:58 smithi080 bash[17386]: audit 2024-02-13T00:49:57.339562+0000 mon.a (mon.0) 3145 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:58.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:58 smithi080 bash[24237]: cluster 2024-02-13T00:49:57.333507+0000 mon.a (mon.0) 3144 : cluster [DBG] osdmap e678: 8 total, 8 up, 8 in 2024-02-13T00:49:58.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:58 smithi080 bash[24237]: audit 2024-02-13T00:49:57.335414+0000 mon.c (mon.2) 508 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:58.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:58 smithi080 bash[24237]: audit 2024-02-13T00:49:57.339562+0000 mon.a (mon.0) 3145 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:49:59.256 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:49:58 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:49:59.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:59 smithi106 bash[18459]: audit 2024-02-13T00:49:58.337892+0000 mon.a (mon.0) 3146 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:49:59.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:59 smithi106 bash[18459]: cluster 2024-02-13T00:49:58.338302+0000 mon.a (mon.0) 3147 : cluster [DBG] osdmap e679: 8 total, 8 up, 8 in 2024-02-13T00:49:59.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:59 smithi106 bash[18459]: audit 2024-02-13T00:49:58.363185+0000 mon.c (mon.2) 509 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:59.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:59 smithi106 bash[18459]: audit 2024-02-13T00:49:58.363655+0000 mon.a (mon.0) 3148 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:59.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:59 smithi106 bash[18459]: cluster 2024-02-13T00:49:58.499785+0000 mgr.y (mgr.24461) 776 : cluster [DBG] pgmap v1211: 204 pgs: 32 creating+peering, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T00:49:59.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:49:59 smithi106 bash[18459]: audit 2024-02-13T00:49:58.793114+0000 mgr.y (mgr.24461) 777 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:49:59.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:59 smithi080 bash[17386]: audit 2024-02-13T00:49:58.337892+0000 mon.a (mon.0) 3146 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:49:59.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:59 smithi080 bash[17386]: cluster 2024-02-13T00:49:58.338302+0000 mon.a (mon.0) 3147 : cluster [DBG] osdmap e679: 8 total, 8 up, 8 in 2024-02-13T00:49:59.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:59 smithi080 bash[17386]: audit 2024-02-13T00:49:58.363185+0000 mon.c (mon.2) 509 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:59.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:59 smithi080 bash[17386]: audit 2024-02-13T00:49:58.363655+0000 mon.a (mon.0) 3148 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:59.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:59 smithi080 bash[17386]: cluster 2024-02-13T00:49:58.499785+0000 mgr.y (mgr.24461) 776 : cluster [DBG] pgmap v1211: 204 pgs: 32 creating+peering, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T00:49:59.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:49:59 smithi080 bash[17386]: audit 2024-02-13T00:49:58.793114+0000 mgr.y (mgr.24461) 777 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:49:59.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:59 smithi080 bash[24237]: audit 2024-02-13T00:49:58.337892+0000 mon.a (mon.0) 3146 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:49:59.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:59 smithi080 bash[24237]: cluster 2024-02-13T00:49:58.338302+0000 mon.a (mon.0) 3147 : cluster [DBG] osdmap e679: 8 total, 8 up, 8 in 2024-02-13T00:49:59.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:59 smithi080 bash[24237]: audit 2024-02-13T00:49:58.363185+0000 mon.c (mon.2) 509 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:59.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:59 smithi080 bash[24237]: audit 2024-02-13T00:49:58.363655+0000 mon.a (mon.0) 3148 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:49:59.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:59 smithi080 bash[24237]: cluster 2024-02-13T00:49:58.499785+0000 mgr.y (mgr.24461) 776 : cluster [DBG] pgmap v1211: 204 pgs: 32 creating+peering, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T00:49:59.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:49:59 smithi080 bash[24237]: audit 2024-02-13T00:49:58.793114+0000 mgr.y (mgr.24461) 777 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:50:00.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:50:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:50:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:50:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:00 smithi106 bash[18459]: audit 2024-02-13T00:49:59.364613+0000 mon.a (mon.0) 3149 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:50:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:00 smithi106 bash[18459]: cluster 2024-02-13T00:49:59.364787+0000 mon.a (mon.0) 3150 : cluster [DBG] osdmap e680: 8 total, 8 up, 8 in 2024-02-13T00:50:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:00 smithi106 bash[18459]: audit 2024-02-13T00:49:59.369081+0000 mon.c (mon.2) 510 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-134"}]: dispatch 2024-02-13T00:50:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:00 smithi106 bash[18459]: audit 2024-02-13T00:49:59.370061+0000 mon.a (mon.0) 3151 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-134"}]: dispatch 2024-02-13T00:50:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:00 smithi106 bash[18459]: cluster 2024-02-13T00:50:00.000192+0000 mon.a (mon.0) 3152 : cluster [WRN] Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2024-02-13T00:50:00.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:00 smithi106 bash[18459]: cluster 2024-02-13T00:50:00.000241+0000 mon.a (mon.0) 3153 : cluster [WRN] [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2024-02-13T00:50:00.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:00 smithi106 bash[18459]: cluster 2024-02-13T00:50:00.000281+0000 mon.a (mon.0) 3154 : cluster [WRN] application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-13T00:50:00.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:00 smithi106 bash[18459]: cluster 2024-02-13T00:50:00.000301+0000 mon.a (mon.0) 3155 : cluster [WRN] application not enabled on pool 'test-rados-api-smithi080-54255-101' 2024-02-13T00:50:00.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:00 smithi106 bash[18459]: cluster 2024-02-13T00:50:00.000330+0000 mon.a (mon.0) 3156 : cluster [WRN] use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-13T00:50:00.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:00 smithi080 bash[24237]: audit 2024-02-13T00:49:59.364613+0000 mon.a (mon.0) 3149 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:50:00.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:00 smithi080 bash[24237]: cluster 2024-02-13T00:49:59.364787+0000 mon.a (mon.0) 3150 : cluster [DBG] osdmap e680: 8 total, 8 up, 8 in 2024-02-13T00:50:00.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:00 smithi080 bash[24237]: audit 2024-02-13T00:49:59.369081+0000 mon.c (mon.2) 510 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-134"}]: dispatch 2024-02-13T00:50:00.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:00 smithi080 bash[24237]: audit 2024-02-13T00:49:59.370061+0000 mon.a (mon.0) 3151 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-134"}]: dispatch 2024-02-13T00:50:00.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:00 smithi080 bash[24237]: cluster 2024-02-13T00:50:00.000192+0000 mon.a (mon.0) 3152 : cluster [WRN] Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2024-02-13T00:50:00.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:00 smithi080 bash[24237]: cluster 2024-02-13T00:50:00.000241+0000 mon.a (mon.0) 3153 : cluster [WRN] [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2024-02-13T00:50:00.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:00 smithi080 bash[24237]: cluster 2024-02-13T00:50:00.000281+0000 mon.a (mon.0) 3154 : cluster [WRN] application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-13T00:50:00.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:00 smithi080 bash[24237]: cluster 2024-02-13T00:50:00.000301+0000 mon.a (mon.0) 3155 : cluster [WRN] application not enabled on pool 'test-rados-api-smithi080-54255-101' 2024-02-13T00:50:00.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:00 smithi080 bash[24237]: cluster 2024-02-13T00:50:00.000330+0000 mon.a (mon.0) 3156 : cluster [WRN] use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-13T00:50:00.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:00 smithi080 bash[17386]: audit 2024-02-13T00:49:59.364613+0000 mon.a (mon.0) 3149 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:50:00.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:00 smithi080 bash[17386]: cluster 2024-02-13T00:49:59.364787+0000 mon.a (mon.0) 3150 : cluster [DBG] osdmap e680: 8 total, 8 up, 8 in 2024-02-13T00:50:00.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:00 smithi080 bash[17386]: audit 2024-02-13T00:49:59.369081+0000 mon.c (mon.2) 510 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-134"}]: dispatch 2024-02-13T00:50:00.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:00 smithi080 bash[17386]: audit 2024-02-13T00:49:59.370061+0000 mon.a (mon.0) 3151 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-134"}]: dispatch 2024-02-13T00:50:00.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:00 smithi080 bash[17386]: cluster 2024-02-13T00:50:00.000192+0000 mon.a (mon.0) 3152 : cluster [WRN] Health detail: HEALTH_WARN 2 pool(s) do not have an application enabled 2024-02-13T00:50:00.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:00 smithi080 bash[17386]: cluster 2024-02-13T00:50:00.000241+0000 mon.a (mon.0) 3153 : cluster [WRN] [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled 2024-02-13T00:50:00.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:00 smithi080 bash[17386]: cluster 2024-02-13T00:50:00.000281+0000 mon.a (mon.0) 3154 : cluster [WRN] application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-13T00:50:00.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:00 smithi080 bash[17386]: cluster 2024-02-13T00:50:00.000301+0000 mon.a (mon.0) 3155 : cluster [WRN] application not enabled on pool 'test-rados-api-smithi080-54255-101' 2024-02-13T00:50:00.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:00 smithi080 bash[17386]: cluster 2024-02-13T00:50:00.000330+0000 mon.a (mon.0) 3156 : cluster [WRN] use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-13T00:50:01.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:01 smithi106 bash[18459]: audit 2024-02-13T00:50:00.364791+0000 mon.a (mon.0) 3157 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-134"}]': finished 2024-02-13T00:50:01.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:01 smithi106 bash[18459]: cluster 2024-02-13T00:50:00.365128+0000 mon.a (mon.0) 3158 : cluster [DBG] osdmap e681: 8 total, 8 up, 8 in 2024-02-13T00:50:01.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:01 smithi106 bash[18459]: audit 2024-02-13T00:50:00.367171+0000 mon.c (mon.2) 511 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-134", "mode": "readproxy"}]: dispatch 2024-02-13T00:50:01.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:01 smithi106 bash[18459]: audit 2024-02-13T00:50:00.373618+0000 mon.a (mon.0) 3159 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-134", "mode": "readproxy"}]: dispatch 2024-02-13T00:50:01.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:01 smithi106 bash[18459]: cluster 2024-02-13T00:50:00.500489+0000 mgr.y (mgr.24461) 778 : cluster [DBG] pgmap v1214: 204 pgs: 32 creating+peering, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T00:50:01.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:01 smithi080 bash[17386]: audit 2024-02-13T00:50:00.364791+0000 mon.a (mon.0) 3157 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-134"}]': finished 2024-02-13T00:50:01.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:01 smithi080 bash[17386]: cluster 2024-02-13T00:50:00.365128+0000 mon.a (mon.0) 3158 : cluster [DBG] osdmap e681: 8 total, 8 up, 8 in 2024-02-13T00:50:01.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:01 smithi080 bash[17386]: audit 2024-02-13T00:50:00.367171+0000 mon.c (mon.2) 511 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-134", "mode": "readproxy"}]: dispatch 2024-02-13T00:50:01.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:01 smithi080 bash[17386]: audit 2024-02-13T00:50:00.373618+0000 mon.a (mon.0) 3159 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-134", "mode": "readproxy"}]: dispatch 2024-02-13T00:50:01.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:01 smithi080 bash[17386]: cluster 2024-02-13T00:50:00.500489+0000 mgr.y (mgr.24461) 778 : cluster [DBG] pgmap v1214: 204 pgs: 32 creating+peering, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T00:50:01.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:01 smithi080 bash[24237]: audit 2024-02-13T00:50:00.364791+0000 mon.a (mon.0) 3157 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-134"}]': finished 2024-02-13T00:50:01.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:01 smithi080 bash[24237]: cluster 2024-02-13T00:50:00.365128+0000 mon.a (mon.0) 3158 : cluster [DBG] osdmap e681: 8 total, 8 up, 8 in 2024-02-13T00:50:01.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:01 smithi080 bash[24237]: audit 2024-02-13T00:50:00.367171+0000 mon.c (mon.2) 511 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-134", "mode": "readproxy"}]: dispatch 2024-02-13T00:50:01.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:01 smithi080 bash[24237]: audit 2024-02-13T00:50:00.373618+0000 mon.a (mon.0) 3159 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-134", "mode": "readproxy"}]: dispatch 2024-02-13T00:50:01.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:01 smithi080 bash[24237]: cluster 2024-02-13T00:50:00.500489+0000 mgr.y (mgr.24461) 778 : cluster [DBG] pgmap v1214: 204 pgs: 32 creating+peering, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T00:50:02.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:02 smithi106 bash[18459]: cluster 2024-02-13T00:50:01.368648+0000 mon.a (mon.0) 3160 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:50:02.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:02 smithi106 bash[18459]: audit 2024-02-13T00:50:01.375476+0000 mon.a (mon.0) 3161 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-134", "mode": "readproxy"}]': finished 2024-02-13T00:50:02.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:02 smithi106 bash[18459]: cluster 2024-02-13T00:50:01.375633+0000 mon.a (mon.0) 3162 : cluster [DBG] osdmap e682: 8 total, 8 up, 8 in 2024-02-13T00:50:02.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:02 smithi106 bash[18459]: audit 2024-02-13T00:50:01.930785+0000 mon.a (mon.0) 3163 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:50:02.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:02 smithi080 bash[24237]: cluster 2024-02-13T00:50:01.368648+0000 mon.a (mon.0) 3160 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:50:02.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:02 smithi080 bash[24237]: audit 2024-02-13T00:50:01.375476+0000 mon.a (mon.0) 3161 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-134", "mode": "readproxy"}]': finished 2024-02-13T00:50:02.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:02 smithi080 bash[24237]: cluster 2024-02-13T00:50:01.375633+0000 mon.a (mon.0) 3162 : cluster [DBG] osdmap e682: 8 total, 8 up, 8 in 2024-02-13T00:50:02.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:02 smithi080 bash[24237]: audit 2024-02-13T00:50:01.930785+0000 mon.a (mon.0) 3163 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:50:02.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:02 smithi080 bash[17386]: cluster 2024-02-13T00:50:01.368648+0000 mon.a (mon.0) 3160 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:50:02.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:02 smithi080 bash[17386]: audit 2024-02-13T00:50:01.375476+0000 mon.a (mon.0) 3161 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-134", "mode": "readproxy"}]': finished 2024-02-13T00:50:02.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:02 smithi080 bash[17386]: cluster 2024-02-13T00:50:01.375633+0000 mon.a (mon.0) 3162 : cluster [DBG] osdmap e682: 8 total, 8 up, 8 in 2024-02-13T00:50:02.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:02 smithi080 bash[17386]: audit 2024-02-13T00:50:01.930785+0000 mon.a (mon.0) 3163 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:50:03.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:50:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:50:03] "GET /metrics HTTP/1.1" 200 191019 "" "Prometheus/2.33.4" 2024-02-13T00:50:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:04 smithi106 bash[18459]: cluster 2024-02-13T00:50:02.501227+0000 mgr.y (mgr.24461) 779 : cluster [DBG] pgmap v1216: 204 pgs: 32 creating+peering, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:50:04.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:04 smithi080 bash[17386]: cluster 2024-02-13T00:50:02.501227+0000 mgr.y (mgr.24461) 779 : cluster [DBG] pgmap v1216: 204 pgs: 32 creating+peering, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:50:04.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:04 smithi080 bash[24237]: cluster 2024-02-13T00:50:02.501227+0000 mgr.y (mgr.24461) 779 : cluster [DBG] pgmap v1216: 204 pgs: 32 creating+peering, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:50:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:06 smithi106 bash[18459]: cluster 2024-02-13T00:50:04.503124+0000 mgr.y (mgr.24461) 780 : cluster [DBG] pgmap v1217: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 72 KiB/s rd, 170 B/s wr, 120 op/s 2024-02-13T00:50:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:06 smithi080 bash[17386]: cluster 2024-02-13T00:50:04.503124+0000 mgr.y (mgr.24461) 780 : cluster [DBG] pgmap v1217: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 72 KiB/s rd, 170 B/s wr, 120 op/s 2024-02-13T00:50:06.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:06 smithi080 bash[24237]: cluster 2024-02-13T00:50:04.503124+0000 mgr.y (mgr.24461) 780 : cluster [DBG] pgmap v1217: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 72 KiB/s rd, 170 B/s wr, 120 op/s 2024-02-13T00:50:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:08 smithi106 bash[18459]: cluster 2024-02-13T00:50:06.503946+0000 mgr.y (mgr.24461) 781 : cluster [DBG] pgmap v1218: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 61 KiB/s rd, 143 B/s wr, 101 op/s 2024-02-13T00:50:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:08 smithi080 bash[17386]: cluster 2024-02-13T00:50:06.503946+0000 mgr.y (mgr.24461) 781 : cluster [DBG] pgmap v1218: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 61 KiB/s rd, 143 B/s wr, 101 op/s 2024-02-13T00:50:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:08 smithi080 bash[24237]: cluster 2024-02-13T00:50:06.503946+0000 mgr.y (mgr.24461) 781 : cluster [DBG] pgmap v1218: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 61 KiB/s rd, 143 B/s wr, 101 op/s 2024-02-13T00:50:09.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:50:08 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:50:10.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:50:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:50:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:50:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:10 smithi106 bash[18459]: cluster 2024-02-13T00:50:08.506170+0000 mgr.y (mgr.24461) 782 : cluster [DBG] pgmap v1219: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 54 KiB/s rd, 125 B/s wr, 89 op/s 2024-02-13T00:50:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:10 smithi106 bash[18459]: audit 2024-02-13T00:50:08.801788+0000 mgr.y (mgr.24461) 783 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:50:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:10 smithi106 bash[18459]: audit 2024-02-13T00:50:09.605894+0000 mon.c (mon.2) 512 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:50:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:10 smithi106 bash[18459]: audit 2024-02-13T00:50:09.901062+0000 mon.c (mon.2) 513 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:50:10.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:10 smithi106 bash[18459]: audit 2024-02-13T00:50:09.902383+0000 mon.c (mon.2) 514 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:50:10.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:10 smithi106 bash[18459]: audit 2024-02-13T00:50:09.910724+0000 mon.a (mon.0) 3164 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:50:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:10 smithi080 bash[17386]: cluster 2024-02-13T00:50:08.506170+0000 mgr.y (mgr.24461) 782 : cluster [DBG] pgmap v1219: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 54 KiB/s rd, 125 B/s wr, 89 op/s 2024-02-13T00:50:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:10 smithi080 bash[17386]: audit 2024-02-13T00:50:08.801788+0000 mgr.y (mgr.24461) 783 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:50:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:10 smithi080 bash[17386]: audit 2024-02-13T00:50:09.605894+0000 mon.c (mon.2) 512 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:50:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:10 smithi080 bash[17386]: audit 2024-02-13T00:50:09.901062+0000 mon.c (mon.2) 513 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:50:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:10 smithi080 bash[17386]: audit 2024-02-13T00:50:09.902383+0000 mon.c (mon.2) 514 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:50:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:10 smithi080 bash[17386]: audit 2024-02-13T00:50:09.910724+0000 mon.a (mon.0) 3164 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:50:10.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:10 smithi080 bash[24237]: cluster 2024-02-13T00:50:08.506170+0000 mgr.y (mgr.24461) 782 : cluster [DBG] pgmap v1219: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 54 KiB/s rd, 125 B/s wr, 89 op/s 2024-02-13T00:50:10.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:10 smithi080 bash[24237]: audit 2024-02-13T00:50:08.801788+0000 mgr.y (mgr.24461) 783 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:50:10.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:10 smithi080 bash[24237]: audit 2024-02-13T00:50:09.605894+0000 mon.c (mon.2) 512 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:50:10.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:10 smithi080 bash[24237]: audit 2024-02-13T00:50:09.901062+0000 mon.c (mon.2) 513 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:50:10.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:10 smithi080 bash[24237]: audit 2024-02-13T00:50:09.902383+0000 mon.c (mon.2) 514 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:50:10.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:10 smithi080 bash[24237]: audit 2024-02-13T00:50:09.910724+0000 mon.a (mon.0) 3164 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:50:12.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:12 smithi106 bash[18459]: cluster 2024-02-13T00:50:10.506648+0000 mgr.y (mgr.24461) 784 : cluster [DBG] pgmap v1220: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 44 KiB/s rd, 102 B/s wr, 72 op/s 2024-02-13T00:50:12.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:12 smithi106 bash[18459]: audit 2024-02-13T00:50:11.631614+0000 mon.c (mon.2) 515 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:12.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:12 smithi106 bash[18459]: audit 2024-02-13T00:50:11.632352+0000 mon.a (mon.0) 3165 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:12.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:12 smithi080 bash[17386]: cluster 2024-02-13T00:50:10.506648+0000 mgr.y (mgr.24461) 784 : cluster [DBG] pgmap v1220: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 44 KiB/s rd, 102 B/s wr, 72 op/s 2024-02-13T00:50:12.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:12 smithi080 bash[17386]: audit 2024-02-13T00:50:11.631614+0000 mon.c (mon.2) 515 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:12.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:12 smithi080 bash[17386]: audit 2024-02-13T00:50:11.632352+0000 mon.a (mon.0) 3165 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:12.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:12 smithi080 bash[24237]: cluster 2024-02-13T00:50:10.506648+0000 mgr.y (mgr.24461) 784 : cluster [DBG] pgmap v1220: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 44 KiB/s rd, 102 B/s wr, 72 op/s 2024-02-13T00:50:12.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:12 smithi080 bash[24237]: audit 2024-02-13T00:50:11.631614+0000 mon.c (mon.2) 515 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:12.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:12 smithi080 bash[24237]: audit 2024-02-13T00:50:11.632352+0000 mon.a (mon.0) 3165 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:13.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:13 smithi106 bash[18459]: audit 2024-02-13T00:50:12.180279+0000 mon.a (mon.0) 3166 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:50:13.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:13 smithi106 bash[18459]: cluster 2024-02-13T00:50:12.180448+0000 mon.a (mon.0) 3167 : cluster [DBG] osdmap e683: 8 total, 8 up, 8 in 2024-02-13T00:50:13.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:13 smithi106 bash[18459]: audit 2024-02-13T00:50:12.182343+0000 mon.c (mon.2) 516 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134"}]: dispatch 2024-02-13T00:50:13.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:13 smithi106 bash[18459]: audit 2024-02-13T00:50:12.183268+0000 mon.a (mon.0) 3168 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134"}]: dispatch 2024-02-13T00:50:13.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:13 smithi106 bash[18459]: cluster 2024-02-13T00:50:13.174836+0000 mon.a (mon.0) 3169 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:50:13.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:13 smithi106 bash[18459]: audit 2024-02-13T00:50:13.183075+0000 mon.a (mon.0) 3170 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134"}]': finished 2024-02-13T00:50:13.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:13 smithi106 bash[18459]: cluster 2024-02-13T00:50:13.183353+0000 mon.a (mon.0) 3171 : cluster [DBG] osdmap e684: 8 total, 8 up, 8 in 2024-02-13T00:50:13.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:50:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:50:13] "GET /metrics HTTP/1.1" 200 191019 "" "Prometheus/2.33.4" 2024-02-13T00:50:13.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:13 smithi080 bash[17386]: audit 2024-02-13T00:50:12.180279+0000 mon.a (mon.0) 3166 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:50:13.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:13 smithi080 bash[17386]: cluster 2024-02-13T00:50:12.180448+0000 mon.a (mon.0) 3167 : cluster [DBG] osdmap e683: 8 total, 8 up, 8 in 2024-02-13T00:50:13.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:13 smithi080 bash[17386]: audit 2024-02-13T00:50:12.182343+0000 mon.c (mon.2) 516 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134"}]: dispatch 2024-02-13T00:50:13.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:13 smithi080 bash[17386]: audit 2024-02-13T00:50:12.183268+0000 mon.a (mon.0) 3168 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134"}]: dispatch 2024-02-13T00:50:13.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:13 smithi080 bash[17386]: cluster 2024-02-13T00:50:13.174836+0000 mon.a (mon.0) 3169 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:50:13.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:13 smithi080 bash[17386]: audit 2024-02-13T00:50:13.183075+0000 mon.a (mon.0) 3170 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134"}]': finished 2024-02-13T00:50:13.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:13 smithi080 bash[17386]: cluster 2024-02-13T00:50:13.183353+0000 mon.a (mon.0) 3171 : cluster [DBG] osdmap e684: 8 total, 8 up, 8 in 2024-02-13T00:50:13.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:13 smithi080 bash[24237]: audit 2024-02-13T00:50:12.180279+0000 mon.a (mon.0) 3166 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:50:13.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:13 smithi080 bash[24237]: cluster 2024-02-13T00:50:12.180448+0000 mon.a (mon.0) 3167 : cluster [DBG] osdmap e683: 8 total, 8 up, 8 in 2024-02-13T00:50:13.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:13 smithi080 bash[24237]: audit 2024-02-13T00:50:12.182343+0000 mon.c (mon.2) 516 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134"}]: dispatch 2024-02-13T00:50:13.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:13 smithi080 bash[24237]: audit 2024-02-13T00:50:12.183268+0000 mon.a (mon.0) 3168 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134"}]: dispatch 2024-02-13T00:50:13.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:13 smithi080 bash[24237]: cluster 2024-02-13T00:50:13.174836+0000 mon.a (mon.0) 3169 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:50:13.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:13 smithi080 bash[24237]: audit 2024-02-13T00:50:13.183075+0000 mon.a (mon.0) 3170 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134"}]': finished 2024-02-13T00:50:13.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:13 smithi080 bash[24237]: cluster 2024-02-13T00:50:13.183353+0000 mon.a (mon.0) 3171 : cluster [DBG] osdmap e684: 8 total, 8 up, 8 in 2024-02-13T00:50:14.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:14 smithi106 bash[18459]: cluster 2024-02-13T00:50:12.507393+0000 mgr.y (mgr.24461) 785 : cluster [DBG] pgmap v1222: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 44 KiB/s rd, 102 B/s wr, 72 op/s 2024-02-13T00:50:14.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:14 smithi106 bash[18459]: audit 2024-02-13T00:50:13.216232+0000 mon.c (mon.2) 517 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:14.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:14 smithi106 bash[18459]: audit 2024-02-13T00:50:13.216813+0000 mon.a (mon.0) 3172 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:14.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:14 smithi106 bash[18459]: audit 2024-02-13T00:50:13.217707+0000 mon.c (mon.2) 518 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134"}]: dispatch 2024-02-13T00:50:14.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:14 smithi106 bash[18459]: audit 2024-02-13T00:50:13.218214+0000 mon.a (mon.0) 3173 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134"}]: dispatch 2024-02-13T00:50:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:14 smithi080 bash[17386]: cluster 2024-02-13T00:50:12.507393+0000 mgr.y (mgr.24461) 785 : cluster [DBG] pgmap v1222: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 44 KiB/s rd, 102 B/s wr, 72 op/s 2024-02-13T00:50:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:14 smithi080 bash[17386]: audit 2024-02-13T00:50:13.216232+0000 mon.c (mon.2) 517 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:14 smithi080 bash[17386]: audit 2024-02-13T00:50:13.216813+0000 mon.a (mon.0) 3172 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:14 smithi080 bash[17386]: audit 2024-02-13T00:50:13.217707+0000 mon.c (mon.2) 518 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134"}]: dispatch 2024-02-13T00:50:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:14 smithi080 bash[17386]: audit 2024-02-13T00:50:13.218214+0000 mon.a (mon.0) 3173 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134"}]: dispatch 2024-02-13T00:50:14.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:14 smithi080 bash[24237]: cluster 2024-02-13T00:50:12.507393+0000 mgr.y (mgr.24461) 785 : cluster [DBG] pgmap v1222: 204 pgs: 204 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 44 KiB/s rd, 102 B/s wr, 72 op/s 2024-02-13T00:50:14.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:14 smithi080 bash[24237]: audit 2024-02-13T00:50:13.216232+0000 mon.c (mon.2) 517 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:14.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:14 smithi080 bash[24237]: audit 2024-02-13T00:50:13.216813+0000 mon.a (mon.0) 3172 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:14.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:14 smithi080 bash[24237]: audit 2024-02-13T00:50:13.217707+0000 mon.c (mon.2) 518 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134"}]: dispatch 2024-02-13T00:50:14.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:14 smithi080 bash[24237]: audit 2024-02-13T00:50:13.218214+0000 mon.a (mon.0) 3173 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-134"}]: dispatch 2024-02-13T00:50:15.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:15 smithi106 bash[18459]: cluster 2024-02-13T00:50:14.207519+0000 mon.a (mon.0) 3174 : cluster [DBG] osdmap e685: 8 total, 8 up, 8 in 2024-02-13T00:50:15.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:15 smithi080 bash[17386]: cluster 2024-02-13T00:50:14.207519+0000 mon.a (mon.0) 3174 : cluster [DBG] osdmap e685: 8 total, 8 up, 8 in 2024-02-13T00:50:15.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:15 smithi080 bash[24237]: cluster 2024-02-13T00:50:14.207519+0000 mon.a (mon.0) 3174 : cluster [DBG] osdmap e685: 8 total, 8 up, 8 in 2024-02-13T00:50:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:16 smithi106 bash[18459]: cluster 2024-02-13T00:50:14.508232+0000 mgr.y (mgr.24461) 786 : cluster [DBG] pgmap v1225: 172 pgs: 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:50:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:16 smithi106 bash[18459]: cluster 2024-02-13T00:50:15.221925+0000 mon.a (mon.0) 3175 : cluster [DBG] osdmap e686: 8 total, 8 up, 8 in 2024-02-13T00:50:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:16 smithi106 bash[18459]: audit 2024-02-13T00:50:15.225503+0000 mon.c (mon.2) 519 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:16.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:16 smithi106 bash[18459]: audit 2024-02-13T00:50:15.226340+0000 mon.a (mon.0) 3176 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:16.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:16 smithi080 bash[17386]: cluster 2024-02-13T00:50:14.508232+0000 mgr.y (mgr.24461) 786 : cluster [DBG] pgmap v1225: 172 pgs: 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:50:16.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:16 smithi080 bash[17386]: cluster 2024-02-13T00:50:15.221925+0000 mon.a (mon.0) 3175 : cluster [DBG] osdmap e686: 8 total, 8 up, 8 in 2024-02-13T00:50:16.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:16 smithi080 bash[17386]: audit 2024-02-13T00:50:15.225503+0000 mon.c (mon.2) 519 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:16.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:16 smithi080 bash[17386]: audit 2024-02-13T00:50:15.226340+0000 mon.a (mon.0) 3176 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:16.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:16 smithi080 bash[24237]: cluster 2024-02-13T00:50:14.508232+0000 mgr.y (mgr.24461) 786 : cluster [DBG] pgmap v1225: 172 pgs: 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:50:16.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:16 smithi080 bash[24237]: cluster 2024-02-13T00:50:15.221925+0000 mon.a (mon.0) 3175 : cluster [DBG] osdmap e686: 8 total, 8 up, 8 in 2024-02-13T00:50:16.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:16 smithi080 bash[24237]: audit 2024-02-13T00:50:15.225503+0000 mon.c (mon.2) 519 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:16.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:16 smithi080 bash[24237]: audit 2024-02-13T00:50:15.226340+0000 mon.a (mon.0) 3176 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:17.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:17 smithi106 bash[18459]: audit 2024-02-13T00:50:16.223775+0000 mon.a (mon.0) 3177 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:50:17.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:17 smithi106 bash[18459]: cluster 2024-02-13T00:50:16.224128+0000 mon.a (mon.0) 3178 : cluster [DBG] osdmap e687: 8 total, 8 up, 8 in 2024-02-13T00:50:17.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:17 smithi106 bash[18459]: audit 2024-02-13T00:50:16.253511+0000 mon.c (mon.2) 520 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:50:17.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:17 smithi106 bash[18459]: audit 2024-02-13T00:50:16.253878+0000 mon.a (mon.0) 3179 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:50:17.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:17 smithi106 bash[18459]: audit 2024-02-13T00:50:16.931328+0000 mon.a (mon.0) 3180 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:50:17.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:17 smithi080 bash[17386]: audit 2024-02-13T00:50:16.223775+0000 mon.a (mon.0) 3177 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:50:17.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:17 smithi080 bash[17386]: cluster 2024-02-13T00:50:16.224128+0000 mon.a (mon.0) 3178 : cluster [DBG] osdmap e687: 8 total, 8 up, 8 in 2024-02-13T00:50:17.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:17 smithi080 bash[17386]: audit 2024-02-13T00:50:16.253511+0000 mon.c (mon.2) 520 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:50:17.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:17 smithi080 bash[17386]: audit 2024-02-13T00:50:16.253878+0000 mon.a (mon.0) 3179 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:50:17.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:17 smithi080 bash[17386]: audit 2024-02-13T00:50:16.931328+0000 mon.a (mon.0) 3180 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:50:17.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:17 smithi080 bash[24237]: audit 2024-02-13T00:50:16.223775+0000 mon.a (mon.0) 3177 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:50:17.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:17 smithi080 bash[24237]: cluster 2024-02-13T00:50:16.224128+0000 mon.a (mon.0) 3178 : cluster [DBG] osdmap e687: 8 total, 8 up, 8 in 2024-02-13T00:50:17.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:17 smithi080 bash[24237]: audit 2024-02-13T00:50:16.253511+0000 mon.c (mon.2) 520 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:50:17.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:17 smithi080 bash[24237]: audit 2024-02-13T00:50:16.253878+0000 mon.a (mon.0) 3179 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:50:17.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:17 smithi080 bash[24237]: audit 2024-02-13T00:50:16.931328+0000 mon.a (mon.0) 3180 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:50:18.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:18 smithi106 bash[18459]: cluster 2024-02-13T00:50:16.509191+0000 mgr.y (mgr.24461) 787 : cluster [DBG] pgmap v1228: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:50:18.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:18 smithi106 bash[18459]: audit 2024-02-13T00:50:17.239289+0000 mon.a (mon.0) 3181 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:50:18.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:18 smithi106 bash[18459]: cluster 2024-02-13T00:50:17.239530+0000 mon.a (mon.0) 3182 : cluster [DBG] osdmap e688: 8 total, 8 up, 8 in 2024-02-13T00:50:18.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:18 smithi106 bash[18459]: audit 2024-02-13T00:50:17.244280+0000 mon.c (mon.2) 521 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-136"}]: dispatch 2024-02-13T00:50:18.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:18 smithi106 bash[18459]: audit 2024-02-13T00:50:17.251225+0000 mon.a (mon.0) 3183 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-136"}]: dispatch 2024-02-13T00:50:18.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:18 smithi080 bash[17386]: cluster 2024-02-13T00:50:16.509191+0000 mgr.y (mgr.24461) 787 : cluster [DBG] pgmap v1228: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:50:18.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:18 smithi080 bash[17386]: audit 2024-02-13T00:50:17.239289+0000 mon.a (mon.0) 3181 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:50:18.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:18 smithi080 bash[17386]: cluster 2024-02-13T00:50:17.239530+0000 mon.a (mon.0) 3182 : cluster [DBG] osdmap e688: 8 total, 8 up, 8 in 2024-02-13T00:50:18.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:18 smithi080 bash[17386]: audit 2024-02-13T00:50:17.244280+0000 mon.c (mon.2) 521 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-136"}]: dispatch 2024-02-13T00:50:18.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:18 smithi080 bash[17386]: audit 2024-02-13T00:50:17.251225+0000 mon.a (mon.0) 3183 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-136"}]: dispatch 2024-02-13T00:50:18.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:18 smithi080 bash[24237]: cluster 2024-02-13T00:50:16.509191+0000 mgr.y (mgr.24461) 787 : cluster [DBG] pgmap v1228: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:50:18.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:18 smithi080 bash[24237]: audit 2024-02-13T00:50:17.239289+0000 mon.a (mon.0) 3181 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:50:18.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:18 smithi080 bash[24237]: cluster 2024-02-13T00:50:17.239530+0000 mon.a (mon.0) 3182 : cluster [DBG] osdmap e688: 8 total, 8 up, 8 in 2024-02-13T00:50:18.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:18 smithi080 bash[24237]: audit 2024-02-13T00:50:17.244280+0000 mon.c (mon.2) 521 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-136"}]: dispatch 2024-02-13T00:50:18.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:18 smithi080 bash[24237]: audit 2024-02-13T00:50:17.251225+0000 mon.a (mon.0) 3183 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-136"}]: dispatch 2024-02-13T00:50:19.256 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:50:18 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:50:19.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:19 smithi106 bash[18459]: audit 2024-02-13T00:50:18.339914+0000 mon.a (mon.0) 3184 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-136"}]': finished 2024-02-13T00:50:19.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:19 smithi106 bash[18459]: cluster 2024-02-13T00:50:18.340011+0000 mon.a (mon.0) 3185 : cluster [DBG] osdmap e689: 8 total, 8 up, 8 in 2024-02-13T00:50:19.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:19 smithi106 bash[18459]: audit 2024-02-13T00:50:18.341290+0000 mon.c (mon.2) 522 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-136", "mode": "writeback"}]: dispatch 2024-02-13T00:50:19.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:19 smithi106 bash[18459]: audit 2024-02-13T00:50:18.341686+0000 mon.a (mon.0) 3186 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-136", "mode": "writeback"}]: dispatch 2024-02-13T00:50:19.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:19 smithi106 bash[18459]: cluster 2024-02-13T00:50:18.510055+0000 mgr.y (mgr.24461) 788 : cluster [DBG] pgmap v1231: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T00:50:19.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:19 smithi106 bash[18459]: audit 2024-02-13T00:50:18.810594+0000 mgr.y (mgr.24461) 789 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:50:19.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:19 smithi080 bash[17386]: audit 2024-02-13T00:50:18.339914+0000 mon.a (mon.0) 3184 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-136"}]': finished 2024-02-13T00:50:19.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:19 smithi080 bash[17386]: cluster 2024-02-13T00:50:18.340011+0000 mon.a (mon.0) 3185 : cluster [DBG] osdmap e689: 8 total, 8 up, 8 in 2024-02-13T00:50:19.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:19 smithi080 bash[17386]: audit 2024-02-13T00:50:18.341290+0000 mon.c (mon.2) 522 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-136", "mode": "writeback"}]: dispatch 2024-02-13T00:50:19.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:19 smithi080 bash[17386]: audit 2024-02-13T00:50:18.341686+0000 mon.a (mon.0) 3186 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-136", "mode": "writeback"}]: dispatch 2024-02-13T00:50:19.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:19 smithi080 bash[17386]: cluster 2024-02-13T00:50:18.510055+0000 mgr.y (mgr.24461) 788 : cluster [DBG] pgmap v1231: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T00:50:19.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:19 smithi080 bash[17386]: audit 2024-02-13T00:50:18.810594+0000 mgr.y (mgr.24461) 789 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:50:19.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:19 smithi080 bash[24237]: audit 2024-02-13T00:50:18.339914+0000 mon.a (mon.0) 3184 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi080-54255-101", "overlaypool": "test-rados-api-smithi080-54255-136"}]': finished 2024-02-13T00:50:19.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:19 smithi080 bash[24237]: cluster 2024-02-13T00:50:18.340011+0000 mon.a (mon.0) 3185 : cluster [DBG] osdmap e689: 8 total, 8 up, 8 in 2024-02-13T00:50:19.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:19 smithi080 bash[24237]: audit 2024-02-13T00:50:18.341290+0000 mon.c (mon.2) 522 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-136", "mode": "writeback"}]: dispatch 2024-02-13T00:50:19.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:19 smithi080 bash[24237]: audit 2024-02-13T00:50:18.341686+0000 mon.a (mon.0) 3186 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-136", "mode": "writeback"}]: dispatch 2024-02-13T00:50:19.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:19 smithi080 bash[24237]: cluster 2024-02-13T00:50:18.510055+0000 mgr.y (mgr.24461) 788 : cluster [DBG] pgmap v1231: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T00:50:19.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:19 smithi080 bash[24237]: audit 2024-02-13T00:50:18.810594+0000 mgr.y (mgr.24461) 789 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:50:20.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:50:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:50:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:50:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:20 smithi106 bash[18459]: cluster 2024-02-13T00:50:19.337160+0000 mon.a (mon.0) 3187 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:50:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:20 smithi106 bash[18459]: audit 2024-02-13T00:50:19.350109+0000 mon.a (mon.0) 3188 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-136", "mode": "writeback"}]': finished 2024-02-13T00:50:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:20 smithi106 bash[18459]: cluster 2024-02-13T00:50:19.350212+0000 mon.a (mon.0) 3189 : cluster [DBG] osdmap e690: 8 total, 8 up, 8 in 2024-02-13T00:50:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:20 smithi106 bash[18459]: audit 2024-02-13T00:50:19.414740+0000 mon.c (mon.2) 523 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:50:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:20 smithi106 bash[18459]: audit 2024-02-13T00:50:19.415359+0000 mon.a (mon.0) 3190 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:50:20.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:20 smithi080 bash[17386]: cluster 2024-02-13T00:50:19.337160+0000 mon.a (mon.0) 3187 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:50:20.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:20 smithi080 bash[17386]: audit 2024-02-13T00:50:19.350109+0000 mon.a (mon.0) 3188 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-136", "mode": "writeback"}]': finished 2024-02-13T00:50:20.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:20 smithi080 bash[17386]: cluster 2024-02-13T00:50:19.350212+0000 mon.a (mon.0) 3189 : cluster [DBG] osdmap e690: 8 total, 8 up, 8 in 2024-02-13T00:50:20.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:20 smithi080 bash[17386]: audit 2024-02-13T00:50:19.414740+0000 mon.c (mon.2) 523 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:50:20.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:20 smithi080 bash[17386]: audit 2024-02-13T00:50:19.415359+0000 mon.a (mon.0) 3190 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:50:20.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:20 smithi080 bash[24237]: cluster 2024-02-13T00:50:19.337160+0000 mon.a (mon.0) 3187 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T00:50:20.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:20 smithi080 bash[24237]: audit 2024-02-13T00:50:19.350109+0000 mon.a (mon.0) 3188 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi080-54255-136", "mode": "writeback"}]': finished 2024-02-13T00:50:20.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:20 smithi080 bash[24237]: cluster 2024-02-13T00:50:19.350212+0000 mon.a (mon.0) 3189 : cluster [DBG] osdmap e690: 8 total, 8 up, 8 in 2024-02-13T00:50:20.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:20 smithi080 bash[24237]: audit 2024-02-13T00:50:19.414740+0000 mon.c (mon.2) 523 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:50:20.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:20 smithi080 bash[24237]: audit 2024-02-13T00:50:19.415359+0000 mon.a (mon.0) 3190 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T00:50:21.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:21 smithi106 bash[18459]: audit 2024-02-13T00:50:20.354022+0000 mon.a (mon.0) 3191 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:50:21.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:21 smithi106 bash[18459]: cluster 2024-02-13T00:50:20.354143+0000 mon.a (mon.0) 3192 : cluster [DBG] osdmap e691: 8 total, 8 up, 8 in 2024-02-13T00:50:21.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:21 smithi106 bash[18459]: audit 2024-02-13T00:50:20.359921+0000 mon.c (mon.2) 524 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:50:21.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:21 smithi106 bash[18459]: audit 2024-02-13T00:50:20.360493+0000 mon.a (mon.0) 3193 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:50:21.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:21 smithi106 bash[18459]: cluster 2024-02-13T00:50:20.510986+0000 mgr.y (mgr.24461) 790 : cluster [DBG] pgmap v1234: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T00:50:21.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:21 smithi080 bash[17386]: audit 2024-02-13T00:50:20.354022+0000 mon.a (mon.0) 3191 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:50:21.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:21 smithi080 bash[17386]: cluster 2024-02-13T00:50:20.354143+0000 mon.a (mon.0) 3192 : cluster [DBG] osdmap e691: 8 total, 8 up, 8 in 2024-02-13T00:50:21.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:21 smithi080 bash[17386]: audit 2024-02-13T00:50:20.359921+0000 mon.c (mon.2) 524 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:50:21.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:21 smithi080 bash[17386]: audit 2024-02-13T00:50:20.360493+0000 mon.a (mon.0) 3193 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:50:21.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:21 smithi080 bash[17386]: cluster 2024-02-13T00:50:20.510986+0000 mgr.y (mgr.24461) 790 : cluster [DBG] pgmap v1234: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T00:50:21.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:21 smithi080 bash[24237]: audit 2024-02-13T00:50:20.354022+0000 mon.a (mon.0) 3191 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_count","val": "2"}]': finished 2024-02-13T00:50:21.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:21 smithi080 bash[24237]: cluster 2024-02-13T00:50:20.354143+0000 mon.a (mon.0) 3192 : cluster [DBG] osdmap e691: 8 total, 8 up, 8 in 2024-02-13T00:50:21.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:21 smithi080 bash[24237]: audit 2024-02-13T00:50:20.359921+0000 mon.c (mon.2) 524 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:50:21.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:21 smithi080 bash[24237]: audit 2024-02-13T00:50:20.360493+0000 mon.a (mon.0) 3193 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T00:50:21.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:21 smithi080 bash[24237]: cluster 2024-02-13T00:50:20.510986+0000 mgr.y (mgr.24461) 790 : cluster [DBG] pgmap v1234: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T00:50:22.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:22 smithi106 bash[18459]: audit 2024-02-13T00:50:21.363616+0000 mon.a (mon.0) 3194 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:50:22.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:22 smithi106 bash[18459]: cluster 2024-02-13T00:50:21.363689+0000 mon.a (mon.0) 3195 : cluster [DBG] osdmap e692: 8 total, 8 up, 8 in 2024-02-13T00:50:22.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:22 smithi106 bash[18459]: audit 2024-02-13T00:50:21.369048+0000 mon.c (mon.2) 525 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:50:22.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:22 smithi106 bash[18459]: audit 2024-02-13T00:50:21.369647+0000 mon.a (mon.0) 3196 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:50:22.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:22 smithi080 bash[17386]: audit 2024-02-13T00:50:21.363616+0000 mon.a (mon.0) 3194 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:50:22.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:22 smithi080 bash[17386]: cluster 2024-02-13T00:50:21.363689+0000 mon.a (mon.0) 3195 : cluster [DBG] osdmap e692: 8 total, 8 up, 8 in 2024-02-13T00:50:22.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:22 smithi080 bash[17386]: audit 2024-02-13T00:50:21.369048+0000 mon.c (mon.2) 525 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:50:22.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:22 smithi080 bash[17386]: audit 2024-02-13T00:50:21.369647+0000 mon.a (mon.0) 3196 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:50:22.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:22 smithi080 bash[24237]: audit 2024-02-13T00:50:21.363616+0000 mon.a (mon.0) 3194 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_period","val": "600"}]': finished 2024-02-13T00:50:22.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:22 smithi080 bash[24237]: cluster 2024-02-13T00:50:21.363689+0000 mon.a (mon.0) 3195 : cluster [DBG] osdmap e692: 8 total, 8 up, 8 in 2024-02-13T00:50:22.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:22 smithi080 bash[24237]: audit 2024-02-13T00:50:21.369048+0000 mon.c (mon.2) 525 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:50:22.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:22 smithi080 bash[24237]: audit 2024-02-13T00:50:21.369647+0000 mon.a (mon.0) 3196 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T00:50:23.381 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:50:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:50:23] "GET /metrics HTTP/1.1" 200 191147 "" "Prometheus/2.33.4" 2024-02-13T00:50:23.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:23 smithi106 bash[18459]: cluster 2024-02-13T00:50:22.361463+0000 mon.a (mon.0) 3197 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:50:23.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:23 smithi106 bash[18459]: audit 2024-02-13T00:50:22.370990+0000 mon.a (mon.0) 3198 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T00:50:23.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:23 smithi106 bash[18459]: cluster 2024-02-13T00:50:22.371080+0000 mon.a (mon.0) 3199 : cluster [DBG] osdmap e693: 8 total, 8 up, 8 in 2024-02-13T00:50:23.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:23 smithi106 bash[18459]: audit 2024-02-13T00:50:22.374052+0000 mon.c (mon.2) 526 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T00:50:23.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:23 smithi106 bash[18459]: audit 2024-02-13T00:50:22.374880+0000 mon.a (mon.0) 3200 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T00:50:23.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:23 smithi106 bash[18459]: cluster 2024-02-13T00:50:22.511835+0000 mgr.y (mgr.24461) 791 : cluster [DBG] pgmap v1237: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:50:23.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:23 smithi106 bash[18459]: audit 2024-02-13T00:50:23.372944+0000 mon.a (mon.0) 3201 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T00:50:23.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:23 smithi106 bash[18459]: cluster 2024-02-13T00:50:23.373214+0000 mon.a (mon.0) 3202 : cluster [DBG] osdmap e694: 8 total, 8 up, 8 in 2024-02-13T00:50:23.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:23 smithi106 bash[18459]: audit 2024-02-13T00:50:23.375418+0000 mon.c (mon.2) 527 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "target_max_objects","val": "1"}]: dispatch 2024-02-13T00:50:23.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:23 smithi106 bash[18459]: audit 2024-02-13T00:50:23.375859+0000 mon.a (mon.0) 3203 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "target_max_objects","val": "1"}]: dispatch 2024-02-13T00:50:23.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:23 smithi080 bash[17386]: cluster 2024-02-13T00:50:22.361463+0000 mon.a (mon.0) 3197 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:50:23.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:23 smithi080 bash[17386]: audit 2024-02-13T00:50:22.370990+0000 mon.a (mon.0) 3198 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T00:50:23.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:23 smithi080 bash[17386]: cluster 2024-02-13T00:50:22.371080+0000 mon.a (mon.0) 3199 : cluster [DBG] osdmap e693: 8 total, 8 up, 8 in 2024-02-13T00:50:23.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:23 smithi080 bash[17386]: audit 2024-02-13T00:50:22.374052+0000 mon.c (mon.2) 526 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T00:50:23.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:23 smithi080 bash[17386]: audit 2024-02-13T00:50:22.374880+0000 mon.a (mon.0) 3200 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T00:50:23.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:23 smithi080 bash[17386]: cluster 2024-02-13T00:50:22.511835+0000 mgr.y (mgr.24461) 791 : cluster [DBG] pgmap v1237: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:50:23.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:23 smithi080 bash[17386]: audit 2024-02-13T00:50:23.372944+0000 mon.a (mon.0) 3201 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T00:50:23.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:23 smithi080 bash[17386]: cluster 2024-02-13T00:50:23.373214+0000 mon.a (mon.0) 3202 : cluster [DBG] osdmap e694: 8 total, 8 up, 8 in 2024-02-13T00:50:23.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:23 smithi080 bash[17386]: audit 2024-02-13T00:50:23.375418+0000 mon.c (mon.2) 527 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "target_max_objects","val": "1"}]: dispatch 2024-02-13T00:50:23.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:23 smithi080 bash[17386]: audit 2024-02-13T00:50:23.375859+0000 mon.a (mon.0) 3203 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "target_max_objects","val": "1"}]: dispatch 2024-02-13T00:50:23.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:23 smithi080 bash[24237]: cluster 2024-02-13T00:50:22.361463+0000 mon.a (mon.0) 3197 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T00:50:23.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:23 smithi080 bash[24237]: audit 2024-02-13T00:50:22.370990+0000 mon.a (mon.0) 3198 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T00:50:23.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:23 smithi080 bash[24237]: cluster 2024-02-13T00:50:22.371080+0000 mon.a (mon.0) 3199 : cluster [DBG] osdmap e693: 8 total, 8 up, 8 in 2024-02-13T00:50:23.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:23 smithi080 bash[24237]: audit 2024-02-13T00:50:22.374052+0000 mon.c (mon.2) 526 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T00:50:23.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:23 smithi080 bash[24237]: audit 2024-02-13T00:50:22.374880+0000 mon.a (mon.0) 3200 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T00:50:23.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:23 smithi080 bash[24237]: cluster 2024-02-13T00:50:22.511835+0000 mgr.y (mgr.24461) 791 : cluster [DBG] pgmap v1237: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:50:23.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:23 smithi080 bash[24237]: audit 2024-02-13T00:50:23.372944+0000 mon.a (mon.0) 3201 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T00:50:23.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:23 smithi080 bash[24237]: cluster 2024-02-13T00:50:23.373214+0000 mon.a (mon.0) 3202 : cluster [DBG] osdmap e694: 8 total, 8 up, 8 in 2024-02-13T00:50:23.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:23 smithi080 bash[24237]: audit 2024-02-13T00:50:23.375418+0000 mon.c (mon.2) 527 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "target_max_objects","val": "1"}]: dispatch 2024-02-13T00:50:23.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:23 smithi080 bash[24237]: audit 2024-02-13T00:50:23.375859+0000 mon.a (mon.0) 3203 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "target_max_objects","val": "1"}]: dispatch 2024-02-13T00:50:25.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:25 smithi106 bash[18459]: audit 2024-02-13T00:50:24.375088+0000 mon.a (mon.0) 3204 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "target_max_objects","val": "1"}]': finished 2024-02-13T00:50:25.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:25 smithi106 bash[18459]: cluster 2024-02-13T00:50:24.375248+0000 mon.a (mon.0) 3205 : cluster [DBG] osdmap e695: 8 total, 8 up, 8 in 2024-02-13T00:50:25.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:25 smithi106 bash[18459]: cluster 2024-02-13T00:50:24.512743+0000 mgr.y (mgr.24461) 792 : cluster [DBG] pgmap v1240: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-13T00:50:25.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:25 smithi080 bash[17386]: audit 2024-02-13T00:50:24.375088+0000 mon.a (mon.0) 3204 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "target_max_objects","val": "1"}]': finished 2024-02-13T00:50:25.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:25 smithi080 bash[17386]: cluster 2024-02-13T00:50:24.375248+0000 mon.a (mon.0) 3205 : cluster [DBG] osdmap e695: 8 total, 8 up, 8 in 2024-02-13T00:50:25.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:25 smithi080 bash[17386]: cluster 2024-02-13T00:50:24.512743+0000 mgr.y (mgr.24461) 792 : cluster [DBG] pgmap v1240: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-13T00:50:25.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:25 smithi080 bash[24237]: audit 2024-02-13T00:50:24.375088+0000 mon.a (mon.0) 3204 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-136","var": "target_max_objects","val": "1"}]': finished 2024-02-13T00:50:25.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:25 smithi080 bash[24237]: cluster 2024-02-13T00:50:24.375248+0000 mon.a (mon.0) 3205 : cluster [DBG] osdmap e695: 8 total, 8 up, 8 in 2024-02-13T00:50:25.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:25 smithi080 bash[24237]: cluster 2024-02-13T00:50:24.512743+0000 mgr.y (mgr.24461) 792 : cluster [DBG] pgmap v1240: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-13T00:50:26.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:26 smithi106 bash[18459]: cluster 2024-02-13T00:50:25.370631+0000 mon.a (mon.0) 3206 : cluster [WRN] Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-02-13T00:50:26.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:26 smithi080 bash[17386]: cluster 2024-02-13T00:50:25.370631+0000 mon.a (mon.0) 3206 : cluster [WRN] Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-02-13T00:50:26.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:26 smithi080 bash[24237]: cluster 2024-02-13T00:50:25.370631+0000 mon.a (mon.0) 3206 : cluster [WRN] Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-02-13T00:50:27.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:27 smithi106 bash[18459]: cluster 2024-02-13T00:50:26.513527+0000 mgr.y (mgr.24461) 793 : cluster [DBG] pgmap v1241: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-13T00:50:27.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:27 smithi080 bash[17386]: cluster 2024-02-13T00:50:26.513527+0000 mgr.y (mgr.24461) 793 : cluster [DBG] pgmap v1241: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-13T00:50:27.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:27 smithi080 bash[24237]: cluster 2024-02-13T00:50:26.513527+0000 mgr.y (mgr.24461) 793 : cluster [DBG] pgmap v1241: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-13T00:50:29.256 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:50:28 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:50:30.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:50:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:50:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:50:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:30 smithi106 bash[18459]: cluster 2024-02-13T00:50:28.515514+0000 mgr.y (mgr.24461) 794 : cluster [DBG] pgmap v1242: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-13T00:50:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:30 smithi106 bash[18459]: audit 2024-02-13T00:50:28.818478+0000 mgr.y (mgr.24461) 795 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:50:30.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:30 smithi080 bash[17386]: cluster 2024-02-13T00:50:28.515514+0000 mgr.y (mgr.24461) 794 : cluster [DBG] pgmap v1242: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-13T00:50:30.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:30 smithi080 bash[17386]: audit 2024-02-13T00:50:28.818478+0000 mgr.y (mgr.24461) 795 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:50:30.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:30 smithi080 bash[24237]: cluster 2024-02-13T00:50:28.515514+0000 mgr.y (mgr.24461) 794 : cluster [DBG] pgmap v1242: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-13T00:50:30.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:30 smithi080 bash[24237]: audit 2024-02-13T00:50:28.818478+0000 mgr.y (mgr.24461) 795 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:50:32.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:32 smithi106 bash[18459]: cluster 2024-02-13T00:50:30.516400+0000 mgr.y (mgr.24461) 796 : cluster [DBG] pgmap v1243: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-13T00:50:32.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:32 smithi106 bash[18459]: audit 2024-02-13T00:50:31.929506+0000 mon.a (mon.0) 3207 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:50:32.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:32 smithi080 bash[17386]: cluster 2024-02-13T00:50:30.516400+0000 mgr.y (mgr.24461) 796 : cluster [DBG] pgmap v1243: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-13T00:50:32.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:32 smithi080 bash[17386]: audit 2024-02-13T00:50:31.929506+0000 mon.a (mon.0) 3207 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:50:32.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:32 smithi080 bash[24237]: cluster 2024-02-13T00:50:30.516400+0000 mgr.y (mgr.24461) 796 : cluster [DBG] pgmap v1243: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-13T00:50:32.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:32 smithi080 bash[24237]: audit 2024-02-13T00:50:31.929506+0000 mon.a (mon.0) 3207 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:50:33.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:50:33 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:50:33] "GET /metrics HTTP/1.1" 200 191172 "" "Prometheus/2.33.4" 2024-02-13T00:50:34.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:34 smithi106 bash[18459]: cluster 2024-02-13T00:50:32.517211+0000 mgr.y (mgr.24461) 797 : cluster [DBG] pgmap v1244: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 559 B/s rd, 0 B/s wr, 0 op/s 2024-02-13T00:50:34.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:34 smithi080 bash[17386]: cluster 2024-02-13T00:50:32.517211+0000 mgr.y (mgr.24461) 797 : cluster [DBG] pgmap v1244: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 559 B/s rd, 0 B/s wr, 0 op/s 2024-02-13T00:50:34.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:34 smithi080 bash[24237]: cluster 2024-02-13T00:50:32.517211+0000 mgr.y (mgr.24461) 797 : cluster [DBG] pgmap v1244: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 559 B/s rd, 0 B/s wr, 0 op/s 2024-02-13T00:50:35.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:35 smithi106 bash[18459]: audit 2024-02-13T00:50:34.406767+0000 mon.c (mon.2) 528 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:35.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:35 smithi106 bash[18459]: audit 2024-02-13T00:50:34.407388+0000 mon.a (mon.0) 3208 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:35.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:35 smithi080 bash[17386]: audit 2024-02-13T00:50:34.406767+0000 mon.c (mon.2) 528 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:35.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:35 smithi080 bash[17386]: audit 2024-02-13T00:50:34.407388+0000 mon.a (mon.0) 3208 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:35.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:35 smithi080 bash[24237]: audit 2024-02-13T00:50:34.406767+0000 mon.c (mon.2) 528 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:35.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:35 smithi080 bash[24237]: audit 2024-02-13T00:50:34.407388+0000 mon.a (mon.0) 3208 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:36.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:36 smithi106 bash[18459]: cluster 2024-02-13T00:50:34.519202+0000 mgr.y (mgr.24461) 798 : cluster [DBG] pgmap v1245: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1009 B/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:50:36.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:36 smithi106 bash[18459]: audit 2024-02-13T00:50:35.201443+0000 mon.a (mon.0) 3209 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:50:36.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:36 smithi106 bash[18459]: cluster 2024-02-13T00:50:35.201533+0000 mon.a (mon.0) 3210 : cluster [DBG] osdmap e696: 8 total, 8 up, 8 in 2024-02-13T00:50:36.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:36 smithi106 bash[18459]: audit 2024-02-13T00:50:35.204942+0000 mon.c (mon.2) 529 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136"}]: dispatch 2024-02-13T00:50:36.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:36 smithi106 bash[18459]: audit 2024-02-13T00:50:35.205966+0000 mon.a (mon.0) 3211 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136"}]: dispatch 2024-02-13T00:50:36.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:36 smithi080 bash[17386]: cluster 2024-02-13T00:50:34.519202+0000 mgr.y (mgr.24461) 798 : cluster [DBG] pgmap v1245: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1009 B/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:50:36.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:36 smithi080 bash[17386]: audit 2024-02-13T00:50:35.201443+0000 mon.a (mon.0) 3209 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:50:36.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:36 smithi080 bash[17386]: cluster 2024-02-13T00:50:35.201533+0000 mon.a (mon.0) 3210 : cluster [DBG] osdmap e696: 8 total, 8 up, 8 in 2024-02-13T00:50:36.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:36 smithi080 bash[17386]: audit 2024-02-13T00:50:35.204942+0000 mon.c (mon.2) 529 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136"}]: dispatch 2024-02-13T00:50:36.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:36 smithi080 bash[17386]: audit 2024-02-13T00:50:35.205966+0000 mon.a (mon.0) 3211 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136"}]: dispatch 2024-02-13T00:50:36.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:36 smithi080 bash[24237]: cluster 2024-02-13T00:50:34.519202+0000 mgr.y (mgr.24461) 798 : cluster [DBG] pgmap v1245: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1009 B/s rd, 0 B/s wr, 1 op/s 2024-02-13T00:50:36.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:36 smithi080 bash[24237]: audit 2024-02-13T00:50:35.201443+0000 mon.a (mon.0) 3209 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:50:36.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:36 smithi080 bash[24237]: cluster 2024-02-13T00:50:35.201533+0000 mon.a (mon.0) 3210 : cluster [DBG] osdmap e696: 8 total, 8 up, 8 in 2024-02-13T00:50:36.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:36 smithi080 bash[24237]: audit 2024-02-13T00:50:35.204942+0000 mon.c (mon.2) 529 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136"}]: dispatch 2024-02-13T00:50:36.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:36 smithi080 bash[24237]: audit 2024-02-13T00:50:35.205966+0000 mon.a (mon.0) 3211 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136"}]: dispatch 2024-02-13T00:50:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:37 smithi106 bash[18459]: audit 2024-02-13T00:50:36.207101+0000 mon.a (mon.0) 3212 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136"}]': finished 2024-02-13T00:50:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:37 smithi106 bash[18459]: cluster 2024-02-13T00:50:36.207407+0000 mon.a (mon.0) 3213 : cluster [DBG] osdmap e697: 8 total, 8 up, 8 in 2024-02-13T00:50:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:37 smithi106 bash[18459]: audit 2024-02-13T00:50:36.248679+0000 mon.c (mon.2) 530 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:37 smithi106 bash[18459]: audit 2024-02-13T00:50:36.249312+0000 mon.a (mon.0) 3214 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:37 smithi106 bash[18459]: audit 2024-02-13T00:50:36.250297+0000 mon.c (mon.2) 531 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136"}]: dispatch 2024-02-13T00:50:37.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:37 smithi106 bash[18459]: audit 2024-02-13T00:50:36.250844+0000 mon.a (mon.0) 3215 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136"}]: dispatch 2024-02-13T00:50:37.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:37 smithi080 bash[24237]: audit 2024-02-13T00:50:36.207101+0000 mon.a (mon.0) 3212 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136"}]': finished 2024-02-13T00:50:37.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:37 smithi080 bash[24237]: cluster 2024-02-13T00:50:36.207407+0000 mon.a (mon.0) 3213 : cluster [DBG] osdmap e697: 8 total, 8 up, 8 in 2024-02-13T00:50:37.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:37 smithi080 bash[24237]: audit 2024-02-13T00:50:36.248679+0000 mon.c (mon.2) 530 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:37.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:37 smithi080 bash[24237]: audit 2024-02-13T00:50:36.249312+0000 mon.a (mon.0) 3214 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:37.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:37 smithi080 bash[24237]: audit 2024-02-13T00:50:36.250297+0000 mon.c (mon.2) 531 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136"}]: dispatch 2024-02-13T00:50:37.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:37 smithi080 bash[24237]: audit 2024-02-13T00:50:36.250844+0000 mon.a (mon.0) 3215 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136"}]: dispatch 2024-02-13T00:50:37.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:37 smithi080 bash[17386]: audit 2024-02-13T00:50:36.207101+0000 mon.a (mon.0) 3212 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136"}]': finished 2024-02-13T00:50:37.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:37 smithi080 bash[17386]: cluster 2024-02-13T00:50:36.207407+0000 mon.a (mon.0) 3213 : cluster [DBG] osdmap e697: 8 total, 8 up, 8 in 2024-02-13T00:50:37.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:37 smithi080 bash[17386]: audit 2024-02-13T00:50:36.248679+0000 mon.c (mon.2) 530 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:37.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:37 smithi080 bash[17386]: audit 2024-02-13T00:50:36.249312+0000 mon.a (mon.0) 3214 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:37.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:37 smithi080 bash[17386]: audit 2024-02-13T00:50:36.250297+0000 mon.c (mon.2) 531 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136"}]: dispatch 2024-02-13T00:50:37.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:37 smithi080 bash[17386]: audit 2024-02-13T00:50:36.250844+0000 mon.a (mon.0) 3215 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-136"}]: dispatch 2024-02-13T00:50:38.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:38 smithi106 bash[18459]: cluster 2024-02-13T00:50:36.520031+0000 mgr.y (mgr.24461) 799 : cluster [DBG] pgmap v1248: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:50:38.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:38 smithi106 bash[18459]: cluster 2024-02-13T00:50:37.210460+0000 mon.a (mon.0) 3216 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:50:38.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:38 smithi106 bash[18459]: cluster 2024-02-13T00:50:37.210530+0000 mon.a (mon.0) 3217 : cluster [INF] Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-02-13T00:50:38.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:38 smithi106 bash[18459]: cluster 2024-02-13T00:50:37.226476+0000 mon.a (mon.0) 3218 : cluster [DBG] osdmap e698: 8 total, 8 up, 8 in 2024-02-13T00:50:38.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:38 smithi080 bash[17386]: cluster 2024-02-13T00:50:36.520031+0000 mgr.y (mgr.24461) 799 : cluster [DBG] pgmap v1248: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:50:38.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:38 smithi080 bash[17386]: cluster 2024-02-13T00:50:37.210460+0000 mon.a (mon.0) 3216 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:50:38.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:38 smithi080 bash[17386]: cluster 2024-02-13T00:50:37.210530+0000 mon.a (mon.0) 3217 : cluster [INF] Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-02-13T00:50:38.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:38 smithi080 bash[17386]: cluster 2024-02-13T00:50:37.226476+0000 mon.a (mon.0) 3218 : cluster [DBG] osdmap e698: 8 total, 8 up, 8 in 2024-02-13T00:50:38.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:38 smithi080 bash[24237]: cluster 2024-02-13T00:50:36.520031+0000 mgr.y (mgr.24461) 799 : cluster [DBG] pgmap v1248: 204 pgs: 204 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:50:38.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:38 smithi080 bash[24237]: cluster 2024-02-13T00:50:37.210460+0000 mon.a (mon.0) 3216 : cluster [WRN] Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:50:38.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:38 smithi080 bash[24237]: cluster 2024-02-13T00:50:37.210530+0000 mon.a (mon.0) 3217 : cluster [INF] Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-02-13T00:50:38.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:38 smithi080 bash[24237]: cluster 2024-02-13T00:50:37.226476+0000 mon.a (mon.0) 3218 : cluster [DBG] osdmap e698: 8 total, 8 up, 8 in 2024-02-13T00:50:39.247 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:50:38 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:50:39.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:39 smithi106 bash[18459]: cluster 2024-02-13T00:50:38.228226+0000 mon.a (mon.0) 3219 : cluster [DBG] osdmap e699: 8 total, 8 up, 8 in 2024-02-13T00:50:39.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:39 smithi106 bash[18459]: audit 2024-02-13T00:50:38.232816+0000 mon.c (mon.2) 532 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:39.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:39 smithi106 bash[18459]: audit 2024-02-13T00:50:38.237426+0000 mon.a (mon.0) 3220 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:39.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:39 smithi080 bash[24237]: cluster 2024-02-13T00:50:38.228226+0000 mon.a (mon.0) 3219 : cluster [DBG] osdmap e699: 8 total, 8 up, 8 in 2024-02-13T00:50:39.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:39 smithi080 bash[24237]: audit 2024-02-13T00:50:38.232816+0000 mon.c (mon.2) 532 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:39.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:39 smithi080 bash[24237]: audit 2024-02-13T00:50:38.237426+0000 mon.a (mon.0) 3220 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:39.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:39 smithi080 bash[17386]: cluster 2024-02-13T00:50:38.228226+0000 mon.a (mon.0) 3219 : cluster [DBG] osdmap e699: 8 total, 8 up, 8 in 2024-02-13T00:50:39.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:39 smithi080 bash[17386]: audit 2024-02-13T00:50:38.232816+0000 mon.c (mon.2) 532 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:39.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:39 smithi080 bash[17386]: audit 2024-02-13T00:50:38.237426+0000 mon.a (mon.0) 3220 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:40.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:50:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:50:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:50:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:40 smithi106 bash[18459]: cluster 2024-02-13T00:50:38.520857+0000 mgr.y (mgr.24461) 800 : cluster [DBG] pgmap v1251: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-13T00:50:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:40 smithi106 bash[18459]: audit 2024-02-13T00:50:38.829755+0000 mgr.y (mgr.24461) 801 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:50:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:40 smithi106 bash[18459]: audit 2024-02-13T00:50:39.231968+0000 mon.a (mon.0) 3221 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:50:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:40 smithi106 bash[18459]: cluster 2024-02-13T00:50:39.232331+0000 mon.a (mon.0) 3222 : cluster [DBG] osdmap e700: 8 total, 8 up, 8 in 2024-02-13T00:50:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:40 smithi106 bash[18459]: audit 2024-02-13T00:50:39.265076+0000 mon.c (mon.2) 533 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:50:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:40 smithi106 bash[18459]: audit 2024-02-13T00:50:39.265439+0000 mon.a (mon.0) 3223 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:50:40.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:40 smithi080 bash[17386]: cluster 2024-02-13T00:50:38.520857+0000 mgr.y (mgr.24461) 800 : cluster [DBG] pgmap v1251: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-13T00:50:40.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:40 smithi080 bash[17386]: audit 2024-02-13T00:50:38.829755+0000 mgr.y (mgr.24461) 801 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:50:40.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:40 smithi080 bash[17386]: audit 2024-02-13T00:50:39.231968+0000 mon.a (mon.0) 3221 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:50:40.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:40 smithi080 bash[17386]: cluster 2024-02-13T00:50:39.232331+0000 mon.a (mon.0) 3222 : cluster [DBG] osdmap e700: 8 total, 8 up, 8 in 2024-02-13T00:50:40.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:40 smithi080 bash[17386]: audit 2024-02-13T00:50:39.265076+0000 mon.c (mon.2) 533 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:50:40.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:40 smithi080 bash[17386]: audit 2024-02-13T00:50:39.265439+0000 mon.a (mon.0) 3223 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:50:40.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:40 smithi080 bash[24237]: cluster 2024-02-13T00:50:38.520857+0000 mgr.y (mgr.24461) 800 : cluster [DBG] pgmap v1251: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-13T00:50:40.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:40 smithi080 bash[24237]: audit 2024-02-13T00:50:38.829755+0000 mgr.y (mgr.24461) 801 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:50:40.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:40 smithi080 bash[24237]: audit 2024-02-13T00:50:39.231968+0000 mon.a (mon.0) 3221 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:50:40.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:40 smithi080 bash[24237]: cluster 2024-02-13T00:50:39.232331+0000 mon.a (mon.0) 3222 : cluster [DBG] osdmap e700: 8 total, 8 up, 8 in 2024-02-13T00:50:40.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:40 smithi080 bash[24237]: audit 2024-02-13T00:50:39.265076+0000 mon.c (mon.2) 533 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:50:40.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:40 smithi080 bash[24237]: audit 2024-02-13T00:50:39.265439+0000 mon.a (mon.0) 3223 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T00:50:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:41 smithi106 bash[18459]: audit 2024-02-13T00:50:40.258205+0000 mon.a (mon.0) 3224 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:50:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:41 smithi106 bash[18459]: cluster 2024-02-13T00:50:40.258345+0000 mon.a (mon.0) 3225 : cluster [DBG] osdmap e701: 8 total, 8 up, 8 in 2024-02-13T00:50:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:41 smithi106 bash[18459]: audit 2024-02-13T00:50:40.266412+0000 mon.c (mon.2) 534 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138"}]: dispatch 2024-02-13T00:50:41.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:41 smithi106 bash[18459]: audit 2024-02-13T00:50:40.266896+0000 mon.a (mon.0) 3226 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138"}]: dispatch 2024-02-13T00:50:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:41 smithi080 bash[17386]: audit 2024-02-13T00:50:40.258205+0000 mon.a (mon.0) 3224 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:50:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:41 smithi080 bash[17386]: cluster 2024-02-13T00:50:40.258345+0000 mon.a (mon.0) 3225 : cluster [DBG] osdmap e701: 8 total, 8 up, 8 in 2024-02-13T00:50:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:41 smithi080 bash[17386]: audit 2024-02-13T00:50:40.266412+0000 mon.c (mon.2) 534 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138"}]: dispatch 2024-02-13T00:50:41.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:41 smithi080 bash[17386]: audit 2024-02-13T00:50:40.266896+0000 mon.a (mon.0) 3226 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138"}]: dispatch 2024-02-13T00:50:41.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:41 smithi080 bash[24237]: audit 2024-02-13T00:50:40.258205+0000 mon.a (mon.0) 3224 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T00:50:41.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:41 smithi080 bash[24237]: cluster 2024-02-13T00:50:40.258345+0000 mon.a (mon.0) 3225 : cluster [DBG] osdmap e701: 8 total, 8 up, 8 in 2024-02-13T00:50:41.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:41 smithi080 bash[24237]: audit 2024-02-13T00:50:40.266412+0000 mon.c (mon.2) 534 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138"}]: dispatch 2024-02-13T00:50:41.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:41 smithi080 bash[24237]: audit 2024-02-13T00:50:40.266896+0000 mon.a (mon.0) 3226 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138"}]: dispatch 2024-02-13T00:50:42.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:42 smithi106 bash[18459]: cluster 2024-02-13T00:50:40.521642+0000 mgr.y (mgr.24461) 802 : cluster [DBG] pgmap v1254: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-13T00:50:42.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:42 smithi106 bash[18459]: audit 2024-02-13T00:50:41.265989+0000 mon.a (mon.0) 3227 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138"}]': finished 2024-02-13T00:50:42.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:42 smithi106 bash[18459]: cluster 2024-02-13T00:50:41.266088+0000 mon.a (mon.0) 3228 : cluster [DBG] osdmap e702: 8 total, 8 up, 8 in 2024-02-13T00:50:42.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:42 smithi106 bash[18459]: audit 2024-02-13T00:50:41.307708+0000 mon.c (mon.2) 535 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:42.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:42 smithi106 bash[18459]: audit 2024-02-13T00:50:41.308202+0000 mon.a (mon.0) 3229 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:42.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:42 smithi106 bash[18459]: audit 2024-02-13T00:50:41.308959+0000 mon.c (mon.2) 536 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138"}]: dispatch 2024-02-13T00:50:42.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:42 smithi106 bash[18459]: audit 2024-02-13T00:50:41.309404+0000 mon.a (mon.0) 3230 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138"}]: dispatch 2024-02-13T00:50:42.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:42 smithi080 bash[24237]: cluster 2024-02-13T00:50:40.521642+0000 mgr.y (mgr.24461) 802 : cluster [DBG] pgmap v1254: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-13T00:50:42.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:42 smithi080 bash[24237]: audit 2024-02-13T00:50:41.265989+0000 mon.a (mon.0) 3227 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138"}]': finished 2024-02-13T00:50:42.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:42 smithi080 bash[24237]: cluster 2024-02-13T00:50:41.266088+0000 mon.a (mon.0) 3228 : cluster [DBG] osdmap e702: 8 total, 8 up, 8 in 2024-02-13T00:50:42.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:42 smithi080 bash[24237]: audit 2024-02-13T00:50:41.307708+0000 mon.c (mon.2) 535 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:42.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:42 smithi080 bash[24237]: audit 2024-02-13T00:50:41.308202+0000 mon.a (mon.0) 3229 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:42.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:42 smithi080 bash[24237]: audit 2024-02-13T00:50:41.308959+0000 mon.c (mon.2) 536 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138"}]: dispatch 2024-02-13T00:50:42.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:42 smithi080 bash[24237]: audit 2024-02-13T00:50:41.309404+0000 mon.a (mon.0) 3230 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138"}]: dispatch 2024-02-13T00:50:42.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:42 smithi080 bash[17386]: cluster 2024-02-13T00:50:40.521642+0000 mgr.y (mgr.24461) 802 : cluster [DBG] pgmap v1254: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-13T00:50:42.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:42 smithi080 bash[17386]: audit 2024-02-13T00:50:41.265989+0000 mon.a (mon.0) 3227 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138"}]': finished 2024-02-13T00:50:42.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:42 smithi080 bash[17386]: cluster 2024-02-13T00:50:41.266088+0000 mon.a (mon.0) 3228 : cluster [DBG] osdmap e702: 8 total, 8 up, 8 in 2024-02-13T00:50:42.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:42 smithi080 bash[17386]: audit 2024-02-13T00:50:41.307708+0000 mon.c (mon.2) 535 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:42.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:42 smithi080 bash[17386]: audit 2024-02-13T00:50:41.308202+0000 mon.a (mon.0) 3229 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:42.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:42 smithi080 bash[17386]: audit 2024-02-13T00:50:41.308959+0000 mon.c (mon.2) 536 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138"}]: dispatch 2024-02-13T00:50:42.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:42 smithi080 bash[17386]: audit 2024-02-13T00:50:41.309404+0000 mon.a (mon.0) 3230 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-138"}]: dispatch 2024-02-13T00:50:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:43 smithi080 bash[17386]: cluster 2024-02-13T00:50:42.273060+0000 mon.a (mon.0) 3231 : cluster [DBG] osdmap e703: 8 total, 8 up, 8 in 2024-02-13T00:50:43.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:43 smithi080 bash[17386]: cluster 2024-02-13T00:50:43.176724+0000 mon.a (mon.0) 3232 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:50:43.509 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:50:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:50:43] "GET /metrics HTTP/1.1" 200 191172 "" "Prometheus/2.33.4" 2024-02-13T00:50:43.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:43 smithi080 bash[24237]: cluster 2024-02-13T00:50:42.273060+0000 mon.a (mon.0) 3231 : cluster [DBG] osdmap e703: 8 total, 8 up, 8 in 2024-02-13T00:50:43.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:43 smithi080 bash[24237]: cluster 2024-02-13T00:50:43.176724+0000 mon.a (mon.0) 3232 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:50:43.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:43 smithi106 bash[18459]: cluster 2024-02-13T00:50:42.273060+0000 mon.a (mon.0) 3231 : cluster [DBG] osdmap e703: 8 total, 8 up, 8 in 2024-02-13T00:50:43.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:43 smithi106 bash[18459]: cluster 2024-02-13T00:50:43.176724+0000 mon.a (mon.0) 3232 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:50:44.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:44 smithi106 bash[18459]: cluster 2024-02-13T00:50:42.522347+0000 mgr.y (mgr.24461) 803 : cluster [DBG] pgmap v1257: 172 pgs: 172 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:50:44.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:44 smithi106 bash[18459]: cluster 2024-02-13T00:50:43.290819+0000 mon.a (mon.0) 3233 : cluster [DBG] osdmap e704: 8 total, 8 up, 8 in 2024-02-13T00:50:44.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:44 smithi106 bash[18459]: audit 2024-02-13T00:50:43.296691+0000 mon.c (mon.2) 537 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:44.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:44 smithi106 bash[18459]: audit 2024-02-13T00:50:43.297378+0000 mon.a (mon.0) 3234 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:44.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:44 smithi080 bash[17386]: cluster 2024-02-13T00:50:42.522347+0000 mgr.y (mgr.24461) 803 : cluster [DBG] pgmap v1257: 172 pgs: 172 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:50:44.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:44 smithi080 bash[17386]: cluster 2024-02-13T00:50:43.290819+0000 mon.a (mon.0) 3233 : cluster [DBG] osdmap e704: 8 total, 8 up, 8 in 2024-02-13T00:50:44.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:44 smithi080 bash[17386]: audit 2024-02-13T00:50:43.296691+0000 mon.c (mon.2) 537 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:44.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:44 smithi080 bash[17386]: audit 2024-02-13T00:50:43.297378+0000 mon.a (mon.0) 3234 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:44.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:44 smithi080 bash[24237]: cluster 2024-02-13T00:50:42.522347+0000 mgr.y (mgr.24461) 803 : cluster [DBG] pgmap v1257: 172 pgs: 172 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:50:44.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:44 smithi080 bash[24237]: cluster 2024-02-13T00:50:43.290819+0000 mon.a (mon.0) 3233 : cluster [DBG] osdmap e704: 8 total, 8 up, 8 in 2024-02-13T00:50:44.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:44 smithi080 bash[24237]: audit 2024-02-13T00:50:43.296691+0000 mon.c (mon.2) 537 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:44.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:44 smithi080 bash[24237]: audit 2024-02-13T00:50:43.297378+0000 mon.a (mon.0) 3234 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:45 smithi106 bash[18459]: audit 2024-02-13T00:50:44.295512+0000 mon.a (mon.0) 3235 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:50:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:45 smithi106 bash[18459]: cluster 2024-02-13T00:50:44.295881+0000 mon.a (mon.0) 3236 : cluster [DBG] osdmap e705: 8 total, 8 up, 8 in 2024-02-13T00:50:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:45 smithi106 bash[18459]: audit 2024-02-13T00:50:44.353322+0000 mon.c (mon.2) 538 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:45 smithi106 bash[18459]: audit 2024-02-13T00:50:44.353985+0000 mon.a (mon.0) 3237 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:45 smithi106 bash[18459]: audit 2024-02-13T00:50:44.355035+0000 mon.c (mon.2) 539 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-140"}]: dispatch 2024-02-13T00:50:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:45 smithi106 bash[18459]: audit 2024-02-13T00:50:44.355632+0000 mon.a (mon.0) 3238 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-140"}]: dispatch 2024-02-13T00:50:46.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:45 smithi106 bash[18459]: cluster 2024-02-13T00:50:45.296826+0000 mon.a (mon.0) 3239 : cluster [DBG] osdmap e706: 8 total, 8 up, 8 in 2024-02-13T00:50:46.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:45 smithi080 bash[17386]: audit 2024-02-13T00:50:44.295512+0000 mon.a (mon.0) 3235 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:50:46.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:45 smithi080 bash[17386]: cluster 2024-02-13T00:50:44.295881+0000 mon.a (mon.0) 3236 : cluster [DBG] osdmap e705: 8 total, 8 up, 8 in 2024-02-13T00:50:46.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:45 smithi080 bash[17386]: audit 2024-02-13T00:50:44.353322+0000 mon.c (mon.2) 538 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:46.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:45 smithi080 bash[17386]: audit 2024-02-13T00:50:44.353985+0000 mon.a (mon.0) 3237 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:46.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:45 smithi080 bash[17386]: audit 2024-02-13T00:50:44.355035+0000 mon.c (mon.2) 539 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-140"}]: dispatch 2024-02-13T00:50:46.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:45 smithi080 bash[17386]: audit 2024-02-13T00:50:44.355632+0000 mon.a (mon.0) 3238 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-140"}]: dispatch 2024-02-13T00:50:46.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:45 smithi080 bash[17386]: cluster 2024-02-13T00:50:45.296826+0000 mon.a (mon.0) 3239 : cluster [DBG] osdmap e706: 8 total, 8 up, 8 in 2024-02-13T00:50:46.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:45 smithi080 bash[24237]: audit 2024-02-13T00:50:44.295512+0000 mon.a (mon.0) 3235 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:50:46.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:45 smithi080 bash[24237]: cluster 2024-02-13T00:50:44.295881+0000 mon.a (mon.0) 3236 : cluster [DBG] osdmap e705: 8 total, 8 up, 8 in 2024-02-13T00:50:46.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:45 smithi080 bash[24237]: audit 2024-02-13T00:50:44.353322+0000 mon.c (mon.2) 538 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:46.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:45 smithi080 bash[24237]: audit 2024-02-13T00:50:44.353985+0000 mon.a (mon.0) 3237 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:46.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:45 smithi080 bash[24237]: audit 2024-02-13T00:50:44.355035+0000 mon.c (mon.2) 539 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-140"}]: dispatch 2024-02-13T00:50:46.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:45 smithi080 bash[24237]: audit 2024-02-13T00:50:44.355632+0000 mon.a (mon.0) 3238 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-140"}]: dispatch 2024-02-13T00:50:46.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:45 smithi080 bash[24237]: cluster 2024-02-13T00:50:45.296826+0000 mon.a (mon.0) 3239 : cluster [DBG] osdmap e706: 8 total, 8 up, 8 in 2024-02-13T00:50:47.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:46 smithi106 bash[18459]: cluster 2024-02-13T00:50:44.523158+0000 mgr.y (mgr.24461) 804 : cluster [DBG] pgmap v1260: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:50:47.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:46 smithi106 bash[18459]: cluster 2024-02-13T00:50:46.301505+0000 mon.a (mon.0) 3240 : cluster [DBG] osdmap e707: 8 total, 8 up, 8 in 2024-02-13T00:50:47.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:46 smithi106 bash[18459]: audit 2024-02-13T00:50:46.307289+0000 mon.c (mon.2) 540 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:47.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:46 smithi106 bash[18459]: audit 2024-02-13T00:50:46.307942+0000 mon.a (mon.0) 3241 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:47.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:46 smithi080 bash[17386]: cluster 2024-02-13T00:50:44.523158+0000 mgr.y (mgr.24461) 804 : cluster [DBG] pgmap v1260: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:50:47.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:46 smithi080 bash[17386]: cluster 2024-02-13T00:50:46.301505+0000 mon.a (mon.0) 3240 : cluster [DBG] osdmap e707: 8 total, 8 up, 8 in 2024-02-13T00:50:47.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:46 smithi080 bash[17386]: audit 2024-02-13T00:50:46.307289+0000 mon.c (mon.2) 540 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:47.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:46 smithi080 bash[17386]: audit 2024-02-13T00:50:46.307942+0000 mon.a (mon.0) 3241 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:47.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:46 smithi080 bash[24237]: cluster 2024-02-13T00:50:44.523158+0000 mgr.y (mgr.24461) 804 : cluster [DBG] pgmap v1260: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:50:47.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:46 smithi080 bash[24237]: cluster 2024-02-13T00:50:46.301505+0000 mon.a (mon.0) 3240 : cluster [DBG] osdmap e707: 8 total, 8 up, 8 in 2024-02-13T00:50:47.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:46 smithi080 bash[24237]: audit 2024-02-13T00:50:46.307289+0000 mon.c (mon.2) 540 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:47.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:46 smithi080 bash[24237]: audit 2024-02-13T00:50:46.307942+0000 mon.a (mon.0) 3241 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:47 smithi106 bash[18459]: cluster 2024-02-13T00:50:46.524129+0000 mgr.y (mgr.24461) 805 : cluster [DBG] pgmap v1263: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:50:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:47 smithi106 bash[18459]: audit 2024-02-13T00:50:46.932281+0000 mon.a (mon.0) 3242 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:50:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:47 smithi106 bash[18459]: audit 2024-02-13T00:50:47.306868+0000 mon.a (mon.0) 3243 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:50:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:47 smithi106 bash[18459]: cluster 2024-02-13T00:50:47.307125+0000 mon.a (mon.0) 3244 : cluster [DBG] osdmap e708: 8 total, 8 up, 8 in 2024-02-13T00:50:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:47 smithi106 bash[18459]: audit 2024-02-13T00:50:47.384356+0000 mon.c (mon.2) 541 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:47 smithi106 bash[18459]: audit 2024-02-13T00:50:47.384927+0000 mon.a (mon.0) 3245 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:47 smithi106 bash[18459]: audit 2024-02-13T00:50:47.385941+0000 mon.c (mon.2) 542 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-142"}]: dispatch 2024-02-13T00:50:48.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:47 smithi106 bash[18459]: audit 2024-02-13T00:50:47.386427+0000 mon.a (mon.0) 3246 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-142"}]: dispatch 2024-02-13T00:50:48.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:47 smithi080 bash[17386]: cluster 2024-02-13T00:50:46.524129+0000 mgr.y (mgr.24461) 805 : cluster [DBG] pgmap v1263: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:50:48.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:47 smithi080 bash[17386]: audit 2024-02-13T00:50:46.932281+0000 mon.a (mon.0) 3242 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:50:48.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:47 smithi080 bash[17386]: audit 2024-02-13T00:50:47.306868+0000 mon.a (mon.0) 3243 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:50:48.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:47 smithi080 bash[17386]: cluster 2024-02-13T00:50:47.307125+0000 mon.a (mon.0) 3244 : cluster [DBG] osdmap e708: 8 total, 8 up, 8 in 2024-02-13T00:50:48.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:47 smithi080 bash[17386]: audit 2024-02-13T00:50:47.384356+0000 mon.c (mon.2) 541 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:48.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:47 smithi080 bash[17386]: audit 2024-02-13T00:50:47.384927+0000 mon.a (mon.0) 3245 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:48.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:47 smithi080 bash[17386]: audit 2024-02-13T00:50:47.385941+0000 mon.c (mon.2) 542 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-142"}]: dispatch 2024-02-13T00:50:48.259 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:47 smithi080 bash[17386]: audit 2024-02-13T00:50:47.386427+0000 mon.a (mon.0) 3246 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-142"}]: dispatch 2024-02-13T00:50:48.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:47 smithi080 bash[24237]: cluster 2024-02-13T00:50:46.524129+0000 mgr.y (mgr.24461) 805 : cluster [DBG] pgmap v1263: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T00:50:48.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:47 smithi080 bash[24237]: audit 2024-02-13T00:50:46.932281+0000 mon.a (mon.0) 3242 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:50:48.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:47 smithi080 bash[24237]: audit 2024-02-13T00:50:47.306868+0000 mon.a (mon.0) 3243 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:50:48.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:47 smithi080 bash[24237]: cluster 2024-02-13T00:50:47.307125+0000 mon.a (mon.0) 3244 : cluster [DBG] osdmap e708: 8 total, 8 up, 8 in 2024-02-13T00:50:48.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:47 smithi080 bash[24237]: audit 2024-02-13T00:50:47.384356+0000 mon.c (mon.2) 541 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:48.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:47 smithi080 bash[24237]: audit 2024-02-13T00:50:47.384927+0000 mon.a (mon.0) 3245 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:48.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:47 smithi080 bash[24237]: audit 2024-02-13T00:50:47.385941+0000 mon.c (mon.2) 542 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-142"}]: dispatch 2024-02-13T00:50:48.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:47 smithi080 bash[24237]: audit 2024-02-13T00:50:47.386427+0000 mon.a (mon.0) 3246 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-142"}]: dispatch 2024-02-13T00:50:49.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:50:48 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:50:49.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:49 smithi106 bash[18459]: cluster 2024-02-13T00:50:48.311997+0000 mon.a (mon.0) 3247 : cluster [DBG] osdmap e709: 8 total, 8 up, 8 in 2024-02-13T00:50:49.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:49 smithi080 bash[17386]: cluster 2024-02-13T00:50:48.311997+0000 mon.a (mon.0) 3247 : cluster [DBG] osdmap e709: 8 total, 8 up, 8 in 2024-02-13T00:50:49.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:49 smithi080 bash[24237]: cluster 2024-02-13T00:50:48.311997+0000 mon.a (mon.0) 3247 : cluster [DBG] osdmap e709: 8 total, 8 up, 8 in 2024-02-13T00:50:50.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:50:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:50:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:50:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:50 smithi106 bash[18459]: cluster 2024-02-13T00:50:48.525006+0000 mgr.y (mgr.24461) 806 : cluster [DBG] pgmap v1266: 172 pgs: 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-13T00:50:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:50 smithi106 bash[18459]: audit 2024-02-13T00:50:48.841303+0000 mgr.y (mgr.24461) 807 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:50:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:50 smithi106 bash[18459]: cluster 2024-02-13T00:50:49.323310+0000 mon.a (mon.0) 3248 : cluster [DBG] osdmap e710: 8 total, 8 up, 8 in 2024-02-13T00:50:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:50 smithi106 bash[18459]: audit 2024-02-13T00:50:49.326343+0000 mon.c (mon.2) 543 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:50.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:50 smithi106 bash[18459]: audit 2024-02-13T00:50:49.327145+0000 mon.a (mon.0) 3249 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:50.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:50 smithi080 bash[17386]: cluster 2024-02-13T00:50:48.525006+0000 mgr.y (mgr.24461) 806 : cluster [DBG] pgmap v1266: 172 pgs: 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-13T00:50:50.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:50 smithi080 bash[17386]: audit 2024-02-13T00:50:48.841303+0000 mgr.y (mgr.24461) 807 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:50:50.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:50 smithi080 bash[17386]: cluster 2024-02-13T00:50:49.323310+0000 mon.a (mon.0) 3248 : cluster [DBG] osdmap e710: 8 total, 8 up, 8 in 2024-02-13T00:50:50.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:50 smithi080 bash[17386]: audit 2024-02-13T00:50:49.326343+0000 mon.c (mon.2) 543 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:50.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:50 smithi080 bash[17386]: audit 2024-02-13T00:50:49.327145+0000 mon.a (mon.0) 3249 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:50.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:50 smithi080 bash[24237]: cluster 2024-02-13T00:50:48.525006+0000 mgr.y (mgr.24461) 806 : cluster [DBG] pgmap v1266: 172 pgs: 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-13T00:50:50.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:50 smithi080 bash[24237]: audit 2024-02-13T00:50:48.841303+0000 mgr.y (mgr.24461) 807 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:50:50.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:50 smithi080 bash[24237]: cluster 2024-02-13T00:50:49.323310+0000 mon.a (mon.0) 3248 : cluster [DBG] osdmap e710: 8 total, 8 up, 8 in 2024-02-13T00:50:50.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:50 smithi080 bash[24237]: audit 2024-02-13T00:50:49.326343+0000 mon.c (mon.2) 543 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:50.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:50 smithi080 bash[24237]: audit 2024-02-13T00:50:49.327145+0000 mon.a (mon.0) 3249 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T00:50:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:51 smithi106 bash[18459]: audit 2024-02-13T00:50:50.333583+0000 mon.a (mon.0) 3250 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:50:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:51 smithi106 bash[18459]: cluster 2024-02-13T00:50:50.334150+0000 mon.a (mon.0) 3251 : cluster [DBG] osdmap e711: 8 total, 8 up, 8 in 2024-02-13T00:50:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:51 smithi106 bash[18459]: audit 2024-02-13T00:50:50.336256+0000 mon.c (mon.2) 544 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-101","var": "dedup_tier","val": "test-rados-api-smithi080-54255-144"}]: dispatch 2024-02-13T00:50:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:51 smithi106 bash[18459]: audit 2024-02-13T00:50:50.338234+0000 mon.a (mon.0) 3252 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-101","var": "dedup_tier","val": "test-rados-api-smithi080-54255-144"}]: dispatch 2024-02-13T00:50:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:51 smithi106 bash[18459]: audit 2024-02-13T00:50:50.366568+0000 mon.c (mon.2) 545 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:51 smithi106 bash[18459]: audit 2024-02-13T00:50:50.366986+0000 mon.a (mon.0) 3253 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:51 smithi106 bash[18459]: audit 2024-02-13T00:50:50.367661+0000 mon.c (mon.2) 546 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-144"}]: dispatch 2024-02-13T00:50:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:51 smithi106 bash[18459]: audit 2024-02-13T00:50:50.367971+0000 mon.a (mon.0) 3254 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-144"}]: dispatch 2024-02-13T00:50:51.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:51 smithi106 bash[18459]: cluster 2024-02-13T00:50:50.525875+0000 mgr.y (mgr.24461) 808 : cluster [DBG] pgmap v1269: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-13T00:50:51.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:51 smithi080 bash[17386]: audit 2024-02-13T00:50:50.333583+0000 mon.a (mon.0) 3250 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:50:51.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:51 smithi080 bash[17386]: cluster 2024-02-13T00:50:50.334150+0000 mon.a (mon.0) 3251 : cluster [DBG] osdmap e711: 8 total, 8 up, 8 in 2024-02-13T00:50:51.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:51 smithi080 bash[17386]: audit 2024-02-13T00:50:50.336256+0000 mon.c (mon.2) 544 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-101","var": "dedup_tier","val": "test-rados-api-smithi080-54255-144"}]: dispatch 2024-02-13T00:50:51.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:51 smithi080 bash[17386]: audit 2024-02-13T00:50:50.338234+0000 mon.a (mon.0) 3252 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-101","var": "dedup_tier","val": "test-rados-api-smithi080-54255-144"}]: dispatch 2024-02-13T00:50:51.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:51 smithi080 bash[17386]: audit 2024-02-13T00:50:50.366568+0000 mon.c (mon.2) 545 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:51.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:51 smithi080 bash[17386]: audit 2024-02-13T00:50:50.366986+0000 mon.a (mon.0) 3253 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:51.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:51 smithi080 bash[17386]: audit 2024-02-13T00:50:50.367661+0000 mon.c (mon.2) 546 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-144"}]: dispatch 2024-02-13T00:50:51.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:51 smithi080 bash[17386]: audit 2024-02-13T00:50:50.367971+0000 mon.a (mon.0) 3254 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-144"}]: dispatch 2024-02-13T00:50:51.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:51 smithi080 bash[17386]: cluster 2024-02-13T00:50:50.525875+0000 mgr.y (mgr.24461) 808 : cluster [DBG] pgmap v1269: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-13T00:50:51.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:51 smithi080 bash[24237]: audit 2024-02-13T00:50:50.333583+0000 mon.a (mon.0) 3250 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi080-54255-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T00:50:51.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:51 smithi080 bash[24237]: cluster 2024-02-13T00:50:50.334150+0000 mon.a (mon.0) 3251 : cluster [DBG] osdmap e711: 8 total, 8 up, 8 in 2024-02-13T00:50:51.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:51 smithi080 bash[24237]: audit 2024-02-13T00:50:50.336256+0000 mon.c (mon.2) 544 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-101","var": "dedup_tier","val": "test-rados-api-smithi080-54255-144"}]: dispatch 2024-02-13T00:50:51.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:51 smithi080 bash[24237]: audit 2024-02-13T00:50:50.338234+0000 mon.a (mon.0) 3252 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi080-54255-101","var": "dedup_tier","val": "test-rados-api-smithi080-54255-144"}]: dispatch 2024-02-13T00:50:51.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:51 smithi080 bash[24237]: audit 2024-02-13T00:50:50.366568+0000 mon.c (mon.2) 545 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:51.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:51 smithi080 bash[24237]: audit 2024-02-13T00:50:50.366986+0000 mon.a (mon.0) 3253 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:51.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:51 smithi080 bash[24237]: audit 2024-02-13T00:50:50.367661+0000 mon.c (mon.2) 546 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-144"}]: dispatch 2024-02-13T00:50:51.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:51 smithi080 bash[24237]: audit 2024-02-13T00:50:50.367971+0000 mon.a (mon.0) 3254 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi080-54255-101", "tierpool": "test-rados-api-smithi080-54255-144"}]: dispatch 2024-02-13T00:50:51.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:51 smithi080 bash[24237]: cluster 2024-02-13T00:50:50.525875+0000 mgr.y (mgr.24461) 808 : cluster [DBG] pgmap v1269: 204 pgs: 32 unknown, 172 active+clean; 3.8 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-13T00:50:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:52 smithi106 bash[18459]: cluster 2024-02-13T00:50:51.337855+0000 mon.a (mon.0) 3255 : cluster [DBG] osdmap e712: 8 total, 8 up, 8 in 2024-02-13T00:50:52.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:52 smithi106 bash[18459]: cluster 2024-02-13T00:50:52.341137+0000 mon.a (mon.0) 3256 : cluster [DBG] osdmap e713: 8 total, 8 up, 8 in 2024-02-13T00:50:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:52 smithi080 bash[17386]: cluster 2024-02-13T00:50:51.337855+0000 mon.a (mon.0) 3255 : cluster [DBG] osdmap e712: 8 total, 8 up, 8 in 2024-02-13T00:50:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:52 smithi080 bash[17386]: cluster 2024-02-13T00:50:52.341137+0000 mon.a (mon.0) 3256 : cluster [DBG] osdmap e713: 8 total, 8 up, 8 in 2024-02-13T00:50:52.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:52 smithi080 bash[24237]: cluster 2024-02-13T00:50:51.337855+0000 mon.a (mon.0) 3255 : cluster [DBG] osdmap e712: 8 total, 8 up, 8 in 2024-02-13T00:50:52.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:52 smithi080 bash[24237]: cluster 2024-02-13T00:50:52.341137+0000 mon.a (mon.0) 3256 : cluster [DBG] osdmap e713: 8 total, 8 up, 8 in 2024-02-13T00:50:53.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:50:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:50:53] "GET /metrics HTTP/1.1" 200 191260 "" "Prometheus/2.33.4" 2024-02-13T00:50:53.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:53 smithi080 bash[17386]: audit 2024-02-13T00:50:52.343821+0000 mon.c (mon.2) 547 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:53.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:53 smithi080 bash[17386]: audit 2024-02-13T00:50:52.345188+0000 mon.a (mon.0) 3257 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:53.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:53 smithi080 bash[17386]: cluster 2024-02-13T00:50:52.526596+0000 mgr.y (mgr.24461) 809 : cluster [DBG] pgmap v1272: 164 pgs: 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:50:53.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:53 smithi080 bash[17386]: audit 2024-02-13T00:50:53.344487+0000 mon.a (mon.0) 3258 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:50:53.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:53 smithi080 bash[17386]: cluster 2024-02-13T00:50:53.344582+0000 mon.a (mon.0) 3259 : cluster [DBG] osdmap e714: 8 total, 8 up, 8 in 2024-02-13T00:50:53.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:53 smithi080 bash[24237]: audit 2024-02-13T00:50:52.343821+0000 mon.c (mon.2) 547 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:53.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:53 smithi080 bash[24237]: audit 2024-02-13T00:50:52.345188+0000 mon.a (mon.0) 3257 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:53.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:53 smithi080 bash[24237]: cluster 2024-02-13T00:50:52.526596+0000 mgr.y (mgr.24461) 809 : cluster [DBG] pgmap v1272: 164 pgs: 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:50:53.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:53 smithi080 bash[24237]: audit 2024-02-13T00:50:53.344487+0000 mon.a (mon.0) 3258 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:50:53.510 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:53 smithi080 bash[24237]: cluster 2024-02-13T00:50:53.344582+0000 mon.a (mon.0) 3259 : cluster [DBG] osdmap e714: 8 total, 8 up, 8 in 2024-02-13T00:50:53.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:53 smithi106 bash[18459]: audit 2024-02-13T00:50:52.343821+0000 mon.c (mon.2) 547 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:53.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:53 smithi106 bash[18459]: audit 2024-02-13T00:50:52.345188+0000 mon.a (mon.0) 3257 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:53.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:53 smithi106 bash[18459]: cluster 2024-02-13T00:50:52.526596+0000 mgr.y (mgr.24461) 809 : cluster [DBG] pgmap v1272: 164 pgs: 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:50:53.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:53 smithi106 bash[18459]: audit 2024-02-13T00:50:53.344487+0000 mon.a (mon.0) 3258 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:50:53.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:53 smithi106 bash[18459]: cluster 2024-02-13T00:50:53.344582+0000 mon.a (mon.0) 3259 : cluster [DBG] osdmap e714: 8 total, 8 up, 8 in 2024-02-13T00:50:54.371 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetRead (9111 ms) 2024-02-13T00:50:54.372 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-02-13T00:50:54.372 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707785369,0 2024-02-13T00:50:54.372 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: first is 1707785369 2024-02-13T00:50:54.372 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707785369,0 2024-02-13T00:50:54.372 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707785369,0 2024-02-13T00:50:54.372 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707785369,1707785371,1707785372,0 2024-02-13T00:50:54.372 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707785369,1707785371,1707785372,0 2024-02-13T00:50:54.372 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707785369,1707785371,1707785372,0 2024-02-13T00:50:54.372 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707785369,1707785371,1707785372,1707785374,1707785375,0 2024-02-13T00:50:54.372 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707785369,1707785371,1707785372,1707785374,1707785375,0 2024-02-13T00:50:54.372 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707785369,1707785371,1707785372,1707785374,1707785375,0 2024-02-13T00:50:54.372 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707785369,1707785371,1707785372,1707785374,1707785375,1707785377,1707785378,0 2024-02-13T00:50:54.373 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707785369,1707785371,1707785372,1707785374,1707785375,1707785377,1707785378,0 2024-02-13T00:50:54.373 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707785369,1707785371,1707785372,1707785374,1707785375,1707785377,1707785378,0 2024-02-13T00:50:54.373 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: got ls 1707785372,1707785374,1707785375,1707785377,1707785378,1707785380,1707785381,0 2024-02-13T00:50:54.373 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: first now 1707785372, trimmed 2024-02-13T00:50:54.373 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetTrim (20833 ms) 2024-02-13T00:50:54.373 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-02-13T00:50:54.373 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: foo0 2024-02-13T00:50:54.373 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-02-13T00:50:54.373 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (14139 ms) 2024-02-13T00:50:54.373 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-02-13T00:50:54.373 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ProxyRead (17881 ms) 2024-02-13T00:50:54.373 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-02-13T00:50:54.373 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.CachePin (23024 ms) 2024-02-13T00:50:54.373 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-02-13T00:50:54.373 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetRedirectRead (5041 ms) 2024-02-13T00:50:54.374 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-02-13T00:50:54.374 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetChunkRead (3027 ms) 2024-02-13T00:50:54.374 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-02-13T00:50:54.374 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ManifestPromoteRead (3012 ms) 2024-02-13T00:50:54.374 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-02-13T00:50:54.374 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TrySetDedupTier (3027 ms) 2024-02-13T00:50:54.374 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (232691 ms total) 2024-02-13T00:50:54.374 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: 2024-02-13T00:50:54.374 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [----------] Global test environment tear-down 2024-02-13T00:50:54.374 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [==========] 72 tests from 4 test suites ran. (805396 ms total) 2024-02-13T00:50:54.374 INFO:tasks.workunit.client.0.smithi080.stdout: api_tier_pp: [ PASSED ] 72 tests. 2024-02-13T00:50:54.376 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:50:54.376 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54470 2024-02-13T00:50:54.376 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54470 2024-02-13T00:50:54.376 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:50:54.376 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54218 2024-02-13T00:50:54.376 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54218 2024-02-13T00:50:54.376 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:50:54.376 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54202 2024-02-13T00:50:54.376 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54202 2024-02-13T00:50:54.376 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:50:54.376 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54234 2024-02-13T00:50:54.377 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54234 2024-02-13T00:50:54.377 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:50:54.377 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54491 2024-02-13T00:50:54.377 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54491 2024-02-13T00:50:54.377 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:50:54.377 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54668 2024-02-13T00:50:54.377 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54668 2024-02-13T00:50:54.377 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:50:54.377 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54337 2024-02-13T00:50:54.377 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54337 2024-02-13T00:50:54.377 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:50:54.377 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54178 2024-02-13T00:50:54.377 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54178 2024-02-13T00:50:54.377 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:50:54.378 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54740 2024-02-13T00:50:54.378 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54740 2024-02-13T00:50:54.378 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:50:54.378 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54592 2024-02-13T00:50:54.378 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54592 2024-02-13T00:50:54.378 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:50:54.378 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54460 2024-02-13T00:50:54.378 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54460 2024-02-13T00:50:54.378 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:50:54.378 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54685 2024-02-13T00:50:54.378 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54685 2024-02-13T00:50:54.378 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:50:54.378 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54210 2024-02-13T00:50:54.378 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54210 2024-02-13T00:50:54.378 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:50:54.378 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54618 2024-02-13T00:50:54.379 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54618 2024-02-13T00:50:54.379 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:50:54.379 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54194 2024-02-13T00:50:54.379 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54194 2024-02-13T00:50:54.379 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:50:54.379 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54510 2024-02-13T00:50:54.379 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54510 2024-02-13T00:50:54.379 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:50:54.379 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54242 2024-02-13T00:50:54.379 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54242 2024-02-13T00:50:54.379 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:50:54.379 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54571 2024-02-13T00:50:54.379 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54571 2024-02-13T00:50:54.379 INFO:tasks.workunit.client.0.smithi080.stderr:+ for t in "${!pids[@]}" 2024-02-13T00:50:54.379 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=54423 2024-02-13T00:50:54.379 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 54423 2024-02-13T00:50:54.380 INFO:tasks.workunit.client.0.smithi080.stderr:+ exit 0 2024-02-13T00:50:54.380 INFO:tasks.workunit.client.0.smithi080.stderr:+ cleanup 2024-02-13T00:50:54.380 INFO:tasks.workunit.client.0.smithi080.stderr:+ pkill -P 54165 2024-02-13T00:50:54.464 INFO:tasks.workunit.client.0.smithi080.stderr:+ true 2024-02-13T00:50:54.466 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-13T00:50:54.466 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-13T00:50:54.482 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-02-13T00:50:54.483 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-02-13T00:50:54.483 DEBUG:teuthology.orchestra.run.smithi080:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=84e714279aa684636ac645daf0a1a85c2094cfb3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-02-13T00:50:54.539 INFO:tasks.workunit.client.0.smithi080.stderr:+ uuidgen 2024-02-13T00:50:54.540 INFO:tasks.workunit.client.0.smithi080.stderr:+ p=4a2d96c2-886f-4ac7-8042-11d5205396f8 2024-02-13T00:50:54.540 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph osd pool create 4a2d96c2-886f-4ac7-8042-11d5205396f8 12 2024-02-13T00:50:54.646 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.637+0000 7f8e1daee700 1 -- 172.21.15.80:0/2211930502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e180fd950 msgr2=0x7f8e180fdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:50:54.647 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.637+0000 7f8e1daee700 1 --2- 172.21.15.80:0/2211930502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e180fd950 0x7f8e180fdd30 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 rx=0x7f8e100047e0 tx=0x7f8e10009cb0).stop 2024-02-13T00:50:54.647 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.637+0000 7f8e1daee700 1 -- 172.21.15.80:0/2211930502 shutdown_connections 2024-02-13T00:50:54.647 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.637+0000 7f8e1daee700 1 --2- 172.21.15.80:0/2211930502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e18060c70 0x7f8e18104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:54.647 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.637+0000 7f8e1daee700 1 --2- 172.21.15.80:0/2211930502 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8e180fe2b0 0x7f8e18060590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:54.647 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.637+0000 7f8e1daee700 1 --2- 172.21.15.80:0/2211930502 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e180fd950 0x7f8e180fdd30 unknown :-1 s=CLOSED pgs=2460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:54.647 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.637+0000 7f8e1daee700 1 -- 172.21.15.80:0/2211930502 >> 172.21.15.80:0/2211930502 conn(0x7f8e1806c740 msgr2=0x7f8e1806cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:50:54.647 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.637+0000 7f8e1daee700 1 -- 172.21.15.80:0/2211930502 shutdown_connections 2024-02-13T00:50:54.647 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.637+0000 7f8e1daee700 1 -- 172.21.15.80:0/2211930502 wait complete. 2024-02-13T00:50:54.649 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e1daee700 1 Processor -- start 2024-02-13T00:50:54.649 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e1daee700 1 -- start start 2024-02-13T00:50:54.649 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e1daee700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8e18060c70 0x7f8e1810dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:50:54.649 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e1daee700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e180fd950 0x7f8e1810e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:50:54.649 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e1daee700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e180fe2b0 0x7f8e18107de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:50:54.649 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e1daee700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e181082d0 con 0x7f8e180fd950 2024-02-13T00:50:54.649 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e1daee700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e18108440 con 0x7f8e180fe2b0 2024-02-13T00:50:54.649 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e1daee700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e18108600 con 0x7f8e18060c70 2024-02-13T00:50:54.649 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e177fe700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8e18060c70 0x7f8e1810dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:50:54.649 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e177fe700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8e18060c70 0x7f8e1810dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:45312/0 (socket says 172.21.15.80:45312) 2024-02-13T00:50:54.650 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e177fe700 1 -- 172.21.15.80:0/2743277100 learned_addr learned my addr 172.21.15.80:0/2743277100 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:50:54.650 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e16ffd700 1 --2- 172.21.15.80:0/2743277100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e180fd950 0x7f8e1810e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:50:54.650 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e17fff700 1 --2- 172.21.15.80:0/2743277100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e180fe2b0 0x7f8e18107de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:50:54.650 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e177fe700 1 -- 172.21.15.80:0/2743277100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e180fe2b0 msgr2=0x7f8e18107de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:50:54.650 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e177fe700 1 --2- 172.21.15.80:0/2743277100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e180fe2b0 0x7f8e18107de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:54.650 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e177fe700 1 -- 172.21.15.80:0/2743277100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e180fd950 msgr2=0x7f8e1810e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:50:54.650 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e177fe700 1 --2- 172.21.15.80:0/2743277100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e180fd950 0x7f8e1810e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:54.650 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e177fe700 1 -- 172.21.15.80:0/2743277100 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e10005040 con 0x7f8e18060c70 2024-02-13T00:50:54.650 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e16ffd700 1 --2- 172.21.15.80:0/2743277100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e180fd950 0x7f8e1810e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:50:54.650 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e177fe700 1 --2- 172.21.15.80:0/2743277100 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8e18060c70 0x7f8e1810dc20 secure :-1 s=READY pgs=3012 cs=0 l=1 rev1=1 rx=0x7f8e100095b0 tx=0x7f8e1000b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:50:54.651 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e14ff9700 1 -- 172.21.15.80:0/2743277100 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e10019070 con 0x7f8e18060c70 2024-02-13T00:50:54.651 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e14ff9700 1 -- 172.21.15.80:0/2743277100 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f8e10009790 con 0x7f8e18060c70 2024-02-13T00:50:54.651 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e1daee700 1 -- 172.21.15.80:0/2743277100 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e18108880 con 0x7f8e18060c70 2024-02-13T00:50:54.651 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e14ff9700 1 -- 172.21.15.80:0/2743277100 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1001e9a0 con 0x7f8e18060c70 2024-02-13T00:50:54.651 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.641+0000 7f8e1daee700 1 -- 172.21.15.80:0/2743277100 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e18114a70 con 0x7f8e18060c70 2024-02-13T00:50:54.651 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.645+0000 7f8e1daee700 1 -- 172.21.15.80:0/2743277100 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1805f540 con 0x7f8e18060c70 2024-02-13T00:50:54.652 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.645+0000 7f8e14ff9700 1 -- 172.21.15.80:0/2743277100 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f8e10014420 con 0x7f8e18060c70 2024-02-13T00:50:54.653 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.645+0000 7f8e14ff9700 1 --2- 172.21.15.80:0/2743277100 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f8e04061340 0x7f8e04063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:50:54.653 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.645+0000 7f8e14ff9700 1 -- 172.21.15.80:0/2743277100 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(715..715 src has 1..715) v4 ==== 8431+0+0 (secure 0 0 0) 0x7f8e1007de40 con 0x7f8e18060c70 2024-02-13T00:50:54.653 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.645+0000 7f8e16ffd700 1 --2- 172.21.15.80:0/2743277100 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f8e04061340 0x7f8e04063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:50:54.653 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.645+0000 7f8e16ffd700 1 --2- 172.21.15.80:0/2743277100 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f8e04061340 0x7f8e04063800 secure :-1 s=READY pgs=3503 cs=0 l=1 rev1=1 rx=0x7f8e00004fd0 tx=0x7f8e0000b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:50:54.661 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.653+0000 7f8e14ff9700 1 -- 172.21.15.80:0/2743277100 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f8e1004d7c0 con 0x7f8e18060c70 2024-02-13T00:50:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:54 smithi106 bash[18459]: cluster 2024-02-13T00:50:53.349070+0000 mon.a (mon.0) 3260 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:50:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:54 smithi106 bash[18459]: audit 2024-02-13T00:50:53.350098+0000 mon.c (mon.2) 548 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:54.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:54 smithi106 bash[18459]: audit 2024-02-13T00:50:53.356668+0000 mon.a (mon.0) 3261 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:54.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:54 smithi080 bash[24237]: cluster 2024-02-13T00:50:53.349070+0000 mon.a (mon.0) 3260 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:50:54.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:54 smithi080 bash[24237]: audit 2024-02-13T00:50:53.350098+0000 mon.c (mon.2) 548 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:54.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:54 smithi080 bash[24237]: audit 2024-02-13T00:50:53.356668+0000 mon.a (mon.0) 3261 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:54 smithi080 bash[17386]: cluster 2024-02-13T00:50:53.349070+0000 mon.a (mon.0) 3260 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T00:50:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:54 smithi080 bash[17386]: audit 2024-02-13T00:50:53.350098+0000 mon.c (mon.2) 548 : audit [INF] from='client.? 172.21.15.80:0/3941359470' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:54 smithi080 bash[17386]: audit 2024-02-13T00:50:53.356668+0000 mon.a (mon.0) 3261 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-101"}]: dispatch 2024-02-13T00:50:54.815 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:54.809+0000 7f8e1daee700 1 -- 172.21.15.80:0/2743277100 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pg_num": 12} v 0) v1 -- 0x7f8e1805f020 con 0x7f8e18060c70 2024-02-13T00:50:55.394 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.384+0000 7f8e14ff9700 1 -- 172.21.15.80:0/2743277100 <== mon.2 v2:172.21.15.80:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pg_num": 12}]=0 pool '4a2d96c2-886f-4ac7-8042-11d5205396f8' created v716) v1 ==== 176+0+0 (secure 0 0 0) 0x7f8e100043d0 con 0x7f8e18060c70 2024-02-13T00:50:55.492 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.484+0000 7f8e1daee700 1 -- 172.21.15.80:0/2743277100 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pg_num": 12} v 0) v1 -- 0x7f8e1805fae0 con 0x7f8e18060c70 2024-02-13T00:50:55.493 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.484+0000 7f8e14ff9700 1 -- 172.21.15.80:0/2743277100 <== mon.2 v2:172.21.15.80:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pg_num": 12}]=0 pool '4a2d96c2-886f-4ac7-8042-11d5205396f8' already exists v716) v1 ==== 183+0+0 (secure 0 0 0) 0x7f8e100043d0 con 0x7f8e18060c70 2024-02-13T00:50:55.497 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.488+0000 7f8e1daee700 1 -- 172.21.15.80:0/2743277100 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f8e04061340 msgr2=0x7f8e04063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:50:55.497 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.488+0000 7f8e1daee700 1 --2- 172.21.15.80:0/2743277100 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f8e04061340 0x7f8e04063800 secure :-1 s=READY pgs=3503 cs=0 l=1 rev1=1 rx=0x7f8e00004fd0 tx=0x7f8e0000b040).stop 2024-02-13T00:50:55.497 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.488+0000 7f8e1daee700 1 -- 172.21.15.80:0/2743277100 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8e18060c70 msgr2=0x7f8e1810dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:50:55.498 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.488+0000 7f8e1daee700 1 --2- 172.21.15.80:0/2743277100 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8e18060c70 0x7f8e1810dc20 secure :-1 s=READY pgs=3012 cs=0 l=1 rev1=1 rx=0x7f8e100095b0 tx=0x7f8e1000b040).stop 2024-02-13T00:50:55.498 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.488+0000 7f8e1daee700 1 -- 172.21.15.80:0/2743277100 shutdown_connections 2024-02-13T00:50:55.498 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.488+0000 7f8e1daee700 1 --2- 172.21.15.80:0/2743277100 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f8e04061340 0x7f8e04063800 unknown :-1 s=CLOSED pgs=3503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:55.498 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.488+0000 7f8e1daee700 1 --2- 172.21.15.80:0/2743277100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e180fe2b0 0x7f8e18107de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:55.498 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.488+0000 7f8e1daee700 1 --2- 172.21.15.80:0/2743277100 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f8e180fd950 0x7f8e1810e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:55.498 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.488+0000 7f8e1daee700 1 --2- 172.21.15.80:0/2743277100 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f8e18060c70 0x7f8e1810dc20 unknown :-1 s=CLOSED pgs=3012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:55.498 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.488+0000 7f8e1daee700 1 -- 172.21.15.80:0/2743277100 >> 172.21.15.80:0/2743277100 conn(0x7f8e1806c740 msgr2=0x7f8e180f5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:50:55.498 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.488+0000 7f8e1daee700 1 -- 172.21.15.80:0/2743277100 shutdown_connections 2024-02-13T00:50:55.498 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.488+0000 7f8e1daee700 1 -- 172.21.15.80:0/2743277100 wait complete. 2024-02-13T00:50:55.498 INFO:tasks.workunit.client.0.smithi080.stderr:pool '4a2d96c2-886f-4ac7-8042-11d5205396f8' already exists 2024-02-13T00:50:55.510 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph osd pool set-quota 4a2d96c2-886f-4ac7-8042-11d5205396f8 max_objects 10 2024-02-13T00:50:55.611 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51aeeb3700 1 -- 172.21.15.80:0/3970247892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51a80fdfb0 msgr2=0x7f51a80f5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:50:55.611 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51aeeb3700 1 --2- 172.21.15.80:0/3970247892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51a80fdfb0 0x7f51a80f5c50 secure :-1 s=READY pgs=2461 cs=0 l=1 rev1=1 rx=0x7f519c004870 tx=0x7f519c009cb0).stop 2024-02-13T00:50:55.611 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51aeeb3700 1 -- 172.21.15.80:0/3970247892 shutdown_connections 2024-02-13T00:50:55.611 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51aeeb3700 1 --2- 172.21.15.80:0/3970247892 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51a80f6220 0x7f51a80f6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:55.612 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51aeeb3700 1 --2- 172.21.15.80:0/3970247892 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51a80fdfb0 0x7f51a80f5c50 unknown :-1 s=CLOSED pgs=2461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:55.612 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51aeeb3700 1 --2- 172.21.15.80:0/3970247892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51a80fd6e0 0x7f51a80fdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:55.612 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51aeeb3700 1 -- 172.21.15.80:0/3970247892 >> 172.21.15.80:0/3970247892 conn(0x7f51a806fc20 msgr2=0x7f51a80f3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:50:55.612 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51aeeb3700 1 -- 172.21.15.80:0/3970247892 shutdown_connections 2024-02-13T00:50:55.612 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51aeeb3700 1 -- 172.21.15.80:0/3970247892 wait complete. 2024-02-13T00:50:55.614 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51aeeb3700 1 Processor -- start 2024-02-13T00:50:55.614 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51aeeb3700 1 -- start start 2024-02-13T00:50:55.614 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51aeeb3700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51a80f6220 0x7f51a810d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:50:55.614 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51aeeb3700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51a80fd6e0 0x7f51a810de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:50:55.614 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51aeeb3700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51a80fdfb0 0x7f51a8107b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:50:55.614 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51aeeb3700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a8108020 con 0x7f51a80fdfb0 2024-02-13T00:50:55.615 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51aeeb3700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a8108190 con 0x7f51a80f6220 2024-02-13T00:50:55.615 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51aeeb3700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a8108350 con 0x7f51a80fd6e0 2024-02-13T00:50:55.615 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51a7fff700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51a80fd6e0 0x7f51a810de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:50:55.615 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51ad450700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51a80fdfb0 0x7f51a8107b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:50:55.615 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51a7fff700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51a80fd6e0 0x7f51a810de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:45336/0 (socket says 172.21.15.80:45336) 2024-02-13T00:50:55.615 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51a7fff700 1 -- 172.21.15.80:0/632931413 learned_addr learned my addr 172.21.15.80:0/632931413 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:50:55.615 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51acc4f700 1 --2- 172.21.15.80:0/632931413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51a80f6220 0x7f51a810d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:50:55.615 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51a7fff700 1 -- 172.21.15.80:0/632931413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51a80f6220 msgr2=0x7f51a810d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:50:55.615 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51a7fff700 1 --2- 172.21.15.80:0/632931413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51a80f6220 0x7f51a810d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:55.615 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51a7fff700 1 -- 172.21.15.80:0/632931413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51a80fdfb0 msgr2=0x7f51a8107b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:50:55.615 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51a7fff700 1 --2- 172.21.15.80:0/632931413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51a80fdfb0 0x7f51a8107b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:55.615 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51a7fff700 1 -- 172.21.15.80:0/632931413 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a00097c0 con 0x7f51a80fd6e0 2024-02-13T00:50:55.615 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51a7fff700 1 --2- 172.21.15.80:0/632931413 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51a80fd6e0 0x7f51a810de20 secure :-1 s=READY pgs=3013 cs=0 l=1 rev1=1 rx=0x7f519c004710 tx=0x7f519c009cb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:50:55.615 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51a5ffb700 1 -- 172.21.15.80:0/632931413 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c00e030 con 0x7f51a80fd6e0 2024-02-13T00:50:55.615 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51aeeb3700 1 -- 172.21.15.80:0/632931413 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519c005040 con 0x7f51a80fd6e0 2024-02-13T00:50:55.615 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51a5ffb700 1 -- 172.21.15.80:0/632931413 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f519c004160 con 0x7f51a80fd6e0 2024-02-13T00:50:55.616 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51a5ffb700 1 -- 172.21.15.80:0/632931413 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c018070 con 0x7f51a80fd6e0 2024-02-13T00:50:55.616 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.604+0000 7f51aeeb3700 1 -- 172.21.15.80:0/632931413 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a81088b0 con 0x7f51a80fd6e0 2024-02-13T00:50:55.616 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.608+0000 7f51aeeb3700 1 -- 172.21.15.80:0/632931413 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a805fc90 con 0x7f51a80fd6e0 2024-02-13T00:50:55.616 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.608+0000 7f51a5ffb700 1 -- 172.21.15.80:0/632931413 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f519c009240 con 0x7f51a80fd6e0 2024-02-13T00:50:55.617 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.608+0000 7f51a5ffb700 1 --2- 172.21.15.80:0/632931413 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5190061340 0x7f5190063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:50:55.617 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.608+0000 7f51a5ffb700 1 -- 172.21.15.80:0/632931413 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(716..716 src has 1..716) v4 ==== 8806+0+0 (secure 0 0 0) 0x7f519c07e200 con 0x7f51a80fd6e0 2024-02-13T00:50:55.617 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.608+0000 7f51acc4f700 1 --2- 172.21.15.80:0/632931413 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5190061340 0x7f5190063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:50:55.618 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.608+0000 7f51acc4f700 1 --2- 172.21.15.80:0/632931413 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5190061340 0x7f5190063800 secure :-1 s=READY pgs=3504 cs=0 l=1 rev1=1 rx=0x7f51a8060670 tx=0x7f519800b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:50:55.624 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.616+0000 7f51a5ffb700 1 -- 172.21.15.80:0/632931413 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f519c04d930 con 0x7f51a80fd6e0 2024-02-13T00:50:55.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:55 smithi106 bash[18459]: audit 2024-02-13T00:50:54.361809+0000 mon.a (mon.0) 3262 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:50:55.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:55 smithi106 bash[18459]: cluster 2024-02-13T00:50:54.362123+0000 mon.a (mon.0) 3263 : cluster [DBG] osdmap e715: 8 total, 8 up, 8 in 2024-02-13T00:50:55.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:55 smithi106 bash[18459]: cluster 2024-02-13T00:50:54.527411+0000 mgr.y (mgr.24461) 810 : cluster [DBG] pgmap v1275: 164 pgs: 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:50:55.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:55 smithi106 bash[18459]: audit 2024-02-13T00:50:54.813514+0000 mon.c (mon.2) 549 : audit [INF] from='client.? 172.21.15.80:0/2743277100' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pg_num": 12}]: dispatch 2024-02-13T00:50:55.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:55 smithi106 bash[18459]: audit 2024-02-13T00:50:54.814226+0000 mon.a (mon.0) 3264 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pg_num": 12}]: dispatch 2024-02-13T00:50:55.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:55 smithi080 bash[17386]: audit 2024-02-13T00:50:54.361809+0000 mon.a (mon.0) 3262 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:50:55.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:55 smithi080 bash[17386]: cluster 2024-02-13T00:50:54.362123+0000 mon.a (mon.0) 3263 : cluster [DBG] osdmap e715: 8 total, 8 up, 8 in 2024-02-13T00:50:55.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:55 smithi080 bash[17386]: cluster 2024-02-13T00:50:54.527411+0000 mgr.y (mgr.24461) 810 : cluster [DBG] pgmap v1275: 164 pgs: 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:50:55.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:55 smithi080 bash[17386]: audit 2024-02-13T00:50:54.813514+0000 mon.c (mon.2) 549 : audit [INF] from='client.? 172.21.15.80:0/2743277100' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pg_num": 12}]: dispatch 2024-02-13T00:50:55.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:55 smithi080 bash[17386]: audit 2024-02-13T00:50:54.814226+0000 mon.a (mon.0) 3264 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pg_num": 12}]: dispatch 2024-02-13T00:50:55.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:55 smithi080 bash[24237]: audit 2024-02-13T00:50:54.361809+0000 mon.a (mon.0) 3262 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi080-54255-101"}]': finished 2024-02-13T00:50:55.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:55 smithi080 bash[24237]: cluster 2024-02-13T00:50:54.362123+0000 mon.a (mon.0) 3263 : cluster [DBG] osdmap e715: 8 total, 8 up, 8 in 2024-02-13T00:50:55.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:55 smithi080 bash[24237]: cluster 2024-02-13T00:50:54.527411+0000 mgr.y (mgr.24461) 810 : cluster [DBG] pgmap v1275: 164 pgs: 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:50:55.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:55 smithi080 bash[24237]: audit 2024-02-13T00:50:54.813514+0000 mon.c (mon.2) 549 : audit [INF] from='client.? 172.21.15.80:0/2743277100' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pg_num": 12}]: dispatch 2024-02-13T00:50:55.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:55 smithi080 bash[24237]: audit 2024-02-13T00:50:54.814226+0000 mon.a (mon.0) 3264 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pg_num": 12}]: dispatch 2024-02-13T00:50:55.779 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:55.772+0000 7f51aeeb3700 1 -- 172.21.15.80:0/632931413 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7f51a8108fd0 con 0x7f51a80fd6e0 2024-02-13T00:50:56.403 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:56.396+0000 7f51a5ffb700 1 -- 172.21.15.80:0/632931413 <== mon.2 v2:172.21.15.80:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 4a2d96c2-886f-4ac7-8042-11d5205396f8 v717) v1 ==== 223+0+0 (secure 0 0 0) 0x7f519c050f50 con 0x7f51a80fd6e0 2024-02-13T00:50:56.510 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:56.500+0000 7f51aeeb3700 1 -- 172.21.15.80:0/632931413 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7f51a81084e0 con 0x7f51a80fd6e0 2024-02-13T00:50:56.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:56 smithi106 bash[18459]: audit 2024-02-13T00:50:55.384564+0000 mon.a (mon.0) 3265 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pg_num": 12}]': finished 2024-02-13T00:50:56.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:56 smithi106 bash[18459]: cluster 2024-02-13T00:50:55.384618+0000 mon.a (mon.0) 3266 : cluster [DBG] osdmap e716: 8 total, 8 up, 8 in 2024-02-13T00:50:56.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:56 smithi106 bash[18459]: audit 2024-02-13T00:50:55.489909+0000 mon.c (mon.2) 550 : audit [INF] from='client.? 172.21.15.80:0/2743277100' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pg_num": 12}]: dispatch 2024-02-13T00:50:56.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:56 smithi106 bash[18459]: audit 2024-02-13T00:50:55.490682+0000 mon.a (mon.0) 3267 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pg_num": 12}]: dispatch 2024-02-13T00:50:56.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:56 smithi106 bash[18459]: audit 2024-02-13T00:50:55.777668+0000 mon.c (mon.2) 551 : audit [INF] from='client.? 172.21.15.80:0/632931413' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:50:56.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:56 smithi106 bash[18459]: audit 2024-02-13T00:50:55.778453+0000 mon.a (mon.0) 3268 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:50:56.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:56 smithi080 bash[17386]: audit 2024-02-13T00:50:55.384564+0000 mon.a (mon.0) 3265 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pg_num": 12}]': finished 2024-02-13T00:50:56.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:56 smithi080 bash[17386]: cluster 2024-02-13T00:50:55.384618+0000 mon.a (mon.0) 3266 : cluster [DBG] osdmap e716: 8 total, 8 up, 8 in 2024-02-13T00:50:56.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:56 smithi080 bash[17386]: audit 2024-02-13T00:50:55.489909+0000 mon.c (mon.2) 550 : audit [INF] from='client.? 172.21.15.80:0/2743277100' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pg_num": 12}]: dispatch 2024-02-13T00:50:56.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:56 smithi080 bash[17386]: audit 2024-02-13T00:50:55.490682+0000 mon.a (mon.0) 3267 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pg_num": 12}]: dispatch 2024-02-13T00:50:56.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:56 smithi080 bash[17386]: audit 2024-02-13T00:50:55.777668+0000 mon.c (mon.2) 551 : audit [INF] from='client.? 172.21.15.80:0/632931413' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:50:56.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:56 smithi080 bash[17386]: audit 2024-02-13T00:50:55.778453+0000 mon.a (mon.0) 3268 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:50:56.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:56 smithi080 bash[24237]: audit 2024-02-13T00:50:55.384564+0000 mon.a (mon.0) 3265 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pg_num": 12}]': finished 2024-02-13T00:50:56.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:56 smithi080 bash[24237]: cluster 2024-02-13T00:50:55.384618+0000 mon.a (mon.0) 3266 : cluster [DBG] osdmap e716: 8 total, 8 up, 8 in 2024-02-13T00:50:56.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:56 smithi080 bash[24237]: audit 2024-02-13T00:50:55.489909+0000 mon.c (mon.2) 550 : audit [INF] from='client.? 172.21.15.80:0/2743277100' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pg_num": 12}]: dispatch 2024-02-13T00:50:56.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:56 smithi080 bash[24237]: audit 2024-02-13T00:50:55.490682+0000 mon.a (mon.0) 3267 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pg_num": 12}]: dispatch 2024-02-13T00:50:56.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:56 smithi080 bash[24237]: audit 2024-02-13T00:50:55.777668+0000 mon.c (mon.2) 551 : audit [INF] from='client.? 172.21.15.80:0/632931413' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:50:56.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:56 smithi080 bash[24237]: audit 2024-02-13T00:50:55.778453+0000 mon.a (mon.0) 3268 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:50:57.417 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.408+0000 7f51a5ffb700 1 -- 172.21.15.80:0/632931413 <== mon.2 v2:172.21.15.80:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 4a2d96c2-886f-4ac7-8042-11d5205396f8 v718) v1 ==== 223+0+0 (secure 0 0 0) 0x7f519c07be60 con 0x7f51a80fd6e0 2024-02-13T00:50:57.420 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.412+0000 7f51aeeb3700 1 -- 172.21.15.80:0/632931413 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5190061340 msgr2=0x7f5190063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:50:57.420 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.412+0000 7f51aeeb3700 1 --2- 172.21.15.80:0/632931413 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5190061340 0x7f5190063800 secure :-1 s=READY pgs=3504 cs=0 l=1 rev1=1 rx=0x7f51a8060670 tx=0x7f519800b040).stop 2024-02-13T00:50:57.420 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.412+0000 7f51aeeb3700 1 -- 172.21.15.80:0/632931413 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51a80fd6e0 msgr2=0x7f51a810de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:50:57.420 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.412+0000 7f51aeeb3700 1 --2- 172.21.15.80:0/632931413 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51a80fd6e0 0x7f51a810de20 secure :-1 s=READY pgs=3013 cs=0 l=1 rev1=1 rx=0x7f519c004710 tx=0x7f519c009cb0).stop 2024-02-13T00:50:57.421 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.412+0000 7f51aeeb3700 1 -- 172.21.15.80:0/632931413 shutdown_connections 2024-02-13T00:50:57.421 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.412+0000 7f51aeeb3700 1 --2- 172.21.15.80:0/632931413 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5190061340 0x7f5190063800 unknown :-1 s=CLOSED pgs=3504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:57.421 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.412+0000 7f51aeeb3700 1 --2- 172.21.15.80:0/632931413 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f51a80fdfb0 0x7f51a8107b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:57.421 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.412+0000 7f51aeeb3700 1 --2- 172.21.15.80:0/632931413 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f51a80fd6e0 0x7f51a810de20 unknown :-1 s=CLOSED pgs=3013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:57.421 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.412+0000 7f51aeeb3700 1 --2- 172.21.15.80:0/632931413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51a80f6220 0x7f51a810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:57.421 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.412+0000 7f51aeeb3700 1 -- 172.21.15.80:0/632931413 >> 172.21.15.80:0/632931413 conn(0x7f51a806fc20 msgr2=0x7f51a806cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:50:57.421 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.412+0000 7f51aeeb3700 1 -- 172.21.15.80:0/632931413 shutdown_connections 2024-02-13T00:50:57.421 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.412+0000 7f51aeeb3700 1 -- 172.21.15.80:0/632931413 wait complete. 2024-02-13T00:50:57.421 INFO:tasks.workunit.client.0.smithi080.stderr:set-quota max_objects = 10 for pool 4a2d96c2-886f-4ac7-8042-11d5205396f8 2024-02-13T00:50:57.431 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph osd pool application enable 4a2d96c2-886f-4ac7-8042-11d5205396f8 rados 2024-02-13T00:50:57.532 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.520+0000 7fb6bffff700 1 -- 172.21.15.80:0/1749236492 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb6c00fc500 msgr2=0x7fb6c00f5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:50:57.532 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.520+0000 7fb6bffff700 1 --2- 172.21.15.80:0/1749236492 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb6c00fc500 0x7fb6c00f5d50 secure :-1 s=READY pgs=3014 cs=0 l=1 rev1=1 rx=0x7fb6b4009be0 tx=0x7fb6b4004d10).stop 2024-02-13T00:50:57.532 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.520+0000 7fb6bffff700 1 -- 172.21.15.80:0/1749236492 shutdown_connections 2024-02-13T00:50:57.532 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.520+0000 7fb6bffff700 1 --2- 172.21.15.80:0/1749236492 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6c00f6430 0x7fb6c0102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:57.532 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.520+0000 7fb6bffff700 1 --2- 172.21.15.80:0/1749236492 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb6c00fc500 0x7fb6c00f5d50 unknown :-1 s=CLOSED pgs=3014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:57.532 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.520+0000 7fb6bffff700 1 --2- 172.21.15.80:0/1749236492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6c00fbba0 0x7fb6c00fbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:57.533 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.520+0000 7fb6bffff700 1 -- 172.21.15.80:0/1749236492 >> 172.21.15.80:0/1749236492 conn(0x7fb6c006c840 msgr2=0x7fb6c00f3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:50:57.533 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.520+0000 7fb6bffff700 1 -- 172.21.15.80:0/1749236492 shutdown_connections 2024-02-13T00:50:57.533 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.520+0000 7fb6bffff700 1 -- 172.21.15.80:0/1749236492 wait complete. 2024-02-13T00:50:57.533 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.520+0000 7fb6bffff700 1 Processor -- start 2024-02-13T00:50:57.533 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.520+0000 7fb6bffff700 1 -- start start 2024-02-13T00:50:57.533 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6bffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6c00f6430 0x7fb6c010f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:50:57.533 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6bffff700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb6c00fbba0 0x7fb6c010fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:50:57.533 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6bffff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6c00fc500 0x7fb6c0109bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:50:57.533 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6bffff700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c010a0c0 con 0x7fb6c00fc500 2024-02-13T00:50:57.533 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6bffff700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c010a230 con 0x7fb6c00f6430 2024-02-13T00:50:57.533 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6bffff700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c010a3f0 con 0x7fb6c00fbba0 2024-02-13T00:50:57.533 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6be7fc700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb6c00fbba0 0x7fb6c010fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:50:57.533 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6bf7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6c00fc500 0x7fb6c0109bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:50:57.534 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6bf7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6c00fc500 0x7fb6c0109bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:40408/0 (socket says 172.21.15.80:40408) 2024-02-13T00:50:57.534 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6bf7fe700 1 -- 172.21.15.80:0/4007534559 learned_addr learned my addr 172.21.15.80:0/4007534559 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:50:57.534 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6beffd700 1 --2- 172.21.15.80:0/4007534559 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6c00f6430 0x7fb6c010f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:50:57.534 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6bf7fe700 1 -- 172.21.15.80:0/4007534559 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb6c00fbba0 msgr2=0x7fb6c010fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:50:57.534 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6bf7fe700 1 --2- 172.21.15.80:0/4007534559 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb6c00fbba0 0x7fb6c010fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:57.534 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6bf7fe700 1 -- 172.21.15.80:0/4007534559 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6c00f6430 msgr2=0x7fb6c010f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:50:57.534 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6bf7fe700 1 --2- 172.21.15.80:0/4007534559 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6c00f6430 0x7fb6c010f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:57.534 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6bf7fe700 1 -- 172.21.15.80:0/4007534559 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b40097c0 con 0x7fb6c00fc500 2024-02-13T00:50:57.534 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6beffd700 1 --2- 172.21.15.80:0/4007534559 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6c00f6430 0x7fb6c010f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-13T00:50:57.534 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6bf7fe700 1 --2- 172.21.15.80:0/4007534559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6c00fc500 0x7fb6c0109bd0 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 rx=0x7fb6b800e910 tx=0x7fb6b800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:50:57.534 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6a7fff700 1 -- 172.21.15.80:0/4007534559 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8004680 con 0x7fb6c00fc500 2024-02-13T00:50:57.534 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6a7fff700 1 -- 172.21.15.80:0/4007534559 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fb6b800f040 con 0x7fb6c00fc500 2024-02-13T00:50:57.534 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6bffff700 1 -- 172.21.15.80:0/4007534559 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c010a670 con 0x7fb6c00fc500 2024-02-13T00:50:57.534 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6a7fff700 1 -- 172.21.15.80:0/4007534559 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b80146f0 con 0x7fb6c00fc500 2024-02-13T00:50:57.534 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6bffff700 1 -- 172.21.15.80:0/4007534559 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c0116650 con 0x7fb6c00fc500 2024-02-13T00:50:57.535 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6bffff700 1 -- 172.21.15.80:0/4007534559 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c0060520 con 0x7fb6c00fc500 2024-02-13T00:50:57.535 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.524+0000 7fb6a7fff700 1 -- 172.21.15.80:0/4007534559 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7fb6b8007b40 con 0x7fb6c00fc500 2024-02-13T00:50:57.535 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.528+0000 7fb6a7fff700 1 --2- 172.21.15.80:0/4007534559 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fb6a8061340 0x7fb6a8063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:50:57.536 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.528+0000 7fb6a7fff700 1 -- 172.21.15.80:0/4007534559 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(718..718 src has 1..718) v4 ==== 8806+0+0 (secure 0 0 0) 0x7fb6b807d060 con 0x7fb6c00fc500 2024-02-13T00:50:57.536 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.528+0000 7fb6beffd700 1 --2- 172.21.15.80:0/4007534559 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fb6a8061340 0x7fb6a8063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:50:57.536 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.528+0000 7fb6beffd700 1 --2- 172.21.15.80:0/4007534559 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fb6a8061340 0x7fb6a8063800 secure :-1 s=READY pgs=3505 cs=0 l=1 rev1=1 rx=0x7fb6b0004c80 tx=0x7fb6b000b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:50:57.542 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.536+0000 7fb6a7fff700 1 -- 172.21.15.80:0/4007534559 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb6b8049f60 con 0x7fb6c00fc500 2024-02-13T00:50:57.696 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:57.688+0000 7fb6bffff700 1 -- 172.21.15.80:0/4007534559 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "app": "rados"} v 0) v1 -- 0x7fb6c01037c0 con 0x7fb6c00fc500 2024-02-13T00:50:57.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:57 smithi106 bash[18459]: audit 2024-02-13T00:50:56.396496+0000 mon.a (mon.0) 3269 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "10"}]': finished 2024-02-13T00:50:57.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:57 smithi106 bash[18459]: cluster 2024-02-13T00:50:56.396604+0000 mon.a (mon.0) 3270 : cluster [DBG] osdmap e717: 8 total, 8 up, 8 in 2024-02-13T00:50:57.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:57 smithi106 bash[18459]: audit 2024-02-13T00:50:56.508185+0000 mon.c (mon.2) 552 : audit [INF] from='client.? 172.21.15.80:0/632931413' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:50:57.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:57 smithi106 bash[18459]: audit 2024-02-13T00:50:56.509078+0000 mon.a (mon.0) 3271 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:50:57.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:57 smithi106 bash[18459]: cluster 2024-02-13T00:50:56.528327+0000 mgr.y (mgr.24461) 811 : cluster [DBG] pgmap v1278: 176 pgs: 12 unknown, 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:50:57.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:57 smithi080 bash[17386]: audit 2024-02-13T00:50:56.396496+0000 mon.a (mon.0) 3269 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "10"}]': finished 2024-02-13T00:50:57.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:57 smithi080 bash[17386]: cluster 2024-02-13T00:50:56.396604+0000 mon.a (mon.0) 3270 : cluster [DBG] osdmap e717: 8 total, 8 up, 8 in 2024-02-13T00:50:57.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:57 smithi080 bash[17386]: audit 2024-02-13T00:50:56.508185+0000 mon.c (mon.2) 552 : audit [INF] from='client.? 172.21.15.80:0/632931413' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:50:57.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:57 smithi080 bash[17386]: audit 2024-02-13T00:50:56.509078+0000 mon.a (mon.0) 3271 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:50:57.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:57 smithi080 bash[17386]: cluster 2024-02-13T00:50:56.528327+0000 mgr.y (mgr.24461) 811 : cluster [DBG] pgmap v1278: 176 pgs: 12 unknown, 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:50:57.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:57 smithi080 bash[24237]: audit 2024-02-13T00:50:56.396496+0000 mon.a (mon.0) 3269 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "10"}]': finished 2024-02-13T00:50:57.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:57 smithi080 bash[24237]: cluster 2024-02-13T00:50:56.396604+0000 mon.a (mon.0) 3270 : cluster [DBG] osdmap e717: 8 total, 8 up, 8 in 2024-02-13T00:50:57.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:57 smithi080 bash[24237]: audit 2024-02-13T00:50:56.508185+0000 mon.c (mon.2) 552 : audit [INF] from='client.? 172.21.15.80:0/632931413' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:50:57.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:57 smithi080 bash[24237]: audit 2024-02-13T00:50:56.509078+0000 mon.a (mon.0) 3271 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:50:57.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:57 smithi080 bash[24237]: cluster 2024-02-13T00:50:56.528327+0000 mgr.y (mgr.24461) 811 : cluster [DBG] pgmap v1278: 176 pgs: 12 unknown, 164 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:50:58.415 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:58.408+0000 7fb6a7fff700 1 -- 172.21.15.80:0/4007534559 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "app": "rados"}]=0 enabled application 'rados' on pool '4a2d96c2-886f-4ac7-8042-11d5205396f8' v719) v1 ==== 213+0+0 (secure 0 0 0) 0x7fb6b804c810 con 0x7fb6c00fc500 2024-02-13T00:50:58.511 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:58.504+0000 7fb6bffff700 1 -- 172.21.15.80:0/4007534559 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "app": "rados"} v 0) v1 -- 0x7fb6c00f7440 con 0x7fb6c00fc500 2024-02-13T00:50:58.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:58 smithi106 bash[18459]: audit 2024-02-13T00:50:57.410013+0000 mon.a (mon.0) 3272 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "10"}]': finished 2024-02-13T00:50:58.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:58 smithi106 bash[18459]: cluster 2024-02-13T00:50:57.410129+0000 mon.a (mon.0) 3273 : cluster [DBG] osdmap e718: 8 total, 8 up, 8 in 2024-02-13T00:50:58.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:58 smithi106 bash[18459]: audit 2024-02-13T00:50:57.693956+0000 mon.a (mon.0) 3274 : audit [INF] from='client.? 172.21.15.80:0/4007534559' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "app": "rados"}]: dispatch 2024-02-13T00:50:58.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:58 smithi080 bash[17386]: audit 2024-02-13T00:50:57.410013+0000 mon.a (mon.0) 3272 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "10"}]': finished 2024-02-13T00:50:58.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:58 smithi080 bash[17386]: cluster 2024-02-13T00:50:57.410129+0000 mon.a (mon.0) 3273 : cluster [DBG] osdmap e718: 8 total, 8 up, 8 in 2024-02-13T00:50:58.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:58 smithi080 bash[17386]: audit 2024-02-13T00:50:57.693956+0000 mon.a (mon.0) 3274 : audit [INF] from='client.? 172.21.15.80:0/4007534559' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "app": "rados"}]: dispatch 2024-02-13T00:50:58.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:58 smithi080 bash[24237]: audit 2024-02-13T00:50:57.410013+0000 mon.a (mon.0) 3272 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "10"}]': finished 2024-02-13T00:50:58.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:58 smithi080 bash[24237]: cluster 2024-02-13T00:50:57.410129+0000 mon.a (mon.0) 3273 : cluster [DBG] osdmap e718: 8 total, 8 up, 8 in 2024-02-13T00:50:58.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:58 smithi080 bash[24237]: audit 2024-02-13T00:50:57.693956+0000 mon.a (mon.0) 3274 : audit [INF] from='client.? 172.21.15.80:0/4007534559' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "app": "rados"}]: dispatch 2024-02-13T00:50:59.256 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:50:58 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:50:59.436 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:59.428+0000 7fb6a7fff700 1 -- 172.21.15.80:0/4007534559 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "app": "rados"}]=0 enabled application 'rados' on pool '4a2d96c2-886f-4ac7-8042-11d5205396f8' v720) v1 ==== 213+0+0 (secure 0 0 0) 0x7fb6b8009080 con 0x7fb6c00fc500 2024-02-13T00:50:59.439 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:59.432+0000 7fb6bffff700 1 -- 172.21.15.80:0/4007534559 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fb6a8061340 msgr2=0x7fb6a8063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:50:59.439 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:59.432+0000 7fb6bffff700 1 --2- 172.21.15.80:0/4007534559 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fb6a8061340 0x7fb6a8063800 secure :-1 s=READY pgs=3505 cs=0 l=1 rev1=1 rx=0x7fb6b0004c80 tx=0x7fb6b000b040).stop 2024-02-13T00:50:59.439 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:59.432+0000 7fb6bffff700 1 -- 172.21.15.80:0/4007534559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6c00fc500 msgr2=0x7fb6c0109bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:50:59.439 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:59.432+0000 7fb6bffff700 1 --2- 172.21.15.80:0/4007534559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6c00fc500 0x7fb6c0109bd0 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 rx=0x7fb6b800e910 tx=0x7fb6b800b040).stop 2024-02-13T00:50:59.439 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:59.432+0000 7fb6bffff700 1 -- 172.21.15.80:0/4007534559 shutdown_connections 2024-02-13T00:50:59.439 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:59.432+0000 7fb6bffff700 1 --2- 172.21.15.80:0/4007534559 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fb6a8061340 0x7fb6a8063800 unknown :-1 s=CLOSED pgs=3505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:59.439 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:59.432+0000 7fb6bffff700 1 --2- 172.21.15.80:0/4007534559 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fb6c00fc500 0x7fb6c0109bd0 unknown :-1 s=CLOSED pgs=2462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:59.440 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:59.432+0000 7fb6bffff700 1 --2- 172.21.15.80:0/4007534559 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fb6c00fbba0 0x7fb6c010fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:59.440 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:59.432+0000 7fb6bffff700 1 --2- 172.21.15.80:0/4007534559 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6c00f6430 0x7fb6c010f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:50:59.440 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:59.432+0000 7fb6bffff700 1 -- 172.21.15.80:0/4007534559 >> 172.21.15.80:0/4007534559 conn(0x7fb6c006c840 msgr2=0x7fb6c006d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:50:59.440 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:59.432+0000 7fb6bffff700 1 -- 172.21.15.80:0/4007534559 shutdown_connections 2024-02-13T00:50:59.440 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:50:59.432+0000 7fb6bffff700 1 -- 172.21.15.80:0/4007534559 wait complete. 2024-02-13T00:50:59.440 INFO:tasks.workunit.client.0.smithi080.stderr:enabled application 'rados' on pool '4a2d96c2-886f-4ac7-8042-11d5205396f8' 2024-02-13T00:50:59.450 INFO:tasks.workunit.client.0.smithi080.stderr:+ seq 1 10 2024-02-13T00:50:59.546 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 4a2d96c2-886f-4ac7-8042-11d5205396f8 put obj1 /etc/passwd 2024-02-13T00:50:59.595 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 4a2d96c2-886f-4ac7-8042-11d5205396f8 put obj2 /etc/passwd 2024-02-13T00:50:59.642 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 4a2d96c2-886f-4ac7-8042-11d5205396f8 put obj3 /etc/passwd 2024-02-13T00:50:59.687 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 4a2d96c2-886f-4ac7-8042-11d5205396f8 put obj4 /etc/passwd 2024-02-13T00:50:59.732 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 4a2d96c2-886f-4ac7-8042-11d5205396f8 put obj5 /etc/passwd 2024-02-13T00:50:59.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:59 smithi106 bash[18459]: audit 2024-02-13T00:50:58.412501+0000 mon.a (mon.0) 3275 : audit [INF] from='client.? 172.21.15.80:0/4007534559' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "app": "rados"}]': finished 2024-02-13T00:50:59.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:59 smithi106 bash[18459]: cluster 2024-02-13T00:50:58.412622+0000 mon.a (mon.0) 3276 : cluster [DBG] osdmap e719: 8 total, 8 up, 8 in 2024-02-13T00:50:59.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:59 smithi106 bash[18459]: audit 2024-02-13T00:50:58.509378+0000 mon.a (mon.0) 3277 : audit [INF] from='client.? 172.21.15.80:0/4007534559' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "app": "rados"}]: dispatch 2024-02-13T00:50:59.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:59 smithi106 bash[18459]: cluster 2024-02-13T00:50:58.529052+0000 mgr.y (mgr.24461) 812 : cluster [DBG] pgmap v1281: 176 pgs: 176 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:50:59.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:50:59 smithi106 bash[18459]: audit 2024-02-13T00:50:58.852745+0000 mgr.y (mgr.24461) 813 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:50:59.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:59 smithi080 bash[17386]: audit 2024-02-13T00:50:58.412501+0000 mon.a (mon.0) 3275 : audit [INF] from='client.? 172.21.15.80:0/4007534559' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "app": "rados"}]': finished 2024-02-13T00:50:59.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:59 smithi080 bash[17386]: cluster 2024-02-13T00:50:58.412622+0000 mon.a (mon.0) 3276 : cluster [DBG] osdmap e719: 8 total, 8 up, 8 in 2024-02-13T00:50:59.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:59 smithi080 bash[17386]: audit 2024-02-13T00:50:58.509378+0000 mon.a (mon.0) 3277 : audit [INF] from='client.? 172.21.15.80:0/4007534559' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "app": "rados"}]: dispatch 2024-02-13T00:50:59.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:59 smithi080 bash[17386]: cluster 2024-02-13T00:50:58.529052+0000 mgr.y (mgr.24461) 812 : cluster [DBG] pgmap v1281: 176 pgs: 176 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:50:59.760 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:50:59 smithi080 bash[17386]: audit 2024-02-13T00:50:58.852745+0000 mgr.y (mgr.24461) 813 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:50:59.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:59 smithi080 bash[24237]: audit 2024-02-13T00:50:58.412501+0000 mon.a (mon.0) 3275 : audit [INF] from='client.? 172.21.15.80:0/4007534559' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "app": "rados"}]': finished 2024-02-13T00:50:59.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:59 smithi080 bash[24237]: cluster 2024-02-13T00:50:58.412622+0000 mon.a (mon.0) 3276 : cluster [DBG] osdmap e719: 8 total, 8 up, 8 in 2024-02-13T00:50:59.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:59 smithi080 bash[24237]: audit 2024-02-13T00:50:58.509378+0000 mon.a (mon.0) 3277 : audit [INF] from='client.? 172.21.15.80:0/4007534559' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "app": "rados"}]: dispatch 2024-02-13T00:50:59.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:59 smithi080 bash[24237]: cluster 2024-02-13T00:50:58.529052+0000 mgr.y (mgr.24461) 812 : cluster [DBG] pgmap v1281: 176 pgs: 176 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:50:59.761 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:50:59 smithi080 bash[24237]: audit 2024-02-13T00:50:58.852745+0000 mgr.y (mgr.24461) 813 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:50:59.772 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 4a2d96c2-886f-4ac7-8042-11d5205396f8 put obj6 /etc/passwd 2024-02-13T00:50:59.815 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 4a2d96c2-886f-4ac7-8042-11d5205396f8 put obj7 /etc/passwd 2024-02-13T00:50:59.859 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 4a2d96c2-886f-4ac7-8042-11d5205396f8 put obj8 /etc/passwd 2024-02-13T00:50:59.901 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 4a2d96c2-886f-4ac7-8042-11d5205396f8 put obj9 /etc/passwd 2024-02-13T00:50:59.943 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 4a2d96c2-886f-4ac7-8042-11d5205396f8 put obj10 /etc/passwd 2024-02-13T00:50:59.985 INFO:tasks.workunit.client.0.smithi080.stderr:+ sleep 30 2024-02-13T00:51:00.432 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:51:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:51:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:51:00.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:00 smithi106 bash[18459]: audit 2024-02-13T00:50:59.429743+0000 mon.a (mon.0) 3278 : audit [INF] from='client.? 172.21.15.80:0/4007534559' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "app": "rados"}]': finished 2024-02-13T00:51:00.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:00 smithi106 bash[18459]: cluster 2024-02-13T00:50:59.429852+0000 mon.a (mon.0) 3279 : cluster [DBG] osdmap e720: 8 total, 8 up, 8 in 2024-02-13T00:51:00.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:00 smithi080 bash[17386]: audit 2024-02-13T00:50:59.429743+0000 mon.a (mon.0) 3278 : audit [INF] from='client.? 172.21.15.80:0/4007534559' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "app": "rados"}]': finished 2024-02-13T00:51:00.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:00 smithi080 bash[17386]: cluster 2024-02-13T00:50:59.429852+0000 mon.a (mon.0) 3279 : cluster [DBG] osdmap e720: 8 total, 8 up, 8 in 2024-02-13T00:51:00.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:00 smithi080 bash[24237]: audit 2024-02-13T00:50:59.429743+0000 mon.a (mon.0) 3278 : audit [INF] from='client.? 172.21.15.80:0/4007534559' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "app": "rados"}]': finished 2024-02-13T00:51:00.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:00 smithi080 bash[24237]: cluster 2024-02-13T00:50:59.429852+0000 mon.a (mon.0) 3279 : cluster [DBG] osdmap e720: 8 total, 8 up, 8 in 2024-02-13T00:51:01.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:01 smithi106 bash[18459]: cluster 2024-02-13T00:51:00.529878+0000 mgr.y (mgr.24461) 814 : cluster [DBG] pgmap v1283: 176 pgs: 176 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:51:01.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:01 smithi080 bash[17386]: cluster 2024-02-13T00:51:00.529878+0000 mgr.y (mgr.24461) 814 : cluster [DBG] pgmap v1283: 176 pgs: 176 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:51:01.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:01 smithi080 bash[24237]: cluster 2024-02-13T00:51:00.529878+0000 mgr.y (mgr.24461) 814 : cluster [DBG] pgmap v1283: 176 pgs: 176 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:51:03.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:51:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:51:03] "GET /metrics HTTP/1.1" 200 188918 "" "Prometheus/2.33.4" 2024-02-13T00:51:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:04 smithi106 bash[18459]: cluster 2024-02-13T00:51:02.530747+0000 mgr.y (mgr.24461) 815 : cluster [DBG] pgmap v1284: 176 pgs: 176 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:04.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:04 smithi080 bash[24237]: cluster 2024-02-13T00:51:02.530747+0000 mgr.y (mgr.24461) 815 : cluster [DBG] pgmap v1284: 176 pgs: 176 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:04.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:04 smithi080 bash[17386]: cluster 2024-02-13T00:51:02.530747+0000 mgr.y (mgr.24461) 815 : cluster [DBG] pgmap v1284: 176 pgs: 176 active+clean; 5.7 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:06 smithi106 bash[18459]: cluster 2024-02-13T00:51:04.532740+0000 mgr.y (mgr.24461) 816 : cluster [DBG] pgmap v1285: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 17 KiB/s wr, 2 op/s 2024-02-13T00:51:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:06 smithi080 bash[17386]: cluster 2024-02-13T00:51:04.532740+0000 mgr.y (mgr.24461) 816 : cluster [DBG] pgmap v1285: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 17 KiB/s wr, 2 op/s 2024-02-13T00:51:06.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:06 smithi080 bash[24237]: cluster 2024-02-13T00:51:04.532740+0000 mgr.y (mgr.24461) 816 : cluster [DBG] pgmap v1285: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 17 KiB/s wr, 2 op/s 2024-02-13T00:51:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:08 smithi106 bash[18459]: cluster 2024-02-13T00:51:06.533615+0000 mgr.y (mgr.24461) 817 : cluster [DBG] pgmap v1286: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 630 B/s rd, 15 KiB/s wr, 1 op/s 2024-02-13T00:51:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:08 smithi106 bash[18459]: cluster 2024-02-13T00:51:08.186278+0000 mon.a (mon.0) 3280 : cluster [WRN] pool '4a2d96c2-886f-4ac7-8042-11d5205396f8' is full (reached quota's max_objects: 10) 2024-02-13T00:51:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:08 smithi106 bash[18459]: cluster 2024-02-13T00:51:08.186756+0000 mon.a (mon.0) 3281 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T00:51:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:08 smithi106 bash[18459]: cluster 2024-02-13T00:51:08.195306+0000 mon.a (mon.0) 3282 : cluster [DBG] osdmap e721: 8 total, 8 up, 8 in 2024-02-13T00:51:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:08 smithi080 bash[17386]: cluster 2024-02-13T00:51:06.533615+0000 mgr.y (mgr.24461) 817 : cluster [DBG] pgmap v1286: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 630 B/s rd, 15 KiB/s wr, 1 op/s 2024-02-13T00:51:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:08 smithi080 bash[17386]: cluster 2024-02-13T00:51:08.186278+0000 mon.a (mon.0) 3280 : cluster [WRN] pool '4a2d96c2-886f-4ac7-8042-11d5205396f8' is full (reached quota's max_objects: 10) 2024-02-13T00:51:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:08 smithi080 bash[17386]: cluster 2024-02-13T00:51:08.186756+0000 mon.a (mon.0) 3281 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T00:51:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:08 smithi080 bash[17386]: cluster 2024-02-13T00:51:08.195306+0000 mon.a (mon.0) 3282 : cluster [DBG] osdmap e721: 8 total, 8 up, 8 in 2024-02-13T00:51:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:08 smithi080 bash[24237]: cluster 2024-02-13T00:51:06.533615+0000 mgr.y (mgr.24461) 817 : cluster [DBG] pgmap v1286: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 630 B/s rd, 15 KiB/s wr, 1 op/s 2024-02-13T00:51:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:08 smithi080 bash[24237]: cluster 2024-02-13T00:51:08.186278+0000 mon.a (mon.0) 3280 : cluster [WRN] pool '4a2d96c2-886f-4ac7-8042-11d5205396f8' is full (reached quota's max_objects: 10) 2024-02-13T00:51:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:08 smithi080 bash[24237]: cluster 2024-02-13T00:51:08.186756+0000 mon.a (mon.0) 3281 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T00:51:08.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:08 smithi080 bash[24237]: cluster 2024-02-13T00:51:08.195306+0000 mon.a (mon.0) 3282 : cluster [DBG] osdmap e721: 8 total, 8 up, 8 in 2024-02-13T00:51:09.256 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:51:08 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:51:10.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:51:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:51:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:51:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:10 smithi106 bash[18459]: cluster 2024-02-13T00:51:08.534460+0000 mgr.y (mgr.24461) 818 : cluster [DBG] pgmap v1288: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 13 KiB/s wr, 2 op/s 2024-02-13T00:51:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:10 smithi106 bash[18459]: audit 2024-02-13T00:51:08.864353+0000 mgr.y (mgr.24461) 819 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:51:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:10 smithi106 bash[18459]: audit 2024-02-13T00:51:09.919148+0000 mon.c (mon.2) 553 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:51:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:10 smithi080 bash[17386]: cluster 2024-02-13T00:51:08.534460+0000 mgr.y (mgr.24461) 818 : cluster [DBG] pgmap v1288: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 13 KiB/s wr, 2 op/s 2024-02-13T00:51:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:10 smithi080 bash[17386]: audit 2024-02-13T00:51:08.864353+0000 mgr.y (mgr.24461) 819 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:51:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:10 smithi080 bash[17386]: audit 2024-02-13T00:51:09.919148+0000 mon.c (mon.2) 553 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:51:10.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:10 smithi080 bash[24237]: cluster 2024-02-13T00:51:08.534460+0000 mgr.y (mgr.24461) 818 : cluster [DBG] pgmap v1288: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 13 KiB/s wr, 2 op/s 2024-02-13T00:51:10.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:10 smithi080 bash[24237]: audit 2024-02-13T00:51:08.864353+0000 mgr.y (mgr.24461) 819 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:51:10.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:10 smithi080 bash[24237]: audit 2024-02-13T00:51:09.919148+0000 mon.c (mon.2) 553 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:51:11.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:11 smithi106 bash[18459]: audit 2024-02-13T00:51:10.224985+0000 mon.c (mon.2) 554 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:51:11.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:11 smithi106 bash[18459]: audit 2024-02-13T00:51:10.226441+0000 mon.c (mon.2) 555 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:51:11.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:11 smithi106 bash[18459]: audit 2024-02-13T00:51:10.235043+0000 mon.a (mon.0) 3283 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:51:11.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:11 smithi080 bash[17386]: audit 2024-02-13T00:51:10.224985+0000 mon.c (mon.2) 554 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:51:11.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:11 smithi080 bash[17386]: audit 2024-02-13T00:51:10.226441+0000 mon.c (mon.2) 555 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:51:11.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:11 smithi080 bash[17386]: audit 2024-02-13T00:51:10.235043+0000 mon.a (mon.0) 3283 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:51:11.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:11 smithi080 bash[24237]: audit 2024-02-13T00:51:10.224985+0000 mon.c (mon.2) 554 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:51:11.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:11 smithi080 bash[24237]: audit 2024-02-13T00:51:10.226441+0000 mon.c (mon.2) 555 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:51:11.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:11 smithi080 bash[24237]: audit 2024-02-13T00:51:10.235043+0000 mon.a (mon.0) 3283 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:51:12.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:12 smithi106 bash[18459]: cluster 2024-02-13T00:51:10.535213+0000 mgr.y (mgr.24461) 820 : cluster [DBG] pgmap v1289: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T00:51:12.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:12 smithi080 bash[17386]: cluster 2024-02-13T00:51:10.535213+0000 mgr.y (mgr.24461) 820 : cluster [DBG] pgmap v1289: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T00:51:12.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:12 smithi080 bash[24237]: cluster 2024-02-13T00:51:10.535213+0000 mgr.y (mgr.24461) 820 : cluster [DBG] pgmap v1289: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T00:51:13.509 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:51:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:51:13] "GET /metrics HTTP/1.1" 200 188918 "" "Prometheus/2.33.4" 2024-02-13T00:51:14.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:14 smithi106 bash[18459]: cluster 2024-02-13T00:51:12.536016+0000 mgr.y (mgr.24461) 821 : cluster [DBG] pgmap v1290: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T00:51:14.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:14 smithi080 bash[17386]: cluster 2024-02-13T00:51:12.536016+0000 mgr.y (mgr.24461) 821 : cluster [DBG] pgmap v1290: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T00:51:14.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:14 smithi080 bash[24237]: cluster 2024-02-13T00:51:12.536016+0000 mgr.y (mgr.24461) 821 : cluster [DBG] pgmap v1290: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T00:51:16.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:16 smithi106 bash[18459]: cluster 2024-02-13T00:51:14.537898+0000 mgr.y (mgr.24461) 822 : cluster [DBG] pgmap v1291: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:51:16.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:16 smithi080 bash[17386]: cluster 2024-02-13T00:51:14.537898+0000 mgr.y (mgr.24461) 822 : cluster [DBG] pgmap v1291: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:51:16.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:16 smithi080 bash[24237]: cluster 2024-02-13T00:51:14.537898+0000 mgr.y (mgr.24461) 822 : cluster [DBG] pgmap v1291: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:51:18.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:17 smithi106 bash[18459]: cluster 2024-02-13T00:51:16.538711+0000 mgr.y (mgr.24461) 823 : cluster [DBG] pgmap v1292: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:51:18.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:17 smithi106 bash[18459]: audit 2024-02-13T00:51:16.932728+0000 mon.a (mon.0) 3284 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:51:18.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:17 smithi080 bash[24237]: cluster 2024-02-13T00:51:16.538711+0000 mgr.y (mgr.24461) 823 : cluster [DBG] pgmap v1292: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:51:18.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:17 smithi080 bash[24237]: audit 2024-02-13T00:51:16.932728+0000 mon.a (mon.0) 3284 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:51:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:17 smithi080 bash[17386]: cluster 2024-02-13T00:51:16.538711+0000 mgr.y (mgr.24461) 823 : cluster [DBG] pgmap v1292: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:51:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:17 smithi080 bash[17386]: audit 2024-02-13T00:51:16.932728+0000 mon.a (mon.0) 3284 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:51:19.256 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:51:18 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:51:20.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:51:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:51:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:51:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:20 smithi106 bash[18459]: cluster 2024-02-13T00:51:18.540567+0000 mgr.y (mgr.24461) 824 : cluster [DBG] pgmap v1293: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 989 B/s rd, 0 op/s 2024-02-13T00:51:20.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:20 smithi106 bash[18459]: audit 2024-02-13T00:51:18.866487+0000 mgr.y (mgr.24461) 825 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:51:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:20 smithi080 bash[17386]: cluster 2024-02-13T00:51:18.540567+0000 mgr.y (mgr.24461) 824 : cluster [DBG] pgmap v1293: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 989 B/s rd, 0 op/s 2024-02-13T00:51:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:20 smithi080 bash[17386]: audit 2024-02-13T00:51:18.866487+0000 mgr.y (mgr.24461) 825 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:51:20.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:20 smithi080 bash[24237]: cluster 2024-02-13T00:51:18.540567+0000 mgr.y (mgr.24461) 824 : cluster [DBG] pgmap v1293: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 989 B/s rd, 0 op/s 2024-02-13T00:51:20.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:20 smithi080 bash[24237]: audit 2024-02-13T00:51:18.866487+0000 mgr.y (mgr.24461) 825 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:51:22.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:22 smithi106 bash[18459]: cluster 2024-02-13T00:51:20.541287+0000 mgr.y (mgr.24461) 826 : cluster [DBG] pgmap v1294: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:22.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:22 smithi080 bash[17386]: cluster 2024-02-13T00:51:20.541287+0000 mgr.y (mgr.24461) 826 : cluster [DBG] pgmap v1294: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:22.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:22 smithi080 bash[24237]: cluster 2024-02-13T00:51:20.541287+0000 mgr.y (mgr.24461) 826 : cluster [DBG] pgmap v1294: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:23.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:51:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:51:23] "GET /metrics HTTP/1.1" 200 188960 "" "Prometheus/2.33.4" 2024-02-13T00:51:24.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:24 smithi106 bash[18459]: cluster 2024-02-13T00:51:22.542098+0000 mgr.y (mgr.24461) 827 : cluster [DBG] pgmap v1295: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:24 smithi080 bash[17386]: cluster 2024-02-13T00:51:22.542098+0000 mgr.y (mgr.24461) 827 : cluster [DBG] pgmap v1295: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:24.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:24 smithi080 bash[24237]: cluster 2024-02-13T00:51:22.542098+0000 mgr.y (mgr.24461) 827 : cluster [DBG] pgmap v1295: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:26.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:26 smithi106 bash[18459]: cluster 2024-02-13T00:51:24.543946+0000 mgr.y (mgr.24461) 828 : cluster [DBG] pgmap v1296: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:51:26.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:26 smithi080 bash[17386]: cluster 2024-02-13T00:51:24.543946+0000 mgr.y (mgr.24461) 828 : cluster [DBG] pgmap v1296: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:51:26.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:26 smithi080 bash[24237]: cluster 2024-02-13T00:51:24.543946+0000 mgr.y (mgr.24461) 828 : cluster [DBG] pgmap v1296: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:51:28.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:28 smithi106 bash[18459]: cluster 2024-02-13T00:51:26.544771+0000 mgr.y (mgr.24461) 829 : cluster [DBG] pgmap v1297: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:28.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:28 smithi080 bash[17386]: cluster 2024-02-13T00:51:26.544771+0000 mgr.y (mgr.24461) 829 : cluster [DBG] pgmap v1297: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:28.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:28 smithi080 bash[24237]: cluster 2024-02-13T00:51:26.544771+0000 mgr.y (mgr.24461) 829 : cluster [DBG] pgmap v1297: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:29.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:51:28 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:51:29.987 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=120862 2024-02-13T00:51:29.987 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph osd pool set-quota 4a2d96c2-886f-4ac7-8042-11d5205396f8 max_objects 100 2024-02-13T00:51:29.987 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 4a2d96c2-886f-4ac7-8042-11d5205396f8 put onemore /etc/passwd 2024-02-13T00:51:30.096 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.092+0000 7fbb5d86b700 1 -- 172.21.15.80:0/4226004098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb580fbd60 msgr2=0x7fbb580fc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:51:30.097 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.092+0000 7fbb5d86b700 1 --2- 172.21.15.80:0/4226004098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb580fbd60 0x7fbb580fc140 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 rx=0x7fbb4c004970 tx=0x7fbb4c00adc0).stop 2024-02-13T00:51:30.097 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.092+0000 7fbb5d86b700 1 -- 172.21.15.80:0/4226004098 shutdown_connections 2024-02-13T00:51:30.097 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.092+0000 7fbb5d86b700 1 --2- 172.21.15.80:0/4226004098 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbb580f65f0 0x7fbb58102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:51:30.097 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.092+0000 7fbb5d86b700 1 --2- 172.21.15.80:0/4226004098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb580fc6c0 0x7fbb580f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:51:30.097 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.092+0000 7fbb5d86b700 1 --2- 172.21.15.80:0/4226004098 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb580fbd60 0x7fbb580fc140 unknown :-1 s=CLOSED pgs=2474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:51:30.097 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.092+0000 7fbb5d86b700 1 -- 172.21.15.80:0/4226004098 >> 172.21.15.80:0/4226004098 conn(0x7fbb5806ca40 msgr2=0x7fbb580f3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:51:30.097 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.092+0000 7fbb5d86b700 1 -- 172.21.15.80:0/4226004098 shutdown_connections 2024-02-13T00:51:30.097 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.092+0000 7fbb5d86b700 1 -- 172.21.15.80:0/4226004098 wait complete. 2024-02-13T00:51:30.098 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.092+0000 7fbb5d86b700 1 Processor -- start 2024-02-13T00:51:30.098 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.092+0000 7fbb5d86b700 1 -- start start 2024-02-13T00:51:30.100 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.092+0000 7fbb5d86b700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbb580f65f0 0x7fbb580f8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:51:30.100 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.092+0000 7fbb5d86b700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb580fbd60 0x7fbb580f8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:51:30.100 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.092+0000 7fbb5d86b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb580fc6c0 0x7fbb580f8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:51:30.100 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.092+0000 7fbb5d86b700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb58115de0 con 0x7fbb580fbd60 2024-02-13T00:51:30.100 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.092+0000 7fbb5d86b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb58115f50 con 0x7fbb580fc6c0 2024-02-13T00:51:30.100 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.092+0000 7fbb5d86b700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb58116110 con 0x7fbb580f65f0 2024-02-13T00:51:30.100 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.092+0000 7fbb567fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb580fbd60 0x7fbb580f8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:51:30.100 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.092+0000 7fbb56ffd700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbb580f65f0 0x7fbb580f8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:51:30.100 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.096+0000 7fbb56ffd700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbb580f65f0 0x7fbb580f8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:38076/0 (socket says 172.21.15.80:38076) 2024-02-13T00:51:30.101 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.096+0000 7fbb56ffd700 1 -- 172.21.15.80:0/4245866420 learned_addr learned my addr 172.21.15.80:0/4245866420 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:51:30.101 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.096+0000 7fbb567fc700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb580fbd60 0x7fbb580f8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32870/0 (socket says 172.21.15.80:32870) 2024-02-13T00:51:30.101 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.096+0000 7fbb577fe700 1 --2- 172.21.15.80:0/4245866420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb580fc6c0 0x7fbb580f8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:51:30.101 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.096+0000 7fbb56ffd700 1 -- 172.21.15.80:0/4245866420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb580fc6c0 msgr2=0x7fbb580f8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:51:30.101 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.096+0000 7fbb56ffd700 1 --2- 172.21.15.80:0/4245866420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb580fc6c0 0x7fbb580f8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:51:30.101 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.096+0000 7fbb56ffd700 1 -- 172.21.15.80:0/4245866420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb580fbd60 msgr2=0x7fbb580f8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:51:30.101 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.096+0000 7fbb56ffd700 1 --2- 172.21.15.80:0/4245866420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb580fbd60 0x7fbb580f8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:51:30.101 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.096+0000 7fbb56ffd700 1 -- 172.21.15.80:0/4245866420 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb500097c0 con 0x7fbb580f65f0 2024-02-13T00:51:30.101 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.096+0000 7fbb567fc700 1 --2- 172.21.15.80:0/4245866420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb580fbd60 0x7fbb580f8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:51:30.101 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.096+0000 7fbb56ffd700 1 --2- 172.21.15.80:0/4245866420 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbb580f65f0 0x7fbb580f8110 secure :-1 s=READY pgs=3037 cs=0 l=1 rev1=1 rx=0x7fbb4c0043a0 tx=0x7fbb4c00adc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:51:30.101 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.096+0000 7fbb3ffff700 1 -- 172.21.15.80:0/4245866420 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c00f030 con 0x7fbb580f65f0 2024-02-13T00:51:30.101 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.096+0000 7fbb5d86b700 1 -- 172.21.15.80:0/4245866420 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4c005040 con 0x7fbb580f65f0 2024-02-13T00:51:30.101 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.096+0000 7fbb3ffff700 1 -- 172.21.15.80:0/4245866420 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fbb4c014660 con 0x7fbb580f65f0 2024-02-13T00:51:30.101 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.096+0000 7fbb3ffff700 1 -- 172.21.15.80:0/4245866420 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c019070 con 0x7fbb580f65f0 2024-02-13T00:51:30.102 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.096+0000 7fbb5d86b700 1 -- 172.21.15.80:0/4245866420 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb58116660 con 0x7fbb580f65f0 2024-02-13T00:51:30.102 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.096+0000 7fbb5d86b700 1 -- 172.21.15.80:0/4245866420 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb580470f0 con 0x7fbb580f65f0 2024-02-13T00:51:30.102 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.096+0000 7fbb3ffff700 1 -- 172.21.15.80:0/4245866420 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7fbb4c007930 con 0x7fbb580f65f0 2024-02-13T00:51:30.103 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.100+0000 7fbb3ffff700 1 --2- 172.21.15.80:0/4245866420 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fbb40061340 0x7fbb40063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:51:30.103 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.100+0000 7fbb3ffff700 1 -- 172.21.15.80:0/4245866420 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(721..721 src has 1..721) v4 ==== 8819+0+0 (secure 0 0 0) 0x7fbb4c07e020 con 0x7fbb580f65f0 2024-02-13T00:51:30.103 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.100+0000 7fbb567fc700 1 --2- 172.21.15.80:0/4245866420 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fbb40061340 0x7fbb40063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:51:30.103 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.100+0000 7fbb3ffff700 1 -- 172.21.15.80:0/4245866420 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=722}) v3 -- 0x7fbb4006c930 con 0x7fbb580f65f0 2024-02-13T00:51:30.103 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.100+0000 7fbb567fc700 1 --2- 172.21.15.80:0/4245866420 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fbb40061340 0x7fbb40063800 secure :-1 s=READY pgs=3517 cs=0 l=1 rev1=1 rx=0x7fbb580f98b0 tx=0x7fbb4800b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:51:30.112 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.108+0000 7fbb3ffff700 1 -- 172.21.15.80:0/4245866420 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fbb4c04d7c0 con 0x7fbb580f65f0 2024-02-13T00:51:30.275 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:30.272+0000 7fbb5d86b700 1 -- 172.21.15.80:0/4245866420 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "100"} v 0) v1 -- 0x7fbb580f95f0 con 0x7fbb580f65f0 2024-02-13T00:51:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:30 smithi106 bash[18459]: cluster 2024-02-13T00:51:28.546578+0000 mgr.y (mgr.24461) 830 : cluster [DBG] pgmap v1298: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:51:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:30 smithi106 bash[18459]: audit 2024-02-13T00:51:28.877866+0000 mgr.y (mgr.24461) 831 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:51:30.507 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:51:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:51:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:51:30.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:30 smithi080 bash[17386]: cluster 2024-02-13T00:51:28.546578+0000 mgr.y (mgr.24461) 830 : cluster [DBG] pgmap v1298: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:51:30.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:30 smithi080 bash[17386]: audit 2024-02-13T00:51:28.877866+0000 mgr.y (mgr.24461) 831 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:51:30.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:30 smithi080 bash[24237]: cluster 2024-02-13T00:51:28.546578+0000 mgr.y (mgr.24461) 830 : cluster [DBG] pgmap v1298: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:51:30.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:30 smithi080 bash[24237]: audit 2024-02-13T00:51:28.877866+0000 mgr.y (mgr.24461) 831 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:51:31.236 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:31.232+0000 7fbb3ffff700 1 -- 172.21.15.80:0/4245866420 <== mon.2 v2:172.21.15.80:3301/0 7 ==== osd_map(722..722 src has 1..722) v4 ==== 620+0+0 (secure 0 0 0) 0x7fbb4c051420 con 0x7fbb580f65f0 2024-02-13T00:51:31.236 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:31.232+0000 7fbb3ffff700 1 -- 172.21.15.80:0/4245866420 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=723}) v3 -- 0x7fbb4006d610 con 0x7fbb580f65f0 2024-02-13T00:51:31.244 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:31.240+0000 7fbb3ffff700 1 -- 172.21.15.80:0/4245866420 <== mon.2 v2:172.21.15.80:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 4a2d96c2-886f-4ac7-8042-11d5205396f8 v722) v1 ==== 225+0+0 (secure 0 0 0) 0x7fbb4c050de0 con 0x7fbb580f65f0 2024-02-13T00:51:31.340 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:31.336+0000 7fbb5d86b700 1 -- 172.21.15.80:0/4245866420 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "100"} v 0) v1 -- 0x7fbb58100140 con 0x7fbb580f65f0 2024-02-13T00:51:31.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:31 smithi106 bash[18459]: audit 2024-02-13T00:51:30.273216+0000 mon.c (mon.2) 556 : audit [INF] from='client.? 172.21.15.80:0/4245866420' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T00:51:31.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:31 smithi106 bash[18459]: audit 2024-02-13T00:51:30.273758+0000 mon.a (mon.0) 3285 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T00:51:31.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:31 smithi080 bash[17386]: audit 2024-02-13T00:51:30.273216+0000 mon.c (mon.2) 556 : audit [INF] from='client.? 172.21.15.80:0/4245866420' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T00:51:31.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:31 smithi080 bash[17386]: audit 2024-02-13T00:51:30.273758+0000 mon.a (mon.0) 3285 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T00:51:31.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:31 smithi080 bash[24237]: audit 2024-02-13T00:51:30.273216+0000 mon.c (mon.2) 556 : audit [INF] from='client.? 172.21.15.80:0/4245866420' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T00:51:31.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:31 smithi080 bash[24237]: audit 2024-02-13T00:51:30.273758+0000 mon.a (mon.0) 3285 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T00:51:32.246 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:32.240+0000 7fbb3ffff700 1 -- 172.21.15.80:0/4245866420 <== mon.2 v2:172.21.15.80:3301/0 9 ==== osd_map(723..723 src has 1..723) v4 ==== 620+0+0 (secure 0 0 0) 0x7fbb4c050de0 con 0x7fbb580f65f0 2024-02-13T00:51:32.246 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:32.240+0000 7fbb3ffff700 1 -- 172.21.15.80:0/4245866420 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=724}) v3 -- 0x7fbb4006dae0 con 0x7fbb580f65f0 2024-02-13T00:51:32.251 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:32.248+0000 7fbb3ffff700 1 -- 172.21.15.80:0/4245866420 <== mon.2 v2:172.21.15.80:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 4a2d96c2-886f-4ac7-8042-11d5205396f8 v723) v1 ==== 225+0+0 (secure 0 0 0) 0x7fbb4c035060 con 0x7fbb580f65f0 2024-02-13T00:51:32.255 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:32.252+0000 7fbb5d86b700 1 -- 172.21.15.80:0/4245866420 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fbb40061340 msgr2=0x7fbb40063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:51:32.255 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:32.252+0000 7fbb5d86b700 1 --2- 172.21.15.80:0/4245866420 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fbb40061340 0x7fbb40063800 secure :-1 s=READY pgs=3517 cs=0 l=1 rev1=1 rx=0x7fbb580f98b0 tx=0x7fbb4800b040).stop 2024-02-13T00:51:32.255 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:32.252+0000 7fbb5d86b700 1 -- 172.21.15.80:0/4245866420 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbb580f65f0 msgr2=0x7fbb580f8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:51:32.255 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:32.252+0000 7fbb5d86b700 1 --2- 172.21.15.80:0/4245866420 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbb580f65f0 0x7fbb580f8110 secure :-1 s=READY pgs=3037 cs=0 l=1 rev1=1 rx=0x7fbb4c0043a0 tx=0x7fbb4c00adc0).stop 2024-02-13T00:51:32.256 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:32.252+0000 7fbb5d86b700 1 -- 172.21.15.80:0/4245866420 shutdown_connections 2024-02-13T00:51:32.256 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:32.252+0000 7fbb5d86b700 1 --2- 172.21.15.80:0/4245866420 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fbb40061340 0x7fbb40063800 unknown :-1 s=CLOSED pgs=3517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:51:32.256 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:32.252+0000 7fbb5d86b700 1 --2- 172.21.15.80:0/4245866420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb580fc6c0 0x7fbb580f8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:51:32.256 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:32.252+0000 7fbb5d86b700 1 --2- 172.21.15.80:0/4245866420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fbb580fbd60 0x7fbb580f8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:51:32.256 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:32.252+0000 7fbb5d86b700 1 --2- 172.21.15.80:0/4245866420 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fbb580f65f0 0x7fbb580f8110 unknown :-1 s=CLOSED pgs=3037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:51:32.256 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:32.252+0000 7fbb5d86b700 1 -- 172.21.15.80:0/4245866420 >> 172.21.15.80:0/4245866420 conn(0x7fbb5806ca40 msgr2=0x7fbb580fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:51:32.256 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:32.252+0000 7fbb5d86b700 1 -- 172.21.15.80:0/4245866420 shutdown_connections 2024-02-13T00:51:32.256 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:32.252+0000 7fbb5d86b700 1 -- 172.21.15.80:0/4245866420 wait complete. 2024-02-13T00:51:32.257 INFO:tasks.workunit.client.0.smithi080.stderr:set-quota max_objects = 100 for pool 4a2d96c2-886f-4ac7-8042-11d5205396f8 2024-02-13T00:51:32.267 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 120862 2024-02-13T00:51:32.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:32 smithi106 bash[18459]: cluster 2024-02-13T00:51:30.547384+0000 mgr.y (mgr.24461) 832 : cluster [DBG] pgmap v1299: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:32.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:32 smithi106 bash[18459]: audit 2024-02-13T00:51:31.237341+0000 mon.a (mon.0) 3286 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "100"}]': finished 2024-02-13T00:51:32.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:32 smithi106 bash[18459]: cluster 2024-02-13T00:51:31.237470+0000 mon.a (mon.0) 3287 : cluster [DBG] osdmap e722: 8 total, 8 up, 8 in 2024-02-13T00:51:32.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:32 smithi106 bash[18459]: audit 2024-02-13T00:51:31.338604+0000 mon.c (mon.2) 557 : audit [INF] from='client.? 172.21.15.80:0/4245866420' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T00:51:32.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:32 smithi106 bash[18459]: audit 2024-02-13T00:51:31.339219+0000 mon.a (mon.0) 3288 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T00:51:32.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:32 smithi080 bash[17386]: cluster 2024-02-13T00:51:30.547384+0000 mgr.y (mgr.24461) 832 : cluster [DBG] pgmap v1299: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:32.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:32 smithi080 bash[17386]: audit 2024-02-13T00:51:31.237341+0000 mon.a (mon.0) 3286 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "100"}]': finished 2024-02-13T00:51:32.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:32 smithi080 bash[17386]: cluster 2024-02-13T00:51:31.237470+0000 mon.a (mon.0) 3287 : cluster [DBG] osdmap e722: 8 total, 8 up, 8 in 2024-02-13T00:51:32.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:32 smithi080 bash[17386]: audit 2024-02-13T00:51:31.338604+0000 mon.c (mon.2) 557 : audit [INF] from='client.? 172.21.15.80:0/4245866420' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T00:51:32.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:32 smithi080 bash[17386]: audit 2024-02-13T00:51:31.339219+0000 mon.a (mon.0) 3288 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T00:51:32.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:32 smithi080 bash[24237]: cluster 2024-02-13T00:51:30.547384+0000 mgr.y (mgr.24461) 832 : cluster [DBG] pgmap v1299: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:32.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:32 smithi080 bash[24237]: audit 2024-02-13T00:51:31.237341+0000 mon.a (mon.0) 3286 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "100"}]': finished 2024-02-13T00:51:32.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:32 smithi080 bash[24237]: cluster 2024-02-13T00:51:31.237470+0000 mon.a (mon.0) 3287 : cluster [DBG] osdmap e722: 8 total, 8 up, 8 in 2024-02-13T00:51:32.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:32 smithi080 bash[24237]: audit 2024-02-13T00:51:31.338604+0000 mon.c (mon.2) 557 : audit [INF] from='client.? 172.21.15.80:0/4245866420' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T00:51:32.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:32 smithi080 bash[24237]: audit 2024-02-13T00:51:31.339219+0000 mon.a (mon.0) 3288 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T00:51:33.217 INFO:tasks.workunit.client.0.smithi080.stderr:+ [ 0 -ne 0 ] 2024-02-13T00:51:33.217 INFO:tasks.workunit.client.0.smithi080.stderr:+ true 2024-02-13T00:51:33.217 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 4a2d96c2-886f-4ac7-8042-11d5205396f8 put twomore /etc/passwd 2024-02-13T00:51:33.255 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph osd pool set-quota 4a2d96c2-886f-4ac7-8042-11d5205396f8 max_bytes 100 2024-02-13T00:51:33.357 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.352+0000 7ffbb0e60700 1 -- 172.21.15.80:0/3786447223 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffbac0ff940 msgr2=0x7ffbac0ffd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:51:33.357 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.352+0000 7ffbb0e60700 1 --2- 172.21.15.80:0/3786447223 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffbac0ff940 0x7ffbac0ffd20 secure :-1 s=READY pgs=3039 cs=0 l=1 rev1=1 rx=0x7ffb9c009c30 tx=0x7ffb9c004c50).stop 2024-02-13T00:51:33.357 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.352+0000 7ffbb0e60700 1 -- 172.21.15.80:0/3786447223 shutdown_connections 2024-02-13T00:51:33.357 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.352+0000 7ffbb0e60700 1 --2- 172.21.15.80:0/3786447223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbac0fa180 0x7ffbac106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:51:33.357 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.352+0000 7ffbb0e60700 1 --2- 172.21.15.80:0/3786447223 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbac100210 0x7ffbac0f9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:51:33.357 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.352+0000 7ffbb0e60700 1 --2- 172.21.15.80:0/3786447223 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffbac0ff940 0x7ffbac0ffd20 unknown :-1 s=CLOSED pgs=3039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:51:33.357 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.352+0000 7ffbb0e60700 1 -- 172.21.15.80:0/3786447223 >> 172.21.15.80:0/3786447223 conn(0x7ffbac0f5560 msgr2=0x7ffbac0f7980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:51:33.357 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.352+0000 7ffbb0e60700 1 -- 172.21.15.80:0/3786447223 shutdown_connections 2024-02-13T00:51:33.357 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.352+0000 7ffbb0e60700 1 -- 172.21.15.80:0/3786447223 wait complete. 2024-02-13T00:51:33.360 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.352+0000 7ffbb0e60700 1 Processor -- start 2024-02-13T00:51:33.360 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.352+0000 7ffbb0e60700 1 -- start start 2024-02-13T00:51:33.360 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.352+0000 7ffbb0e60700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbac0fa180 0x7ffbac10fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:51:33.360 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.352+0000 7ffbb0e60700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbac0ff940 0x7ffbac110150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:51:33.360 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.352+0000 7ffbb0e60700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffbac100210 0x7ffbac109e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:51:33.360 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.352+0000 7ffbb0e60700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac10a310 con 0x7ffbac0fa180 2024-02-13T00:51:33.360 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.352+0000 7ffbb0e60700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac10a480 con 0x7ffbac0ff940 2024-02-13T00:51:33.361 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.352+0000 7ffbb0e60700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac10a640 con 0x7ffbac100210 2024-02-13T00:51:33.361 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.356+0000 7ffbaa59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbac0fa180 0x7ffbac10fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:51:33.361 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.356+0000 7ffbaa59c700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbac0fa180 0x7ffbac10fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:32934/0 (socket says 172.21.15.80:32934) 2024-02-13T00:51:33.361 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.356+0000 7ffbaa59c700 1 -- 172.21.15.80:0/2347477625 learned_addr learned my addr 172.21.15.80:0/2347477625 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:51:33.361 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.356+0000 7ffbaad9d700 1 --2- 172.21.15.80:0/2347477625 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffbac100210 0x7ffbac109e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:51:33.361 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.356+0000 7ffba9d9b700 1 --2- 172.21.15.80:0/2347477625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbac0ff940 0x7ffbac110150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:51:33.361 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.356+0000 7ffbaa59c700 1 -- 172.21.15.80:0/2347477625 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffbac100210 msgr2=0x7ffbac109e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:51:33.361 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.356+0000 7ffbaa59c700 1 --2- 172.21.15.80:0/2347477625 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffbac100210 0x7ffbac109e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:51:33.361 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.356+0000 7ffbaa59c700 1 -- 172.21.15.80:0/2347477625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbac0ff940 msgr2=0x7ffbac110150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:51:33.361 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.356+0000 7ffbaa59c700 1 --2- 172.21.15.80:0/2347477625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbac0ff940 0x7ffbac110150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:51:33.361 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.356+0000 7ffbaa59c700 1 -- 172.21.15.80:0/2347477625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9c0097c0 con 0x7ffbac0fa180 2024-02-13T00:51:33.362 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.356+0000 7ffba9d9b700 1 --2- 172.21.15.80:0/2347477625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbac0ff940 0x7ffbac110150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-13T00:51:33.362 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.356+0000 7ffbaa59c700 1 --2- 172.21.15.80:0/2347477625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbac0fa180 0x7ffbac10fc60 secure :-1 s=READY pgs=2477 cs=0 l=1 rev1=1 rx=0x7ffb9c0011d0 tx=0x7ffb9c004c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:51:33.362 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.356+0000 7ffb9b7fe700 1 -- 172.21.15.80:0/2347477625 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c00e040 con 0x7ffbac0fa180 2024-02-13T00:51:33.362 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.356+0000 7ffb9b7fe700 1 -- 172.21.15.80:0/2347477625 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7ffb9c018040 con 0x7ffbac0fa180 2024-02-13T00:51:33.362 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.356+0000 7ffbb0e60700 1 -- 172.21.15.80:0/2347477625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbac10a8c0 con 0x7ffbac0fa180 2024-02-13T00:51:33.362 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.356+0000 7ffb9b7fe700 1 -- 172.21.15.80:0/2347477625 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c013d20 con 0x7ffbac0fa180 2024-02-13T00:51:33.362 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.356+0000 7ffbb0e60700 1 -- 172.21.15.80:0/2347477625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbac116ab0 con 0x7ffbac0fa180 2024-02-13T00:51:33.363 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.356+0000 7ffb9b7fe700 1 -- 172.21.15.80:0/2347477625 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7ffb9c01d610 con 0x7ffbac0fa180 2024-02-13T00:51:33.363 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.356+0000 7ffbb0e60700 1 -- 172.21.15.80:0/2347477625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbac10ace0 con 0x7ffbac0fa180 2024-02-13T00:51:33.363 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.356+0000 7ffb9b7fe700 1 --2- 172.21.15.80:0/2347477625 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7ffb94061340 0x7ffb94063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:51:33.363 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.356+0000 7ffb9b7fe700 1 -- 172.21.15.80:0/2347477625 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(724..724 src has 1..724) v4 ==== 8819+0+0 (secure 0 0 0) 0x7ffb9c07efe0 con 0x7ffbac0fa180 2024-02-13T00:51:33.363 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.356+0000 7ffba9d9b700 1 --2- 172.21.15.80:0/2347477625 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7ffb94061340 0x7ffb94063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:51:33.363 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.360+0000 7ffba9d9b700 1 --2- 172.21.15.80:0/2347477625 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7ffb94061340 0x7ffb94063800 secure :-1 s=READY pgs=3519 cs=0 l=1 rev1=1 rx=0x7ffba00043d0 tx=0x7ffba000b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:51:33.369 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.364+0000 7ffb9b7fe700 1 -- 172.21.15.80:0/2347477625 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ffb9c04e720 con 0x7ffbac0fa180 2024-02-13T00:51:33.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:33 smithi106 bash[18459]: audit 2024-02-13T00:51:32.247079+0000 mon.a (mon.0) 3289 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "100"}]': finished 2024-02-13T00:51:33.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:33 smithi106 bash[18459]: cluster 2024-02-13T00:51:32.247176+0000 mon.a (mon.0) 3290 : cluster [DBG] osdmap e723: 8 total, 8 up, 8 in 2024-02-13T00:51:33.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:33 smithi106 bash[18459]: cluster 2024-02-13T00:51:33.194455+0000 mon.a (mon.0) 3291 : cluster [INF] pool '4a2d96c2-886f-4ac7-8042-11d5205396f8' no longer out of quota; removing NO_QUOTA flag 2024-02-13T00:51:33.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:33 smithi106 bash[18459]: cluster 2024-02-13T00:51:33.194961+0000 mon.a (mon.0) 3292 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-13T00:51:33.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:33 smithi106 bash[18459]: cluster 2024-02-13T00:51:33.205053+0000 mon.a (mon.0) 3293 : cluster [DBG] osdmap e724: 8 total, 8 up, 8 in 2024-02-13T00:51:33.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:51:33 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:51:33] "GET /metrics HTTP/1.1" 200 188961 "" "Prometheus/2.33.4" 2024-02-13T00:51:33.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:33 smithi080 bash[17386]: audit 2024-02-13T00:51:32.247079+0000 mon.a (mon.0) 3289 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "100"}]': finished 2024-02-13T00:51:33.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:33 smithi080 bash[17386]: cluster 2024-02-13T00:51:32.247176+0000 mon.a (mon.0) 3290 : cluster [DBG] osdmap e723: 8 total, 8 up, 8 in 2024-02-13T00:51:33.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:33 smithi080 bash[17386]: cluster 2024-02-13T00:51:33.194455+0000 mon.a (mon.0) 3291 : cluster [INF] pool '4a2d96c2-886f-4ac7-8042-11d5205396f8' no longer out of quota; removing NO_QUOTA flag 2024-02-13T00:51:33.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:33 smithi080 bash[17386]: cluster 2024-02-13T00:51:33.194961+0000 mon.a (mon.0) 3292 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-13T00:51:33.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:33 smithi080 bash[17386]: cluster 2024-02-13T00:51:33.205053+0000 mon.a (mon.0) 3293 : cluster [DBG] osdmap e724: 8 total, 8 up, 8 in 2024-02-13T00:51:33.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:33 smithi080 bash[24237]: audit 2024-02-13T00:51:32.247079+0000 mon.a (mon.0) 3289 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "100"}]': finished 2024-02-13T00:51:33.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:33 smithi080 bash[24237]: cluster 2024-02-13T00:51:32.247176+0000 mon.a (mon.0) 3290 : cluster [DBG] osdmap e723: 8 total, 8 up, 8 in 2024-02-13T00:51:33.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:33 smithi080 bash[24237]: cluster 2024-02-13T00:51:33.194455+0000 mon.a (mon.0) 3291 : cluster [INF] pool '4a2d96c2-886f-4ac7-8042-11d5205396f8' no longer out of quota; removing NO_QUOTA flag 2024-02-13T00:51:33.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:33 smithi080 bash[24237]: cluster 2024-02-13T00:51:33.194961+0000 mon.a (mon.0) 3292 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-13T00:51:33.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:33 smithi080 bash[24237]: cluster 2024-02-13T00:51:33.205053+0000 mon.a (mon.0) 3293 : cluster [DBG] osdmap e724: 8 total, 8 up, 8 in 2024-02-13T00:51:33.527 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:33.524+0000 7ffbb0e60700 1 -- 172.21.15.80:0/2347477625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "100"} v 0) v1 -- 0x7ffbac108bb0 con 0x7ffbac0fa180 2024-02-13T00:51:34.261 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:34.256+0000 7ffb9b7fe700 1 -- 172.21.15.80:0/2347477625 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 4a2d96c2-886f-4ac7-8042-11d5205396f8 v725) v1 ==== 221+0+0 (secure 0 0 0) 0x7ffb9c051d40 con 0x7ffbac0fa180 2024-02-13T00:51:34.358 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:34.352+0000 7ffbb0e60700 1 -- 172.21.15.80:0/2347477625 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "100"} v 0) v1 -- 0x7ffbac10b300 con 0x7ffbac0fa180 2024-02-13T00:51:34.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:34 smithi106 bash[18459]: cluster 2024-02-13T00:51:32.548227+0000 mgr.y (mgr.24461) 833 : cluster [DBG] pgmap v1302: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:51:34.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:34 smithi106 bash[18459]: audit 2024-02-13T00:51:33.525634+0000 mon.a (mon.0) 3294 : audit [INF] from='client.? 172.21.15.80:0/2347477625' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-13T00:51:34.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:34 smithi080 bash[17386]: cluster 2024-02-13T00:51:32.548227+0000 mgr.y (mgr.24461) 833 : cluster [DBG] pgmap v1302: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:51:34.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:34 smithi080 bash[17386]: audit 2024-02-13T00:51:33.525634+0000 mon.a (mon.0) 3294 : audit [INF] from='client.? 172.21.15.80:0/2347477625' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-13T00:51:34.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:34 smithi080 bash[24237]: cluster 2024-02-13T00:51:32.548227+0000 mgr.y (mgr.24461) 833 : cluster [DBG] pgmap v1302: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:51:34.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:34 smithi080 bash[24237]: audit 2024-02-13T00:51:33.525634+0000 mon.a (mon.0) 3294 : audit [INF] from='client.? 172.21.15.80:0/2347477625' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-13T00:51:35.282 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:35.276+0000 7ffb9b7fe700 1 -- 172.21.15.80:0/2347477625 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 4a2d96c2-886f-4ac7-8042-11d5205396f8 v726) v1 ==== 221+0+0 (secure 0 0 0) 0x7ffb9c051f20 con 0x7ffbac0fa180 2024-02-13T00:51:35.286 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:35.280+0000 7ffbb0e60700 1 -- 172.21.15.80:0/2347477625 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7ffb94061340 msgr2=0x7ffb94063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:51:35.286 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:35.280+0000 7ffbb0e60700 1 --2- 172.21.15.80:0/2347477625 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7ffb94061340 0x7ffb94063800 secure :-1 s=READY pgs=3519 cs=0 l=1 rev1=1 rx=0x7ffba00043d0 tx=0x7ffba000b040).stop 2024-02-13T00:51:35.286 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:35.280+0000 7ffbb0e60700 1 -- 172.21.15.80:0/2347477625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbac0fa180 msgr2=0x7ffbac10fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:51:35.286 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:35.280+0000 7ffbb0e60700 1 --2- 172.21.15.80:0/2347477625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbac0fa180 0x7ffbac10fc60 secure :-1 s=READY pgs=2477 cs=0 l=1 rev1=1 rx=0x7ffb9c0011d0 tx=0x7ffb9c004c50).stop 2024-02-13T00:51:35.287 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:35.284+0000 7ffbb0e60700 1 -- 172.21.15.80:0/2347477625 shutdown_connections 2024-02-13T00:51:35.287 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:35.284+0000 7ffbb0e60700 1 --2- 172.21.15.80:0/2347477625 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7ffb94061340 0x7ffb94063800 unknown :-1 s=CLOSED pgs=3519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:51:35.287 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:35.284+0000 7ffbb0e60700 1 --2- 172.21.15.80:0/2347477625 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7ffbac100210 0x7ffbac109e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:51:35.287 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:35.284+0000 7ffbb0e60700 1 --2- 172.21.15.80:0/2347477625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbac0ff940 0x7ffbac110150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:51:35.287 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:35.284+0000 7ffbb0e60700 1 --2- 172.21.15.80:0/2347477625 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7ffbac0fa180 0x7ffbac10fc60 unknown :-1 s=CLOSED pgs=2477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:51:35.287 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:35.284+0000 7ffbb0e60700 1 -- 172.21.15.80:0/2347477625 >> 172.21.15.80:0/2347477625 conn(0x7ffbac0f5560 msgr2=0x7ffbac0f7040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:51:35.287 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:35.284+0000 7ffbb0e60700 1 -- 172.21.15.80:0/2347477625 shutdown_connections 2024-02-13T00:51:35.287 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:51:35.284+0000 7ffbb0e60700 1 -- 172.21.15.80:0/2347477625 wait complete. 2024-02-13T00:51:35.288 INFO:tasks.workunit.client.0.smithi080.stderr:set-quota max_bytes = 100 for pool 4a2d96c2-886f-4ac7-8042-11d5205396f8 2024-02-13T00:51:35.297 INFO:tasks.workunit.client.0.smithi080.stderr:+ sleep 30 2024-02-13T00:51:35.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:35 smithi106 bash[18459]: audit 2024-02-13T00:51:34.258178+0000 mon.a (mon.0) 3295 : audit [INF] from='client.? 172.21.15.80:0/2347477625' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "100"}]': finished 2024-02-13T00:51:35.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:35 smithi106 bash[18459]: cluster 2024-02-13T00:51:34.258343+0000 mon.a (mon.0) 3296 : cluster [DBG] osdmap e725: 8 total, 8 up, 8 in 2024-02-13T00:51:35.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:35 smithi106 bash[18459]: audit 2024-02-13T00:51:34.356459+0000 mon.a (mon.0) 3297 : audit [INF] from='client.? 172.21.15.80:0/2347477625' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-13T00:51:35.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:35 smithi080 bash[17386]: audit 2024-02-13T00:51:34.258178+0000 mon.a (mon.0) 3295 : audit [INF] from='client.? 172.21.15.80:0/2347477625' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "100"}]': finished 2024-02-13T00:51:35.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:35 smithi080 bash[17386]: cluster 2024-02-13T00:51:34.258343+0000 mon.a (mon.0) 3296 : cluster [DBG] osdmap e725: 8 total, 8 up, 8 in 2024-02-13T00:51:35.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:35 smithi080 bash[17386]: audit 2024-02-13T00:51:34.356459+0000 mon.a (mon.0) 3297 : audit [INF] from='client.? 172.21.15.80:0/2347477625' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-13T00:51:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:35 smithi080 bash[24237]: audit 2024-02-13T00:51:34.258178+0000 mon.a (mon.0) 3295 : audit [INF] from='client.? 172.21.15.80:0/2347477625' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "100"}]': finished 2024-02-13T00:51:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:35 smithi080 bash[24237]: cluster 2024-02-13T00:51:34.258343+0000 mon.a (mon.0) 3296 : cluster [DBG] osdmap e725: 8 total, 8 up, 8 in 2024-02-13T00:51:35.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:35 smithi080 bash[24237]: audit 2024-02-13T00:51:34.356459+0000 mon.a (mon.0) 3297 : audit [INF] from='client.? 172.21.15.80:0/2347477625' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-13T00:51:36.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:36 smithi106 bash[18459]: cluster 2024-02-13T00:51:34.549018+0000 mgr.y (mgr.24461) 834 : cluster [DBG] pgmap v1305: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:51:36.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:36 smithi106 bash[18459]: audit 2024-02-13T00:51:35.279905+0000 mon.a (mon.0) 3298 : audit [INF] from='client.? 172.21.15.80:0/2347477625' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "100"}]': finished 2024-02-13T00:51:36.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:36 smithi106 bash[18459]: cluster 2024-02-13T00:51:35.280149+0000 mon.a (mon.0) 3299 : cluster [DBG] osdmap e726: 8 total, 8 up, 8 in 2024-02-13T00:51:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:36 smithi080 bash[17386]: cluster 2024-02-13T00:51:34.549018+0000 mgr.y (mgr.24461) 834 : cluster [DBG] pgmap v1305: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:51:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:36 smithi080 bash[17386]: audit 2024-02-13T00:51:35.279905+0000 mon.a (mon.0) 3298 : audit [INF] from='client.? 172.21.15.80:0/2347477625' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "100"}]': finished 2024-02-13T00:51:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:36 smithi080 bash[17386]: cluster 2024-02-13T00:51:35.280149+0000 mon.a (mon.0) 3299 : cluster [DBG] osdmap e726: 8 total, 8 up, 8 in 2024-02-13T00:51:36.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:36 smithi080 bash[24237]: cluster 2024-02-13T00:51:34.549018+0000 mgr.y (mgr.24461) 834 : cluster [DBG] pgmap v1305: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:51:36.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:36 smithi080 bash[24237]: audit 2024-02-13T00:51:35.279905+0000 mon.a (mon.0) 3298 : audit [INF] from='client.? 172.21.15.80:0/2347477625' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "100"}]': finished 2024-02-13T00:51:36.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:36 smithi080 bash[24237]: cluster 2024-02-13T00:51:35.280149+0000 mon.a (mon.0) 3299 : cluster [DBG] osdmap e726: 8 total, 8 up, 8 in 2024-02-13T00:51:38.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:38 smithi106 bash[18459]: cluster 2024-02-13T00:51:36.549803+0000 mgr.y (mgr.24461) 835 : cluster [DBG] pgmap v1307: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:51:38.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:38 smithi106 bash[18459]: cluster 2024-02-13T00:51:38.196639+0000 mon.a (mon.0) 3300 : cluster [WRN] pool '4a2d96c2-886f-4ac7-8042-11d5205396f8' is full (reached quota's max_bytes: 100 B) 2024-02-13T00:51:38.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:38 smithi106 bash[18459]: cluster 2024-02-13T00:51:38.197175+0000 mon.a (mon.0) 3301 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T00:51:38.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:38 smithi106 bash[18459]: cluster 2024-02-13T00:51:38.209087+0000 mon.a (mon.0) 3302 : cluster [DBG] osdmap e727: 8 total, 8 up, 8 in 2024-02-13T00:51:38.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:38 smithi080 bash[24237]: cluster 2024-02-13T00:51:36.549803+0000 mgr.y (mgr.24461) 835 : cluster [DBG] pgmap v1307: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:51:38.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:38 smithi080 bash[24237]: cluster 2024-02-13T00:51:38.196639+0000 mon.a (mon.0) 3300 : cluster [WRN] pool '4a2d96c2-886f-4ac7-8042-11d5205396f8' is full (reached quota's max_bytes: 100 B) 2024-02-13T00:51:38.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:38 smithi080 bash[24237]: cluster 2024-02-13T00:51:38.197175+0000 mon.a (mon.0) 3301 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T00:51:38.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:38 smithi080 bash[24237]: cluster 2024-02-13T00:51:38.209087+0000 mon.a (mon.0) 3302 : cluster [DBG] osdmap e727: 8 total, 8 up, 8 in 2024-02-13T00:51:38.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:38 smithi080 bash[17386]: cluster 2024-02-13T00:51:36.549803+0000 mgr.y (mgr.24461) 835 : cluster [DBG] pgmap v1307: 176 pgs: 176 active+clean; 123 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:51:38.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:38 smithi080 bash[17386]: cluster 2024-02-13T00:51:38.196639+0000 mon.a (mon.0) 3300 : cluster [WRN] pool '4a2d96c2-886f-4ac7-8042-11d5205396f8' is full (reached quota's max_bytes: 100 B) 2024-02-13T00:51:38.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:38 smithi080 bash[17386]: cluster 2024-02-13T00:51:38.197175+0000 mon.a (mon.0) 3301 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T00:51:38.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:38 smithi080 bash[17386]: cluster 2024-02-13T00:51:38.209087+0000 mon.a (mon.0) 3302 : cluster [DBG] osdmap e727: 8 total, 8 up, 8 in 2024-02-13T00:51:39.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:51:38 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:51:40.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:51:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:51:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:51:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:40 smithi106 bash[18459]: cluster 2024-02-13T00:51:38.550563+0000 mgr.y (mgr.24461) 836 : cluster [DBG] pgmap v1309: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 957 B/s rd, 4.5 KiB/s wr, 1 op/s 2024-02-13T00:51:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:40 smithi106 bash[18459]: audit 2024-02-13T00:51:38.889401+0000 mgr.y (mgr.24461) 837 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:51:40.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:40 smithi080 bash[17386]: cluster 2024-02-13T00:51:38.550563+0000 mgr.y (mgr.24461) 836 : cluster [DBG] pgmap v1309: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 957 B/s rd, 4.5 KiB/s wr, 1 op/s 2024-02-13T00:51:40.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:40 smithi080 bash[17386]: audit 2024-02-13T00:51:38.889401+0000 mgr.y (mgr.24461) 837 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:51:40.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:40 smithi080 bash[24237]: cluster 2024-02-13T00:51:38.550563+0000 mgr.y (mgr.24461) 836 : cluster [DBG] pgmap v1309: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 957 B/s rd, 4.5 KiB/s wr, 1 op/s 2024-02-13T00:51:40.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:40 smithi080 bash[24237]: audit 2024-02-13T00:51:38.889401+0000 mgr.y (mgr.24461) 837 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:51:42.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:42 smithi106 bash[18459]: cluster 2024-02-13T00:51:40.551376+0000 mgr.y (mgr.24461) 838 : cluster [DBG] pgmap v1310: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 813 B/s rd, 3.8 KiB/s wr, 1 op/s 2024-02-13T00:51:42.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:42 smithi080 bash[17386]: cluster 2024-02-13T00:51:40.551376+0000 mgr.y (mgr.24461) 838 : cluster [DBG] pgmap v1310: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 813 B/s rd, 3.8 KiB/s wr, 1 op/s 2024-02-13T00:51:42.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:42 smithi080 bash[24237]: cluster 2024-02-13T00:51:40.551376+0000 mgr.y (mgr.24461) 838 : cluster [DBG] pgmap v1310: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 813 B/s rd, 3.8 KiB/s wr, 1 op/s 2024-02-13T00:51:43.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:51:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:51:43] "GET /metrics HTTP/1.1" 200 188961 "" "Prometheus/2.33.4" 2024-02-13T00:51:44.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:44 smithi106 bash[18459]: cluster 2024-02-13T00:51:42.552177+0000 mgr.y (mgr.24461) 839 : cluster [DBG] pgmap v1311: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 3.0 KiB/s wr, 0 op/s 2024-02-13T00:51:44.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:44 smithi080 bash[17386]: cluster 2024-02-13T00:51:42.552177+0000 mgr.y (mgr.24461) 839 : cluster [DBG] pgmap v1311: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 3.0 KiB/s wr, 0 op/s 2024-02-13T00:51:44.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:44 smithi080 bash[24237]: cluster 2024-02-13T00:51:42.552177+0000 mgr.y (mgr.24461) 839 : cluster [DBG] pgmap v1311: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 3.0 KiB/s wr, 0 op/s 2024-02-13T00:51:46.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:46 smithi106 bash[18459]: cluster 2024-02-13T00:51:44.554021+0000 mgr.y (mgr.24461) 840 : cluster [DBG] pgmap v1312: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.6 KiB/s wr, 1 op/s 2024-02-13T00:51:46.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:46 smithi080 bash[17386]: cluster 2024-02-13T00:51:44.554021+0000 mgr.y (mgr.24461) 840 : cluster [DBG] pgmap v1312: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.6 KiB/s wr, 1 op/s 2024-02-13T00:51:46.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:46 smithi080 bash[24237]: cluster 2024-02-13T00:51:44.554021+0000 mgr.y (mgr.24461) 840 : cluster [DBG] pgmap v1312: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 2.6 KiB/s wr, 1 op/s 2024-02-13T00:51:48.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:48 smithi106 bash[18459]: cluster 2024-02-13T00:51:46.554829+0000 mgr.y (mgr.24461) 841 : cluster [DBG] pgmap v1313: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 2.4 KiB/s wr, 1 op/s 2024-02-13T00:51:48.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:48 smithi080 bash[17386]: cluster 2024-02-13T00:51:46.554829+0000 mgr.y (mgr.24461) 841 : cluster [DBG] pgmap v1313: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 2.4 KiB/s wr, 1 op/s 2024-02-13T00:51:48.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:48 smithi080 bash[24237]: cluster 2024-02-13T00:51:46.554829+0000 mgr.y (mgr.24461) 841 : cluster [DBG] pgmap v1313: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 2.4 KiB/s wr, 1 op/s 2024-02-13T00:51:49.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:51:48 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:51:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:50 smithi106 bash[18459]: cluster 2024-02-13T00:51:48.556684+0000 mgr.y (mgr.24461) 842 : cluster [DBG] pgmap v1314: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 989 B/s rd, 0 op/s 2024-02-13T00:51:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:50 smithi106 bash[18459]: audit 2024-02-13T00:51:48.900940+0000 mgr.y (mgr.24461) 843 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:51:50.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:51:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:51:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:51:50.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:50 smithi080 bash[17386]: cluster 2024-02-13T00:51:48.556684+0000 mgr.y (mgr.24461) 842 : cluster [DBG] pgmap v1314: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 989 B/s rd, 0 op/s 2024-02-13T00:51:50.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:50 smithi080 bash[17386]: audit 2024-02-13T00:51:48.900940+0000 mgr.y (mgr.24461) 843 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:51:50.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:50 smithi080 bash[24237]: cluster 2024-02-13T00:51:48.556684+0000 mgr.y (mgr.24461) 842 : cluster [DBG] pgmap v1314: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 989 B/s rd, 0 op/s 2024-02-13T00:51:50.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:50 smithi080 bash[24237]: audit 2024-02-13T00:51:48.900940+0000 mgr.y (mgr.24461) 843 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:51:52.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:52 smithi106 bash[18459]: cluster 2024-02-13T00:51:50.557402+0000 mgr.y (mgr.24461) 844 : cluster [DBG] pgmap v1315: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:52 smithi080 bash[17386]: cluster 2024-02-13T00:51:50.557402+0000 mgr.y (mgr.24461) 844 : cluster [DBG] pgmap v1315: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:52.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:52 smithi080 bash[24237]: cluster 2024-02-13T00:51:50.557402+0000 mgr.y (mgr.24461) 844 : cluster [DBG] pgmap v1315: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:53.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:51:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:51:53] "GET /metrics HTTP/1.1" 200 188962 "" "Prometheus/2.33.4" 2024-02-13T00:51:54.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:54 smithi106 bash[18459]: cluster 2024-02-13T00:51:52.558222+0000 mgr.y (mgr.24461) 845 : cluster [DBG] pgmap v1316: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:54 smithi080 bash[17386]: cluster 2024-02-13T00:51:52.558222+0000 mgr.y (mgr.24461) 845 : cluster [DBG] pgmap v1316: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:54.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:54 smithi080 bash[24237]: cluster 2024-02-13T00:51:52.558222+0000 mgr.y (mgr.24461) 845 : cluster [DBG] pgmap v1316: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:55.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:55 smithi106 bash[18459]: cluster 2024-02-13T00:51:54.560131+0000 mgr.y (mgr.24461) 846 : cluster [DBG] pgmap v1317: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:51:55.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:55 smithi080 bash[17386]: cluster 2024-02-13T00:51:54.560131+0000 mgr.y (mgr.24461) 846 : cluster [DBG] pgmap v1317: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:51:55.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:55 smithi080 bash[24237]: cluster 2024-02-13T00:51:54.560131+0000 mgr.y (mgr.24461) 846 : cluster [DBG] pgmap v1317: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:51:58.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:51:57 smithi106 bash[18459]: cluster 2024-02-13T00:51:56.560951+0000 mgr.y (mgr.24461) 847 : cluster [DBG] pgmap v1318: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:58.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:51:57 smithi080 bash[17386]: cluster 2024-02-13T00:51:56.560951+0000 mgr.y (mgr.24461) 847 : cluster [DBG] pgmap v1318: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:58.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:51:57 smithi080 bash[24237]: cluster 2024-02-13T00:51:56.560951+0000 mgr.y (mgr.24461) 847 : cluster [DBG] pgmap v1318: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:51:59.256 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:51:58 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:52:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:00 smithi106 bash[18459]: cluster 2024-02-13T00:51:58.562725+0000 mgr.y (mgr.24461) 848 : cluster [DBG] pgmap v1319: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:52:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:00 smithi106 bash[18459]: audit 2024-02-13T00:51:58.912215+0000 mgr.y (mgr.24461) 849 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:52:00.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:52:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:52:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:52:00.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:00 smithi080 bash[17386]: cluster 2024-02-13T00:51:58.562725+0000 mgr.y (mgr.24461) 848 : cluster [DBG] pgmap v1319: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:52:00.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:00 smithi080 bash[17386]: audit 2024-02-13T00:51:58.912215+0000 mgr.y (mgr.24461) 849 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:52:00.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:00 smithi080 bash[24237]: cluster 2024-02-13T00:51:58.562725+0000 mgr.y (mgr.24461) 848 : cluster [DBG] pgmap v1319: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:52:00.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:00 smithi080 bash[24237]: audit 2024-02-13T00:51:58.912215+0000 mgr.y (mgr.24461) 849 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:52:02.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:02 smithi106 bash[18459]: cluster 2024-02-13T00:52:00.563519+0000 mgr.y (mgr.24461) 850 : cluster [DBG] pgmap v1320: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:02.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:02 smithi080 bash[17386]: cluster 2024-02-13T00:52:00.563519+0000 mgr.y (mgr.24461) 850 : cluster [DBG] pgmap v1320: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:02.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:02 smithi080 bash[24237]: cluster 2024-02-13T00:52:00.563519+0000 mgr.y (mgr.24461) 850 : cluster [DBG] pgmap v1320: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:03.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:52:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:52:03] "GET /metrics HTTP/1.1" 200 188966 "" "Prometheus/2.33.4" 2024-02-13T00:52:04.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:04 smithi106 bash[18459]: cluster 2024-02-13T00:52:02.564350+0000 mgr.y (mgr.24461) 851 : cluster [DBG] pgmap v1321: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:04.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:04 smithi080 bash[17386]: cluster 2024-02-13T00:52:02.564350+0000 mgr.y (mgr.24461) 851 : cluster [DBG] pgmap v1321: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:04.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:04 smithi080 bash[24237]: cluster 2024-02-13T00:52:02.564350+0000 mgr.y (mgr.24461) 851 : cluster [DBG] pgmap v1321: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:05.299 INFO:tasks.workunit.client.0.smithi080.stderr:+ pid=120951 2024-02-13T00:52:05.300 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph osd pool set-quota 4a2d96c2-886f-4ac7-8042-11d5205396f8 max_bytes 0 2024-02-13T00:52:05.300 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 4a2d96c2-886f-4ac7-8042-11d5205396f8 put two /etc/passwd 2024-02-13T00:52:05.410 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.403+0000 7f42923c2700 1 -- 172.21.15.80:0/3915743549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f428c0f6e30 msgr2=0x7f428c103bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:05.410 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.403+0000 7f42923c2700 1 --2- 172.21.15.80:0/3915743549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f428c0f6e30 0x7f428c103bd0 secure :-1 s=READY pgs=2481 cs=0 l=1 rev1=1 rx=0x7f427c0048a0 tx=0x7f427c009cb0).stop 2024-02-13T00:52:05.411 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.403+0000 7f42923c2700 1 -- 172.21.15.80:0/3915743549 shutdown_connections 2024-02-13T00:52:05.411 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.403+0000 7f42923c2700 1 --2- 172.21.15.80:0/3915743549 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f428c1040c0 0x7f428c1064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:05.411 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.403+0000 7f42923c2700 1 --2- 172.21.15.80:0/3915743549 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f428c0f6e30 0x7f428c103bd0 unknown :-1 s=CLOSED pgs=2481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:05.411 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.403+0000 7f42923c2700 1 --2- 172.21.15.80:0/3915743549 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f428c0f6560 0x7f428c0f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:05.411 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.403+0000 7f42923c2700 1 -- 172.21.15.80:0/3915743549 >> 172.21.15.80:0/3915743549 conn(0x7f428c06e640 msgr2=0x7f428c0f48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:52:05.411 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.403+0000 7f42923c2700 1 -- 172.21.15.80:0/3915743549 shutdown_connections 2024-02-13T00:52:05.411 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.403+0000 7f42923c2700 1 -- 172.21.15.80:0/3915743549 wait complete. 2024-02-13T00:52:05.413 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f42923c2700 1 Processor -- start 2024-02-13T00:52:05.413 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f42923c2700 1 -- start start 2024-02-13T00:52:05.413 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f42923c2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f428c0f6560 0x7f428c10fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:52:05.414 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f42923c2700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f428c0f6e30 0x7f428c110090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:52:05.414 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f42923c2700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f428c1040c0 0x7f428c109d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:52:05.414 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f42923c2700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c10a250 con 0x7f428c0f6e30 2024-02-13T00:52:05.414 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f42923c2700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c10a3c0 con 0x7f428c0f6560 2024-02-13T00:52:05.414 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f42923c2700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c10a580 con 0x7f428c1040c0 2024-02-13T00:52:05.414 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f428b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f428c0f6e30 0x7f428c110090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:52:05.414 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f429095f700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f428c1040c0 0x7f428c109d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:52:05.414 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f428b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f428c0f6e30 0x7f428c110090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37892/0 (socket says 172.21.15.80:37892) 2024-02-13T00:52:05.414 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f428b7fe700 1 -- 172.21.15.80:0/4097407420 learned_addr learned my addr 172.21.15.80:0/4097407420 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:52:05.414 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f428bfff700 1 --2- 172.21.15.80:0/4097407420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f428c0f6560 0x7f428c10fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:52:05.414 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f428b7fe700 1 -- 172.21.15.80:0/4097407420 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f428c1040c0 msgr2=0x7f428c109d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:05.414 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f428b7fe700 1 --2- 172.21.15.80:0/4097407420 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f428c1040c0 0x7f428c109d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:05.414 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f428b7fe700 1 -- 172.21.15.80:0/4097407420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f428c0f6560 msgr2=0x7f428c10fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:05.415 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f428b7fe700 1 --2- 172.21.15.80:0/4097407420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f428c0f6560 0x7f428c10fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:05.415 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f428b7fe700 1 -- 172.21.15.80:0/4097407420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c005040 con 0x7f428c0f6e30 2024-02-13T00:52:05.415 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f428bfff700 1 --2- 172.21.15.80:0/4097407420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f428c0f6560 0x7f428c10fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-13T00:52:05.415 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f429095f700 1 --2- 172.21.15.80:0/4097407420 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f428c1040c0 0x7f428c109d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:52:05.415 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f428b7fe700 1 --2- 172.21.15.80:0/4097407420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f428c0f6e30 0x7f428c110090 secure :-1 s=READY pgs=2482 cs=0 l=1 rev1=1 rx=0x7f427c0045d0 tx=0x7f427c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:52:05.415 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f42897fa700 1 -- 172.21.15.80:0/4097407420 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c00e070 con 0x7f428c0f6e30 2024-02-13T00:52:05.415 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f42897fa700 1 -- 172.21.15.80:0/4097407420 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f427c013e70 con 0x7f428c0f6e30 2024-02-13T00:52:05.415 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f42923c2700 1 -- 172.21.15.80:0/4097407420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428c10a800 con 0x7f428c0f6e30 2024-02-13T00:52:05.415 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f42897fa700 1 -- 172.21.15.80:0/4097407420 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c018070 con 0x7f428c0f6e30 2024-02-13T00:52:05.415 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.407+0000 7f42923c2700 1 -- 172.21.15.80:0/4097407420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428c1169f0 con 0x7f428c0f6e30 2024-02-13T00:52:05.416 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.411+0000 7f42923c2700 1 -- 172.21.15.80:0/4097407420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428c060470 con 0x7f428c0f6e30 2024-02-13T00:52:05.416 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.411+0000 7f42897fa700 1 -- 172.21.15.80:0/4097407420 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f427c009240 con 0x7f428c0f6e30 2024-02-13T00:52:05.416 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.411+0000 7f42897fa700 1 --2- 172.21.15.80:0/4097407420 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4274061340 0x7f4274063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:52:05.417 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.411+0000 7f42897fa700 1 -- 172.21.15.80:0/4097407420 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(727..727 src has 1..727) v4 ==== 8819+0+0 (secure 0 0 0) 0x7f427c07dc20 con 0x7f428c0f6e30 2024-02-13T00:52:05.417 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.411+0000 7f428bfff700 1 --2- 172.21.15.80:0/4097407420 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4274061340 0x7f4274063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:52:05.417 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.411+0000 7f42897fa700 1 -- 172.21.15.80:0/4097407420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=728}) v3 -- 0x7f427406c930 con 0x7f428c0f6e30 2024-02-13T00:52:05.417 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.411+0000 7f428bfff700 1 --2- 172.21.15.80:0/4097407420 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4274061340 0x7f4274063800 secure :-1 s=READY pgs=3521 cs=0 l=1 rev1=1 rx=0x7f4280009250 tx=0x7f4280009d60).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:52:05.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.419+0000 7f42897fa700 1 -- 172.21.15.80:0/4097407420 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f427c022030 con 0x7f428c0f6e30 2024-02-13T00:52:05.586 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:05.579+0000 7f42923c2700 1 -- 172.21.15.80:0/4097407420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7f428c108bb0 con 0x7f428c0f6e30 2024-02-13T00:52:06.229 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:06.223+0000 7f42897fa700 1 -- 172.21.15.80:0/4097407420 <== mon.0 v2:172.21.15.80:3300/0 7 ==== osd_map(728..728 src has 1..728) v4 ==== 620+0+0 (secure 0 0 0) 0x7f427c051020 con 0x7f428c0f6e30 2024-02-13T00:52:06.229 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:06.223+0000 7f42897fa700 1 -- 172.21.15.80:0/4097407420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=729}) v3 -- 0x7f427406d5c0 con 0x7f428c0f6e30 2024-02-13T00:52:06.235 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:06.231+0000 7f42897fa700 1 -- 172.21.15.80:0/4097407420 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 4a2d96c2-886f-4ac7-8042-11d5205396f8 v728) v1 ==== 217+0+0 (secure 0 0 0) 0x7f427c022020 con 0x7f428c0f6e30 2024-02-13T00:52:06.334 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:06.327+0000 7f42923c2700 1 -- 172.21.15.80:0/4097407420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7f428c05fc90 con 0x7f428c0f6e30 2024-02-13T00:52:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:06 smithi106 bash[18459]: cluster 2024-02-13T00:52:04.566205+0000 mgr.y (mgr.24461) 852 : cluster [DBG] pgmap v1322: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:52:06.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:06 smithi106 bash[18459]: audit 2024-02-13T00:52:05.584505+0000 mon.a (mon.0) 3303 : audit [INF] from='client.? 172.21.15.80:0/4097407420' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T00:52:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:06 smithi080 bash[17386]: cluster 2024-02-13T00:52:04.566205+0000 mgr.y (mgr.24461) 852 : cluster [DBG] pgmap v1322: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:52:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:06 smithi080 bash[17386]: audit 2024-02-13T00:52:05.584505+0000 mon.a (mon.0) 3303 : audit [INF] from='client.? 172.21.15.80:0/4097407420' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T00:52:06.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:06 smithi080 bash[24237]: cluster 2024-02-13T00:52:04.566205+0000 mgr.y (mgr.24461) 852 : cluster [DBG] pgmap v1322: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:52:06.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:06 smithi080 bash[24237]: audit 2024-02-13T00:52:05.584505+0000 mon.a (mon.0) 3303 : audit [INF] from='client.? 172.21.15.80:0/4097407420' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T00:52:07.250 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.243+0000 7f42897fa700 1 -- 172.21.15.80:0/4097407420 <== mon.0 v2:172.21.15.80:3300/0 9 ==== osd_map(729..729 src has 1..729) v4 ==== 620+0+0 (secure 0 0 0) 0x7f427c04f1c0 con 0x7f428c0f6e30 2024-02-13T00:52:07.250 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.243+0000 7f42897fa700 1 -- 172.21.15.80:0/4097407420 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=730}) v3 -- 0x7f427406da90 con 0x7f428c0f6e30 2024-02-13T00:52:07.254 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.251+0000 7f42897fa700 1 -- 172.21.15.80:0/4097407420 <== mon.0 v2:172.21.15.80:3300/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 4a2d96c2-886f-4ac7-8042-11d5205396f8 v729) v1 ==== 217+0+0 (secure 0 0 0) 0x7f427c05d060 con 0x7f428c0f6e30 2024-02-13T00:52:07.259 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.255+0000 7f42923c2700 1 -- 172.21.15.80:0/4097407420 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4274061340 msgr2=0x7f4274063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:07.260 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.255+0000 7f42923c2700 1 --2- 172.21.15.80:0/4097407420 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4274061340 0x7f4274063800 secure :-1 s=READY pgs=3521 cs=0 l=1 rev1=1 rx=0x7f4280009250 tx=0x7f4280009d60).stop 2024-02-13T00:52:07.260 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.255+0000 7f42923c2700 1 -- 172.21.15.80:0/4097407420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f428c0f6e30 msgr2=0x7f428c110090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:07.260 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.255+0000 7f42923c2700 1 --2- 172.21.15.80:0/4097407420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f428c0f6e30 0x7f428c110090 secure :-1 s=READY pgs=2482 cs=0 l=1 rev1=1 rx=0x7f427c0045d0 tx=0x7f427c009cb0).stop 2024-02-13T00:52:07.260 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.255+0000 7f42923c2700 1 -- 172.21.15.80:0/4097407420 shutdown_connections 2024-02-13T00:52:07.260 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.255+0000 7f42923c2700 1 --2- 172.21.15.80:0/4097407420 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f4274061340 0x7f4274063800 unknown :-1 s=CLOSED pgs=3521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:07.260 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.255+0000 7f42923c2700 1 --2- 172.21.15.80:0/4097407420 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f428c1040c0 0x7f428c109d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:07.260 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.255+0000 7f42923c2700 1 --2- 172.21.15.80:0/4097407420 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f428c0f6e30 0x7f428c110090 unknown :-1 s=CLOSED pgs=2482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:07.260 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.255+0000 7f42923c2700 1 --2- 172.21.15.80:0/4097407420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f428c0f6560 0x7f428c10fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:07.260 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.255+0000 7f42923c2700 1 -- 172.21.15.80:0/4097407420 >> 172.21.15.80:0/4097407420 conn(0x7f428c06e640 msgr2=0x7f428c06f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:52:07.260 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.255+0000 7f42923c2700 1 -- 172.21.15.80:0/4097407420 shutdown_connections 2024-02-13T00:52:07.260 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.255+0000 7f42923c2700 1 -- 172.21.15.80:0/4097407420 wait complete. 2024-02-13T00:52:07.261 INFO:tasks.workunit.client.0.smithi080.stderr:set-quota max_bytes = 0 for pool 4a2d96c2-886f-4ac7-8042-11d5205396f8 2024-02-13T00:52:07.270 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph osd pool set-quota 4a2d96c2-886f-4ac7-8042-11d5205396f8 max_objects 0 2024-02-13T00:52:07.371 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.363+0000 7f6c13427700 1 -- 172.21.15.80:0/3246452873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c0c0fdfb0 msgr2=0x7f6c0c0f5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:07.371 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.363+0000 7f6c13427700 1 --2- 172.21.15.80:0/3246452873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c0c0fdfb0 0x7f6c0c0f5c50 secure :-1 s=READY pgs=3500 cs=0 l=1 rev1=1 rx=0x7f6c080047b0 tx=0x7f6c08009cb0).stop 2024-02-13T00:52:07.371 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c13427700 1 -- 172.21.15.80:0/3246452873 shutdown_connections 2024-02-13T00:52:07.371 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c13427700 1 --2- 172.21.15.80:0/3246452873 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c0c0f6220 0x7f6c0c0f6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:07.371 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c13427700 1 --2- 172.21.15.80:0/3246452873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c0c0fdfb0 0x7f6c0c0f5c50 unknown :-1 s=CLOSED pgs=3500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:07.371 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c13427700 1 --2- 172.21.15.80:0/3246452873 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c0c0fd6e0 0x7f6c0c0fdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:07.371 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c13427700 1 -- 172.21.15.80:0/3246452873 >> 172.21.15.80:0/3246452873 conn(0x7f6c0c06fc20 msgr2=0x7f6c0c0f3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:52:07.371 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c13427700 1 -- 172.21.15.80:0/3246452873 shutdown_connections 2024-02-13T00:52:07.371 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c13427700 1 -- 172.21.15.80:0/3246452873 wait complete. 2024-02-13T00:52:07.373 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c13427700 1 Processor -- start 2024-02-13T00:52:07.374 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c13427700 1 -- start start 2024-02-13T00:52:07.374 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c13427700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c0c0f6220 0x7f6c0c10dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:52:07.374 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c13427700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c0c0fd6e0 0x7f6c0c10e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:52:07.374 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c13427700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c0c0fdfb0 0x7f6c0c107d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:52:07.374 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c13427700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c108280 con 0x7f6c0c0fdfb0 2024-02-13T00:52:07.374 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c13427700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c1083f0 con 0x7f6c0c0fd6e0 2024-02-13T00:52:07.374 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c13427700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c1085b0 con 0x7f6c0c0f6220 2024-02-13T00:52:07.375 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c119c4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c0c0fdfb0 0x7f6c0c107d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:52:07.375 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c111c3700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c0c0f6220 0x7f6c0c10dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:52:07.375 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c111c3700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c0c0f6220 0x7f6c0c10dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:32880/0 (socket says 172.21.15.80:32880) 2024-02-13T00:52:07.375 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c119c4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c0c0fdfb0 0x7f6c0c107d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:37912/0 (socket says 172.21.15.80:37912) 2024-02-13T00:52:07.375 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c111c3700 1 -- 172.21.15.80:0/3827884767 learned_addr learned my addr 172.21.15.80:0/3827884767 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:52:07.375 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c109c2700 1 --2- 172.21.15.80:0/3827884767 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c0c0fd6e0 0x7f6c0c10e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:52:07.375 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c111c3700 1 -- 172.21.15.80:0/3827884767 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c0c0fd6e0 msgr2=0x7f6c0c10e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:07.376 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c111c3700 1 --2- 172.21.15.80:0/3827884767 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c0c0fd6e0 0x7f6c0c10e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:07.376 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c111c3700 1 -- 172.21.15.80:0/3827884767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c0c0fdfb0 msgr2=0x7f6c0c107d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:07.376 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c111c3700 1 --2- 172.21.15.80:0/3827884767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c0c0fdfb0 0x7f6c0c107d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:07.376 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c111c3700 1 -- 172.21.15.80:0/3827884767 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c08005040 con 0x7f6c0c0f6220 2024-02-13T00:52:07.376 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c119c4700 1 --2- 172.21.15.80:0/3827884767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c0c0fdfb0 0x7f6c0c107d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:52:07.376 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c111c3700 1 --2- 172.21.15.80:0/3827884767 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c0c0f6220 0x7f6c0c10dbd0 secure :-1 s=READY pgs=3040 cs=0 l=1 rev1=1 rx=0x7f6bfc00e940 tx=0x7f6bfc00b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:52:07.377 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c027fc700 1 -- 172.21.15.80:0/3827884767 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc004660 con 0x7f6c0c0f6220 2024-02-13T00:52:07.377 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c13427700 1 -- 172.21.15.80:0/3827884767 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0c108890 con 0x7f6c0c0f6220 2024-02-13T00:52:07.377 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c027fc700 1 -- 172.21.15.80:0/3827884767 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f6bfc00f040 con 0x7f6c0c0f6220 2024-02-13T00:52:07.377 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c027fc700 1 -- 172.21.15.80:0/3827884767 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc0146f0 con 0x7f6c0c0f6220 2024-02-13T00:52:07.377 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.367+0000 7f6c13427700 1 -- 172.21.15.80:0/3827884767 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0c114a20 con 0x7f6c0c0f6220 2024-02-13T00:52:07.378 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.371+0000 7f6c13427700 1 -- 172.21.15.80:0/3827884767 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0c05fc90 con 0x7f6c0c0f6220 2024-02-13T00:52:07.378 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.371+0000 7f6c027fc700 1 -- 172.21.15.80:0/3827884767 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f6bfc007b40 con 0x7f6c0c0f6220 2024-02-13T00:52:07.378 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.371+0000 7f6c027fc700 1 --2- 172.21.15.80:0/3827884767 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f6bf8061340 0x7f6bf8063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:52:07.379 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.371+0000 7f6c027fc700 1 -- 172.21.15.80:0/3827884767 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(729..729 src has 1..729) v4 ==== 8819+0+0 (secure 0 0 0) 0x7f6bfc07cf90 con 0x7f6c0c0f6220 2024-02-13T00:52:07.379 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.371+0000 7f6c109c2700 1 --2- 172.21.15.80:0/3827884767 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f6bf8061340 0x7f6bf8063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:52:07.379 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.371+0000 7f6c027fc700 1 -- 172.21.15.80:0/3827884767 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=730}) v3 -- 0x7f6bf806c930 con 0x7f6c0c0f6220 2024-02-13T00:52:07.379 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.371+0000 7f6c109c2700 1 --2- 172.21.15.80:0/3827884767 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f6bf8061340 0x7f6bf8063800 secure :-1 s=READY pgs=3522 cs=0 l=1 rev1=1 rx=0x7f6c08004e20 tx=0x7f6c08009cb0).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:52:07.383 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.379+0000 7f6c027fc700 1 -- 172.21.15.80:0/3827884767 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f6bfc019020 con 0x7f6c0c0f6220 2024-02-13T00:52:07.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:07 smithi106 bash[18459]: audit 2024-02-13T00:52:06.232527+0000 mon.a (mon.0) 3304 : audit [INF] from='client.? 172.21.15.80:0/4097407420' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T00:52:07.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:07 smithi106 bash[18459]: cluster 2024-02-13T00:52:06.232627+0000 mon.a (mon.0) 3305 : cluster [DBG] osdmap e728: 8 total, 8 up, 8 in 2024-02-13T00:52:07.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:07 smithi106 bash[18459]: audit 2024-02-13T00:52:06.332438+0000 mon.a (mon.0) 3306 : audit [INF] from='client.? 172.21.15.80:0/4097407420' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T00:52:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:07 smithi080 bash[17386]: audit 2024-02-13T00:52:06.232527+0000 mon.a (mon.0) 3304 : audit [INF] from='client.? 172.21.15.80:0/4097407420' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T00:52:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:07 smithi080 bash[17386]: cluster 2024-02-13T00:52:06.232627+0000 mon.a (mon.0) 3305 : cluster [DBG] osdmap e728: 8 total, 8 up, 8 in 2024-02-13T00:52:07.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:07 smithi080 bash[17386]: audit 2024-02-13T00:52:06.332438+0000 mon.a (mon.0) 3306 : audit [INF] from='client.? 172.21.15.80:0/4097407420' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T00:52:07.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:07 smithi080 bash[24237]: audit 2024-02-13T00:52:06.232527+0000 mon.a (mon.0) 3304 : audit [INF] from='client.? 172.21.15.80:0/4097407420' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T00:52:07.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:07 smithi080 bash[24237]: cluster 2024-02-13T00:52:06.232627+0000 mon.a (mon.0) 3305 : cluster [DBG] osdmap e728: 8 total, 8 up, 8 in 2024-02-13T00:52:07.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:07 smithi080 bash[24237]: audit 2024-02-13T00:52:06.332438+0000 mon.a (mon.0) 3306 : audit [INF] from='client.? 172.21.15.80:0/4097407420' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T00:52:07.536 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:07.531+0000 7f6c13427700 1 -- 172.21.15.80:0/3827884767 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f6c0c106960 con 0x7f6c0c0f6220 2024-02-13T00:52:08.213 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:08.207+0000 7f6c027fc700 1 -- 172.21.15.80:0/3827884767 <== mon.2 v2:172.21.15.80:3301/0 7 ==== osd_map(730..730 src has 1..730) v4 ==== 620+0+0 (secure 0 0 0) 0x7f6bfc055c20 con 0x7f6c0c0f6220 2024-02-13T00:52:08.213 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:08.207+0000 7f6c027fc700 1 -- 172.21.15.80:0/3827884767 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=731}) v3 -- 0x7f6bf806d610 con 0x7f6c0c0f6220 2024-02-13T00:52:08.222 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:08.215+0000 7f6c027fc700 1 -- 172.21.15.80:0/3827884767 <== mon.2 v2:172.21.15.80:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 4a2d96c2-886f-4ac7-8042-11d5205396f8 v730) v1 ==== 221+0+0 (secure 0 0 0) 0x7f6bfc04c780 con 0x7f6c0c0f6220 2024-02-13T00:52:08.319 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:08.315+0000 7f6c13427700 1 -- 172.21.15.80:0/3827884767 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f6c0c114fd0 con 0x7f6c0c0f6220 2024-02-13T00:52:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:08 smithi106 bash[18459]: cluster 2024-02-13T00:52:06.567012+0000 mgr.y (mgr.24461) 853 : cluster [DBG] pgmap v1324: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:52:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:08 smithi106 bash[18459]: audit 2024-02-13T00:52:07.251778+0000 mon.a (mon.0) 3307 : audit [INF] from='client.? 172.21.15.80:0/4097407420' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T00:52:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:08 smithi106 bash[18459]: cluster 2024-02-13T00:52:07.251872+0000 mon.a (mon.0) 3308 : cluster [DBG] osdmap e729: 8 total, 8 up, 8 in 2024-02-13T00:52:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:08 smithi106 bash[18459]: audit 2024-02-13T00:52:07.534107+0000 mon.c (mon.2) 558 : audit [INF] from='client.? 172.21.15.80:0/3827884767' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:52:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:08 smithi106 bash[18459]: audit 2024-02-13T00:52:07.534794+0000 mon.a (mon.0) 3309 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:52:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:08 smithi106 bash[18459]: cluster 2024-02-13T00:52:08.206401+0000 mon.a (mon.0) 3310 : cluster [INF] pool '4a2d96c2-886f-4ac7-8042-11d5205396f8' no longer out of quota; removing NO_QUOTA flag 2024-02-13T00:52:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:08 smithi106 bash[18459]: cluster 2024-02-13T00:52:08.206863+0000 mon.a (mon.0) 3311 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-13T00:52:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:08 smithi106 bash[18459]: audit 2024-02-13T00:52:08.217448+0000 mon.a (mon.0) 3312 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]': finished 2024-02-13T00:52:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:08 smithi106 bash[18459]: cluster 2024-02-13T00:52:08.217673+0000 mon.a (mon.0) 3313 : cluster [DBG] osdmap e730: 8 total, 8 up, 8 in 2024-02-13T00:52:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:08 smithi080 bash[24237]: cluster 2024-02-13T00:52:06.567012+0000 mgr.y (mgr.24461) 853 : cluster [DBG] pgmap v1324: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:52:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:08 smithi080 bash[24237]: audit 2024-02-13T00:52:07.251778+0000 mon.a (mon.0) 3307 : audit [INF] from='client.? 172.21.15.80:0/4097407420' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T00:52:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:08 smithi080 bash[24237]: cluster 2024-02-13T00:52:07.251872+0000 mon.a (mon.0) 3308 : cluster [DBG] osdmap e729: 8 total, 8 up, 8 in 2024-02-13T00:52:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:08 smithi080 bash[24237]: audit 2024-02-13T00:52:07.534107+0000 mon.c (mon.2) 558 : audit [INF] from='client.? 172.21.15.80:0/3827884767' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:52:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:08 smithi080 bash[24237]: audit 2024-02-13T00:52:07.534794+0000 mon.a (mon.0) 3309 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:52:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:08 smithi080 bash[24237]: cluster 2024-02-13T00:52:08.206401+0000 mon.a (mon.0) 3310 : cluster [INF] pool '4a2d96c2-886f-4ac7-8042-11d5205396f8' no longer out of quota; removing NO_QUOTA flag 2024-02-13T00:52:08.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:08 smithi080 bash[24237]: cluster 2024-02-13T00:52:08.206863+0000 mon.a (mon.0) 3311 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-13T00:52:08.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:08 smithi080 bash[24237]: audit 2024-02-13T00:52:08.217448+0000 mon.a (mon.0) 3312 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]': finished 2024-02-13T00:52:08.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:08 smithi080 bash[24237]: cluster 2024-02-13T00:52:08.217673+0000 mon.a (mon.0) 3313 : cluster [DBG] osdmap e730: 8 total, 8 up, 8 in 2024-02-13T00:52:08.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:08 smithi080 bash[17386]: cluster 2024-02-13T00:52:06.567012+0000 mgr.y (mgr.24461) 853 : cluster [DBG] pgmap v1324: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:52:08.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:08 smithi080 bash[17386]: audit 2024-02-13T00:52:07.251778+0000 mon.a (mon.0) 3307 : audit [INF] from='client.? 172.21.15.80:0/4097407420' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T00:52:08.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:08 smithi080 bash[17386]: cluster 2024-02-13T00:52:07.251872+0000 mon.a (mon.0) 3308 : cluster [DBG] osdmap e729: 8 total, 8 up, 8 in 2024-02-13T00:52:08.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:08 smithi080 bash[17386]: audit 2024-02-13T00:52:07.534107+0000 mon.c (mon.2) 558 : audit [INF] from='client.? 172.21.15.80:0/3827884767' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:52:08.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:08 smithi080 bash[17386]: audit 2024-02-13T00:52:07.534794+0000 mon.a (mon.0) 3309 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:52:08.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:08 smithi080 bash[17386]: cluster 2024-02-13T00:52:08.206401+0000 mon.a (mon.0) 3310 : cluster [INF] pool '4a2d96c2-886f-4ac7-8042-11d5205396f8' no longer out of quota; removing NO_QUOTA flag 2024-02-13T00:52:08.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:08 smithi080 bash[17386]: cluster 2024-02-13T00:52:08.206863+0000 mon.a (mon.0) 3311 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-13T00:52:08.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:08 smithi080 bash[17386]: audit 2024-02-13T00:52:08.217448+0000 mon.a (mon.0) 3312 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]': finished 2024-02-13T00:52:08.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:08 smithi080 bash[17386]: cluster 2024-02-13T00:52:08.217673+0000 mon.a (mon.0) 3313 : cluster [DBG] osdmap e730: 8 total, 8 up, 8 in 2024-02-13T00:52:09.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:52:08 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:52:09.263 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.259+0000 7f6c027fc700 1 -- 172.21.15.80:0/3827884767 <== mon.2 v2:172.21.15.80:3301/0 9 ==== osd_map(731..731 src has 1..731) v4 ==== 620+0+0 (secure 0 0 0) 0x7f6bfc055c20 con 0x7f6c0c0f6220 2024-02-13T00:52:09.267 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.263+0000 7f6c027fc700 1 -- 172.21.15.80:0/3827884767 <== mon.2 v2:172.21.15.80:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 4a2d96c2-886f-4ac7-8042-11d5205396f8 v731) v1 ==== 221+0+0 (secure 0 0 0) 0x7f6bfc0501b0 con 0x7f6c0c0f6220 2024-02-13T00:52:09.271 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.267+0000 7f6c13427700 1 -- 172.21.15.80:0/3827884767 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f6bf8061340 msgr2=0x7f6bf8063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:09.271 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.267+0000 7f6c13427700 1 --2- 172.21.15.80:0/3827884767 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f6bf8061340 0x7f6bf8063800 secure :-1 s=READY pgs=3522 cs=0 l=1 rev1=1 rx=0x7f6c08004e20 tx=0x7f6c08009cb0).stop 2024-02-13T00:52:09.271 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.267+0000 7f6c13427700 1 -- 172.21.15.80:0/3827884767 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c0c0f6220 msgr2=0x7f6c0c10dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:09.271 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.267+0000 7f6c13427700 1 --2- 172.21.15.80:0/3827884767 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c0c0f6220 0x7f6c0c10dbd0 secure :-1 s=READY pgs=3040 cs=0 l=1 rev1=1 rx=0x7f6bfc00e940 tx=0x7f6bfc00b040).stop 2024-02-13T00:52:09.271 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.267+0000 7f6c13427700 1 -- 172.21.15.80:0/3827884767 shutdown_connections 2024-02-13T00:52:09.271 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.267+0000 7f6c13427700 1 --2- 172.21.15.80:0/3827884767 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f6bf8061340 0x7f6bf8063800 unknown :-1 s=CLOSED pgs=3522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:09.271 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.267+0000 7f6c13427700 1 --2- 172.21.15.80:0/3827884767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f6c0c0fdfb0 0x7f6c0c107d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:09.271 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.267+0000 7f6c13427700 1 --2- 172.21.15.80:0/3827884767 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c0c0fd6e0 0x7f6c0c10e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:09.271 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.267+0000 7f6c13427700 1 --2- 172.21.15.80:0/3827884767 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f6c0c0f6220 0x7f6c0c10dbd0 unknown :-1 s=CLOSED pgs=3040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:09.271 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.267+0000 7f6c13427700 1 -- 172.21.15.80:0/3827884767 >> 172.21.15.80:0/3827884767 conn(0x7f6c0c06fc20 msgr2=0x7f6c0c06ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:52:09.272 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.267+0000 7f6c13427700 1 -- 172.21.15.80:0/3827884767 shutdown_connections 2024-02-13T00:52:09.272 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.267+0000 7f6c13427700 1 -- 172.21.15.80:0/3827884767 wait complete. 2024-02-13T00:52:09.272 INFO:tasks.workunit.client.0.smithi080.stderr:set-quota max_objects = 0 for pool 4a2d96c2-886f-4ac7-8042-11d5205396f8 2024-02-13T00:52:09.282 INFO:tasks.workunit.client.0.smithi080.stderr:+ wait 120951 2024-02-13T00:52:09.282 INFO:tasks.workunit.client.0.smithi080.stderr:+ [ 0 -ne 0 ] 2024-02-13T00:52:09.282 INFO:tasks.workunit.client.0.smithi080.stderr:+ true 2024-02-13T00:52:09.282 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 4a2d96c2-886f-4ac7-8042-11d5205396f8 put three /etc/passwd 2024-02-13T00:52:09.318 INFO:tasks.workunit.client.0.smithi080.stderr:+ uuidgen 2024-02-13T00:52:09.319 INFO:tasks.workunit.client.0.smithi080.stderr:+ pp=202352ae-8764-48cf-9bc7-8298889ef897 2024-02-13T00:52:09.319 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph osd pool create 202352ae-8764-48cf-9bc7-8298889ef897 12 2024-02-13T00:52:09.421 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.415+0000 7f0819020700 1 -- 172.21.15.80:0/3952464767 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08140fd730 msgr2=0x7f08140fdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:09.421 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.415+0000 7f0819020700 1 --2- 172.21.15.80:0/3952464767 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08140fd730 0x7f08140fdb10 secure :-1 s=READY pgs=3043 cs=0 l=1 rev1=1 rx=0x7f0804004870 tx=0x7f0804009cb0).stop 2024-02-13T00:52:09.421 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.415+0000 7f0819020700 1 -- 172.21.15.80:0/3952464767 shutdown_connections 2024-02-13T00:52:09.421 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.415+0000 7f0819020700 1 --2- 172.21.15.80:0/3952464767 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0814061200 0x7f0814104510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:09.421 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.415+0000 7f0819020700 1 --2- 172.21.15.80:0/3952464767 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08140fe090 0x7f0814060b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:09.421 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.415+0000 7f0819020700 1 --2- 172.21.15.80:0/3952464767 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08140fd730 0x7f08140fdb10 unknown :-1 s=CLOSED pgs=3043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:09.421 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.415+0000 7f0819020700 1 -- 172.21.15.80:0/3952464767 >> 172.21.15.80:0/3952464767 conn(0x7f081406e6d0 msgr2=0x7f081406eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:52:09.421 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.415+0000 7f0819020700 1 -- 172.21.15.80:0/3952464767 shutdown_connections 2024-02-13T00:52:09.421 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.415+0000 7f0819020700 1 -- 172.21.15.80:0/3952464767 wait complete. 2024-02-13T00:52:09.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.415+0000 7f0819020700 1 Processor -- start 2024-02-13T00:52:09.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.415+0000 7f0819020700 1 -- start start 2024-02-13T00:52:09.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f0819020700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0814061200 0x7f081410d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:52:09.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f0819020700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08140fd730 0x7f081410de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:52:09.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f0819020700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08140fe090 0x7f0814107b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:52:09.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f0819020700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0814108030 con 0x7f0814061200 2024-02-13T00:52:09.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f0819020700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08141081a0 con 0x7f08140fe090 2024-02-13T00:52:09.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f0819020700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0814108360 con 0x7f08140fd730 2024-02-13T00:52:09.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f0812d9d700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0814061200 0x7f081410d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:52:09.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f081259c700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08140fd730 0x7f081410de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:52:09.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f081259c700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08140fd730 0x7f081410de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:42886/0 (socket says 172.21.15.80:42886) 2024-02-13T00:52:09.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f081259c700 1 -- 172.21.15.80:0/3674625088 learned_addr learned my addr 172.21.15.80:0/3674625088 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:52:09.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f081359e700 1 --2- 172.21.15.80:0/3674625088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08140fe090 0x7f0814107b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:52:09.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f0812d9d700 1 -- 172.21.15.80:0/3674625088 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08140fd730 msgr2=0x7f081410de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:09.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f0812d9d700 1 --2- 172.21.15.80:0/3674625088 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08140fd730 0x7f081410de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:09.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f0812d9d700 1 -- 172.21.15.80:0/3674625088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08140fe090 msgr2=0x7f0814107b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:09.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f0812d9d700 1 --2- 172.21.15.80:0/3674625088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08140fe090 0x7f0814107b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:09.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f0812d9d700 1 -- 172.21.15.80:0/3674625088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0804005040 con 0x7f0814061200 2024-02-13T00:52:09.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f081359e700 1 --2- 172.21.15.80:0/3674625088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08140fe090 0x7f0814107b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-13T00:52:09.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f081259c700 1 --2- 172.21.15.80:0/3674625088 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08140fd730 0x7f081410de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:52:09.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f0812d9d700 1 --2- 172.21.15.80:0/3674625088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0814061200 0x7f081410d940 secure :-1 s=READY pgs=2484 cs=0 l=1 rev1=1 rx=0x7f0804004870 tx=0x7f0804009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:52:09.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f07fbfff700 1 -- 172.21.15.80:0/3674625088 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080400e030 con 0x7f0814061200 2024-02-13T00:52:09.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f0819020700 1 -- 172.21.15.80:0/3674625088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08141085e0 con 0x7f0814061200 2024-02-13T00:52:09.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f07fbfff700 1 -- 172.21.15.80:0/3674625088 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f0804013db0 con 0x7f0814061200 2024-02-13T00:52:09.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f07fbfff700 1 -- 172.21.15.80:0/3674625088 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0804018070 con 0x7f0814061200 2024-02-13T00:52:09.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f0819020700 1 -- 172.21.15.80:0/3674625088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08141147d0 con 0x7f0814061200 2024-02-13T00:52:09.426 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f0819020700 1 -- 172.21.15.80:0/3674625088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0814060470 con 0x7f0814061200 2024-02-13T00:52:09.426 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.419+0000 7f07fbfff700 1 -- 172.21.15.80:0/3674625088 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f0804009240 con 0x7f0814061200 2024-02-13T00:52:09.427 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.423+0000 7f07fbfff700 1 --2- 172.21.15.80:0/3674625088 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f07fc061340 0x7f07fc063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:52:09.427 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.423+0000 7f081259c700 1 --2- 172.21.15.80:0/3674625088 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f07fc061340 0x7f07fc063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:52:09.427 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.423+0000 7f07fbfff700 1 -- 172.21.15.80:0/3674625088 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(731..731 src has 1..731) v4 ==== 8819+0+0 (secure 0 0 0) 0x7f080407e700 con 0x7f0814061200 2024-02-13T00:52:09.427 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.423+0000 7f081259c700 1 --2- 172.21.15.80:0/3674625088 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f07fc061340 0x7f07fc063800 secure :-1 s=READY pgs=3524 cs=0 l=1 rev1=1 rx=0x7f0808004fd0 tx=0x7f080800b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:52:09.434 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.427+0000 7f07fbfff700 1 -- 172.21.15.80:0/3674625088 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f080404de20 con 0x7f0814061200 2024-02-13T00:52:09.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:09 smithi080 bash[17386]: audit 2024-02-13T00:52:08.317193+0000 mon.c (mon.2) 559 : audit [INF] from='client.? 172.21.15.80:0/3827884767' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:52:09.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:09 smithi080 bash[17386]: audit 2024-02-13T00:52:08.317799+0000 mon.a (mon.0) 3314 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:52:09.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:09 smithi080 bash[24237]: audit 2024-02-13T00:52:08.317193+0000 mon.c (mon.2) 559 : audit [INF] from='client.? 172.21.15.80:0/3827884767' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:52:09.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:09 smithi080 bash[24237]: audit 2024-02-13T00:52:08.317799+0000 mon.a (mon.0) 3314 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:52:09.595 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:09.591+0000 7f0819020700 1 -- 172.21.15.80:0/3674625088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pg_num": 12} v 0) v1 -- 0x7f081405fc90 con 0x7f0814061200 2024-02-13T00:52:09.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:09 smithi106 bash[18459]: audit 2024-02-13T00:52:08.317193+0000 mon.c (mon.2) 559 : audit [INF] from='client.? 172.21.15.80:0/3827884767' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:52:09.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:09 smithi106 bash[18459]: audit 2024-02-13T00:52:08.317799+0000 mon.a (mon.0) 3314 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:52:10.281 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.275+0000 7f07fbfff700 1 -- 172.21.15.80:0/3674625088 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pg_num": 12}]=0 pool '202352ae-8764-48cf-9bc7-8298889ef897' created v732) v1 ==== 176+0+0 (secure 0 0 0) 0x7f0804051440 con 0x7f0814061200 2024-02-13T00:52:10.379 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.375+0000 7f0819020700 1 -- 172.21.15.80:0/3674625088 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pg_num": 12} v 0) v1 -- 0x7f0814108fe0 con 0x7f0814061200 2024-02-13T00:52:10.380 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.375+0000 7f07fbfff700 1 -- 172.21.15.80:0/3674625088 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pg_num": 12}]=0 pool '202352ae-8764-48cf-9bc7-8298889ef897' already exists v732) v1 ==== 183+0+0 (secure 0 0 0) 0x7f0804051620 con 0x7f0814061200 2024-02-13T00:52:10.383 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.375+0000 7f0819020700 1 -- 172.21.15.80:0/3674625088 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f07fc061340 msgr2=0x7f07fc063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:10.383 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.375+0000 7f0819020700 1 --2- 172.21.15.80:0/3674625088 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f07fc061340 0x7f07fc063800 secure :-1 s=READY pgs=3524 cs=0 l=1 rev1=1 rx=0x7f0808004fd0 tx=0x7f080800b040).stop 2024-02-13T00:52:10.383 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.375+0000 7f0819020700 1 -- 172.21.15.80:0/3674625088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0814061200 msgr2=0x7f081410d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:10.383 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.375+0000 7f0819020700 1 --2- 172.21.15.80:0/3674625088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0814061200 0x7f081410d940 secure :-1 s=READY pgs=2484 cs=0 l=1 rev1=1 rx=0x7f0804004870 tx=0x7f0804009cb0).stop 2024-02-13T00:52:10.383 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.375+0000 7f0819020700 1 -- 172.21.15.80:0/3674625088 shutdown_connections 2024-02-13T00:52:10.383 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.375+0000 7f0819020700 1 --2- 172.21.15.80:0/3674625088 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f07fc061340 0x7f07fc063800 unknown :-1 s=CLOSED pgs=3524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:10.383 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.375+0000 7f0819020700 1 --2- 172.21.15.80:0/3674625088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08140fe090 0x7f0814107b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:10.383 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.375+0000 7f0819020700 1 --2- 172.21.15.80:0/3674625088 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f08140fd730 0x7f081410de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:10.383 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.375+0000 7f0819020700 1 --2- 172.21.15.80:0/3674625088 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f0814061200 0x7f081410d940 unknown :-1 s=CLOSED pgs=2484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:10.383 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.375+0000 7f0819020700 1 -- 172.21.15.80:0/3674625088 >> 172.21.15.80:0/3674625088 conn(0x7f081406e6d0 msgr2=0x7f08140fb490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:52:10.383 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.379+0000 7f0819020700 1 -- 172.21.15.80:0/3674625088 shutdown_connections 2024-02-13T00:52:10.383 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.379+0000 7f0819020700 1 -- 172.21.15.80:0/3674625088 wait complete. 2024-02-13T00:52:10.384 INFO:tasks.workunit.client.0.smithi080.stderr:pool '202352ae-8764-48cf-9bc7-8298889ef897' already exists 2024-02-13T00:52:10.393 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph osd pool application enable 202352ae-8764-48cf-9bc7-8298889ef897 rados 2024-02-13T00:52:10.486 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.479+0000 7fec487c6700 1 -- 172.21.15.80:0/3797487257 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec400f8230 msgr2=0x7fec40104750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:10.486 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.479+0000 7fec487c6700 1 --2- 172.21.15.80:0/3797487257 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec400f8230 0x7fec40104750 secure :-1 s=READY pgs=3044 cs=0 l=1 rev1=1 rx=0x7fec38009c10 tx=0x7fec38004d10).stop 2024-02-13T00:52:10.486 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.479+0000 7fec487c6700 1 -- 172.21.15.80:0/3797487257 shutdown_connections 2024-02-13T00:52:10.486 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.479+0000 7fec487c6700 1 --2- 172.21.15.80:0/3797487257 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec400f8230 0x7fec40104750 unknown :-1 s=CLOSED pgs=3044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:10.487 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.479+0000 7fec487c6700 1 --2- 172.21.15.80:0/3797487257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec400fe290 0x7fec400f7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:10.487 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.479+0000 7fec487c6700 1 --2- 172.21.15.80:0/3797487257 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec400fd930 0x7fec400fdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:10.487 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.479+0000 7fec487c6700 1 -- 172.21.15.80:0/3797487257 >> 172.21.15.80:0/3797487257 conn(0x7fec4006e950 msgr2=0x7fec4006ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:52:10.487 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.479+0000 7fec487c6700 1 -- 172.21.15.80:0/3797487257 shutdown_connections 2024-02-13T00:52:10.487 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.479+0000 7fec487c6700 1 -- 172.21.15.80:0/3797487257 wait complete. 2024-02-13T00:52:10.489 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec487c6700 1 Processor -- start 2024-02-13T00:52:10.489 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec487c6700 1 -- start start 2024-02-13T00:52:10.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec487c6700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec400f8230 0x7fec4010d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:52:10.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec487c6700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec400fd930 0x7fec4010de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:52:10.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec487c6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec400fe290 0x7fec40107ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:52:10.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec487c6700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec40107fc0 con 0x7fec400f8230 2024-02-13T00:52:10.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec487c6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec40108130 con 0x7fec400fe290 2024-02-13T00:52:10.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec487c6700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec401082f0 con 0x7fec400fd930 2024-02-13T00:52:10.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec45d61700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec400fd930 0x7fec4010de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:52:10.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec45d61700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec400fd930 0x7fec4010de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:42902/0 (socket says 172.21.15.80:42902) 2024-02-13T00:52:10.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec45d61700 1 -- 172.21.15.80:0/3052657798 learned_addr learned my addr 172.21.15.80:0/3052657798 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:52:10.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec46562700 1 --2- 172.21.15.80:0/3052657798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec400f8230 0x7fec4010d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:52:10.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec46d63700 1 --2- 172.21.15.80:0/3052657798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec400fe290 0x7fec40107ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:52:10.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec46562700 1 -- 172.21.15.80:0/3052657798 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec400fd930 msgr2=0x7fec4010de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:10.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec46562700 1 --2- 172.21.15.80:0/3052657798 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec400fd930 0x7fec4010de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:10.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec46562700 1 -- 172.21.15.80:0/3052657798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec400fe290 msgr2=0x7fec40107ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:10.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec46562700 1 --2- 172.21.15.80:0/3052657798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec400fe290 0x7fec40107ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:10.491 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec46562700 1 -- 172.21.15.80:0/3052657798 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec380097c0 con 0x7fec400f8230 2024-02-13T00:52:10.491 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec45d61700 1 --2- 172.21.15.80:0/3052657798 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec400fd930 0x7fec4010de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:52:10.491 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec46d63700 1 --2- 172.21.15.80:0/3052657798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec400fe290 0x7fec40107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-13T00:52:10.491 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec46562700 1 --2- 172.21.15.80:0/3052657798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec400f8230 0x7fec4010d910 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 rx=0x7fec3c002800 tx=0x7fec3c009ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:52:10.491 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec377fe700 1 -- 172.21.15.80:0/3052657798 <== mon.0 v2:172.21.15.80:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c007b40 con 0x7fec400f8230 2024-02-13T00:52:10.491 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec487c6700 1 -- 172.21.15.80:0/3052657798 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec401085d0 con 0x7fec400f8230 2024-02-13T00:52:10.491 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec377fe700 1 -- 172.21.15.80:0/3052657798 <== mon.0 v2:172.21.15.80:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fec3c00f040 con 0x7fec400f8230 2024-02-13T00:52:10.491 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec377fe700 1 -- 172.21.15.80:0/3052657798 <== mon.0 v2:172.21.15.80:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c014670 con 0x7fec400f8230 2024-02-13T00:52:10.491 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.483+0000 7fec487c6700 1 -- 172.21.15.80:0/3052657798 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec401147b0 con 0x7fec400f8230 2024-02-13T00:52:10.491 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.487+0000 7fec487c6700 1 -- 172.21.15.80:0/3052657798 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4005f540 con 0x7fec400f8230 2024-02-13T00:52:10.492 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.487+0000 7fec377fe700 1 -- 172.21.15.80:0/3052657798 <== mon.0 v2:172.21.15.80:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7fec3c007ca0 con 0x7fec400f8230 2024-02-13T00:52:10.493 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.487+0000 7fec377fe700 1 --2- 172.21.15.80:0/3052657798 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fec2c061340 0x7fec2c063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:52:10.493 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.487+0000 7fec377fe700 1 -- 172.21.15.80:0/3052657798 <== mon.0 v2:172.21.15.80:3300/0 5 ==== osd_map(732..732 src has 1..732) v4 ==== 9194+0+0 (secure 0 0 0) 0x7fec3c07d3a0 con 0x7fec400f8230 2024-02-13T00:52:10.493 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.487+0000 7fec45d61700 1 --2- 172.21.15.80:0/3052657798 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fec2c061340 0x7fec2c063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:52:10.493 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.487+0000 7fec45d61700 1 --2- 172.21.15.80:0/3052657798 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fec2c061340 0x7fec2c063800 secure :-1 s=READY pgs=3525 cs=0 l=1 rev1=1 rx=0x7fec40108dd0 tx=0x7fec3000b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:52:10.499 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.495+0000 7fec377fe700 1 -- 172.21.15.80:0/3052657798 <== mon.0 v2:172.21.15.80:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fec3c04c970 con 0x7fec400f8230 2024-02-13T00:52:10.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:52:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:52:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:52:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:10 smithi106 bash[18459]: cluster 2024-02-13T00:52:08.567799+0000 mgr.y (mgr.24461) 854 : cluster [DBG] pgmap v1327: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T00:52:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:10 smithi106 bash[18459]: audit 2024-02-13T00:52:08.914858+0000 mgr.y (mgr.24461) 855 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:52:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:10 smithi106 bash[18459]: audit 2024-02-13T00:52:09.264003+0000 mon.a (mon.0) 3315 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]': finished 2024-02-13T00:52:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:10 smithi106 bash[18459]: cluster 2024-02-13T00:52:09.264127+0000 mon.a (mon.0) 3316 : cluster [DBG] osdmap e731: 8 total, 8 up, 8 in 2024-02-13T00:52:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:10 smithi106 bash[18459]: audit 2024-02-13T00:52:09.592931+0000 mon.a (mon.0) 3317 : audit [INF] from='client.? 172.21.15.80:0/3674625088' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pg_num": 12}]: dispatch 2024-02-13T00:52:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:10 smithi106 bash[18459]: audit 2024-02-13T00:52:10.244325+0000 mon.c (mon.2) 560 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:52:10.651 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:10.647+0000 7fec487c6700 1 -- 172.21.15.80:0/3052657798 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "app": "rados"} v 0) v1 -- 0x7fec4005fae0 con 0x7fec400f8230 2024-02-13T00:52:10.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:10 smithi080 bash[17386]: cluster 2024-02-13T00:52:08.567799+0000 mgr.y (mgr.24461) 854 : cluster [DBG] pgmap v1327: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T00:52:10.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:10 smithi080 bash[17386]: audit 2024-02-13T00:52:08.914858+0000 mgr.y (mgr.24461) 855 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:52:10.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:10 smithi080 bash[17386]: audit 2024-02-13T00:52:09.264003+0000 mon.a (mon.0) 3315 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]': finished 2024-02-13T00:52:10.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:10 smithi080 bash[17386]: cluster 2024-02-13T00:52:09.264127+0000 mon.a (mon.0) 3316 : cluster [DBG] osdmap e731: 8 total, 8 up, 8 in 2024-02-13T00:52:10.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:10 smithi080 bash[17386]: audit 2024-02-13T00:52:09.592931+0000 mon.a (mon.0) 3317 : audit [INF] from='client.? 172.21.15.80:0/3674625088' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pg_num": 12}]: dispatch 2024-02-13T00:52:10.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:10 smithi080 bash[17386]: audit 2024-02-13T00:52:10.244325+0000 mon.c (mon.2) 560 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:52:10.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:10 smithi080 bash[24237]: cluster 2024-02-13T00:52:08.567799+0000 mgr.y (mgr.24461) 854 : cluster [DBG] pgmap v1327: 176 pgs: 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T00:52:10.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:10 smithi080 bash[24237]: audit 2024-02-13T00:52:08.914858+0000 mgr.y (mgr.24461) 855 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:52:10.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:10 smithi080 bash[24237]: audit 2024-02-13T00:52:09.264003+0000 mon.a (mon.0) 3315 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]': finished 2024-02-13T00:52:10.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:10 smithi080 bash[24237]: cluster 2024-02-13T00:52:09.264127+0000 mon.a (mon.0) 3316 : cluster [DBG] osdmap e731: 8 total, 8 up, 8 in 2024-02-13T00:52:10.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:10 smithi080 bash[24237]: audit 2024-02-13T00:52:09.592931+0000 mon.a (mon.0) 3317 : audit [INF] from='client.? 172.21.15.80:0/3674625088' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pg_num": 12}]: dispatch 2024-02-13T00:52:10.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:10 smithi080 bash[24237]: audit 2024-02-13T00:52:10.244325+0000 mon.c (mon.2) 560 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:52:11.294 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:11.287+0000 7fec377fe700 1 -- 172.21.15.80:0/3052657798 <== mon.0 v2:172.21.15.80:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "app": "rados"}]=0 enabled application 'rados' on pool '202352ae-8764-48cf-9bc7-8298889ef897' v733) v1 ==== 213+0+0 (secure 0 0 0) 0x7fec3c04ff90 con 0x7fec400f8230 2024-02-13T00:52:11.395 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:11.391+0000 7fec487c6700 1 -- 172.21.15.80:0/3052657798 --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "app": "rados"} v 0) v1 -- 0x7fec40106ca0 con 0x7fec400f8230 2024-02-13T00:52:11.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:11 smithi106 bash[18459]: audit 2024-02-13T00:52:10.278234+0000 mon.a (mon.0) 3318 : audit [INF] from='client.? 172.21.15.80:0/3674625088' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pg_num": 12}]': finished 2024-02-13T00:52:11.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:11 smithi106 bash[18459]: cluster 2024-02-13T00:52:10.278550+0000 mon.a (mon.0) 3319 : cluster [DBG] osdmap e732: 8 total, 8 up, 8 in 2024-02-13T00:52:11.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:11 smithi106 bash[18459]: audit 2024-02-13T00:52:10.377374+0000 mon.a (mon.0) 3320 : audit [INF] from='client.? 172.21.15.80:0/3674625088' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pg_num": 12}]: dispatch 2024-02-13T00:52:11.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:11 smithi106 bash[18459]: audit 2024-02-13T00:52:10.649795+0000 mon.a (mon.0) 3321 : audit [INF] from='client.? 172.21.15.80:0/3052657798' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "app": "rados"}]: dispatch 2024-02-13T00:52:11.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:11 smithi080 bash[17386]: audit 2024-02-13T00:52:10.278234+0000 mon.a (mon.0) 3318 : audit [INF] from='client.? 172.21.15.80:0/3674625088' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pg_num": 12}]': finished 2024-02-13T00:52:11.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:11 smithi080 bash[17386]: cluster 2024-02-13T00:52:10.278550+0000 mon.a (mon.0) 3319 : cluster [DBG] osdmap e732: 8 total, 8 up, 8 in 2024-02-13T00:52:11.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:11 smithi080 bash[17386]: audit 2024-02-13T00:52:10.377374+0000 mon.a (mon.0) 3320 : audit [INF] from='client.? 172.21.15.80:0/3674625088' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pg_num": 12}]: dispatch 2024-02-13T00:52:11.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:11 smithi080 bash[17386]: audit 2024-02-13T00:52:10.649795+0000 mon.a (mon.0) 3321 : audit [INF] from='client.? 172.21.15.80:0/3052657798' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "app": "rados"}]: dispatch 2024-02-13T00:52:11.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:11 smithi080 bash[24237]: audit 2024-02-13T00:52:10.278234+0000 mon.a (mon.0) 3318 : audit [INF] from='client.? 172.21.15.80:0/3674625088' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pg_num": 12}]': finished 2024-02-13T00:52:11.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:11 smithi080 bash[24237]: cluster 2024-02-13T00:52:10.278550+0000 mon.a (mon.0) 3319 : cluster [DBG] osdmap e732: 8 total, 8 up, 8 in 2024-02-13T00:52:11.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:11 smithi080 bash[24237]: audit 2024-02-13T00:52:10.377374+0000 mon.a (mon.0) 3320 : audit [INF] from='client.? 172.21.15.80:0/3674625088' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pg_num": 12}]: dispatch 2024-02-13T00:52:11.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:11 smithi080 bash[24237]: audit 2024-02-13T00:52:10.649795+0000 mon.a (mon.0) 3321 : audit [INF] from='client.? 172.21.15.80:0/3052657798' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "app": "rados"}]: dispatch 2024-02-13T00:52:12.298 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.291+0000 7fec377fe700 1 -- 172.21.15.80:0/3052657798 <== mon.0 v2:172.21.15.80:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "app": "rados"}]=0 enabled application 'rados' on pool '202352ae-8764-48cf-9bc7-8298889ef897' v734) v1 ==== 213+0+0 (secure 0 0 0) 0x7fec3c050170 con 0x7fec400f8230 2024-02-13T00:52:12.305 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.299+0000 7fec487c6700 1 -- 172.21.15.80:0/3052657798 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fec2c061340 msgr2=0x7fec2c063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:12.305 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.299+0000 7fec487c6700 1 --2- 172.21.15.80:0/3052657798 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fec2c061340 0x7fec2c063800 secure :-1 s=READY pgs=3525 cs=0 l=1 rev1=1 rx=0x7fec40108dd0 tx=0x7fec3000b040).stop 2024-02-13T00:52:12.305 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.299+0000 7fec487c6700 1 -- 172.21.15.80:0/3052657798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec400f8230 msgr2=0x7fec4010d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:12.305 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.299+0000 7fec487c6700 1 --2- 172.21.15.80:0/3052657798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec400f8230 0x7fec4010d910 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 rx=0x7fec3c002800 tx=0x7fec3c009ec0).stop 2024-02-13T00:52:12.305 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.299+0000 7fec487c6700 1 -- 172.21.15.80:0/3052657798 shutdown_connections 2024-02-13T00:52:12.306 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.299+0000 7fec487c6700 1 --2- 172.21.15.80:0/3052657798 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fec2c061340 0x7fec2c063800 unknown :-1 s=CLOSED pgs=3525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:12.306 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.299+0000 7fec487c6700 1 --2- 172.21.15.80:0/3052657798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec400fe290 0x7fec40107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:12.306 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.299+0000 7fec487c6700 1 --2- 172.21.15.80:0/3052657798 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fec400fd930 0x7fec4010de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:12.306 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.299+0000 7fec487c6700 1 --2- 172.21.15.80:0/3052657798 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fec400f8230 0x7fec4010d910 unknown :-1 s=CLOSED pgs=2485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:12.306 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.299+0000 7fec487c6700 1 -- 172.21.15.80:0/3052657798 >> 172.21.15.80:0/3052657798 conn(0x7fec4006e950 msgr2=0x7fec400f6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:52:12.306 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.299+0000 7fec487c6700 1 -- 172.21.15.80:0/3052657798 shutdown_connections 2024-02-13T00:52:12.306 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.299+0000 7fec487c6700 1 -- 172.21.15.80:0/3052657798 wait complete. 2024-02-13T00:52:12.306 INFO:tasks.workunit.client.0.smithi080.stderr:enabled application 'rados' on pool '202352ae-8764-48cf-9bc7-8298889ef897' 2024-02-13T00:52:12.315 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph osd pool set-quota 202352ae-8764-48cf-9bc7-8298889ef897 max_objects 10 2024-02-13T00:52:12.422 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.415+0000 7fccbb983700 1 -- 172.21.15.80:0/3481274267 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fccb40fd950 msgr2=0x7fccb40fdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:12.422 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.415+0000 7fccbb983700 1 --2- 172.21.15.80:0/3481274267 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fccb40fd950 0x7fccb40fdd30 secure :-1 s=READY pgs=3045 cs=0 l=1 rev1=1 rx=0x7fccb0009be0 tx=0x7fccb0004d10).stop 2024-02-13T00:52:12.422 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.415+0000 7fccbb983700 1 -- 172.21.15.80:0/3481274267 shutdown_connections 2024-02-13T00:52:12.422 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.415+0000 7fccbb983700 1 --2- 172.21.15.80:0/3481274267 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fccb4060c70 0x7fccb4104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:12.422 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.415+0000 7fccbb983700 1 --2- 172.21.15.80:0/3481274267 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccb40fe2b0 0x7fccb4060590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:12.422 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.415+0000 7fccbb983700 1 --2- 172.21.15.80:0/3481274267 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fccb40fd950 0x7fccb40fdd30 unknown :-1 s=CLOSED pgs=3045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:12.422 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.415+0000 7fccbb983700 1 -- 172.21.15.80:0/3481274267 >> 172.21.15.80:0/3481274267 conn(0x7fccb406c740 msgr2=0x7fccb406cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:52:12.422 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.415+0000 7fccbb983700 1 -- 172.21.15.80:0/3481274267 shutdown_connections 2024-02-13T00:52:12.422 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.415+0000 7fccbb983700 1 -- 172.21.15.80:0/3481274267 wait complete. 2024-02-13T00:52:12.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccbb983700 1 Processor -- start 2024-02-13T00:52:12.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccbb983700 1 -- start start 2024-02-13T00:52:12.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccbb983700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccb4060c70 0x7fccb410dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:52:12.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccbb983700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fccb40fd950 0x7fccb410e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:52:12.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccbb983700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fccb40fe2b0 0x7fccb4107ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:52:12.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccbb983700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb41083d0 con 0x7fccb40fe2b0 2024-02-13T00:52:12.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccbb983700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb4108540 con 0x7fccb4060c70 2024-02-13T00:52:12.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccbb983700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb4108700 con 0x7fccb40fd950 2024-02-13T00:52:12.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccb8f1e700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fccb40fd950 0x7fccb410e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:52:12.424 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccb9f20700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fccb40fe2b0 0x7fccb4107ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:52:12.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccb971f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccb4060c70 0x7fccb410dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:52:12.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccb8f1e700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fccb40fd950 0x7fccb410e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:42910/0 (socket says 172.21.15.80:42910) 2024-02-13T00:52:12.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccb8f1e700 1 -- 172.21.15.80:0/2310967228 learned_addr learned my addr 172.21.15.80:0/2310967228 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:52:12.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccb8f1e700 1 -- 172.21.15.80:0/2310967228 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccb4060c70 msgr2=0x7fccb410dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:12.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccb8f1e700 1 --2- 172.21.15.80:0/2310967228 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccb4060c70 0x7fccb410dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:12.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccb8f1e700 1 -- 172.21.15.80:0/2310967228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fccb40fe2b0 msgr2=0x7fccb4107ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:12.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccb8f1e700 1 --2- 172.21.15.80:0/2310967228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fccb40fe2b0 0x7fccb4107ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:12.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccb8f1e700 1 -- 172.21.15.80:0/2310967228 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb00097c0 con 0x7fccb40fd950 2024-02-13T00:52:12.425 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccb9f20700 1 --2- 172.21.15.80:0/2310967228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fccb40fe2b0 0x7fccb4107ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:52:12.426 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccb8f1e700 1 --2- 172.21.15.80:0/2310967228 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fccb40fd950 0x7fccb410e210 secure :-1 s=READY pgs=3046 cs=0 l=1 rev1=1 rx=0x7fcca400e990 tx=0x7fcca400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:52:12.426 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccaa7fc700 1 -- 172.21.15.80:0/2310967228 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca4004620 con 0x7fccb40fd950 2024-02-13T00:52:12.426 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccbb983700 1 -- 172.21.15.80:0/2310967228 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb4108980 con 0x7fccb40fd950 2024-02-13T00:52:12.426 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccaa7fc700 1 -- 172.21.15.80:0/2310967228 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7fcca400f040 con 0x7fccb40fd950 2024-02-13T00:52:12.426 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccaa7fc700 1 -- 172.21.15.80:0/2310967228 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca40146f0 con 0x7fccb40fd950 2024-02-13T00:52:12.426 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccbb983700 1 -- 172.21.15.80:0/2310967228 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb4114b70 con 0x7fccb40fd950 2024-02-13T00:52:12.426 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.419+0000 7fccbb983700 1 -- 172.21.15.80:0/2310967228 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb405f540 con 0x7fccb40fd950 2024-02-13T00:52:12.427 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.423+0000 7fccaa7fc700 1 -- 172.21.15.80:0/2310967228 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7fcca4007b40 con 0x7fccb40fd950 2024-02-13T00:52:12.428 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.423+0000 7fccaa7fc700 1 --2- 172.21.15.80:0/2310967228 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fcca0061340 0x7fcca0063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:52:12.428 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.423+0000 7fccaa7fc700 1 -- 172.21.15.80:0/2310967228 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(734..734 src has 1..734) v4 ==== 9207+0+0 (secure 0 0 0) 0x7fcca407d190 con 0x7fccb40fd950 2024-02-13T00:52:12.428 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.423+0000 7fccb971f700 1 --2- 172.21.15.80:0/2310967228 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fcca0061340 0x7fcca0063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:52:12.428 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.423+0000 7fccb971f700 1 --2- 172.21.15.80:0/2310967228 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fcca0061340 0x7fcca0063800 secure :-1 s=READY pgs=3526 cs=0 l=1 rev1=1 rx=0x7fccb00049c0 tx=0x7fccb0004d10).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:52:12.435 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.431+0000 7fccaa7fc700 1 -- 172.21.15.80:0/2310967228 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fcca4049f60 con 0x7fccb40fd950 2024-02-13T00:52:12.598 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:12.591+0000 7fccbb983700 1 -- 172.21.15.80:0/2310967228 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7fccb405fae0 con 0x7fccb40fd950 2024-02-13T00:52:12.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:12 smithi106 bash[18459]: cluster 2024-02-13T00:52:10.568455+0000 mgr.y (mgr.24461) 856 : cluster [DBG] pgmap v1330: 188 pgs: 12 unknown, 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:52:12.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:12 smithi106 bash[18459]: audit 2024-02-13T00:52:11.290389+0000 mon.a (mon.0) 3322 : audit [INF] from='client.? 172.21.15.80:0/3052657798' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "app": "rados"}]': finished 2024-02-13T00:52:12.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:12 smithi106 bash[18459]: cluster 2024-02-13T00:52:11.290481+0000 mon.a (mon.0) 3323 : cluster [DBG] osdmap e733: 8 total, 8 up, 8 in 2024-02-13T00:52:12.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:12 smithi106 bash[18459]: audit 2024-02-13T00:52:11.393730+0000 mon.a (mon.0) 3324 : audit [INF] from='client.? 172.21.15.80:0/3052657798' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "app": "rados"}]: dispatch 2024-02-13T00:52:12.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:12 smithi080 bash[17386]: cluster 2024-02-13T00:52:10.568455+0000 mgr.y (mgr.24461) 856 : cluster [DBG] pgmap v1330: 188 pgs: 12 unknown, 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:52:12.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:12 smithi080 bash[17386]: audit 2024-02-13T00:52:11.290389+0000 mon.a (mon.0) 3322 : audit [INF] from='client.? 172.21.15.80:0/3052657798' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "app": "rados"}]': finished 2024-02-13T00:52:12.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:12 smithi080 bash[17386]: cluster 2024-02-13T00:52:11.290481+0000 mon.a (mon.0) 3323 : cluster [DBG] osdmap e733: 8 total, 8 up, 8 in 2024-02-13T00:52:12.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:12 smithi080 bash[17386]: audit 2024-02-13T00:52:11.393730+0000 mon.a (mon.0) 3324 : audit [INF] from='client.? 172.21.15.80:0/3052657798' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "app": "rados"}]: dispatch 2024-02-13T00:52:12.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:12 smithi080 bash[24237]: cluster 2024-02-13T00:52:10.568455+0000 mgr.y (mgr.24461) 856 : cluster [DBG] pgmap v1330: 188 pgs: 12 unknown, 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:52:12.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:12 smithi080 bash[24237]: audit 2024-02-13T00:52:11.290389+0000 mon.a (mon.0) 3322 : audit [INF] from='client.? 172.21.15.80:0/3052657798' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "app": "rados"}]': finished 2024-02-13T00:52:12.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:12 smithi080 bash[24237]: cluster 2024-02-13T00:52:11.290481+0000 mon.a (mon.0) 3323 : cluster [DBG] osdmap e733: 8 total, 8 up, 8 in 2024-02-13T00:52:12.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:12 smithi080 bash[24237]: audit 2024-02-13T00:52:11.393730+0000 mon.a (mon.0) 3324 : audit [INF] from='client.? 172.21.15.80:0/3052657798' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "app": "rados"}]: dispatch 2024-02-13T00:52:13.321 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:13.315+0000 7fccaa7fc700 1 -- 172.21.15.80:0/2310967228 <== mon.2 v2:172.21.15.80:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 202352ae-8764-48cf-9bc7-8298889ef897 v735) v1 ==== 223+0+0 (secure 0 0 0) 0x7fcca404c730 con 0x7fccb40fd950 2024-02-13T00:52:13.416 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:13.411+0000 7fccbb983700 1 -- 172.21.15.80:0/2310967228 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7fccb4106c10 con 0x7fccb40fd950 2024-02-13T00:52:13.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:52:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:52:13] "GET /metrics HTTP/1.1" 200 188966 "" "Prometheus/2.33.4" 2024-02-13T00:52:13.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:13 smithi080 bash[17386]: audit 2024-02-13T00:52:12.295330+0000 mon.a (mon.0) 3325 : audit [INF] from='client.? 172.21.15.80:0/3052657798' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "app": "rados"}]': finished 2024-02-13T00:52:13.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:13 smithi080 bash[17386]: cluster 2024-02-13T00:52:12.295461+0000 mon.a (mon.0) 3326 : cluster [DBG] osdmap e734: 8 total, 8 up, 8 in 2024-02-13T00:52:13.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:13 smithi080 bash[17386]: audit 2024-02-13T00:52:12.596080+0000 mon.c (mon.2) 561 : audit [INF] from='client.? 172.21.15.80:0/2310967228' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:52:13.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:13 smithi080 bash[17386]: audit 2024-02-13T00:52:12.596723+0000 mon.a (mon.0) 3327 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:52:13.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:13 smithi080 bash[24237]: audit 2024-02-13T00:52:12.295330+0000 mon.a (mon.0) 3325 : audit [INF] from='client.? 172.21.15.80:0/3052657798' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "app": "rados"}]': finished 2024-02-13T00:52:13.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:13 smithi080 bash[24237]: cluster 2024-02-13T00:52:12.295461+0000 mon.a (mon.0) 3326 : cluster [DBG] osdmap e734: 8 total, 8 up, 8 in 2024-02-13T00:52:13.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:13 smithi080 bash[24237]: audit 2024-02-13T00:52:12.596080+0000 mon.c (mon.2) 561 : audit [INF] from='client.? 172.21.15.80:0/2310967228' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:52:13.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:13 smithi080 bash[24237]: audit 2024-02-13T00:52:12.596723+0000 mon.a (mon.0) 3327 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:52:13.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:13 smithi106 bash[18459]: audit 2024-02-13T00:52:12.295330+0000 mon.a (mon.0) 3325 : audit [INF] from='client.? 172.21.15.80:0/3052657798' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "app": "rados"}]': finished 2024-02-13T00:52:13.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:13 smithi106 bash[18459]: cluster 2024-02-13T00:52:12.295461+0000 mon.a (mon.0) 3326 : cluster [DBG] osdmap e734: 8 total, 8 up, 8 in 2024-02-13T00:52:13.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:13 smithi106 bash[18459]: audit 2024-02-13T00:52:12.596080+0000 mon.c (mon.2) 561 : audit [INF] from='client.? 172.21.15.80:0/2310967228' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:52:13.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:13 smithi106 bash[18459]: audit 2024-02-13T00:52:12.596723+0000 mon.a (mon.0) 3327 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:52:14.325 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:14.319+0000 7fccaa7fc700 1 -- 172.21.15.80:0/2310967228 <== mon.2 v2:172.21.15.80:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 202352ae-8764-48cf-9bc7-8298889ef897 v736) v1 ==== 223+0+0 (secure 0 0 0) 0x7fcca404fd50 con 0x7fccb40fd950 2024-02-13T00:52:14.329 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:14.323+0000 7fccbb983700 1 -- 172.21.15.80:0/2310967228 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fcca0061340 msgr2=0x7fcca0063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:14.330 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:14.323+0000 7fccbb983700 1 --2- 172.21.15.80:0/2310967228 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fcca0061340 0x7fcca0063800 secure :-1 s=READY pgs=3526 cs=0 l=1 rev1=1 rx=0x7fccb00049c0 tx=0x7fccb0004d10).stop 2024-02-13T00:52:14.330 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:14.323+0000 7fccbb983700 1 -- 172.21.15.80:0/2310967228 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fccb40fd950 msgr2=0x7fccb410e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:52:14.330 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:14.323+0000 7fccbb983700 1 --2- 172.21.15.80:0/2310967228 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fccb40fd950 0x7fccb410e210 secure :-1 s=READY pgs=3046 cs=0 l=1 rev1=1 rx=0x7fcca400e990 tx=0x7fcca400b040).stop 2024-02-13T00:52:14.330 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:14.323+0000 7fccbb983700 1 -- 172.21.15.80:0/2310967228 shutdown_connections 2024-02-13T00:52:14.330 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:14.323+0000 7fccbb983700 1 --2- 172.21.15.80:0/2310967228 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7fcca0061340 0x7fcca0063800 unknown :-1 s=CLOSED pgs=3526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:14.330 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:14.323+0000 7fccbb983700 1 --2- 172.21.15.80:0/2310967228 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7fccb40fe2b0 0x7fccb4107ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:14.330 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:14.323+0000 7fccbb983700 1 --2- 172.21.15.80:0/2310967228 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7fccb40fd950 0x7fccb410e210 unknown :-1 s=CLOSED pgs=3046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:14.330 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:14.323+0000 7fccbb983700 1 --2- 172.21.15.80:0/2310967228 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccb4060c70 0x7fccb410dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:52:14.330 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:14.323+0000 7fccbb983700 1 -- 172.21.15.80:0/2310967228 >> 172.21.15.80:0/2310967228 conn(0x7fccb406c740 msgr2=0x7fccb40f6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:52:14.330 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:14.323+0000 7fccbb983700 1 -- 172.21.15.80:0/2310967228 shutdown_connections 2024-02-13T00:52:14.330 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:52:14.323+0000 7fccbb983700 1 -- 172.21.15.80:0/2310967228 wait complete. 2024-02-13T00:52:14.331 INFO:tasks.workunit.client.0.smithi080.stderr:set-quota max_objects = 10 for pool 202352ae-8764-48cf-9bc7-8298889ef897 2024-02-13T00:52:14.340 INFO:tasks.workunit.client.0.smithi080.stderr:+ sleep 30 2024-02-13T00:52:14.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:14 smithi106 bash[18459]: cluster 2024-02-13T00:52:12.569158+0000 mgr.y (mgr.24461) 857 : cluster [DBG] pgmap v1333: 188 pgs: 12 unknown, 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:52:14.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:14 smithi106 bash[18459]: audit 2024-02-13T00:52:13.314036+0000 mon.a (mon.0) 3328 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "field": "max_objects", "val": "10"}]': finished 2024-02-13T00:52:14.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:14 smithi106 bash[18459]: cluster 2024-02-13T00:52:13.314113+0000 mon.a (mon.0) 3329 : cluster [DBG] osdmap e735: 8 total, 8 up, 8 in 2024-02-13T00:52:14.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:14 smithi106 bash[18459]: audit 2024-02-13T00:52:13.414938+0000 mon.c (mon.2) 562 : audit [INF] from='client.? 172.21.15.80:0/2310967228' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:52:14.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:14 smithi106 bash[18459]: audit 2024-02-13T00:52:13.415621+0000 mon.a (mon.0) 3330 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:52:14.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:14 smithi080 bash[17386]: cluster 2024-02-13T00:52:12.569158+0000 mgr.y (mgr.24461) 857 : cluster [DBG] pgmap v1333: 188 pgs: 12 unknown, 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:52:14.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:14 smithi080 bash[17386]: audit 2024-02-13T00:52:13.314036+0000 mon.a (mon.0) 3328 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "field": "max_objects", "val": "10"}]': finished 2024-02-13T00:52:14.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:14 smithi080 bash[17386]: cluster 2024-02-13T00:52:13.314113+0000 mon.a (mon.0) 3329 : cluster [DBG] osdmap e735: 8 total, 8 up, 8 in 2024-02-13T00:52:14.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:14 smithi080 bash[17386]: audit 2024-02-13T00:52:13.414938+0000 mon.c (mon.2) 562 : audit [INF] from='client.? 172.21.15.80:0/2310967228' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:52:14.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:14 smithi080 bash[17386]: audit 2024-02-13T00:52:13.415621+0000 mon.a (mon.0) 3330 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:52:14.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:14 smithi080 bash[24237]: cluster 2024-02-13T00:52:12.569158+0000 mgr.y (mgr.24461) 857 : cluster [DBG] pgmap v1333: 188 pgs: 12 unknown, 176 active+clean; 146 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2024-02-13T00:52:14.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:14 smithi080 bash[24237]: audit 2024-02-13T00:52:13.314036+0000 mon.a (mon.0) 3328 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "field": "max_objects", "val": "10"}]': finished 2024-02-13T00:52:14.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:14 smithi080 bash[24237]: cluster 2024-02-13T00:52:13.314113+0000 mon.a (mon.0) 3329 : cluster [DBG] osdmap e735: 8 total, 8 up, 8 in 2024-02-13T00:52:14.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:14 smithi080 bash[24237]: audit 2024-02-13T00:52:13.414938+0000 mon.c (mon.2) 562 : audit [INF] from='client.? 172.21.15.80:0/2310967228' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:52:14.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:14 smithi080 bash[24237]: audit 2024-02-13T00:52:13.415621+0000 mon.a (mon.0) 3330 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T00:52:15.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:15 smithi106 bash[18459]: audit 2024-02-13T00:52:14.321807+0000 mon.a (mon.0) 3331 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "field": "max_objects", "val": "10"}]': finished 2024-02-13T00:52:15.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:15 smithi106 bash[18459]: cluster 2024-02-13T00:52:14.322217+0000 mon.a (mon.0) 3332 : cluster [DBG] osdmap e736: 8 total, 8 up, 8 in 2024-02-13T00:52:15.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:15 smithi106 bash[18459]: cluster 2024-02-13T00:52:14.570012+0000 mgr.y (mgr.24461) 858 : cluster [DBG] pgmap v1336: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-02-13T00:52:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:15 smithi080 bash[17386]: audit 2024-02-13T00:52:14.321807+0000 mon.a (mon.0) 3331 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "field": "max_objects", "val": "10"}]': finished 2024-02-13T00:52:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:15 smithi080 bash[17386]: cluster 2024-02-13T00:52:14.322217+0000 mon.a (mon.0) 3332 : cluster [DBG] osdmap e736: 8 total, 8 up, 8 in 2024-02-13T00:52:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:15 smithi080 bash[17386]: cluster 2024-02-13T00:52:14.570012+0000 mgr.y (mgr.24461) 858 : cluster [DBG] pgmap v1336: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-02-13T00:52:15.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:15 smithi080 bash[24237]: audit 2024-02-13T00:52:14.321807+0000 mon.a (mon.0) 3331 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "field": "max_objects", "val": "10"}]': finished 2024-02-13T00:52:15.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:15 smithi080 bash[24237]: cluster 2024-02-13T00:52:14.322217+0000 mon.a (mon.0) 3332 : cluster [DBG] osdmap e736: 8 total, 8 up, 8 in 2024-02-13T00:52:15.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:15 smithi080 bash[24237]: cluster 2024-02-13T00:52:14.570012+0000 mgr.y (mgr.24461) 858 : cluster [DBG] pgmap v1336: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-02-13T00:52:17.255 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:16 smithi106 bash[18459]: audit 2024-02-13T00:52:15.881195+0000 mon.a (mon.0) 3333 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:52:17.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:16 smithi106 bash[18459]: audit 2024-02-13T00:52:16.173429+0000 mon.c (mon.2) 563 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:52:17.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:16 smithi106 bash[18459]: audit 2024-02-13T00:52:16.175076+0000 mon.c (mon.2) 564 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:52:17.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:16 smithi106 bash[18459]: audit 2024-02-13T00:52:16.183349+0000 mon.a (mon.0) 3334 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:52:17.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:16 smithi080 bash[17386]: audit 2024-02-13T00:52:15.881195+0000 mon.a (mon.0) 3333 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:52:17.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:16 smithi080 bash[17386]: audit 2024-02-13T00:52:16.173429+0000 mon.c (mon.2) 563 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:52:17.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:16 smithi080 bash[17386]: audit 2024-02-13T00:52:16.175076+0000 mon.c (mon.2) 564 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:52:17.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:16 smithi080 bash[17386]: audit 2024-02-13T00:52:16.183349+0000 mon.a (mon.0) 3334 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:52:17.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:16 smithi080 bash[24237]: audit 2024-02-13T00:52:15.881195+0000 mon.a (mon.0) 3333 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:52:17.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:16 smithi080 bash[24237]: audit 2024-02-13T00:52:16.173429+0000 mon.c (mon.2) 563 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:52:17.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:16 smithi080 bash[24237]: audit 2024-02-13T00:52:16.175076+0000 mon.c (mon.2) 564 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:52:17.259 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:16 smithi080 bash[24237]: audit 2024-02-13T00:52:16.183349+0000 mon.a (mon.0) 3334 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:52:18.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:17 smithi106 bash[18459]: cluster 2024-02-13T00:52:16.570868+0000 mgr.y (mgr.24461) 859 : cluster [DBG] pgmap v1337: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 969 B/s rd, 4.5 KiB/s wr, 1 op/s 2024-02-13T00:52:18.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:17 smithi106 bash[18459]: audit 2024-02-13T00:52:16.933874+0000 mon.a (mon.0) 3335 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:52:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:17 smithi080 bash[17386]: cluster 2024-02-13T00:52:16.570868+0000 mgr.y (mgr.24461) 859 : cluster [DBG] pgmap v1337: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 969 B/s rd, 4.5 KiB/s wr, 1 op/s 2024-02-13T00:52:18.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:17 smithi080 bash[17386]: audit 2024-02-13T00:52:16.933874+0000 mon.a (mon.0) 3335 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:52:18.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:17 smithi080 bash[24237]: cluster 2024-02-13T00:52:16.570868+0000 mgr.y (mgr.24461) 859 : cluster [DBG] pgmap v1337: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 969 B/s rd, 4.5 KiB/s wr, 1 op/s 2024-02-13T00:52:18.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:17 smithi080 bash[24237]: audit 2024-02-13T00:52:16.933874+0000 mon.a (mon.0) 3335 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:52:19.256 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:52:18 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:52:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:20 smithi106 bash[18459]: cluster 2024-02-13T00:52:18.572853+0000 mgr.y (mgr.24461) 860 : cluster [DBG] pgmap v1338: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 3.8 KiB/s wr, 1 op/s 2024-02-13T00:52:20.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:20 smithi106 bash[18459]: audit 2024-02-13T00:52:18.926328+0000 mgr.y (mgr.24461) 861 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:52:20.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:52:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:52:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:52:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:20 smithi080 bash[17386]: cluster 2024-02-13T00:52:18.572853+0000 mgr.y (mgr.24461) 860 : cluster [DBG] pgmap v1338: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 3.8 KiB/s wr, 1 op/s 2024-02-13T00:52:20.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:20 smithi080 bash[17386]: audit 2024-02-13T00:52:18.926328+0000 mgr.y (mgr.24461) 861 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:52:20.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:20 smithi080 bash[24237]: cluster 2024-02-13T00:52:18.572853+0000 mgr.y (mgr.24461) 860 : cluster [DBG] pgmap v1338: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.6 KiB/s rd, 3.8 KiB/s wr, 1 op/s 2024-02-13T00:52:20.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:20 smithi080 bash[24237]: audit 2024-02-13T00:52:18.926328+0000 mgr.y (mgr.24461) 861 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:52:22.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:22 smithi106 bash[18459]: cluster 2024-02-13T00:52:20.573332+0000 mgr.y (mgr.24461) 862 : cluster [DBG] pgmap v1339: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 1 op/s 2024-02-13T00:52:22.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:22 smithi080 bash[17386]: cluster 2024-02-13T00:52:20.573332+0000 mgr.y (mgr.24461) 862 : cluster [DBG] pgmap v1339: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 1 op/s 2024-02-13T00:52:22.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:22 smithi080 bash[24237]: cluster 2024-02-13T00:52:20.573332+0000 mgr.y (mgr.24461) 862 : cluster [DBG] pgmap v1339: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 1 op/s 2024-02-13T00:52:23.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:52:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:52:23] "GET /metrics HTTP/1.1" 200 191507 "" "Prometheus/2.33.4" 2024-02-13T00:52:24.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:24 smithi106 bash[18459]: cluster 2024-02-13T00:52:22.574072+0000 mgr.y (mgr.24461) 863 : cluster [DBG] pgmap v1340: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 553 B/s rd, 0 op/s 2024-02-13T00:52:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:24 smithi080 bash[17386]: cluster 2024-02-13T00:52:22.574072+0000 mgr.y (mgr.24461) 863 : cluster [DBG] pgmap v1340: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 553 B/s rd, 0 op/s 2024-02-13T00:52:24.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:24 smithi080 bash[24237]: cluster 2024-02-13T00:52:22.574072+0000 mgr.y (mgr.24461) 863 : cluster [DBG] pgmap v1340: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 553 B/s rd, 0 op/s 2024-02-13T00:52:26.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:26 smithi106 bash[18459]: cluster 2024-02-13T00:52:24.576138+0000 mgr.y (mgr.24461) 864 : cluster [DBG] pgmap v1341: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 998 B/s rd, 0 op/s 2024-02-13T00:52:26.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:26 smithi080 bash[17386]: cluster 2024-02-13T00:52:24.576138+0000 mgr.y (mgr.24461) 864 : cluster [DBG] pgmap v1341: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 998 B/s rd, 0 op/s 2024-02-13T00:52:26.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:26 smithi080 bash[24237]: cluster 2024-02-13T00:52:24.576138+0000 mgr.y (mgr.24461) 864 : cluster [DBG] pgmap v1341: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 998 B/s rd, 0 op/s 2024-02-13T00:52:28.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:28 smithi106 bash[18459]: cluster 2024-02-13T00:52:26.576990+0000 mgr.y (mgr.24461) 865 : cluster [DBG] pgmap v1342: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:28.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:28 smithi080 bash[17386]: cluster 2024-02-13T00:52:26.576990+0000 mgr.y (mgr.24461) 865 : cluster [DBG] pgmap v1342: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:28.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:28 smithi080 bash[24237]: cluster 2024-02-13T00:52:26.576990+0000 mgr.y (mgr.24461) 865 : cluster [DBG] pgmap v1342: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:29.256 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:52:28 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:52:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:30 smithi106 bash[18459]: cluster 2024-02-13T00:52:28.578954+0000 mgr.y (mgr.24461) 866 : cluster [DBG] pgmap v1343: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:52:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:30 smithi106 bash[18459]: audit 2024-02-13T00:52:28.937672+0000 mgr.y (mgr.24461) 867 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:52:30.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:52:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:52:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:52:30.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:30 smithi080 bash[17386]: cluster 2024-02-13T00:52:28.578954+0000 mgr.y (mgr.24461) 866 : cluster [DBG] pgmap v1343: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:52:30.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:30 smithi080 bash[17386]: audit 2024-02-13T00:52:28.937672+0000 mgr.y (mgr.24461) 867 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:52:30.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:30 smithi080 bash[24237]: cluster 2024-02-13T00:52:28.578954+0000 mgr.y (mgr.24461) 866 : cluster [DBG] pgmap v1343: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:52:30.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:30 smithi080 bash[24237]: audit 2024-02-13T00:52:28.937672+0000 mgr.y (mgr.24461) 867 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:52:32.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:32 smithi080 bash[17386]: cluster 2024-02-13T00:52:30.579667+0000 mgr.y (mgr.24461) 868 : cluster [DBG] pgmap v1344: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:32.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:32 smithi080 bash[24237]: cluster 2024-02-13T00:52:30.579667+0000 mgr.y (mgr.24461) 868 : cluster [DBG] pgmap v1344: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:32.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:32 smithi106 bash[18459]: cluster 2024-02-13T00:52:30.579667+0000 mgr.y (mgr.24461) 868 : cluster [DBG] pgmap v1344: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:33.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:52:33 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:52:33] "GET /metrics HTTP/1.1" 200 191503 "" "Prometheus/2.33.4" 2024-02-13T00:52:34.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:34 smithi106 bash[18459]: cluster 2024-02-13T00:52:32.580491+0000 mgr.y (mgr.24461) 869 : cluster [DBG] pgmap v1345: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:34.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:34 smithi080 bash[17386]: cluster 2024-02-13T00:52:32.580491+0000 mgr.y (mgr.24461) 869 : cluster [DBG] pgmap v1345: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:34.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:34 smithi080 bash[24237]: cluster 2024-02-13T00:52:32.580491+0000 mgr.y (mgr.24461) 869 : cluster [DBG] pgmap v1345: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:36.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:36 smithi106 bash[18459]: cluster 2024-02-13T00:52:34.582384+0000 mgr.y (mgr.24461) 870 : cluster [DBG] pgmap v1346: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:52:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:36 smithi080 bash[17386]: cluster 2024-02-13T00:52:34.582384+0000 mgr.y (mgr.24461) 870 : cluster [DBG] pgmap v1346: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:52:36.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:36 smithi080 bash[24237]: cluster 2024-02-13T00:52:34.582384+0000 mgr.y (mgr.24461) 870 : cluster [DBG] pgmap v1346: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:52:38.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:38 smithi106 bash[18459]: cluster 2024-02-13T00:52:36.583174+0000 mgr.y (mgr.24461) 871 : cluster [DBG] pgmap v1347: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:38.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:38 smithi080 bash[17386]: cluster 2024-02-13T00:52:36.583174+0000 mgr.y (mgr.24461) 871 : cluster [DBG] pgmap v1347: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:38.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:38 smithi080 bash[24237]: cluster 2024-02-13T00:52:36.583174+0000 mgr.y (mgr.24461) 871 : cluster [DBG] pgmap v1347: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:39.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:52:38 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:52:40.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:52:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:52:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:52:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:40 smithi106 bash[18459]: cluster 2024-02-13T00:52:38.585144+0000 mgr.y (mgr.24461) 872 : cluster [DBG] pgmap v1348: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:52:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:40 smithi106 bash[18459]: audit 2024-02-13T00:52:38.944672+0000 mgr.y (mgr.24461) 873 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:52:40.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:40 smithi080 bash[17386]: cluster 2024-02-13T00:52:38.585144+0000 mgr.y (mgr.24461) 872 : cluster [DBG] pgmap v1348: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:52:40.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:40 smithi080 bash[17386]: audit 2024-02-13T00:52:38.944672+0000 mgr.y (mgr.24461) 873 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:52:40.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:40 smithi080 bash[24237]: cluster 2024-02-13T00:52:38.585144+0000 mgr.y (mgr.24461) 872 : cluster [DBG] pgmap v1348: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:52:40.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:40 smithi080 bash[24237]: audit 2024-02-13T00:52:38.944672+0000 mgr.y (mgr.24461) 873 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:52:42.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:42 smithi106 bash[18459]: cluster 2024-02-13T00:52:40.586052+0000 mgr.y (mgr.24461) 874 : cluster [DBG] pgmap v1349: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:42.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:42 smithi080 bash[17386]: cluster 2024-02-13T00:52:40.586052+0000 mgr.y (mgr.24461) 874 : cluster [DBG] pgmap v1349: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:42.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:42 smithi080 bash[24237]: cluster 2024-02-13T00:52:40.586052+0000 mgr.y (mgr.24461) 874 : cluster [DBG] pgmap v1349: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:43.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:52:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:52:43] "GET /metrics HTTP/1.1" 200 191503 "" "Prometheus/2.33.4" 2024-02-13T00:52:44.342 INFO:tasks.workunit.client.0.smithi080.stderr:+ seq 1 10 2024-02-13T00:52:44.343 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 202352ae-8764-48cf-9bc7-8298889ef897 put obj1 /etc/passwd 2024-02-13T00:52:44.387 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 202352ae-8764-48cf-9bc7-8298889ef897 put obj2 /etc/passwd 2024-02-13T00:52:44.428 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 202352ae-8764-48cf-9bc7-8298889ef897 put obj3 /etc/passwd 2024-02-13T00:52:44.469 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 202352ae-8764-48cf-9bc7-8298889ef897 put obj4 /etc/passwd 2024-02-13T00:52:44.511 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 202352ae-8764-48cf-9bc7-8298889ef897 put obj5 /etc/passwd 2024-02-13T00:52:44.551 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 202352ae-8764-48cf-9bc7-8298889ef897 put obj6 /etc/passwd 2024-02-13T00:52:44.594 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 202352ae-8764-48cf-9bc7-8298889ef897 put obj7 /etc/passwd 2024-02-13T00:52:44.638 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 202352ae-8764-48cf-9bc7-8298889ef897 put obj8 /etc/passwd 2024-02-13T00:52:44.680 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 202352ae-8764-48cf-9bc7-8298889ef897 put obj9 /etc/passwd 2024-02-13T00:52:44.720 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 202352ae-8764-48cf-9bc7-8298889ef897 put obj10 /etc/passwd 2024-02-13T00:52:44.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:44 smithi106 bash[18459]: cluster 2024-02-13T00:52:42.586796+0000 mgr.y (mgr.24461) 875 : cluster [DBG] pgmap v1350: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:44.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:44 smithi080 bash[17386]: cluster 2024-02-13T00:52:42.586796+0000 mgr.y (mgr.24461) 875 : cluster [DBG] pgmap v1350: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:44.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:44 smithi080 bash[24237]: cluster 2024-02-13T00:52:42.586796+0000 mgr.y (mgr.24461) 875 : cluster [DBG] pgmap v1350: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:44.762 INFO:tasks.workunit.client.0.smithi080.stderr:+ sleep 30 2024-02-13T00:52:46.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:46 smithi106 bash[18459]: cluster 2024-02-13T00:52:44.587982+0000 mgr.y (mgr.24461) 876 : cluster [DBG] pgmap v1351: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:52:46.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:46 smithi080 bash[17386]: cluster 2024-02-13T00:52:44.587982+0000 mgr.y (mgr.24461) 876 : cluster [DBG] pgmap v1351: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:52:46.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:46 smithi080 bash[24237]: cluster 2024-02-13T00:52:44.587982+0000 mgr.y (mgr.24461) 876 : cluster [DBG] pgmap v1351: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:52:48.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:48 smithi106 bash[18459]: cluster 2024-02-13T00:52:46.588777+0000 mgr.y (mgr.24461) 877 : cluster [DBG] pgmap v1352: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:48.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:48 smithi080 bash[17386]: cluster 2024-02-13T00:52:46.588777+0000 mgr.y (mgr.24461) 877 : cluster [DBG] pgmap v1352: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:48.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:48 smithi080 bash[24237]: cluster 2024-02-13T00:52:46.588777+0000 mgr.y (mgr.24461) 877 : cluster [DBG] pgmap v1352: 188 pgs: 188 active+clean; 170 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:52:49.256 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:52:48 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:52:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:50 smithi106 bash[18459]: cluster 2024-02-13T00:52:48.590738+0000 mgr.y (mgr.24461) 878 : cluster [DBG] pgmap v1353: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-02-13T00:52:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:50 smithi106 bash[18459]: audit 2024-02-13T00:52:48.956229+0000 mgr.y (mgr.24461) 879 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:52:50.507 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:52:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:52:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:52:50.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:50 smithi080 bash[17386]: cluster 2024-02-13T00:52:48.590738+0000 mgr.y (mgr.24461) 878 : cluster [DBG] pgmap v1353: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-02-13T00:52:50.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:50 smithi080 bash[17386]: audit 2024-02-13T00:52:48.956229+0000 mgr.y (mgr.24461) 879 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:52:50.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:50 smithi080 bash[24237]: cluster 2024-02-13T00:52:48.590738+0000 mgr.y (mgr.24461) 878 : cluster [DBG] pgmap v1353: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-02-13T00:52:50.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:50 smithi080 bash[24237]: audit 2024-02-13T00:52:48.956229+0000 mgr.y (mgr.24461) 879 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:52:52.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:52 smithi106 bash[18459]: cluster 2024-02-13T00:52:50.591525+0000 mgr.y (mgr.24461) 880 : cluster [DBG] pgmap v1354: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 10 KiB/s wr, 1 op/s 2024-02-13T00:52:52.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:52 smithi080 bash[17386]: cluster 2024-02-13T00:52:50.591525+0000 mgr.y (mgr.24461) 880 : cluster [DBG] pgmap v1354: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 10 KiB/s wr, 1 op/s 2024-02-13T00:52:52.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:52 smithi080 bash[24237]: cluster 2024-02-13T00:52:50.591525+0000 mgr.y (mgr.24461) 880 : cluster [DBG] pgmap v1354: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 10 KiB/s wr, 1 op/s 2024-02-13T00:52:53.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:52:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:52:53] "GET /metrics HTTP/1.1" 200 191507 "" "Prometheus/2.33.4" 2024-02-13T00:52:53.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:53 smithi080 bash[17386]: cluster 2024-02-13T00:52:53.220652+0000 mon.a (mon.0) 3336 : cluster [WRN] pool '202352ae-8764-48cf-9bc7-8298889ef897' is full (reached quota's max_objects: 10) 2024-02-13T00:52:53.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:53 smithi080 bash[17386]: cluster 2024-02-13T00:52:53.221280+0000 mon.a (mon.0) 3337 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T00:52:53.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:53 smithi080 bash[17386]: cluster 2024-02-13T00:52:53.229153+0000 mon.a (mon.0) 3338 : cluster [DBG] osdmap e737: 8 total, 8 up, 8 in 2024-02-13T00:52:53.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:53 smithi080 bash[24237]: cluster 2024-02-13T00:52:53.220652+0000 mon.a (mon.0) 3336 : cluster [WRN] pool '202352ae-8764-48cf-9bc7-8298889ef897' is full (reached quota's max_objects: 10) 2024-02-13T00:52:53.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:53 smithi080 bash[24237]: cluster 2024-02-13T00:52:53.221280+0000 mon.a (mon.0) 3337 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T00:52:53.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:53 smithi080 bash[24237]: cluster 2024-02-13T00:52:53.229153+0000 mon.a (mon.0) 3338 : cluster [DBG] osdmap e737: 8 total, 8 up, 8 in 2024-02-13T00:52:53.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:53 smithi106 bash[18459]: cluster 2024-02-13T00:52:53.220652+0000 mon.a (mon.0) 3336 : cluster [WRN] pool '202352ae-8764-48cf-9bc7-8298889ef897' is full (reached quota's max_objects: 10) 2024-02-13T00:52:53.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:53 smithi106 bash[18459]: cluster 2024-02-13T00:52:53.221280+0000 mon.a (mon.0) 3337 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T00:52:53.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:53 smithi106 bash[18459]: cluster 2024-02-13T00:52:53.229153+0000 mon.a (mon.0) 3338 : cluster [DBG] osdmap e737: 8 total, 8 up, 8 in 2024-02-13T00:52:54.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:54 smithi106 bash[18459]: cluster 2024-02-13T00:52:52.592338+0000 mgr.y (mgr.24461) 881 : cluster [DBG] pgmap v1355: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 10 KiB/s wr, 1 op/s 2024-02-13T00:52:54.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:54 smithi080 bash[17386]: cluster 2024-02-13T00:52:52.592338+0000 mgr.y (mgr.24461) 881 : cluster [DBG] pgmap v1355: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 10 KiB/s wr, 1 op/s 2024-02-13T00:52:54.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:54 smithi080 bash[24237]: cluster 2024-02-13T00:52:52.592338+0000 mgr.y (mgr.24461) 881 : cluster [DBG] pgmap v1355: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 10 KiB/s wr, 1 op/s 2024-02-13T00:52:56.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:56 smithi106 bash[18459]: cluster 2024-02-13T00:52:54.593181+0000 mgr.y (mgr.24461) 882 : cluster [DBG] pgmap v1357: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T00:52:56.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:56 smithi080 bash[17386]: cluster 2024-02-13T00:52:54.593181+0000 mgr.y (mgr.24461) 882 : cluster [DBG] pgmap v1357: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T00:52:56.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:56 smithi080 bash[24237]: cluster 2024-02-13T00:52:54.593181+0000 mgr.y (mgr.24461) 882 : cluster [DBG] pgmap v1357: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T00:52:58.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:52:58 smithi106 bash[18459]: cluster 2024-02-13T00:52:56.594044+0000 mgr.y (mgr.24461) 883 : cluster [DBG] pgmap v1358: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T00:52:58.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:52:58 smithi080 bash[17386]: cluster 2024-02-13T00:52:56.594044+0000 mgr.y (mgr.24461) 883 : cluster [DBG] pgmap v1358: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T00:52:58.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:52:58 smithi080 bash[24237]: cluster 2024-02-13T00:52:56.594044+0000 mgr.y (mgr.24461) 883 : cluster [DBG] pgmap v1358: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T00:52:59.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:52:58 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:53:00.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:53:00 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:53:00] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:53:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:00 smithi106 bash[18459]: cluster 2024-02-13T00:52:58.595950+0000 mgr.y (mgr.24461) 884 : cluster [DBG] pgmap v1359: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:53:00.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:00 smithi106 bash[18459]: audit 2024-02-13T00:52:58.967841+0000 mgr.y (mgr.24461) 885 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:53:00.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:00 smithi080 bash[17386]: cluster 2024-02-13T00:52:58.595950+0000 mgr.y (mgr.24461) 884 : cluster [DBG] pgmap v1359: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:53:00.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:00 smithi080 bash[17386]: audit 2024-02-13T00:52:58.967841+0000 mgr.y (mgr.24461) 885 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:53:00.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:00 smithi080 bash[24237]: cluster 2024-02-13T00:52:58.595950+0000 mgr.y (mgr.24461) 884 : cluster [DBG] pgmap v1359: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:53:00.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:00 smithi080 bash[24237]: audit 2024-02-13T00:52:58.967841+0000 mgr.y (mgr.24461) 885 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:53:01.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:01 smithi106 bash[18459]: cluster 2024-02-13T00:53:00.596762+0000 mgr.y (mgr.24461) 886 : cluster [DBG] pgmap v1360: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:53:01.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:01 smithi080 bash[17386]: cluster 2024-02-13T00:53:00.596762+0000 mgr.y (mgr.24461) 886 : cluster [DBG] pgmap v1360: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:53:01.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:01 smithi080 bash[24237]: cluster 2024-02-13T00:53:00.596762+0000 mgr.y (mgr.24461) 886 : cluster [DBG] pgmap v1360: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:53:03.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:02 smithi106 bash[18459]: audit 2024-02-13T00:53:01.932744+0000 mon.a (mon.0) 3339 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:53:03.258 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:53:03 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:53:03] "GET /metrics HTTP/1.1" 200 191535 "" "Prometheus/2.33.4" 2024-02-13T00:53:03.258 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:02 smithi080 bash[17386]: audit 2024-02-13T00:53:01.932744+0000 mon.a (mon.0) 3339 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:53:03.258 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:02 smithi080 bash[24237]: audit 2024-02-13T00:53:01.932744+0000 mon.a (mon.0) 3339 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:53:04.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:04 smithi106 bash[18459]: cluster 2024-02-13T00:53:02.597521+0000 mgr.y (mgr.24461) 887 : cluster [DBG] pgmap v1361: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:53:04.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:04 smithi080 bash[17386]: cluster 2024-02-13T00:53:02.597521+0000 mgr.y (mgr.24461) 887 : cluster [DBG] pgmap v1361: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:53:04.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:04 smithi080 bash[24237]: cluster 2024-02-13T00:53:02.597521+0000 mgr.y (mgr.24461) 887 : cluster [DBG] pgmap v1361: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T00:53:06.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:06 smithi106 bash[18459]: cluster 2024-02-13T00:53:04.599432+0000 mgr.y (mgr.24461) 888 : cluster [DBG] pgmap v1362: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 900 B/s rd, 0 op/s 2024-02-13T00:53:06.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:06 smithi080 bash[17386]: cluster 2024-02-13T00:53:04.599432+0000 mgr.y (mgr.24461) 888 : cluster [DBG] pgmap v1362: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 900 B/s rd, 0 op/s 2024-02-13T00:53:06.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:06 smithi080 bash[24237]: cluster 2024-02-13T00:53:04.599432+0000 mgr.y (mgr.24461) 888 : cluster [DBG] pgmap v1362: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 900 B/s rd, 0 op/s 2024-02-13T00:53:08.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:08 smithi106 bash[18459]: cluster 2024-02-13T00:53:06.600194+0000 mgr.y (mgr.24461) 889 : cluster [DBG] pgmap v1363: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:08.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:08 smithi080 bash[17386]: cluster 2024-02-13T00:53:06.600194+0000 mgr.y (mgr.24461) 889 : cluster [DBG] pgmap v1363: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:08.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:08 smithi080 bash[24237]: cluster 2024-02-13T00:53:06.600194+0000 mgr.y (mgr.24461) 889 : cluster [DBG] pgmap v1363: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:09.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:53:08 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:53:10.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:53:10 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:53:10] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:53:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:10 smithi106 bash[18459]: cluster 2024-02-13T00:53:08.602092+0000 mgr.y (mgr.24461) 890 : cluster [DBG] pgmap v1364: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:53:10.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:10 smithi106 bash[18459]: audit 2024-02-13T00:53:08.979357+0000 mgr.y (mgr.24461) 891 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:53:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:10 smithi080 bash[17386]: cluster 2024-02-13T00:53:08.602092+0000 mgr.y (mgr.24461) 890 : cluster [DBG] pgmap v1364: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:53:10.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:10 smithi080 bash[17386]: audit 2024-02-13T00:53:08.979357+0000 mgr.y (mgr.24461) 891 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:53:10.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:10 smithi080 bash[24237]: cluster 2024-02-13T00:53:08.602092+0000 mgr.y (mgr.24461) 890 : cluster [DBG] pgmap v1364: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:53:10.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:10 smithi080 bash[24237]: audit 2024-02-13T00:53:08.979357+0000 mgr.y (mgr.24461) 891 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:53:12.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:12 smithi106 bash[18459]: cluster 2024-02-13T00:53:10.602834+0000 mgr.y (mgr.24461) 892 : cluster [DBG] pgmap v1365: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:12.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:12 smithi080 bash[24237]: cluster 2024-02-13T00:53:10.602834+0000 mgr.y (mgr.24461) 892 : cluster [DBG] pgmap v1365: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:12.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:12 smithi080 bash[17386]: cluster 2024-02-13T00:53:10.602834+0000 mgr.y (mgr.24461) 892 : cluster [DBG] pgmap v1365: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:13.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:53:13 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:53:13] "GET /metrics HTTP/1.1" 200 191535 "" "Prometheus/2.33.4" 2024-02-13T00:53:14.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:14 smithi106 bash[18459]: cluster 2024-02-13T00:53:12.603634+0000 mgr.y (mgr.24461) 893 : cluster [DBG] pgmap v1366: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:14.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:14 smithi080 bash[17386]: cluster 2024-02-13T00:53:12.603634+0000 mgr.y (mgr.24461) 893 : cluster [DBG] pgmap v1366: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:14.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:14 smithi080 bash[24237]: cluster 2024-02-13T00:53:12.603634+0000 mgr.y (mgr.24461) 893 : cluster [DBG] pgmap v1366: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:14.763 INFO:tasks.workunit.client.0.smithi080.stderr:+ rados -p 4a2d96c2-886f-4ac7-8042-11d5205396f8 put threemore /etc/passwd 2024-02-13T00:53:14.812 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph osd pool set-quota 4a2d96c2-886f-4ac7-8042-11d5205396f8 max_bytes 0 2024-02-13T00:53:14.914 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.905+0000 7f02ab557700 1 -- 172.21.15.80:0/2513544820 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02a40fd1b0 msgr2=0x7f02a40f6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:53:14.914 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.905+0000 7f02ab557700 1 --2- 172.21.15.80:0/2513544820 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02a40fd1b0 0x7f02a40f6a70 secure :-1 s=READY pgs=3062 cs=0 l=1 rev1=1 rx=0x7f02980048a0 tx=0x7f0298009cb0).stop 2024-02-13T00:53:14.914 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.905+0000 7f02ab557700 1 -- 172.21.15.80:0/2513544820 shutdown_connections 2024-02-13T00:53:14.914 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.905+0000 7f02ab557700 1 --2- 172.21.15.80:0/2513544820 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a40f7100 0x7f02a40f7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:14.914 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.905+0000 7f02ab557700 1 --2- 172.21.15.80:0/2513544820 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02a40fd1b0 0x7f02a40f6a70 unknown :-1 s=CLOSED pgs=3062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:14.914 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.905+0000 7f02ab557700 1 --2- 172.21.15.80:0/2513544820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02a40fc850 0x7f02a40fcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:14.914 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.905+0000 7f02ab557700 1 -- 172.21.15.80:0/2513544820 >> 172.21.15.80:0/2513544820 conn(0x7f02a406c740 msgr2=0x7f02a406cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:53:14.915 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.905+0000 7f02ab557700 1 -- 172.21.15.80:0/2513544820 shutdown_connections 2024-02-13T00:53:14.915 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.905+0000 7f02ab557700 1 -- 172.21.15.80:0/2513544820 wait complete. 2024-02-13T00:53:14.915 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02ab557700 1 Processor -- start 2024-02-13T00:53:14.915 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02ab557700 1 -- start start 2024-02-13T00:53:14.916 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02ab557700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02a40f7100 0x7f02a4108df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:53:14.916 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02ab557700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02a40fc850 0x7f02a41092e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:53:14.916 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02ab557700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a40fd1b0 0x7f02a41097d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:53:14.916 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02ab557700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a4113ea0 con 0x7f02a40fd1b0 2024-02-13T00:53:14.916 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02ab557700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a4114010 con 0x7f02a40f7100 2024-02-13T00:53:14.916 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02ab557700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a41141d0 con 0x7f02a40fc850 2024-02-13T00:53:14.916 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02a8af2700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02a40fc850 0x7f02a41092e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:53:14.916 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02a9af4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a40fd1b0 0x7f02a41097d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:53:14.917 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02a92f3700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02a40f7100 0x7f02a4108df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:53:14.917 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02a8af2700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02a40fc850 0x7f02a41092e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:43986/0 (socket says 172.21.15.80:43986) 2024-02-13T00:53:14.917 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02a9af4700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a40fd1b0 0x7f02a41097d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52362/0 (socket says 172.21.15.80:52362) 2024-02-13T00:53:14.917 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02a8af2700 1 -- 172.21.15.80:0/2220766246 learned_addr learned my addr 172.21.15.80:0/2220766246 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:53:14.918 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02a8af2700 1 -- 172.21.15.80:0/2220766246 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02a40f7100 msgr2=0x7f02a4108df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:53:14.918 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02a8af2700 1 --2- 172.21.15.80:0/2220766246 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02a40f7100 0x7f02a4108df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:14.918 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02a8af2700 1 -- 172.21.15.80:0/2220766246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a40fd1b0 msgr2=0x7f02a41097d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:53:14.918 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02a8af2700 1 --2- 172.21.15.80:0/2220766246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a40fd1b0 0x7f02a41097d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:14.918 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02a8af2700 1 -- 172.21.15.80:0/2220766246 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c0097c0 con 0x7f02a40fc850 2024-02-13T00:53:14.918 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02a9af4700 1 --2- 172.21.15.80:0/2220766246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a40fd1b0 0x7f02a41097d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:53:14.918 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02a92f3700 1 --2- 172.21.15.80:0/2220766246 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02a40f7100 0x7f02a4108df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:53:14.919 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02a8af2700 1 --2- 172.21.15.80:0/2220766246 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02a40fc850 0x7f02a41092e0 secure :-1 s=READY pgs=3063 cs=0 l=1 rev1=1 rx=0x7f0298004ed0 tx=0x7f0298009cb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:53:14.919 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02967fc700 1 -- 172.21.15.80:0/2220766246 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029800e070 con 0x7f02a40fc850 2024-02-13T00:53:14.919 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02967fc700 1 -- 172.21.15.80:0/2220766246 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f0298013d70 con 0x7f02a40fc850 2024-02-13T00:53:14.919 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02ab557700 1 -- 172.21.15.80:0/2220766246 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0298005040 con 0x7f02a40fc850 2024-02-13T00:53:14.919 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02967fc700 1 -- 172.21.15.80:0/2220766246 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298018070 con 0x7f02a40fc850 2024-02-13T00:53:14.919 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.909+0000 7f02ab557700 1 -- 172.21.15.80:0/2220766246 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a4114720 con 0x7f02a40fc850 2024-02-13T00:53:14.919 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.913+0000 7f02ab557700 1 -- 172.21.15.80:0/2220766246 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a405f540 con 0x7f02a40fc850 2024-02-13T00:53:14.919 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.913+0000 7f02967fc700 1 -- 172.21.15.80:0/2220766246 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f029801dc70 con 0x7f02a40fc850 2024-02-13T00:53:14.920 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.913+0000 7f02967fc700 1 --2- 172.21.15.80:0/2220766246 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f0290061340 0x7f0290063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:53:14.920 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.913+0000 7f02a92f3700 1 --2- 172.21.15.80:0/2220766246 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f0290061340 0x7f0290063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:53:14.920 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.913+0000 7f02967fc700 1 -- 172.21.15.80:0/2220766246 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(737..737 src has 1..737) v4 ==== 9207+0+0 (secure 0 0 0) 0x7f029807de80 con 0x7f02a40fc850 2024-02-13T00:53:14.921 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.913+0000 7f02967fc700 1 -- 172.21.15.80:0/2220766246 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=738}) v3 -- 0x7f029006d1d0 con 0x7f02a40fc850 2024-02-13T00:53:14.921 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.913+0000 7f02a92f3700 1 --2- 172.21.15.80:0/2220766246 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f0290061340 0x7f0290063800 secure :-1 s=READY pgs=3538 cs=0 l=1 rev1=1 rx=0x7f02a0007bf0 tx=0x7f02a000b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:53:14.928 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:14.921+0000 7f02967fc700 1 -- 172.21.15.80:0/2220766246 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f029804d520 con 0x7f02a40fc850 2024-02-13T00:53:15.082 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:15.073+0000 7f02ab557700 1 -- 172.21.15.80:0/2220766246 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7f02a405fae0 con 0x7f02a40fc850 2024-02-13T00:53:15.277 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:15.269+0000 7f02967fc700 1 -- 172.21.15.80:0/2220766246 <== mon.2 v2:172.21.15.80:3301/0 7 ==== osd_map(738..738 src has 1..738) v4 ==== 620+0+0 (secure 0 0 0) 0x7f0298051180 con 0x7f02a40fc850 2024-02-13T00:53:15.282 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:15.269+0000 7f02967fc700 1 -- 172.21.15.80:0/2220766246 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=739}) v3 -- 0x7f029006dec0 con 0x7f02a40fc850 2024-02-13T00:53:15.282 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:15.273+0000 7f02967fc700 1 -- 172.21.15.80:0/2220766246 <== mon.2 v2:172.21.15.80:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 4a2d96c2-886f-4ac7-8042-11d5205396f8 v738) v1 ==== 217+0+0 (secure 0 0 0) 0x7f0298022030 con 0x7f02a40fc850 2024-02-13T00:53:15.379 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:15.373+0000 7f02ab557700 1 -- 172.21.15.80:0/2220766246 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7f02a4105a80 con 0x7f02a40fc850 2024-02-13T00:53:15.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:15 smithi106 bash[18459]: audit 2024-02-13T00:53:15.080115+0000 mon.c (mon.2) 565 : audit [INF] from='client.? 172.21.15.80:0/2220766246' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T00:53:15.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:15 smithi106 bash[18459]: audit 2024-02-13T00:53:15.080889+0000 mon.a (mon.0) 3340 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T00:53:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:15 smithi080 bash[17386]: audit 2024-02-13T00:53:15.080115+0000 mon.c (mon.2) 565 : audit [INF] from='client.? 172.21.15.80:0/2220766246' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T00:53:15.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:15 smithi080 bash[17386]: audit 2024-02-13T00:53:15.080889+0000 mon.a (mon.0) 3340 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T00:53:15.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:15 smithi080 bash[24237]: audit 2024-02-13T00:53:15.080115+0000 mon.c (mon.2) 565 : audit [INF] from='client.? 172.21.15.80:0/2220766246' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T00:53:15.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:15 smithi080 bash[24237]: audit 2024-02-13T00:53:15.080889+0000 mon.a (mon.0) 3340 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T00:53:16.280 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.273+0000 7f02967fc700 1 -- 172.21.15.80:0/2220766246 <== mon.2 v2:172.21.15.80:3301/0 9 ==== osd_map(739..739 src has 1..739) v4 ==== 620+0+0 (secure 0 0 0) 0x7f029804f320 con 0x7f02a40fc850 2024-02-13T00:53:16.281 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.273+0000 7f02967fc700 1 -- 172.21.15.80:0/2220766246 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=740}) v3 -- 0x7f029006e390 con 0x7f02a40fc850 2024-02-13T00:53:16.287 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.281+0000 7f02967fc700 1 -- 172.21.15.80:0/2220766246 <== mon.2 v2:172.21.15.80:3301/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 4a2d96c2-886f-4ac7-8042-11d5205396f8 v739) v1 ==== 217+0+0 (secure 0 0 0) 0x7f0298063060 con 0x7f02a40fc850 2024-02-13T00:53:16.291 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.285+0000 7f02ab557700 1 -- 172.21.15.80:0/2220766246 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f0290061340 msgr2=0x7f0290063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:53:16.291 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.285+0000 7f02ab557700 1 --2- 172.21.15.80:0/2220766246 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f0290061340 0x7f0290063800 secure :-1 s=READY pgs=3538 cs=0 l=1 rev1=1 rx=0x7f02a0007bf0 tx=0x7f02a000b040).stop 2024-02-13T00:53:16.291 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.285+0000 7f02ab557700 1 -- 172.21.15.80:0/2220766246 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02a40fc850 msgr2=0x7f02a41092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:53:16.291 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.285+0000 7f02ab557700 1 --2- 172.21.15.80:0/2220766246 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02a40fc850 0x7f02a41092e0 secure :-1 s=READY pgs=3063 cs=0 l=1 rev1=1 rx=0x7f0298004ed0 tx=0x7f0298009cb0).stop 2024-02-13T00:53:16.292 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.285+0000 7f02ab557700 1 -- 172.21.15.80:0/2220766246 shutdown_connections 2024-02-13T00:53:16.292 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.285+0000 7f02ab557700 1 --2- 172.21.15.80:0/2220766246 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f0290061340 0x7f0290063800 unknown :-1 s=CLOSED pgs=3538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:16.292 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.285+0000 7f02ab557700 1 --2- 172.21.15.80:0/2220766246 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f02a40fd1b0 0x7f02a41097d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:16.293 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.285+0000 7f02ab557700 1 --2- 172.21.15.80:0/2220766246 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f02a40fc850 0x7f02a41092e0 unknown :-1 s=CLOSED pgs=3063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:16.293 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.285+0000 7f02ab557700 1 --2- 172.21.15.80:0/2220766246 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02a40f7100 0x7f02a4108df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:16.293 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.285+0000 7f02ab557700 1 -- 172.21.15.80:0/2220766246 >> 172.21.15.80:0/2220766246 conn(0x7f02a406c740 msgr2=0x7f02a40f5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:53:16.293 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.285+0000 7f02ab557700 1 -- 172.21.15.80:0/2220766246 shutdown_connections 2024-02-13T00:53:16.293 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.285+0000 7f02ab557700 1 -- 172.21.15.80:0/2220766246 wait complete. 2024-02-13T00:53:16.293 INFO:tasks.workunit.client.0.smithi080.stderr:set-quota max_bytes = 0 for pool 4a2d96c2-886f-4ac7-8042-11d5205396f8 2024-02-13T00:53:16.304 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph osd pool set-quota 4a2d96c2-886f-4ac7-8042-11d5205396f8 max_objects 0 2024-02-13T00:53:16.404 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559c325700 1 -- 172.21.15.80:0/1261739202 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5594100440 msgr2=0x7f55940f9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:53:16.404 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559c325700 1 --2- 172.21.15.80:0/1261739202 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5594100440 0x7f55940f9c90 secure :-1 s=READY pgs=3064 cs=0 l=1 rev1=1 rx=0x7f55840047b0 tx=0x7f5584009cb0).stop 2024-02-13T00:53:16.404 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559c325700 1 -- 172.21.15.80:0/1261739202 shutdown_connections 2024-02-13T00:53:16.404 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559c325700 1 --2- 172.21.15.80:0/1261739202 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55940fa370 0x7f5594106970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:16.405 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559c325700 1 --2- 172.21.15.80:0/1261739202 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5594100440 0x7f55940f9c90 unknown :-1 s=CLOSED pgs=3064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:16.405 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559c325700 1 --2- 172.21.15.80:0/1261739202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55940ffae0 0x7f55940ffec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:16.405 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559c325700 1 -- 172.21.15.80:0/1261739202 >> 172.21.15.80:0/1261739202 conn(0x7f55940f5790 msgr2=0x7f55940f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:53:16.405 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559c325700 1 -- 172.21.15.80:0/1261739202 shutdown_connections 2024-02-13T00:53:16.405 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559c325700 1 -- 172.21.15.80:0/1261739202 wait complete. 2024-02-13T00:53:16.405 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559c325700 1 Processor -- start 2024-02-13T00:53:16.405 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559c325700 1 -- start start 2024-02-13T00:53:16.405 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559c325700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55940fa370 0x7f559410fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:53:16.406 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559c325700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55940ffae0 0x7f5594110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:53:16.406 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559c325700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5594100440 0x7f5594109f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:53:16.406 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559c325700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559410a450 con 0x7f55940fa370 2024-02-13T00:53:16.406 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559c325700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559410a5c0 con 0x7f55940ffae0 2024-02-13T00:53:16.406 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559c325700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559410a780 con 0x7f5594100440 2024-02-13T00:53:16.406 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559a0c1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55940fa370 0x7f559410fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:53:16.406 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559a0c1700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55940fa370 0x7f559410fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3300/0 says I am v2:172.21.15.80:52376/0 (socket says 172.21.15.80:52376) 2024-02-13T00:53:16.406 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559a0c1700 1 -- 172.21.15.80:0/3644840018 learned_addr learned my addr 172.21.15.80:0/3644840018 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:53:16.407 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559a8c2700 1 --2- 172.21.15.80:0/3644840018 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5594100440 0x7f5594109f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:53:16.407 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f55998c0700 1 --2- 172.21.15.80:0/3644840018 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55940ffae0 0x7f5594110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:53:16.407 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f55998c0700 1 -- 172.21.15.80:0/3644840018 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5594100440 msgr2=0x7f5594109f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:53:16.407 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f55998c0700 1 --2- 172.21.15.80:0/3644840018 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5594100440 0x7f5594109f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:16.407 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f55998c0700 1 -- 172.21.15.80:0/3644840018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55940fa370 msgr2=0x7f559410fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:53:16.407 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f55998c0700 1 --2- 172.21.15.80:0/3644840018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55940fa370 0x7f559410fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:16.407 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f55998c0700 1 -- 172.21.15.80:0/3644840018 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558c0097c0 con 0x7f55940ffae0 2024-02-13T00:53:16.408 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559a0c1700 1 --2- 172.21.15.80:0/3644840018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55940fa370 0x7f559410fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-13T00:53:16.408 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f55998c0700 1 --2- 172.21.15.80:0/3644840018 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55940ffae0 0x7f5594110290 secure :-1 s=READY pgs=3501 cs=0 l=1 rev1=1 rx=0x7f55840047b0 tx=0x7f5584009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:53:16.408 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f558b7fe700 1 -- 172.21.15.80:0/3644840018 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5584018070 con 0x7f55940ffae0 2024-02-13T00:53:16.408 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f558b7fe700 1 -- 172.21.15.80:0/3644840018 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f5584013df0 con 0x7f55940ffae0 2024-02-13T00:53:16.408 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f558b7fe700 1 -- 172.21.15.80:0/3644840018 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558401d9e0 con 0x7f55940ffae0 2024-02-13T00:53:16.408 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559c325700 1 -- 172.21.15.80:0/3644840018 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5584005040 con 0x7f55940ffae0 2024-02-13T00:53:16.408 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.393+0000 7f559c325700 1 -- 172.21.15.80:0/3644840018 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559410ac20 con 0x7f55940ffae0 2024-02-13T00:53:16.410 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.397+0000 7f559c325700 1 -- 172.21.15.80:0/3644840018 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559410ae10 con 0x7f55940ffae0 2024-02-13T00:53:16.410 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.397+0000 7f558b7fe700 1 -- 172.21.15.80:0/3644840018 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f5584027440 con 0x7f55940ffae0 2024-02-13T00:53:16.410 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.397+0000 7f558b7fe700 1 --2- 172.21.15.80:0/3644840018 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5580061340 0x7f5580063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:53:16.410 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.397+0000 7f558b7fe700 1 -- 172.21.15.80:0/3644840018 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(739..739 src has 1..739) v4 ==== 9207+0+0 (secure 0 0 0) 0x7f558407e8a0 con 0x7f55940ffae0 2024-02-13T00:53:16.411 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.397+0000 7f559a0c1700 1 --2- 172.21.15.80:0/3644840018 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5580061340 0x7f5580063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:53:16.411 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.397+0000 7f558b7fe700 1 -- 172.21.15.80:0/3644840018 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=740}) v3 -- 0x7f558006d1d0 con 0x7f55940ffae0 2024-02-13T00:53:16.411 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.397+0000 7f559a0c1700 1 --2- 172.21.15.80:0/3644840018 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5580061340 0x7f5580063800 secure :-1 s=READY pgs=3539 cs=0 l=1 rev1=1 rx=0x7f5590004fd0 tx=0x7f559000b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:53:16.415 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.409+0000 7f558b7fe700 1 -- 172.21.15.80:0/3644840018 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f558404dee0 con 0x7f55940ffae0 2024-02-13T00:53:16.577 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:16.569+0000 7f559c325700 1 -- 172.21.15.80:0/3644840018 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f559405f540 con 0x7f55940ffae0 2024-02-13T00:53:16.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:16 smithi106 bash[18459]: cluster 2024-02-13T00:53:14.605738+0000 mgr.y (mgr.24461) 894 : cluster [DBG] pgmap v1367: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:53:16.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:16 smithi106 bash[18459]: audit 2024-02-13T00:53:15.277958+0000 mon.a (mon.0) 3341 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T00:53:16.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:16 smithi106 bash[18459]: cluster 2024-02-13T00:53:15.278089+0000 mon.a (mon.0) 3342 : cluster [DBG] osdmap e738: 8 total, 8 up, 8 in 2024-02-13T00:53:16.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:16 smithi106 bash[18459]: audit 2024-02-13T00:53:15.377478+0000 mon.c (mon.2) 566 : audit [INF] from='client.? 172.21.15.80:0/2220766246' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T00:53:16.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:16 smithi106 bash[18459]: audit 2024-02-13T00:53:15.378199+0000 mon.a (mon.0) 3343 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T00:53:16.757 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:16 smithi106 bash[18459]: audit 2024-02-13T00:53:16.194022+0000 mon.c (mon.2) 567 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:53:16.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:16 smithi080 bash[17386]: cluster 2024-02-13T00:53:14.605738+0000 mgr.y (mgr.24461) 894 : cluster [DBG] pgmap v1367: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:53:16.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:16 smithi080 bash[17386]: audit 2024-02-13T00:53:15.277958+0000 mon.a (mon.0) 3341 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T00:53:16.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:16 smithi080 bash[17386]: cluster 2024-02-13T00:53:15.278089+0000 mon.a (mon.0) 3342 : cluster [DBG] osdmap e738: 8 total, 8 up, 8 in 2024-02-13T00:53:16.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:16 smithi080 bash[17386]: audit 2024-02-13T00:53:15.377478+0000 mon.c (mon.2) 566 : audit [INF] from='client.? 172.21.15.80:0/2220766246' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T00:53:16.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:16 smithi080 bash[17386]: audit 2024-02-13T00:53:15.378199+0000 mon.a (mon.0) 3343 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T00:53:16.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:16 smithi080 bash[17386]: audit 2024-02-13T00:53:16.194022+0000 mon.c (mon.2) 567 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:53:16.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:16 smithi080 bash[24237]: cluster 2024-02-13T00:53:14.605738+0000 mgr.y (mgr.24461) 894 : cluster [DBG] pgmap v1367: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:53:16.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:16 smithi080 bash[24237]: audit 2024-02-13T00:53:15.277958+0000 mon.a (mon.0) 3341 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T00:53:16.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:16 smithi080 bash[24237]: cluster 2024-02-13T00:53:15.278089+0000 mon.a (mon.0) 3342 : cluster [DBG] osdmap e738: 8 total, 8 up, 8 in 2024-02-13T00:53:16.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:16 smithi080 bash[24237]: audit 2024-02-13T00:53:15.377478+0000 mon.c (mon.2) 566 : audit [INF] from='client.? 172.21.15.80:0/2220766246' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T00:53:16.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:16 smithi080 bash[24237]: audit 2024-02-13T00:53:15.378199+0000 mon.a (mon.0) 3343 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T00:53:16.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:16 smithi080 bash[24237]: audit 2024-02-13T00:53:16.194022+0000 mon.c (mon.2) 567 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T00:53:17.479 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:17.473+0000 7f558b7fe700 1 -- 172.21.15.80:0/3644840018 <== mon.1 v2:172.21.15.106:3300/0 7 ==== osd_map(740..740 src has 1..740) v4 ==== 620+0+0 (secure 0 0 0) 0x7f558401be20 con 0x7f55940ffae0 2024-02-13T00:53:17.479 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:17.473+0000 7f558b7fe700 1 -- 172.21.15.80:0/3644840018 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=741}) v3 -- 0x7f558006df10 con 0x7f55940ffae0 2024-02-13T00:53:17.481 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:17.473+0000 7f558b7fe700 1 -- 172.21.15.80:0/3644840018 <== mon.1 v2:172.21.15.106:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 4a2d96c2-886f-4ac7-8042-11d5205396f8 v740) v1 ==== 221+0+0 (secure 0 0 0) 0x7f558400f270 con 0x7f55940ffae0 2024-02-13T00:53:17.581 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:17.573+0000 7f559c325700 1 -- 172.21.15.80:0/3644840018 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f5594108e10 con 0x7f55940ffae0 2024-02-13T00:53:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:17 smithi106 bash[18459]: audit 2024-02-13T00:53:16.281518+0000 mon.a (mon.0) 3344 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T00:53:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:17 smithi106 bash[18459]: cluster 2024-02-13T00:53:16.281632+0000 mon.a (mon.0) 3345 : cluster [DBG] osdmap e739: 8 total, 8 up, 8 in 2024-02-13T00:53:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:17 smithi106 bash[18459]: audit 2024-02-13T00:53:16.468136+0000 mon.a (mon.0) 3346 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:53:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:17 smithi106 bash[18459]: audit 2024-02-13T00:53:16.575548+0000 mon.b (mon.1) 90 : audit [INF] from='client.? 172.21.15.80:0/3644840018' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:53:17.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:17 smithi106 bash[18459]: audit 2024-02-13T00:53:16.575947+0000 mon.a (mon.0) 3347 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:53:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:17 smithi080 bash[17386]: audit 2024-02-13T00:53:16.281518+0000 mon.a (mon.0) 3344 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T00:53:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:17 smithi080 bash[17386]: cluster 2024-02-13T00:53:16.281632+0000 mon.a (mon.0) 3345 : cluster [DBG] osdmap e739: 8 total, 8 up, 8 in 2024-02-13T00:53:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:17 smithi080 bash[17386]: audit 2024-02-13T00:53:16.468136+0000 mon.a (mon.0) 3346 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:53:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:17 smithi080 bash[17386]: audit 2024-02-13T00:53:16.575548+0000 mon.b (mon.1) 90 : audit [INF] from='client.? 172.21.15.80:0/3644840018' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:53:17.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:17 smithi080 bash[17386]: audit 2024-02-13T00:53:16.575947+0000 mon.a (mon.0) 3347 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:53:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:17 smithi080 bash[24237]: audit 2024-02-13T00:53:16.281518+0000 mon.a (mon.0) 3344 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T00:53:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:17 smithi080 bash[24237]: cluster 2024-02-13T00:53:16.281632+0000 mon.a (mon.0) 3345 : cluster [DBG] osdmap e739: 8 total, 8 up, 8 in 2024-02-13T00:53:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:17 smithi080 bash[24237]: audit 2024-02-13T00:53:16.468136+0000 mon.a (mon.0) 3346 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:53:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:17 smithi080 bash[24237]: audit 2024-02-13T00:53:16.575548+0000 mon.b (mon.1) 90 : audit [INF] from='client.? 172.21.15.80:0/3644840018' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:53:17.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:17 smithi080 bash[24237]: audit 2024-02-13T00:53:16.575947+0000 mon.a (mon.0) 3347 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:53:18.479 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:18.473+0000 7f558b7fe700 1 -- 172.21.15.80:0/3644840018 <== mon.1 v2:172.21.15.106:3300/0 9 ==== osd_map(741..741 src has 1..741) v4 ==== 620+0+0 (secure 0 0 0) 0x7f5584051b40 con 0x7f55940ffae0 2024-02-13T00:53:18.479 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:18.473+0000 7f558b7fe700 1 -- 172.21.15.80:0/3644840018 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=742}) v3 -- 0x7f558006e3e0 con 0x7f55940ffae0 2024-02-13T00:53:18.485 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:18.477+0000 7f558b7fe700 1 -- 172.21.15.80:0/3644840018 <== mon.1 v2:172.21.15.106:3300/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 4a2d96c2-886f-4ac7-8042-11d5205396f8 v741) v1 ==== 221+0+0 (secure 0 0 0) 0x7f5584051500 con 0x7f55940ffae0 2024-02-13T00:53:18.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:18.481+0000 7f559c325700 1 -- 172.21.15.80:0/3644840018 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5580061340 msgr2=0x7f5580063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:53:18.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:18.481+0000 7f559c325700 1 --2- 172.21.15.80:0/3644840018 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5580061340 0x7f5580063800 secure :-1 s=READY pgs=3539 cs=0 l=1 rev1=1 rx=0x7f5590004fd0 tx=0x7f559000b040).stop 2024-02-13T00:53:18.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:18.481+0000 7f559c325700 1 -- 172.21.15.80:0/3644840018 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55940ffae0 msgr2=0x7f5594110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:53:18.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:18.481+0000 7f559c325700 1 --2- 172.21.15.80:0/3644840018 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55940ffae0 0x7f5594110290 secure :-1 s=READY pgs=3501 cs=0 l=1 rev1=1 rx=0x7f55840047b0 tx=0x7f5584009cb0).stop 2024-02-13T00:53:18.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:18.481+0000 7f559c325700 1 -- 172.21.15.80:0/3644840018 shutdown_connections 2024-02-13T00:53:18.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:18.481+0000 7f559c325700 1 --2- 172.21.15.80:0/3644840018 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f5580061340 0x7f5580063800 secure :-1 s=CLOSED pgs=3539 cs=0 l=1 rev1=1 rx=0x7f5590004fd0 tx=0x7f559000b040).stop 2024-02-13T00:53:18.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:18.481+0000 7f559c325700 1 --2- 172.21.15.80:0/3644840018 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f5594100440 0x7f5594109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:18.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:18.481+0000 7f559c325700 1 --2- 172.21.15.80:0/3644840018 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55940ffae0 0x7f5594110290 unknown :-1 s=CLOSED pgs=3501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:18.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:18.481+0000 7f559c325700 1 --2- 172.21.15.80:0/3644840018 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f55940fa370 0x7f559410fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:18.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:18.481+0000 7f559c325700 1 -- 172.21.15.80:0/3644840018 >> 172.21.15.80:0/3644840018 conn(0x7f55940f5790 msgr2=0x7f55940fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:53:18.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:18.481+0000 7f559c325700 1 -- 172.21.15.80:0/3644840018 shutdown_connections 2024-02-13T00:53:18.490 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:18.481+0000 7f559c325700 1 -- 172.21.15.80:0/3644840018 wait complete. 2024-02-13T00:53:18.491 INFO:tasks.workunit.client.0.smithi080.stderr:set-quota max_objects = 0 for pool 4a2d96c2-886f-4ac7-8042-11d5205396f8 2024-02-13T00:53:18.501 INFO:tasks.workunit.client.0.smithi080.stderr:+ sleep 30 2024-02-13T00:53:18.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:18 smithi106 bash[18459]: cluster 2024-02-13T00:53:16.606545+0000 mgr.y (mgr.24461) 895 : cluster [DBG] pgmap v1370: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:53:18.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:18 smithi106 bash[18459]: audit 2024-02-13T00:53:17.477503+0000 mon.a (mon.0) 3348 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]': finished 2024-02-13T00:53:18.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:18 smithi106 bash[18459]: cluster 2024-02-13T00:53:17.477610+0000 mon.a (mon.0) 3349 : cluster [DBG] osdmap e740: 8 total, 8 up, 8 in 2024-02-13T00:53:18.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:18 smithi106 bash[18459]: audit 2024-02-13T00:53:17.579546+0000 mon.b (mon.1) 91 : audit [INF] from='client.? 172.21.15.80:0/3644840018' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:53:18.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:18 smithi106 bash[18459]: audit 2024-02-13T00:53:17.580027+0000 mon.a (mon.0) 3350 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:53:18.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:18 smithi080 bash[17386]: cluster 2024-02-13T00:53:16.606545+0000 mgr.y (mgr.24461) 895 : cluster [DBG] pgmap v1370: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:53:18.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:18 smithi080 bash[17386]: audit 2024-02-13T00:53:17.477503+0000 mon.a (mon.0) 3348 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]': finished 2024-02-13T00:53:18.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:18 smithi080 bash[17386]: cluster 2024-02-13T00:53:17.477610+0000 mon.a (mon.0) 3349 : cluster [DBG] osdmap e740: 8 total, 8 up, 8 in 2024-02-13T00:53:18.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:18 smithi080 bash[17386]: audit 2024-02-13T00:53:17.579546+0000 mon.b (mon.1) 91 : audit [INF] from='client.? 172.21.15.80:0/3644840018' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:53:18.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:18 smithi080 bash[17386]: audit 2024-02-13T00:53:17.580027+0000 mon.a (mon.0) 3350 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:53:18.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:18 smithi080 bash[24237]: cluster 2024-02-13T00:53:16.606545+0000 mgr.y (mgr.24461) 895 : cluster [DBG] pgmap v1370: 188 pgs: 188 active+clean; 287 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T00:53:18.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:18 smithi080 bash[24237]: audit 2024-02-13T00:53:17.477503+0000 mon.a (mon.0) 3348 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]': finished 2024-02-13T00:53:18.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:18 smithi080 bash[24237]: cluster 2024-02-13T00:53:17.477610+0000 mon.a (mon.0) 3349 : cluster [DBG] osdmap e740: 8 total, 8 up, 8 in 2024-02-13T00:53:18.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:18 smithi080 bash[24237]: audit 2024-02-13T00:53:17.579546+0000 mon.b (mon.1) 91 : audit [INF] from='client.? 172.21.15.80:0/3644840018' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:53:18.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:18 smithi080 bash[24237]: audit 2024-02-13T00:53:17.580027+0000 mon.a (mon.0) 3350 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T00:53:19.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:53:18 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:53:19.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:19 smithi106 bash[18459]: audit 2024-02-13T00:53:18.482271+0000 mon.a (mon.0) 3351 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]': finished 2024-02-13T00:53:19.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:19 smithi106 bash[18459]: cluster 2024-02-13T00:53:18.482423+0000 mon.a (mon.0) 3352 : cluster [DBG] osdmap e741: 8 total, 8 up, 8 in 2024-02-13T00:53:19.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:19 smithi106 bash[18459]: cluster 2024-02-13T00:53:18.607468+0000 mgr.y (mgr.24461) 896 : cluster [DBG] pgmap v1373: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 1 op/s 2024-02-13T00:53:19.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:19 smithi106 bash[18459]: audit 2024-02-13T00:53:18.989546+0000 mgr.y (mgr.24461) 897 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:53:19.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:19 smithi080 bash[17386]: audit 2024-02-13T00:53:18.482271+0000 mon.a (mon.0) 3351 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]': finished 2024-02-13T00:53:19.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:19 smithi080 bash[17386]: cluster 2024-02-13T00:53:18.482423+0000 mon.a (mon.0) 3352 : cluster [DBG] osdmap e741: 8 total, 8 up, 8 in 2024-02-13T00:53:19.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:19 smithi080 bash[17386]: cluster 2024-02-13T00:53:18.607468+0000 mgr.y (mgr.24461) 896 : cluster [DBG] pgmap v1373: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 1 op/s 2024-02-13T00:53:19.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:19 smithi080 bash[17386]: audit 2024-02-13T00:53:18.989546+0000 mgr.y (mgr.24461) 897 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:53:19.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:19 smithi080 bash[24237]: audit 2024-02-13T00:53:18.482271+0000 mon.a (mon.0) 3351 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "field": "max_objects", "val": "0"}]': finished 2024-02-13T00:53:19.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:19 smithi080 bash[24237]: cluster 2024-02-13T00:53:18.482423+0000 mon.a (mon.0) 3352 : cluster [DBG] osdmap e741: 8 total, 8 up, 8 in 2024-02-13T00:53:19.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:19 smithi080 bash[24237]: cluster 2024-02-13T00:53:18.607468+0000 mgr.y (mgr.24461) 896 : cluster [DBG] pgmap v1373: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 1 op/s 2024-02-13T00:53:19.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:19 smithi080 bash[24237]: audit 2024-02-13T00:53:18.989546+0000 mgr.y (mgr.24461) 897 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:53:20.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:53:20 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:53:20] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:53:22.005 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:21 smithi106 bash[18459]: cluster 2024-02-13T00:53:20.608470+0000 mgr.y (mgr.24461) 898 : cluster [DBG] pgmap v1374: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 960 B/s rd, 2.2 KiB/s wr, 1 op/s 2024-02-13T00:53:22.008 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:21 smithi080 bash[24237]: cluster 2024-02-13T00:53:20.608470+0000 mgr.y (mgr.24461) 898 : cluster [DBG] pgmap v1374: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 960 B/s rd, 2.2 KiB/s wr, 1 op/s 2024-02-13T00:53:22.008 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:21 smithi080 bash[17386]: cluster 2024-02-13T00:53:20.608470+0000 mgr.y (mgr.24461) 898 : cluster [DBG] pgmap v1374: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 960 B/s rd, 2.2 KiB/s wr, 1 op/s 2024-02-13T00:53:23.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:23 smithi106 bash[18459]: audit 2024-02-13T00:53:22.231960+0000 mon.a (mon.0) 3353 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:53:23.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:23 smithi106 bash[18459]: audit 2024-02-13T00:53:22.500117+0000 mon.c (mon.2) 568 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:53:23.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:23 smithi106 bash[18459]: audit 2024-02-13T00:53:22.502225+0000 mon.c (mon.2) 569 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:53:23.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:23 smithi106 bash[18459]: audit 2024-02-13T00:53:22.512183+0000 mon.a (mon.0) 3354 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:53:23.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:53:23 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:53:23] "GET /metrics HTTP/1.1" 200 191546 "" "Prometheus/2.33.4" 2024-02-13T00:53:23.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:23 smithi080 bash[17386]: audit 2024-02-13T00:53:22.231960+0000 mon.a (mon.0) 3353 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:53:23.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:23 smithi080 bash[17386]: audit 2024-02-13T00:53:22.500117+0000 mon.c (mon.2) 568 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:53:23.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:23 smithi080 bash[17386]: audit 2024-02-13T00:53:22.502225+0000 mon.c (mon.2) 569 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:53:23.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:23 smithi080 bash[17386]: audit 2024-02-13T00:53:22.512183+0000 mon.a (mon.0) 3354 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:53:23.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:23 smithi080 bash[24237]: audit 2024-02-13T00:53:22.231960+0000 mon.a (mon.0) 3353 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:53:23.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:23 smithi080 bash[24237]: audit 2024-02-13T00:53:22.500117+0000 mon.c (mon.2) 568 : audit [DBG] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T00:53:23.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:23 smithi080 bash[24237]: audit 2024-02-13T00:53:22.502225+0000 mon.c (mon.2) 569 : audit [INF] from='mgr.24461 172.21.15.80:0/2972082178' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T00:53:23.509 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:23 smithi080 bash[24237]: audit 2024-02-13T00:53:22.512183+0000 mon.a (mon.0) 3354 : audit [INF] from='mgr.24461 ' entity='mgr.y' 2024-02-13T00:53:24.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:24 smithi106 bash[18459]: cluster 2024-02-13T00:53:22.609294+0000 mgr.y (mgr.24461) 899 : cluster [DBG] pgmap v1375: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 808 B/s rd, 1.9 KiB/s wr, 0 op/s 2024-02-13T00:53:24.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:24 smithi080 bash[17386]: cluster 2024-02-13T00:53:22.609294+0000 mgr.y (mgr.24461) 899 : cluster [DBG] pgmap v1375: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 808 B/s rd, 1.9 KiB/s wr, 0 op/s 2024-02-13T00:53:24.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:24 smithi080 bash[24237]: cluster 2024-02-13T00:53:22.609294+0000 mgr.y (mgr.24461) 899 : cluster [DBG] pgmap v1375: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 808 B/s rd, 1.9 KiB/s wr, 0 op/s 2024-02-13T00:53:26.505 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:26 smithi106 bash[18459]: cluster 2024-02-13T00:53:24.611254+0000 mgr.y (mgr.24461) 900 : cluster [DBG] pgmap v1376: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-02-13T00:53:26.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:26 smithi080 bash[17386]: cluster 2024-02-13T00:53:24.611254+0000 mgr.y (mgr.24461) 900 : cluster [DBG] pgmap v1376: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-02-13T00:53:26.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:26 smithi080 bash[24237]: cluster 2024-02-13T00:53:24.611254+0000 mgr.y (mgr.24461) 900 : cluster [DBG] pgmap v1376: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-02-13T00:53:28.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:28 smithi080 bash[17386]: cluster 2024-02-13T00:53:26.612053+0000 mgr.y (mgr.24461) 901 : cluster [DBG] pgmap v1377: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 1 op/s 2024-02-13T00:53:28.508 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:28 smithi080 bash[24237]: cluster 2024-02-13T00:53:26.612053+0000 mgr.y (mgr.24461) 901 : cluster [DBG] pgmap v1377: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 1 op/s 2024-02-13T00:53:28.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:28 smithi106 bash[18459]: cluster 2024-02-13T00:53:26.612053+0000 mgr.y (mgr.24461) 901 : cluster [DBG] pgmap v1377: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 1 op/s 2024-02-13T00:53:29.255 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:53:28 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:53:30.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:53:30 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:53:30] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:53:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:30 smithi106 bash[18459]: cluster 2024-02-13T00:53:28.613930+0000 mgr.y (mgr.24461) 902 : cluster [DBG] pgmap v1378: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1011 B/s rd, 0 op/s 2024-02-13T00:53:30.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:30 smithi106 bash[18459]: audit 2024-02-13T00:53:28.997697+0000 mgr.y (mgr.24461) 903 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:53:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:30 smithi080 bash[17386]: cluster 2024-02-13T00:53:28.613930+0000 mgr.y (mgr.24461) 902 : cluster [DBG] pgmap v1378: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1011 B/s rd, 0 op/s 2024-02-13T00:53:30.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:30 smithi080 bash[17386]: audit 2024-02-13T00:53:28.997697+0000 mgr.y (mgr.24461) 903 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:53:30.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:30 smithi080 bash[24237]: cluster 2024-02-13T00:53:28.613930+0000 mgr.y (mgr.24461) 902 : cluster [DBG] pgmap v1378: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1011 B/s rd, 0 op/s 2024-02-13T00:53:30.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:30 smithi080 bash[24237]: audit 2024-02-13T00:53:28.997697+0000 mgr.y (mgr.24461) 903 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:53:32.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:32 smithi106 bash[18459]: cluster 2024-02-13T00:53:30.614662+0000 mgr.y (mgr.24461) 904 : cluster [DBG] pgmap v1379: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:32.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:32 smithi080 bash[17386]: cluster 2024-02-13T00:53:30.614662+0000 mgr.y (mgr.24461) 904 : cluster [DBG] pgmap v1379: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:32.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:32 smithi080 bash[24237]: cluster 2024-02-13T00:53:30.614662+0000 mgr.y (mgr.24461) 904 : cluster [DBG] pgmap v1379: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:33.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:53:33 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:53:33] "GET /metrics HTTP/1.1" 200 191550 "" "Prometheus/2.33.4" 2024-02-13T00:53:34.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:34 smithi106 bash[18459]: cluster 2024-02-13T00:53:32.615466+0000 mgr.y (mgr.24461) 905 : cluster [DBG] pgmap v1380: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:34.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:34 smithi080 bash[17386]: cluster 2024-02-13T00:53:32.615466+0000 mgr.y (mgr.24461) 905 : cluster [DBG] pgmap v1380: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:34.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:34 smithi080 bash[24237]: cluster 2024-02-13T00:53:32.615466+0000 mgr.y (mgr.24461) 905 : cluster [DBG] pgmap v1380: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:36.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:36 smithi106 bash[18459]: cluster 2024-02-13T00:53:34.617493+0000 mgr.y (mgr.24461) 906 : cluster [DBG] pgmap v1381: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:53:36.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:36 smithi080 bash[17386]: cluster 2024-02-13T00:53:34.617493+0000 mgr.y (mgr.24461) 906 : cluster [DBG] pgmap v1381: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:53:36.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:36 smithi080 bash[24237]: cluster 2024-02-13T00:53:34.617493+0000 mgr.y (mgr.24461) 906 : cluster [DBG] pgmap v1381: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:53:38.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:38 smithi106 bash[18459]: cluster 2024-02-13T00:53:36.618290+0000 mgr.y (mgr.24461) 907 : cluster [DBG] pgmap v1382: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:38.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:38 smithi080 bash[17386]: cluster 2024-02-13T00:53:36.618290+0000 mgr.y (mgr.24461) 907 : cluster [DBG] pgmap v1382: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:38.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:38 smithi080 bash[24237]: cluster 2024-02-13T00:53:36.618290+0000 mgr.y (mgr.24461) 907 : cluster [DBG] pgmap v1382: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:39.505 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:53:39 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:53:40.506 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:53:40 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:53:40] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:53:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:40 smithi106 bash[18459]: cluster 2024-02-13T00:53:38.620247+0000 mgr.y (mgr.24461) 908 : cluster [DBG] pgmap v1383: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:53:40.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:40 smithi106 bash[18459]: audit 2024-02-13T00:53:39.005125+0000 mgr.y (mgr.24461) 909 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:53:40.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:40 smithi080 bash[17386]: cluster 2024-02-13T00:53:38.620247+0000 mgr.y (mgr.24461) 908 : cluster [DBG] pgmap v1383: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:53:40.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:40 smithi080 bash[17386]: audit 2024-02-13T00:53:39.005125+0000 mgr.y (mgr.24461) 909 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:53:40.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:40 smithi080 bash[24237]: cluster 2024-02-13T00:53:38.620247+0000 mgr.y (mgr.24461) 908 : cluster [DBG] pgmap v1383: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:53:40.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:40 smithi080 bash[24237]: audit 2024-02-13T00:53:39.005125+0000 mgr.y (mgr.24461) 909 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:53:42.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:42 smithi106 bash[18459]: cluster 2024-02-13T00:53:40.621039+0000 mgr.y (mgr.24461) 910 : cluster [DBG] pgmap v1384: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:42.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:42 smithi080 bash[17386]: cluster 2024-02-13T00:53:40.621039+0000 mgr.y (mgr.24461) 910 : cluster [DBG] pgmap v1384: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:42.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:42 smithi080 bash[24237]: cluster 2024-02-13T00:53:40.621039+0000 mgr.y (mgr.24461) 910 : cluster [DBG] pgmap v1384: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:43.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:53:43 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:53:43] "GET /metrics HTTP/1.1" 200 191550 "" "Prometheus/2.33.4" 2024-02-13T00:53:44.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:44 smithi106 bash[18459]: cluster 2024-02-13T00:53:42.621845+0000 mgr.y (mgr.24461) 911 : cluster [DBG] pgmap v1385: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:44.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:44 smithi080 bash[17386]: cluster 2024-02-13T00:53:42.621845+0000 mgr.y (mgr.24461) 911 : cluster [DBG] pgmap v1385: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:44.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:44 smithi080 bash[24237]: cluster 2024-02-13T00:53:42.621845+0000 mgr.y (mgr.24461) 911 : cluster [DBG] pgmap v1385: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:46.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:46 smithi106 bash[18459]: cluster 2024-02-13T00:53:44.623795+0000 mgr.y (mgr.24461) 912 : cluster [DBG] pgmap v1386: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:53:46.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:46 smithi080 bash[17386]: cluster 2024-02-13T00:53:44.623795+0000 mgr.y (mgr.24461) 912 : cluster [DBG] pgmap v1386: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:53:46.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:46 smithi080 bash[24237]: cluster 2024-02-13T00:53:44.623795+0000 mgr.y (mgr.24461) 912 : cluster [DBG] pgmap v1386: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:53:48.502 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph osd pool delete 4a2d96c2-886f-4ac7-8042-11d5205396f8 4a2d96c2-886f-4ac7-8042-11d5205396f8 --yes-i-really-really-mean-it 2024-02-13T00:53:48.608 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9ba1321700 1 -- 172.21.15.80:0/2647652821 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b9c0fcf80 msgr2=0x7f9b9c0f6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:53:48.608 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9ba1321700 1 --2- 172.21.15.80:0/2647652821 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b9c0fcf80 0x7f9b9c0f6780 secure :-1 s=READY pgs=3065 cs=0 l=1 rev1=1 rx=0x7f9b8c0047b0 tx=0x7f9b8c009cb0).stop 2024-02-13T00:53:48.608 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9ba1321700 1 -- 172.21.15.80:0/2647652821 shutdown_connections 2024-02-13T00:53:48.608 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9ba1321700 1 --2- 172.21.15.80:0/2647652821 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b9c0f6e60 0x7f9b9c103460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:48.608 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9ba1321700 1 --2- 172.21.15.80:0/2647652821 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b9c0fcf80 0x7f9b9c0f6780 unknown :-1 s=CLOSED pgs=3065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:48.608 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9ba1321700 1 --2- 172.21.15.80:0/2647652821 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b9c0fc620 0x7f9b9c0fca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:48.608 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9ba1321700 1 -- 172.21.15.80:0/2647652821 >> 172.21.15.80:0/2647652821 conn(0x7f9b9c06e640 msgr2=0x7f9b9c0f48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:53:48.608 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9ba1321700 1 -- 172.21.15.80:0/2647652821 shutdown_connections 2024-02-13T00:53:48.608 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9ba1321700 1 -- 172.21.15.80:0/2647652821 wait complete. 2024-02-13T00:53:48.610 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9ba1321700 1 Processor -- start 2024-02-13T00:53:48.610 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9ba1321700 1 -- start start 2024-02-13T00:53:48.610 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9ba1321700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b9c0f6e60 0x7f9b9c108b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:53:48.610 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9ba1321700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b9c0fc620 0x7f9b9c109050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:53:48.610 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9ba1321700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b9c0fcf80 0x7f9b9c109580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:53:48.610 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9ba1321700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c113cb0 con 0x7f9b9c0fcf80 2024-02-13T00:53:48.610 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9ba1321700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c113e20 con 0x7f9b9c0f6e60 2024-02-13T00:53:48.610 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9ba1321700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c113fe0 con 0x7f9b9c0fc620 2024-02-13T00:53:48.610 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9b9a7fc700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b9c0fc620 0x7f9b9c109050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:53:48.610 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9b9b7fe700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b9c0fcf80 0x7f9b9c109580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:53:48.610 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9b9a7fc700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b9c0fc620 0x7f9b9c109050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:45382/0 (socket says 172.21.15.80:45382) 2024-02-13T00:53:48.610 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9b9a7fc700 1 -- 172.21.15.80:0/2826604771 learned_addr learned my addr 172.21.15.80:0/2826604771 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:53:48.610 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9b9affd700 1 --2- 172.21.15.80:0/2826604771 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b9c0f6e60 0x7f9b9c108b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:53:48.611 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9b9a7fc700 1 -- 172.21.15.80:0/2826604771 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b9c0f6e60 msgr2=0x7f9b9c108b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:53:48.612 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9b9a7fc700 1 --2- 172.21.15.80:0/2826604771 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b9c0f6e60 0x7f9b9c108b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:48.612 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9b9a7fc700 1 -- 172.21.15.80:0/2826604771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b9c0fcf80 msgr2=0x7f9b9c109580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:53:48.612 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9b9a7fc700 1 --2- 172.21.15.80:0/2826604771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b9c0fcf80 0x7f9b9c109580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:48.612 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9b9a7fc700 1 -- 172.21.15.80:0/2826604771 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b90005040 con 0x7f9b9c0fc620 2024-02-13T00:53:48.612 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.601+0000 7f9b9a7fc700 1 --2- 172.21.15.80:0/2826604771 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b9c0fc620 0x7f9b9c109050 secure :-1 s=READY pgs=3066 cs=0 l=1 rev1=1 rx=0x7f9b8c004650 tx=0x7f9b8c00b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:53:48.612 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.605+0000 7f9b83fff700 1 -- 172.21.15.80:0/2826604771 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c019070 con 0x7f9b9c0fc620 2024-02-13T00:53:48.612 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.605+0000 7f9b83fff700 1 -- 172.21.15.80:0/2826604771 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f9b8c013bc0 con 0x7f9b9c0fc620 2024-02-13T00:53:48.612 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.605+0000 7f9b83fff700 1 -- 172.21.15.80:0/2826604771 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c01e910 con 0x7f9b9c0fc620 2024-02-13T00:53:48.612 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.605+0000 7f9ba1321700 1 -- 172.21.15.80:0/2826604771 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8c005040 con 0x7f9b9c0fc620 2024-02-13T00:53:48.612 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.605+0000 7f9ba1321700 1 -- 172.21.15.80:0/2826604771 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9c1144e0 con 0x7f9b9c0fc620 2024-02-13T00:53:48.613 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.605+0000 7f9ba1321700 1 -- 172.21.15.80:0/2826604771 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9c060470 con 0x7f9b9c0fc620 2024-02-13T00:53:48.613 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.605+0000 7f9b83fff700 1 -- 172.21.15.80:0/2826604771 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f9b8c013730 con 0x7f9b9c0fc620 2024-02-13T00:53:48.613 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.605+0000 7f9b83fff700 1 --2- 172.21.15.80:0/2826604771 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f9b84061340 0x7f9b84063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:53:48.613 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.605+0000 7f9b83fff700 1 -- 172.21.15.80:0/2826604771 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(741..741 src has 1..741) v4 ==== 9207+0+0 (secure 0 0 0) 0x7f9b8c07e140 con 0x7f9b9c0fc620 2024-02-13T00:53:48.613 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.605+0000 7f9b9affd700 1 --2- 172.21.15.80:0/2826604771 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f9b84061340 0x7f9b84063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:53:48.614 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.605+0000 7f9b83fff700 1 -- 172.21.15.80:0/2826604771 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=742}) v3 -- 0x7f9b8406d150 con 0x7f9b9c0fc620 2024-02-13T00:53:48.614 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.605+0000 7f9b9affd700 1 --2- 172.21.15.80:0/2826604771 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f9b84061340 0x7f9b84063800 secure :-1 s=READY pgs=3540 cs=0 l=1 rev1=1 rx=0x7f9b90004870 tx=0x7f9b9000b040).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:53:48.621 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.613+0000 7f9b83fff700 1 -- 172.21.15.80:0/2826604771 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9b8c04d810 con 0x7f9b9c0fc620 2024-02-13T00:53:48.755 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:48 smithi106 bash[18459]: cluster 2024-02-13T00:53:46.624625+0000 mgr.y (mgr.24461) 913 : cluster [DBG] pgmap v1387: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:48.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:48 smithi080 bash[17386]: cluster 2024-02-13T00:53:46.624625+0000 mgr.y (mgr.24461) 913 : cluster [DBG] pgmap v1387: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:48.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:48 smithi080 bash[24237]: cluster 2024-02-13T00:53:46.624625+0000 mgr.y (mgr.24461) 913 : cluster [DBG] pgmap v1387: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T00:53:48.775 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:48.769+0000 7f9ba1321700 1 -- 172.21.15.80:0/2826604771 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pool2": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9b9c1058b0 con 0x7f9b9c0fc620 2024-02-13T00:53:49.318 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:53:49 smithi106 bash[39366]: debug there is no tcmu-runner data available 2024-02-13T00:53:49.327 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.321+0000 7f9b83fff700 1 -- 172.21.15.80:0/2826604771 <== mon.2 v2:172.21.15.80:3301/0 7 ==== osd_map(742..742 src has 1..742) v4 ==== 288+0+0 (secure 0 0 0) 0x7f9b8c0139e0 con 0x7f9b9c0fc620 2024-02-13T00:53:49.327 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.321+0000 7f9b83fff700 1 -- 172.21.15.80:0/2826604771 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=743}) v3 -- 0x7f9b8406db90 con 0x7f9b9c0fc620 2024-02-13T00:53:49.334 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.325+0000 7f9b83fff700 1 -- 172.21.15.80:0/2826604771 <== mon.2 v2:172.21.15.80:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pool2": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "yes_i_really_really_mean_it": true}]=0 pool '4a2d96c2-886f-4ac7-8042-11d5205396f8' removed v742) v1 ==== 248+0+0 (secure 0 0 0) 0x7f9b8c023030 con 0x7f9b9c0fc620 2024-02-13T00:53:49.429 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.421+0000 7f9ba1321700 1 -- 172.21.15.80:0/2826604771 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pool2": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9b9c0fe9f0 con 0x7f9b9c0fc620 2024-02-13T00:53:49.431 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.425+0000 7f9b83fff700 1 -- 172.21.15.80:0/2826604771 <== mon.2 v2:172.21.15.80:3301/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pool2": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "yes_i_really_really_mean_it": true}]=0 pool '4a2d96c2-886f-4ac7-8042-11d5205396f8' does not exist v742) v1 ==== 255+0+0 (secure 0 0 0) 0x7f9b8c023070 con 0x7f9b9c0fc620 2024-02-13T00:53:49.434 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.425+0000 7f9ba1321700 1 -- 172.21.15.80:0/2826604771 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f9b84061340 msgr2=0x7f9b84063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:53:49.434 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.425+0000 7f9ba1321700 1 --2- 172.21.15.80:0/2826604771 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f9b84061340 0x7f9b84063800 secure :-1 s=READY pgs=3540 cs=0 l=1 rev1=1 rx=0x7f9b90004870 tx=0x7f9b9000b040).stop 2024-02-13T00:53:49.434 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.425+0000 7f9ba1321700 1 -- 172.21.15.80:0/2826604771 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b9c0fc620 msgr2=0x7f9b9c109050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:53:49.434 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.425+0000 7f9ba1321700 1 --2- 172.21.15.80:0/2826604771 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b9c0fc620 0x7f9b9c109050 secure :-1 s=READY pgs=3066 cs=0 l=1 rev1=1 rx=0x7f9b8c004650 tx=0x7f9b8c00b040).stop 2024-02-13T00:53:49.434 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.425+0000 7f9ba1321700 1 -- 172.21.15.80:0/2826604771 shutdown_connections 2024-02-13T00:53:49.434 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.425+0000 7f9ba1321700 1 --2- 172.21.15.80:0/2826604771 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f9b84061340 0x7f9b84063800 unknown :-1 s=CLOSED pgs=3540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:49.434 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.425+0000 7f9ba1321700 1 --2- 172.21.15.80:0/2826604771 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f9b9c0fcf80 0x7f9b9c109580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:49.434 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.425+0000 7f9ba1321700 1 --2- 172.21.15.80:0/2826604771 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f9b9c0fc620 0x7f9b9c109050 unknown :-1 s=CLOSED pgs=3066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:49.434 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.425+0000 7f9ba1321700 1 --2- 172.21.15.80:0/2826604771 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b9c0f6e60 0x7f9b9c108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:49.434 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.425+0000 7f9ba1321700 1 -- 172.21.15.80:0/2826604771 >> 172.21.15.80:0/2826604771 conn(0x7f9b9c06e640 msgr2=0x7f9b9c0fa380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:53:49.434 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.425+0000 7f9ba1321700 1 -- 172.21.15.80:0/2826604771 shutdown_connections 2024-02-13T00:53:49.434 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.425+0000 7f9ba1321700 1 -- 172.21.15.80:0/2826604771 wait complete. 2024-02-13T00:53:49.435 INFO:tasks.workunit.client.0.smithi080.stderr:pool '4a2d96c2-886f-4ac7-8042-11d5205396f8' does not exist 2024-02-13T00:53:49.444 INFO:tasks.workunit.client.0.smithi080.stderr:+ ceph osd pool delete 202352ae-8764-48cf-9bc7-8298889ef897 202352ae-8764-48cf-9bc7-8298889ef897 --yes-i-really-really-mean-it 2024-02-13T00:53:49.539 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.529+0000 7f74bdb0f700 1 -- 172.21.15.80:0/1194015861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b80fc6c0 msgr2=0x7f74b80f5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:53:49.539 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.529+0000 7f74bdb0f700 1 --2- 172.21.15.80:0/1194015861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b80fc6c0 0x7f74b80f5f10 secure :-1 s=READY pgs=2504 cs=0 l=1 rev1=1 rx=0x7f74ac004870 tx=0x7f74ac009cb0).stop 2024-02-13T00:53:49.539 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74bdb0f700 1 -- 172.21.15.80:0/1194015861 shutdown_connections 2024-02-13T00:53:49.539 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74bdb0f700 1 --2- 172.21.15.80:0/1194015861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74b80f65f0 0x7f74b8102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:49.539 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74bdb0f700 1 --2- 172.21.15.80:0/1194015861 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b80fc6c0 0x7f74b80f5f10 unknown :-1 s=CLOSED pgs=2504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:49.539 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74bdb0f700 1 --2- 172.21.15.80:0/1194015861 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74b80fbd60 0x7f74b80fc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:49.539 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74bdb0f700 1 -- 172.21.15.80:0/1194015861 >> 172.21.15.80:0/1194015861 conn(0x7f74b806fc20 msgr2=0x7f74b80f3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:53:49.539 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74bdb0f700 1 -- 172.21.15.80:0/1194015861 shutdown_connections 2024-02-13T00:53:49.539 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74bdb0f700 1 -- 172.21.15.80:0/1194015861 wait complete. 2024-02-13T00:53:49.540 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74bdb0f700 1 Processor -- start 2024-02-13T00:53:49.540 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74bdb0f700 1 -- start start 2024-02-13T00:53:49.542 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74bdb0f700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74b80f65f0 0x7f74b810c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:53:49.542 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74bdb0f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74b80fbd60 0x7f74b810ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:53:49.542 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74bdb0f700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b80fc6c0 0x7f74b8106af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:53:49.542 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74bdb0f700 1 -- --> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b8106fe0 con 0x7f74b80fc6c0 2024-02-13T00:53:49.542 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74bdb0f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b8107150 con 0x7f74b80fbd60 2024-02-13T00:53:49.542 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74bdb0f700 1 -- --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b8107310 con 0x7f74b80f65f0 2024-02-13T00:53:49.543 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74b77fe700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74b80f65f0 0x7f74b810c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:53:49.543 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74b77fe700 1 --2- >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74b80f65f0 0x7f74b810c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.80:3301/0 says I am v2:172.21.15.80:43410/0 (socket says 172.21.15.80:43410) 2024-02-13T00:53:49.543 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74b7fff700 1 --2- >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b80fc6c0 0x7f74b8106af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:53:49.543 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74b77fe700 1 -- 172.21.15.80:0/1719773176 learned_addr learned my addr 172.21.15.80:0/1719773176 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-02-13T00:53:49.543 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74b6ffd700 1 --2- 172.21.15.80:0/1719773176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74b80fbd60 0x7f74b810ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:53:49.543 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74b77fe700 1 -- 172.21.15.80:0/1719773176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74b80fbd60 msgr2=0x7f74b810ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:53:49.543 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74b77fe700 1 --2- 172.21.15.80:0/1719773176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74b80fbd60 0x7f74b810ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:49.543 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74b77fe700 1 -- 172.21.15.80:0/1719773176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b80fc6c0 msgr2=0x7f74b8106af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:53:49.543 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74b77fe700 1 --2- 172.21.15.80:0/1719773176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b80fc6c0 0x7f74b8106af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:49.543 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74b77fe700 1 -- 172.21.15.80:0/1719773176 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac005040 con 0x7f74b80f65f0 2024-02-13T00:53:49.543 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74b77fe700 1 --2- 172.21.15.80:0/1719773176 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74b80f65f0 0x7f74b810c930 secure :-1 s=READY pgs=3067 cs=0 l=1 rev1=1 rx=0x7f74a800e970 tx=0x7f74a800b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:53:49.543 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74b4ff9700 1 -- 172.21.15.80:0/1719773176 <== mon.2 v2:172.21.15.80:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a800ee60 con 0x7f74b80f65f0 2024-02-13T00:53:49.543 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74bdb0f700 1 -- 172.21.15.80:0/1719773176 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b81075f0 con 0x7f74b80f65f0 2024-02-13T00:53:49.543 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74b4ff9700 1 -- 172.21.15.80:0/1719773176 <== mon.2 v2:172.21.15.80:3301/0 2 ==== config(23 keys) v1 ==== 1041+0+0 (secure 0 0 0) 0x7f74a800f040 con 0x7f74b80f65f0 2024-02-13T00:53:49.543 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74b4ff9700 1 -- 172.21.15.80:0/1719773176 <== mon.2 v2:172.21.15.80:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a800c5b0 con 0x7f74b80f65f0 2024-02-13T00:53:49.543 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.533+0000 7f74bdb0f700 1 -- 172.21.15.80:0/1719773176 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b81138f0 con 0x7f74b80f65f0 2024-02-13T00:53:49.544 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.537+0000 7f74bdb0f700 1 -- 172.21.15.80:0/1719773176 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b805fc90 con 0x7f74b80f65f0 2024-02-13T00:53:49.544 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.537+0000 7f74b4ff9700 1 -- 172.21.15.80:0/1719773176 <== mon.2 v2:172.21.15.80:3301/0 4 ==== mgrmap(e 19) v1 ==== 77121+0+0 (secure 0 0 0) 0x7f74a8007b40 con 0x7f74b80f65f0 2024-02-13T00:53:49.544 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.537+0000 7f74b4ff9700 1 --2- 172.21.15.80:0/1719773176 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f74a0061340 0x7f74a0063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-13T00:53:49.545 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.537+0000 7f74b4ff9700 1 -- 172.21.15.80:0/1719773176 <== mon.2 v2:172.21.15.80:3301/0 5 ==== osd_map(742..742 src has 1..742) v4 ==== 8819+0+0 (secure 0 0 0) 0x7f74a807d190 con 0x7f74b80f65f0 2024-02-13T00:53:49.545 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.537+0000 7f74b4ff9700 1 -- 172.21.15.80:0/1719773176 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=743}) v3 -- 0x7f74a006c930 con 0x7f74b80f65f0 2024-02-13T00:53:49.545 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.537+0000 7f74b6ffd700 1 --2- 172.21.15.80:0/1719773176 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f74a0061340 0x7f74a0063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-13T00:53:49.545 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.537+0000 7f74b6ffd700 1 --2- 172.21.15.80:0/1719773176 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f74a0061340 0x7f74a0063800 secure :-1 s=READY pgs=3541 cs=0 l=1 rev1=1 rx=0x7f74ac004ee0 tx=0x7f74ac009cb0).ready entity=mgr.24461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-13T00:53:49.553 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.545+0000 7f74b4ff9700 1 -- 172.21.15.80:0/1719773176 <== mon.2 v2:172.21.15.80:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f74a8019070 con 0x7f74b80f65f0 2024-02-13T00:53:49.708 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:49.701+0000 7f74bdb0f700 1 -- 172.21.15.80:0/1719773176 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pool2": "202352ae-8764-48cf-9bc7-8298889ef897", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f74b8107fd0 con 0x7f74b80f65f0 2024-02-13T00:53:49.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:49 smithi106 bash[18459]: audit 2024-02-13T00:53:48.773358+0000 mon.c (mon.2) 570 : audit [INF] from='client.? 172.21.15.80:0/2826604771' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pool2": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:53:49.756 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:49 smithi106 bash[18459]: audit 2024-02-13T00:53:48.774181+0000 mon.a (mon.0) 3355 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pool2": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:53:49.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:49 smithi080 bash[17386]: audit 2024-02-13T00:53:48.773358+0000 mon.c (mon.2) 570 : audit [INF] from='client.? 172.21.15.80:0/2826604771' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pool2": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:53:49.758 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:49 smithi080 bash[17386]: audit 2024-02-13T00:53:48.774181+0000 mon.a (mon.0) 3355 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pool2": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:53:49.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:49 smithi080 bash[24237]: audit 2024-02-13T00:53:48.773358+0000 mon.c (mon.2) 570 : audit [INF] from='client.? 172.21.15.80:0/2826604771' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pool2": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:53:49.758 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:49 smithi080 bash[24237]: audit 2024-02-13T00:53:48.774181+0000 mon.a (mon.0) 3355 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pool2": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:53:50.344 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:50.337+0000 7f74b4ff9700 1 -- 172.21.15.80:0/1719773176 <== mon.2 v2:172.21.15.80:3301/0 7 ==== osd_map(743..743 src has 1..743) v4 ==== 288+0+0 (secure 0 0 0) 0x7f74a8055e20 con 0x7f74b80f65f0 2024-02-13T00:53:50.344 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:50.337+0000 7f74b4ff9700 1 -- 172.21.15.80:0/1719773176 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_subscribe({osdmap=744}) v3 -- 0x7f74a006d2c0 con 0x7f74b80f65f0 2024-02-13T00:53:50.354 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:50.345+0000 7f74b4ff9700 1 -- 172.21.15.80:0/1719773176 <== mon.2 v2:172.21.15.80:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pool2": "202352ae-8764-48cf-9bc7-8298889ef897", "yes_i_really_really_mean_it": true}]=0 pool '202352ae-8764-48cf-9bc7-8298889ef897' removed v743) v1 ==== 248+0+0 (secure 0 0 0) 0x7f74a80503b0 con 0x7f74b80f65f0 2024-02-13T00:53:50.447 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:50.441+0000 7f74bdb0f700 1 -- 172.21.15.80:0/1719773176 --> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pool2": "202352ae-8764-48cf-9bc7-8298889ef897", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f74b8105910 con 0x7f74b80f65f0 2024-02-13T00:53:50.449 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:50.441+0000 7f74b4ff9700 1 -- 172.21.15.80:0/1719773176 <== mon.2 v2:172.21.15.80:3301/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pool2": "202352ae-8764-48cf-9bc7-8298889ef897", "yes_i_really_really_mean_it": true}]=0 pool '202352ae-8764-48cf-9bc7-8298889ef897' does not exist v743) v1 ==== 255+0+0 (secure 0 0 0) 0x7f74a8059020 con 0x7f74b80f65f0 2024-02-13T00:53:50.451 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:50.445+0000 7f74bdb0f700 1 -- 172.21.15.80:0/1719773176 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f74a0061340 msgr2=0x7f74a0063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:53:50.451 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:50.445+0000 7f74bdb0f700 1 --2- 172.21.15.80:0/1719773176 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f74a0061340 0x7f74a0063800 secure :-1 s=READY pgs=3541 cs=0 l=1 rev1=1 rx=0x7f74ac004ee0 tx=0x7f74ac009cb0).stop 2024-02-13T00:53:50.451 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:50.445+0000 7f74bdb0f700 1 -- 172.21.15.80:0/1719773176 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74b80f65f0 msgr2=0x7f74b810c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T00:53:50.451 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:50.445+0000 7f74bdb0f700 1 --2- 172.21.15.80:0/1719773176 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74b80f65f0 0x7f74b810c930 secure :-1 s=READY pgs=3067 cs=0 l=1 rev1=1 rx=0x7f74a800e970 tx=0x7f74a800b040).stop 2024-02-13T00:53:50.452 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:50.445+0000 7f74bdb0f700 1 -- 172.21.15.80:0/1719773176 shutdown_connections 2024-02-13T00:53:50.452 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:50.445+0000 7f74bdb0f700 1 --2- 172.21.15.80:0/1719773176 >> [v2:172.21.15.80:6800/2955905243,v1:172.21.15.80:6801/2955905243] conn(0x7f74a0061340 0x7f74a0063800 unknown :-1 s=CLOSED pgs=3541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:50.452 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:50.445+0000 7f74bdb0f700 1 --2- 172.21.15.80:0/1719773176 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x7f74b80fc6c0 0x7f74b8106af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:50.452 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:50.445+0000 7f74bdb0f700 1 --2- 172.21.15.80:0/1719773176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74b80fbd60 0x7f74b810ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:50.452 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:50.445+0000 7f74bdb0f700 1 --2- 172.21.15.80:0/1719773176 >> [v2:172.21.15.80:3301/0,v1:172.21.15.80:6790/0] conn(0x7f74b80f65f0 0x7f74b810c930 unknown :-1 s=CLOSED pgs=3067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-13T00:53:50.452 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:50.445+0000 7f74bdb0f700 1 -- 172.21.15.80:0/1719773176 >> 172.21.15.80:0/1719773176 conn(0x7f74b806fc20 msgr2=0x7f74b806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T00:53:50.452 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:50.445+0000 7f74bdb0f700 1 -- 172.21.15.80:0/1719773176 shutdown_connections 2024-02-13T00:53:50.452 INFO:tasks.workunit.client.0.smithi080.stderr:2024-02-13T00:53:50.445+0000 7f74bdb0f700 1 -- 172.21.15.80:0/1719773176 wait complete. 2024-02-13T00:53:50.452 INFO:tasks.workunit.client.0.smithi080.stderr:pool '202352ae-8764-48cf-9bc7-8298889ef897' does not exist 2024-02-13T00:53:50.461 INFO:tasks.workunit.client.0.smithi080.stderr:+ echo OK 2024-02-13T00:53:50.462 INFO:tasks.workunit.client.0.smithi080.stdout:OK 2024-02-13T00:53:50.462 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-13T00:53:50.462 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-13T00:53:50.477 INFO:tasks.workunit:Stopping ['rados/test.sh', 'rados/test_pool_quota.sh'] on client.0... 2024-02-13T00:53:50.478 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-13T00:53:50.505 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:53:50 smithi106 bash[19299]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:53:50] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-02-13T00:53:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:50 smithi106 bash[18459]: cluster 2024-02-13T00:53:48.625822+0000 mgr.y (mgr.24461) 914 : cluster [DBG] pgmap v1388: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:53:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:50 smithi106 bash[18459]: audit 2024-02-13T00:53:49.013661+0000 mgr.y (mgr.24461) 915 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:53:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:50 smithi106 bash[18459]: audit 2024-02-13T00:53:49.326647+0000 mon.a (mon.0) 3356 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pool2": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "yes_i_really_really_mean_it": true}]': finished 2024-02-13T00:53:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:50 smithi106 bash[18459]: cluster 2024-02-13T00:53:49.326747+0000 mon.a (mon.0) 3357 : cluster [DBG] osdmap e742: 8 total, 8 up, 8 in 2024-02-13T00:53:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:50 smithi106 bash[18459]: audit 2024-02-13T00:53:49.427255+0000 mon.c (mon.2) 571 : audit [INF] from='client.? 172.21.15.80:0/2826604771' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pool2": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:53:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:50 smithi106 bash[18459]: audit 2024-02-13T00:53:49.427902+0000 mon.a (mon.0) 3358 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pool2": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:53:50.506 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:50 smithi106 bash[18459]: audit 2024-02-13T00:53:49.706719+0000 mon.c (mon.2) 572 : audit [INF] from='client.? 172.21.15.80:0/1719773176' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pool2": "202352ae-8764-48cf-9bc7-8298889ef897", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:53:50.507 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:50 smithi106 bash[18459]: audit 2024-02-13T00:53:49.707487+0000 mon.a (mon.0) 3359 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pool2": "202352ae-8764-48cf-9bc7-8298889ef897", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:53:50.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:50 smithi080 bash[17386]: cluster 2024-02-13T00:53:48.625822+0000 mgr.y (mgr.24461) 914 : cluster [DBG] pgmap v1388: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:53:50.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:50 smithi080 bash[17386]: audit 2024-02-13T00:53:49.013661+0000 mgr.y (mgr.24461) 915 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:53:50.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:50 smithi080 bash[17386]: audit 2024-02-13T00:53:49.326647+0000 mon.a (mon.0) 3356 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pool2": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "yes_i_really_really_mean_it": true}]': finished 2024-02-13T00:53:50.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:50 smithi080 bash[17386]: cluster 2024-02-13T00:53:49.326747+0000 mon.a (mon.0) 3357 : cluster [DBG] osdmap e742: 8 total, 8 up, 8 in 2024-02-13T00:53:50.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:50 smithi080 bash[17386]: audit 2024-02-13T00:53:49.427255+0000 mon.c (mon.2) 571 : audit [INF] from='client.? 172.21.15.80:0/2826604771' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pool2": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:53:50.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:50 smithi080 bash[17386]: audit 2024-02-13T00:53:49.427902+0000 mon.a (mon.0) 3358 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pool2": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:53:50.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:50 smithi080 bash[17386]: audit 2024-02-13T00:53:49.706719+0000 mon.c (mon.2) 572 : audit [INF] from='client.? 172.21.15.80:0/1719773176' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pool2": "202352ae-8764-48cf-9bc7-8298889ef897", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:53:50.759 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:50 smithi080 bash[17386]: audit 2024-02-13T00:53:49.707487+0000 mon.a (mon.0) 3359 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pool2": "202352ae-8764-48cf-9bc7-8298889ef897", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:53:50.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:50 smithi080 bash[24237]: cluster 2024-02-13T00:53:48.625822+0000 mgr.y (mgr.24461) 914 : cluster [DBG] pgmap v1388: 188 pgs: 188 active+clean; 299 KiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T00:53:50.759 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:50 smithi080 bash[24237]: audit 2024-02-13T00:53:49.013661+0000 mgr.y (mgr.24461) 915 : audit [DBG] from='client.24436 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T00:53:50.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:50 smithi080 bash[24237]: audit 2024-02-13T00:53:49.326647+0000 mon.a (mon.0) 3356 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pool2": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "yes_i_really_really_mean_it": true}]': finished 2024-02-13T00:53:50.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:50 smithi080 bash[24237]: cluster 2024-02-13T00:53:49.326747+0000 mon.a (mon.0) 3357 : cluster [DBG] osdmap e742: 8 total, 8 up, 8 in 2024-02-13T00:53:50.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:50 smithi080 bash[24237]: audit 2024-02-13T00:53:49.427255+0000 mon.c (mon.2) 571 : audit [INF] from='client.? 172.21.15.80:0/2826604771' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pool2": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:53:50.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:50 smithi080 bash[24237]: audit 2024-02-13T00:53:49.427902+0000 mon.a (mon.0) 3358 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "pool2": "4a2d96c2-886f-4ac7-8042-11d5205396f8", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:53:50.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:50 smithi080 bash[24237]: audit 2024-02-13T00:53:49.706719+0000 mon.c (mon.2) 572 : audit [INF] from='client.? 172.21.15.80:0/1719773176' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pool2": "202352ae-8764-48cf-9bc7-8298889ef897", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:53:50.760 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:50 smithi080 bash[24237]: audit 2024-02-13T00:53:49.707487+0000 mon.a (mon.0) 3359 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "202352ae-8764-48cf-9bc7-8298889ef897", "pool2": "202352ae-8764-48cf-9bc7-8298889ef897", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T00:53:50.813 DEBUG:teuthology.parallel:result is None 2024-02-13T00:53:50.814 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-13T00:53:50.829 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-13T00:53:50.829 DEBUG:teuthology.orchestra.run.smithi080:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-02-13T00:53:50.911 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-02-13T00:53:50.912 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-13T00:53:50.922 INFO:tasks.cephadm:Teardown begin 2024-02-13T00:53:50.922 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-13T00:53:50.969 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-13T00:53:50.986 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-13T00:53:50.986 DEBUG:teuthology.orchestra.run.smithi080:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-13T00:53:51.016 DEBUG:teuthology.orchestra.run.smithi106:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-13T00:53:51.037 INFO:tasks.cephadm:Stopping all daemons... 2024-02-13T00:53:51.038 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-02-13T00:53:51.038 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@mon.a 2024-02-13T00:53:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:51 smithi080 systemd[1]: Stopping Ceph mon.a for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:53:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:51 smithi080 bash[121799]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-mon.a 2024-02-13T00:53:51.508 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:51 smithi080 bash[17386]: debug 2024-02-13T00:53:51.281+0000 7f9ba3a22700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-13T00:53:51.509 INFO:journalctl@ceph.mon.a.smithi080.stdout:Feb 13 00:53:51 smithi080 bash[17386]: debug 2024-02-13T00:53:51.281+0000 7f9ba3a22700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-02-13T00:53:52.544 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@mon.a.service' 2024-02-13T00:53:52.577 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T00:53:52.577 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-02-13T00:53:52.578 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-02-13T00:53:52.578 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@mon.c 2024-02-13T00:53:52.921 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:53:52 smithi080 bash[17652]: [13/Feb/2024:00:53:52] ENGINE Bus STOPPING 2024-02-13T00:53:52.922 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:53:52 smithi080 bash[17652]: [13/Feb/2024:00:53:52] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-13T00:53:52.922 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:53:52 smithi080 bash[17652]: [13/Feb/2024:00:53:52] ENGINE Bus STOPPED 2024-02-13T00:53:52.922 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:53:52 smithi080 bash[17652]: [13/Feb/2024:00:53:52] ENGINE Bus STARTING 2024-02-13T00:53:52.922 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:52 smithi080 systemd[1]: Stopping Ceph mon.c for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:53:52.922 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:52 smithi080 bash[121912]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-mon.c 2024-02-13T00:53:52.922 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:52 smithi080 bash[24237]: debug 2024-02-13T00:53:52.785+0000 7f5738419700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-13T00:53:52.922 INFO:journalctl@ceph.mon.c.smithi080.stdout:Feb 13 00:53:52 smithi080 bash[24237]: debug 2024-02-13T00:53:52.785+0000 7f5738419700 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-02-13T00:53:53.258 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:53:52 smithi080 bash[17652]: [13/Feb/2024:00:53:52] ENGINE Serving on http://:::9283 2024-02-13T00:53:53.258 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:53:52 smithi080 bash[17652]: [13/Feb/2024:00:53:52] ENGINE Bus STARTED 2024-02-13T00:53:53.258 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:53:53 smithi080 bash[17652]: ::ffff:172.21.15.106 - - [13/Feb/2024:00:53:53] "GET /metrics HTTP/1.1" 200 191556 "" "Prometheus/2.33.4" 2024-02-13T00:53:53.871 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@mon.c.service' 2024-02-13T00:53:53.904 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T00:53:53.904 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-02-13T00:53:53.904 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-02-13T00:53:53.904 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@mon.b 2024-02-13T00:53:54.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:53 smithi106 systemd[1]: Stopping Ceph mon.b for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:53:54.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:53 smithi106 bash[44650]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-mon.b 2024-02-13T00:53:54.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:54 smithi106 bash[18459]: debug 2024-02-13T00:53:54.101+0000 7f25ef595700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-13T00:53:54.256 INFO:journalctl@ceph.mon.b.smithi106.stdout:Feb 13 00:53:54 smithi106 bash[18459]: debug 2024-02-13T00:53:54.101+0000 7f25ef595700 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-02-13T00:53:55.198 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@mon.b.service' 2024-02-13T00:53:55.237 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T00:53:55.237 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-02-13T00:53:55.237 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-02-13T00:53:55.238 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@mgr.y 2024-02-13T00:53:55.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:53:55 smithi080 systemd[1]: Stopping Ceph mgr.y for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:53:55.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:53:55 smithi080 bash[122037]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-mgr.y 2024-02-13T00:53:55.508 INFO:journalctl@ceph.mgr.y.smithi080.stdout:Feb 13 00:53:55 smithi080 bash[17652]: debug 2024-02-13T00:53:55.437+0000 7f16a949f700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-13T00:53:56.299 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@mgr.y.service' 2024-02-13T00:53:56.329 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T00:53:56.329 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-02-13T00:53:56.329 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-02-13T00:53:56.329 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@mgr.x 2024-02-13T00:53:56.602 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:53:56 smithi106 systemd[1]: Stopping Ceph mgr.x for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:53:56.602 INFO:journalctl@ceph.mgr.x.smithi106.stdout:Feb 13 00:53:56 smithi106 bash[44768]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-mgr.x 2024-02-13T00:53:57.361 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@mgr.x.service' 2024-02-13T00:53:57.389 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T00:53:57.390 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-02-13T00:53:57.390 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-13T00:53:57.390 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.0 2024-02-13T00:53:57.758 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 13 00:53:57 smithi080 systemd[1]: Stopping Ceph osd.0 for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:53:57.758 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 13 00:53:57 smithi080 bash[122149]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd.0 2024-02-13T00:53:57.758 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 13 00:53:57 smithi080 bash[27380]: debug 2024-02-13T00:53:57.572+0000 7fc7bfb4e700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-13T00:53:57.758 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 13 00:53:57 smithi080 bash[27380]: debug 2024-02-13T00:53:57.572+0000 7fc7bfb4e700 -1 osd.0 743 *** Got signal Terminated *** 2024-02-13T00:53:57.758 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 13 00:53:57 smithi080 bash[27380]: debug 2024-02-13T00:53:57.572+0000 7fc7bfb4e700 -1 osd.0 743 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-13T00:54:03.542 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 13 00:54:03 smithi080 bash[122184]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd-0 2024-02-13T00:54:03.542 INFO:journalctl@ceph.osd.0.smithi080.stdout:Feb 13 00:54:03 smithi080 bash[122252]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd-0 2024-02-13T00:54:04.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:03 smithi080 bash[48089]: level=warn ts=2024-02-13T00:54:03.599Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:54:04.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:03 smithi080 bash[48089]: level=warn ts=2024-02-13T00:54:03.600Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:54:05.693 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.0.service' 2024-02-13T00:54:05.724 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T00:54:05.724 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-13T00:54:05.724 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-13T00:54:05.725 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.1 2024-02-13T00:54:05.940 INFO:journalctl@ceph.osd.1.smithi080.stdout:Feb 13 00:54:05 smithi080 systemd[1]: Stopping Ceph osd.1 for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:54:05.940 INFO:journalctl@ceph.osd.1.smithi080.stdout:Feb 13 00:54:05 smithi080 bash[122369]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd.1 2024-02-13T00:54:06.258 INFO:journalctl@ceph.osd.1.smithi080.stdout:Feb 13 00:54:05 smithi080 bash[31904]: debug 2024-02-13T00:54:05.932+0000 7ff0c60ca700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-13T00:54:06.258 INFO:journalctl@ceph.osd.1.smithi080.stdout:Feb 13 00:54:05 smithi080 bash[31904]: debug 2024-02-13T00:54:05.932+0000 7ff0c60ca700 -1 osd.1 743 *** Got signal Terminated *** 2024-02-13T00:54:06.258 INFO:journalctl@ceph.osd.1.smithi080.stdout:Feb 13 00:54:05 smithi080 bash[31904]: debug 2024-02-13T00:54:05.932+0000 7ff0c60ca700 -1 osd.1 743 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-13T00:54:10.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:10 smithi080 bash[48089]: level=warn ts=2024-02-13T00:54:10.145Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:54:10.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:10 smithi080 bash[48089]: level=warn ts=2024-02-13T00:54:10.146Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:54:11.958 INFO:journalctl@ceph.osd.1.smithi080.stdout:Feb 13 00:54:11 smithi080 bash[122406]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd-1 2024-02-13T00:54:11.958 INFO:journalctl@ceph.osd.1.smithi080.stdout:Feb 13 00:54:11 smithi080 bash[122474]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd-1 2024-02-13T00:54:13.923 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:13 smithi080 bash[48089]: level=error ts=2024-02-13T00:54:13.597Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:54:13.924 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:13 smithi080 bash[48089]: level=warn ts=2024-02-13T00:54:13.598Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:54:13.924 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:13 smithi080 bash[48089]: level=warn ts=2024-02-13T00:54:13.599Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:54:13.926 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.1.service' 2024-02-13T00:54:13.955 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T00:54:13.956 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-13T00:54:13.956 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-13T00:54:13.956 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.2 2024-02-13T00:54:14.196 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 13 00:54:14 smithi080 systemd[1]: Stopping Ceph osd.2 for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:54:14.197 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 13 00:54:14 smithi080 bash[122589]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd.2 2024-02-13T00:54:14.508 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 13 00:54:14 smithi080 bash[36676]: debug 2024-02-13T00:54:14.188+0000 7fd65284d700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-13T00:54:14.508 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 13 00:54:14 smithi080 bash[36676]: debug 2024-02-13T00:54:14.188+0000 7fd65284d700 -1 osd.2 743 *** Got signal Terminated *** 2024-02-13T00:54:14.508 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 13 00:54:14 smithi080 bash[36676]: debug 2024-02-13T00:54:14.188+0000 7fd65284d700 -1 osd.2 743 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-13T00:54:20.148 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 13 00:54:19 smithi080 bash[122626]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd-2 2024-02-13T00:54:20.148 INFO:journalctl@ceph.osd.2.smithi080.stdout:Feb 13 00:54:20 smithi080 bash[122692]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd-2 2024-02-13T00:54:20.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:20 smithi080 bash[48089]: level=error ts=2024-02-13T00:54:20.145Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:54:20.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:20 smithi080 bash[48089]: level=warn ts=2024-02-13T00:54:20.145Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:54:20.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:20 smithi080 bash[48089]: level=warn ts=2024-02-13T00:54:20.146Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:54:22.209 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.2.service' 2024-02-13T00:54:22.236 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T00:54:22.236 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-13T00:54:22.236 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-13T00:54:22.236 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.3 2024-02-13T00:54:22.459 INFO:journalctl@ceph.osd.3.smithi080.stdout:Feb 13 00:54:22 smithi080 systemd[1]: Stopping Ceph osd.3 for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:54:22.459 INFO:journalctl@ceph.osd.3.smithi080.stdout:Feb 13 00:54:22 smithi080 bash[122808]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd.3 2024-02-13T00:54:22.758 INFO:journalctl@ceph.osd.3.smithi080.stdout:Feb 13 00:54:22 smithi080 bash[41448]: debug 2024-02-13T00:54:22.452+0000 7f3f3a678700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-13T00:54:22.758 INFO:journalctl@ceph.osd.3.smithi080.stdout:Feb 13 00:54:22 smithi080 bash[41448]: debug 2024-02-13T00:54:22.452+0000 7f3f3a678700 -1 osd.3 743 *** Got signal Terminated *** 2024-02-13T00:54:22.758 INFO:journalctl@ceph.osd.3.smithi080.stdout:Feb 13 00:54:22 smithi080 bash[41448]: debug 2024-02-13T00:54:22.452+0000 7f3f3a678700 -1 osd.3 743 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-13T00:54:24.006 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:23 smithi106 bash[26571]: debug 2024-02-13T00:54:23.545+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.445252+0000 front 2024-02-13T00:53:57.445525+0000 (oldest deadline 2024-02-13T00:54:22.745475+0000) 2024-02-13T00:54:24.006 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:23 smithi106 bash[36129]: debug 2024-02-13T00:54:23.573+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:24.008 INFO:journalctl@ceph.osd.3.smithi080.stdout:Feb 13 00:54:23 smithi080 bash[41448]: debug 2024-02-13T00:54:23.708+0000 7f3f375f5700 -1 osd.3 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.511695+0000 front 2024-02-13T00:53:57.511808+0000 (oldest deadline 2024-02-13T00:54:23.411859+0000) 2024-02-13T00:54:24.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:23 smithi080 bash[48089]: level=error ts=2024-02-13T00:54:23.598Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:54:24.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:23 smithi080 bash[48089]: level=warn ts=2024-02-13T00:54:23.599Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:54:24.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:23 smithi080 bash[48089]: level=warn ts=2024-02-13T00:54:23.601Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:54:25.006 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:24 smithi106 bash[26571]: debug 2024-02-13T00:54:24.533+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.445252+0000 front 2024-02-13T00:53:57.445525+0000 (oldest deadline 2024-02-13T00:54:22.745475+0000) 2024-02-13T00:54:25.006 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:24 smithi106 bash[36129]: debug 2024-02-13T00:54:24.589+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:25.008 INFO:journalctl@ceph.osd.3.smithi080.stdout:Feb 13 00:54:24 smithi080 bash[41448]: debug 2024-02-13T00:54:24.684+0000 7f3f375f5700 -1 osd.3 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.511695+0000 front 2024-02-13T00:53:57.511808+0000 (oldest deadline 2024-02-13T00:54:23.411859+0000) 2024-02-13T00:54:25.816 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:25 smithi106 bash[36129]: debug 2024-02-13T00:54:25.557+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:25.816 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:25 smithi106 bash[26571]: debug 2024-02-13T00:54:25.525+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.445252+0000 front 2024-02-13T00:53:57.445525+0000 (oldest deadline 2024-02-13T00:54:22.745475+0000) 2024-02-13T00:54:26.008 INFO:journalctl@ceph.osd.3.smithi080.stdout:Feb 13 00:54:25 smithi080 bash[41448]: debug 2024-02-13T00:54:25.672+0000 7f3f375f5700 -1 osd.3 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.511695+0000 front 2024-02-13T00:53:57.511808+0000 (oldest deadline 2024-02-13T00:54:23.411859+0000) 2024-02-13T00:54:26.256 INFO:journalctl@ceph.osd.4.smithi106.stdout:Feb 13 00:54:25 smithi106 bash[22013]: debug 2024-02-13T00:54:25.813+0000 7fae25857700 -1 osd.4 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.615818+0000 front 2024-02-13T00:54:01.615831+0000 (oldest deadline 2024-02-13T00:54:25.715444+0000) 2024-02-13T00:54:26.839 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:26 smithi106 bash[26571]: debug 2024-02-13T00:54:26.549+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.445252+0000 front 2024-02-13T00:53:57.445525+0000 (oldest deadline 2024-02-13T00:54:22.745475+0000) 2024-02-13T00:54:26.839 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:26 smithi106 bash[31333]: debug 2024-02-13T00:54:26.609+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:26.840 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:26 smithi106 bash[36129]: debug 2024-02-13T00:54:26.525+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:27.008 INFO:journalctl@ceph.osd.3.smithi080.stdout:Feb 13 00:54:26 smithi080 bash[41448]: debug 2024-02-13T00:54:26.720+0000 7f3f375f5700 -1 osd.3 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.511695+0000 front 2024-02-13T00:53:57.511808+0000 (oldest deadline 2024-02-13T00:54:23.411859+0000) 2024-02-13T00:54:27.255 INFO:journalctl@ceph.osd.4.smithi106.stdout:Feb 13 00:54:26 smithi106 bash[22013]: debug 2024-02-13T00:54:26.833+0000 7fae25857700 -1 osd.4 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.615818+0000 front 2024-02-13T00:54:01.615831+0000 (oldest deadline 2024-02-13T00:54:25.715444+0000) 2024-02-13T00:54:27.825 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:27 smithi106 bash[26571]: debug 2024-02-13T00:54:27.529+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.445252+0000 front 2024-02-13T00:53:57.445525+0000 (oldest deadline 2024-02-13T00:54:22.745475+0000) 2024-02-13T00:54:27.826 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:27 smithi106 bash[36129]: debug 2024-02-13T00:54:27.537+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:27.826 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:27 smithi106 bash[31333]: debug 2024-02-13T00:54:27.641+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:28.255 INFO:journalctl@ceph.osd.4.smithi106.stdout:Feb 13 00:54:27 smithi106 bash[22013]: debug 2024-02-13T00:54:27.821+0000 7fae25857700 -1 osd.4 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.615818+0000 front 2024-02-13T00:54:01.615831+0000 (oldest deadline 2024-02-13T00:54:25.715444+0000) 2024-02-13T00:54:28.493 INFO:journalctl@ceph.osd.3.smithi080.stdout:Feb 13 00:54:28 smithi080 bash[122844]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd-3 2024-02-13T00:54:28.493 INFO:journalctl@ceph.osd.3.smithi080.stdout:Feb 13 00:54:28 smithi080 bash[122909]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd-3 2024-02-13T00:54:28.820 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:28 smithi106 bash[26571]: debug 2024-02-13T00:54:28.549+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.445252+0000 front 2024-02-13T00:53:57.445525+0000 (oldest deadline 2024-02-13T00:54:22.745475+0000) 2024-02-13T00:54:28.820 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:28 smithi106 bash[36129]: debug 2024-02-13T00:54:28.581+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:28.820 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:28 smithi106 bash[31333]: debug 2024-02-13T00:54:28.609+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:29.255 INFO:journalctl@ceph.osd.4.smithi106.stdout:Feb 13 00:54:28 smithi106 bash[22013]: debug 2024-02-13T00:54:28.817+0000 7fae25857700 -1 osd.4 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.615818+0000 front 2024-02-13T00:54:01.615831+0000 (oldest deadline 2024-02-13T00:54:25.715444+0000) 2024-02-13T00:54:30.005 INFO:journalctl@ceph.osd.4.smithi106.stdout:Feb 13 00:54:29 smithi106 bash[22013]: debug 2024-02-13T00:54:29.801+0000 7fae25857700 -1 osd.4 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.615818+0000 front 2024-02-13T00:54:01.615831+0000 (oldest deadline 2024-02-13T00:54:25.715444+0000) 2024-02-13T00:54:30.006 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:29 smithi106 bash[31333]: debug 2024-02-13T00:54:29.581+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:30.006 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:29 smithi106 bash[26571]: debug 2024-02-13T00:54:29.549+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.445252+0000 front 2024-02-13T00:53:57.445525+0000 (oldest deadline 2024-02-13T00:54:22.745475+0000) 2024-02-13T00:54:30.006 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:29 smithi106 bash[36129]: debug 2024-02-13T00:54:29.565+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:30.314 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.3.service' 2024-02-13T00:54:30.345 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T00:54:30.345 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-13T00:54:30.346 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-13T00:54:30.346 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.4 2024-02-13T00:54:30.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:30 smithi080 bash[48089]: level=error ts=2024-02-13T00:54:30.146Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:54:30.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:30 smithi080 bash[48089]: level=warn ts=2024-02-13T00:54:30.146Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:54:30.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:30 smithi080 bash[48089]: level=warn ts=2024-02-13T00:54:30.147Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:54:30.669 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:30 smithi106 bash[31333]: debug 2024-02-13T00:54:30.589+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:30.669 INFO:journalctl@ceph.osd.4.smithi106.stdout:Feb 13 00:54:30 smithi106 systemd[1]: Stopping Ceph osd.4 for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:54:30.669 INFO:journalctl@ceph.osd.4.smithi106.stdout:Feb 13 00:54:30 smithi106 bash[44883]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd.4 2024-02-13T00:54:30.670 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:30 smithi106 bash[26571]: debug 2024-02-13T00:54:30.525+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.445252+0000 front 2024-02-13T00:53:57.445525+0000 (oldest deadline 2024-02-13T00:54:22.745475+0000) 2024-02-13T00:54:30.670 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:30 smithi106 bash[36129]: debug 2024-02-13T00:54:30.569+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:31.005 INFO:journalctl@ceph.osd.4.smithi106.stdout:Feb 13 00:54:30 smithi106 bash[22013]: debug 2024-02-13T00:54:30.665+0000 7fae280d9700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-13T00:54:31.006 INFO:journalctl@ceph.osd.4.smithi106.stdout:Feb 13 00:54:30 smithi106 bash[22013]: debug 2024-02-13T00:54:30.665+0000 7fae280d9700 -1 osd.4 743 *** Got signal Terminated *** 2024-02-13T00:54:31.006 INFO:journalctl@ceph.osd.4.smithi106.stdout:Feb 13 00:54:30 smithi106 bash[22013]: debug 2024-02-13T00:54:30.665+0000 7fae280d9700 -1 osd.4 743 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-13T00:54:31.006 INFO:journalctl@ceph.osd.4.smithi106.stdout:Feb 13 00:54:30 smithi106 bash[22013]: debug 2024-02-13T00:54:30.837+0000 7fae25857700 -1 osd.4 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.615818+0000 front 2024-02-13T00:54:01.615831+0000 (oldest deadline 2024-02-13T00:54:25.715444+0000) 2024-02-13T00:54:31.827 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:31 smithi106 bash[26571]: debug 2024-02-13T00:54:31.545+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.445252+0000 front 2024-02-13T00:53:57.445525+0000 (oldest deadline 2024-02-13T00:54:22.745475+0000) 2024-02-13T00:54:31.827 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:31 smithi106 bash[36129]: debug 2024-02-13T00:54:31.573+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:31.827 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:31 smithi106 bash[31333]: debug 2024-02-13T00:54:31.593+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:32.255 INFO:journalctl@ceph.osd.4.smithi106.stdout:Feb 13 00:54:31 smithi106 bash[22013]: debug 2024-02-13T00:54:31.820+0000 7fae25857700 -1 osd.4 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.615818+0000 front 2024-02-13T00:54:01.615831+0000 (oldest deadline 2024-02-13T00:54:25.715444+0000) 2024-02-13T00:54:33.006 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:32 smithi106 bash[26571]: debug 2024-02-13T00:54:32.544+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.445252+0000 front 2024-02-13T00:53:57.445525+0000 (oldest deadline 2024-02-13T00:54:22.745475+0000) 2024-02-13T00:54:33.006 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:32 smithi106 bash[31333]: debug 2024-02-13T00:54:32.604+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:33.006 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:32 smithi106 bash[36129]: debug 2024-02-13T00:54:32.572+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:33.006 INFO:journalctl@ceph.osd.4.smithi106.stdout:Feb 13 00:54:32 smithi106 bash[22013]: debug 2024-02-13T00:54:32.792+0000 7fae25857700 -1 osd.4 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.615818+0000 front 2024-02-13T00:54:01.615831+0000 (oldest deadline 2024-02-13T00:54:25.715444+0000) 2024-02-13T00:54:33.823 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:33 smithi106 bash[26571]: debug 2024-02-13T00:54:33.556+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.445252+0000 front 2024-02-13T00:53:57.445525+0000 (oldest deadline 2024-02-13T00:54:22.745475+0000) 2024-02-13T00:54:33.823 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:33 smithi106 bash[31333]: debug 2024-02-13T00:54:33.560+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:33.823 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:33 smithi106 bash[31333]: debug 2024-02-13T00:54:33.560+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:07.438970+0000 front 2024-02-13T00:54:07.438994+0000 (oldest deadline 2024-02-13T00:54:33.338473+0000) 2024-02-13T00:54:33.823 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:33 smithi106 bash[36129]: debug 2024-02-13T00:54:33.580+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:33.823 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:33 smithi106 bash[36129]: debug 2024-02-13T00:54:33.580+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:34.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:33 smithi080 bash[48089]: level=error ts=2024-02-13T00:54:33.599Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:54:34.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:33 smithi080 bash[48089]: level=warn ts=2024-02-13T00:54:33.600Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:54:34.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:33 smithi080 bash[48089]: level=warn ts=2024-02-13T00:54:33.601Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:54:34.255 INFO:journalctl@ceph.osd.4.smithi106.stdout:Feb 13 00:54:33 smithi106 bash[22013]: debug 2024-02-13T00:54:33.816+0000 7fae25857700 -1 osd.4 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.615818+0000 front 2024-02-13T00:54:01.615831+0000 (oldest deadline 2024-02-13T00:54:25.715444+0000) 2024-02-13T00:54:34.783 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:34 smithi106 bash[26571]: debug 2024-02-13T00:54:34.524+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.445252+0000 front 2024-02-13T00:53:57.445525+0000 (oldest deadline 2024-02-13T00:54:22.745475+0000) 2024-02-13T00:54:34.784 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:34 smithi106 bash[36129]: debug 2024-02-13T00:54:34.604+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:34.784 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:34 smithi106 bash[36129]: debug 2024-02-13T00:54:34.604+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:34.784 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:34 smithi106 bash[31333]: debug 2024-02-13T00:54:34.516+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:34.784 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:34 smithi106 bash[31333]: debug 2024-02-13T00:54:34.516+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:07.438970+0000 front 2024-02-13T00:54:07.438994+0000 (oldest deadline 2024-02-13T00:54:33.338473+0000) 2024-02-13T00:54:35.255 INFO:journalctl@ceph.osd.4.smithi106.stdout:Feb 13 00:54:34 smithi106 bash[22013]: debug 2024-02-13T00:54:34.776+0000 7fae25857700 -1 osd.4 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.615818+0000 front 2024-02-13T00:54:01.615831+0000 (oldest deadline 2024-02-13T00:54:25.715444+0000) 2024-02-13T00:54:35.256 INFO:journalctl@ceph.osd.4.smithi106.stdout:Feb 13 00:54:34 smithi106 bash[22013]: debug 2024-02-13T00:54:34.776+0000 7fae25857700 -1 osd.4 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:10.417400+0000 front 2024-02-13T00:54:10.417155+0000 (oldest deadline 2024-02-13T00:54:34.516886+0000) 2024-02-13T00:54:35.755 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:35 smithi106 bash[26571]: debug 2024-02-13T00:54:35.544+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.445252+0000 front 2024-02-13T00:53:57.445525+0000 (oldest deadline 2024-02-13T00:54:22.745475+0000) 2024-02-13T00:54:35.756 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:35 smithi106 bash[26571]: debug 2024-02-13T00:54:35.544+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.147735+0000 front 2024-02-13T00:54:09.147530+0000 (oldest deadline 2024-02-13T00:54:35.047450+0000) 2024-02-13T00:54:35.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:35 smithi106 bash[36129]: debug 2024-02-13T00:54:35.576+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:35.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:35 smithi106 bash[36129]: debug 2024-02-13T00:54:35.576+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:35.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:35 smithi106 bash[31333]: debug 2024-02-13T00:54:35.476+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:35.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:35 smithi106 bash[31333]: debug 2024-02-13T00:54:35.476+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:07.438970+0000 front 2024-02-13T00:54:07.438994+0000 (oldest deadline 2024-02-13T00:54:33.338473+0000) 2024-02-13T00:54:36.625 INFO:journalctl@ceph.osd.4.smithi106.stdout:Feb 13 00:54:36 smithi106 bash[44919]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd-4 2024-02-13T00:54:36.625 INFO:journalctl@ceph.osd.4.smithi106.stdout:Feb 13 00:54:36 smithi106 bash[44985]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd-4 2024-02-13T00:54:36.625 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:36 smithi106 bash[26571]: debug 2024-02-13T00:54:36.568+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.445252+0000 front 2024-02-13T00:53:57.445525+0000 (oldest deadline 2024-02-13T00:54:22.745475+0000) 2024-02-13T00:54:36.625 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:36 smithi106 bash[26571]: debug 2024-02-13T00:54:36.568+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.147735+0000 front 2024-02-13T00:54:09.147530+0000 (oldest deadline 2024-02-13T00:54:35.047450+0000) 2024-02-13T00:54:36.626 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:36 smithi106 bash[36129]: debug 2024-02-13T00:54:36.564+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:36.626 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:36 smithi106 bash[36129]: debug 2024-02-13T00:54:36.564+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:36.626 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:36 smithi106 bash[31333]: debug 2024-02-13T00:54:36.460+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:36.626 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:36 smithi106 bash[31333]: debug 2024-02-13T00:54:36.460+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:07.438970+0000 front 2024-02-13T00:54:07.438994+0000 (oldest deadline 2024-02-13T00:54:33.338473+0000) 2024-02-13T00:54:37.755 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:37 smithi106 bash[31333]: debug 2024-02-13T00:54:37.424+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:37.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:37 smithi106 bash[31333]: debug 2024-02-13T00:54:37.424+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:07.438970+0000 front 2024-02-13T00:54:07.438994+0000 (oldest deadline 2024-02-13T00:54:33.338473+0000) 2024-02-13T00:54:37.756 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:37 smithi106 bash[26571]: debug 2024-02-13T00:54:37.540+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.445252+0000 front 2024-02-13T00:53:57.445525+0000 (oldest deadline 2024-02-13T00:54:22.745475+0000) 2024-02-13T00:54:37.756 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:37 smithi106 bash[26571]: debug 2024-02-13T00:54:37.540+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.147735+0000 front 2024-02-13T00:54:09.147530+0000 (oldest deadline 2024-02-13T00:54:35.047450+0000) 2024-02-13T00:54:37.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:37 smithi106 bash[36129]: debug 2024-02-13T00:54:37.600+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:37.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:37 smithi106 bash[36129]: debug 2024-02-13T00:54:37.600+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:38.607 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.4.service' 2024-02-13T00:54:38.635 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:38 smithi106 bash[36129]: debug 2024-02-13T00:54:38.592+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:38.635 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:38 smithi106 bash[36129]: debug 2024-02-13T00:54:38.592+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:38.636 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:38 smithi106 bash[26571]: debug 2024-02-13T00:54:38.496+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.445252+0000 front 2024-02-13T00:53:57.445525+0000 (oldest deadline 2024-02-13T00:54:22.745475+0000) 2024-02-13T00:54:38.636 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:38 smithi106 bash[26571]: debug 2024-02-13T00:54:38.496+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.147735+0000 front 2024-02-13T00:54:09.147530+0000 (oldest deadline 2024-02-13T00:54:35.047450+0000) 2024-02-13T00:54:38.636 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:38 smithi106 bash[31333]: debug 2024-02-13T00:54:38.380+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:38.636 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:38 smithi106 bash[31333]: debug 2024-02-13T00:54:38.380+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:07.438970+0000 front 2024-02-13T00:54:07.438994+0000 (oldest deadline 2024-02-13T00:54:33.338473+0000) 2024-02-13T00:54:38.637 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T00:54:38.637 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-13T00:54:38.637 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-13T00:54:38.637 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.5 2024-02-13T00:54:38.914 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:38 smithi106 systemd[1]: Stopping Ceph osd.5 for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:54:38.914 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:38 smithi106 bash[45101]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd.5 2024-02-13T00:54:39.255 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:38 smithi106 bash[26571]: debug 2024-02-13T00:54:38.908+0000 7fc3a602b700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-13T00:54:39.256 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:38 smithi106 bash[26571]: debug 2024-02-13T00:54:38.908+0000 7fc3a602b700 -1 osd.5 743 *** Got signal Terminated *** 2024-02-13T00:54:39.256 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:38 smithi106 bash[26571]: debug 2024-02-13T00:54:38.908+0000 7fc3a602b700 -1 osd.5 743 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-13T00:54:39.755 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:39 smithi106 bash[31333]: debug 2024-02-13T00:54:39.392+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:39.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:39 smithi106 bash[31333]: debug 2024-02-13T00:54:39.392+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:07.438970+0000 front 2024-02-13T00:54:07.438994+0000 (oldest deadline 2024-02-13T00:54:33.338473+0000) 2024-02-13T00:54:39.756 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:39 smithi106 bash[26571]: debug 2024-02-13T00:54:39.532+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.445252+0000 front 2024-02-13T00:53:57.445525+0000 (oldest deadline 2024-02-13T00:54:22.745475+0000) 2024-02-13T00:54:39.756 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:39 smithi106 bash[26571]: debug 2024-02-13T00:54:39.532+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.147735+0000 front 2024-02-13T00:54:09.147530+0000 (oldest deadline 2024-02-13T00:54:35.047450+0000) 2024-02-13T00:54:39.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:39 smithi106 bash[36129]: debug 2024-02-13T00:54:39.584+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:39.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:39 smithi106 bash[36129]: debug 2024-02-13T00:54:39.584+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:39.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:39 smithi106 bash[36129]: debug 2024-02-13T00:54:39.584+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:15.434578+0000 front 2024-02-13T00:54:15.434660+0000 (oldest deadline 2024-02-13T00:54:39.534463+0000) 2024-02-13T00:54:40.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:40 smithi080 bash[48089]: level=error ts=2024-02-13T00:54:40.147Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:54:40.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:40 smithi080 bash[48089]: level=warn ts=2024-02-13T00:54:40.148Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:54:40.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:40 smithi080 bash[48089]: level=warn ts=2024-02-13T00:54:40.149Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:54:40.755 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:40 smithi106 bash[26571]: debug 2024-02-13T00:54:40.492+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.445252+0000 front 2024-02-13T00:53:57.445525+0000 (oldest deadline 2024-02-13T00:54:22.745475+0000) 2024-02-13T00:54:40.756 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:40 smithi106 bash[26571]: debug 2024-02-13T00:54:40.492+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.147735+0000 front 2024-02-13T00:54:09.147530+0000 (oldest deadline 2024-02-13T00:54:35.047450+0000) 2024-02-13T00:54:40.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:40 smithi106 bash[31333]: debug 2024-02-13T00:54:40.392+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:40.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:40 smithi106 bash[31333]: debug 2024-02-13T00:54:40.392+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:07.438970+0000 front 2024-02-13T00:54:07.438994+0000 (oldest deadline 2024-02-13T00:54:33.338473+0000) 2024-02-13T00:54:40.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:40 smithi106 bash[31333]: debug 2024-02-13T00:54:40.392+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:17.940485+0000 front 2024-02-13T00:54:17.940421+0000 (oldest deadline 2024-02-13T00:54:40.240267+0000) 2024-02-13T00:54:40.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:40 smithi106 bash[36129]: debug 2024-02-13T00:54:40.592+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:40.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:40 smithi106 bash[36129]: debug 2024-02-13T00:54:40.592+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:40.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:40 smithi106 bash[36129]: debug 2024-02-13T00:54:40.592+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:15.434578+0000 front 2024-02-13T00:54:15.434660+0000 (oldest deadline 2024-02-13T00:54:39.534463+0000) 2024-02-13T00:54:41.755 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:41 smithi106 bash[26571]: debug 2024-02-13T00:54:41.504+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.445252+0000 front 2024-02-13T00:53:57.445525+0000 (oldest deadline 2024-02-13T00:54:22.745475+0000) 2024-02-13T00:54:41.756 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:41 smithi106 bash[26571]: debug 2024-02-13T00:54:41.504+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.147735+0000 front 2024-02-13T00:54:09.147530+0000 (oldest deadline 2024-02-13T00:54:35.047450+0000) 2024-02-13T00:54:41.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:41 smithi106 bash[31333]: debug 2024-02-13T00:54:41.368+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:41.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:41 smithi106 bash[31333]: debug 2024-02-13T00:54:41.368+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:07.438970+0000 front 2024-02-13T00:54:07.438994+0000 (oldest deadline 2024-02-13T00:54:33.338473+0000) 2024-02-13T00:54:41.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:41 smithi106 bash[31333]: debug 2024-02-13T00:54:41.368+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:17.940485+0000 front 2024-02-13T00:54:17.940421+0000 (oldest deadline 2024-02-13T00:54:40.240267+0000) 2024-02-13T00:54:41.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:41 smithi106 bash[36129]: debug 2024-02-13T00:54:41.580+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:41.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:41 smithi106 bash[36129]: debug 2024-02-13T00:54:41.580+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:41.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:41 smithi106 bash[36129]: debug 2024-02-13T00:54:41.580+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:15.434578+0000 front 2024-02-13T00:54:15.434660+0000 (oldest deadline 2024-02-13T00:54:39.534463+0000) 2024-02-13T00:54:42.755 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:42 smithi106 bash[26571]: debug 2024-02-13T00:54:42.532+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.445252+0000 front 2024-02-13T00:53:57.445525+0000 (oldest deadline 2024-02-13T00:54:22.745475+0000) 2024-02-13T00:54:42.756 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:42 smithi106 bash[26571]: debug 2024-02-13T00:54:42.532+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.147735+0000 front 2024-02-13T00:54:09.147530+0000 (oldest deadline 2024-02-13T00:54:35.047450+0000) 2024-02-13T00:54:42.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:42 smithi106 bash[31333]: debug 2024-02-13T00:54:42.368+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:42.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:42 smithi106 bash[31333]: debug 2024-02-13T00:54:42.368+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:07.438970+0000 front 2024-02-13T00:54:07.438994+0000 (oldest deadline 2024-02-13T00:54:33.338473+0000) 2024-02-13T00:54:42.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:42 smithi106 bash[31333]: debug 2024-02-13T00:54:42.368+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:17.940485+0000 front 2024-02-13T00:54:17.940421+0000 (oldest deadline 2024-02-13T00:54:40.240267+0000) 2024-02-13T00:54:42.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:42 smithi106 bash[36129]: debug 2024-02-13T00:54:42.556+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:42.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:42 smithi106 bash[36129]: debug 2024-02-13T00:54:42.556+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:42.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:42 smithi106 bash[36129]: debug 2024-02-13T00:54:42.556+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:15.434578+0000 front 2024-02-13T00:54:15.434660+0000 (oldest deadline 2024-02-13T00:54:39.534463+0000) 2024-02-13T00:54:43.755 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:43 smithi106 bash[31333]: debug 2024-02-13T00:54:43.332+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:43.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:43 smithi106 bash[31333]: debug 2024-02-13T00:54:43.332+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:07.438970+0000 front 2024-02-13T00:54:07.438994+0000 (oldest deadline 2024-02-13T00:54:33.338473+0000) 2024-02-13T00:54:43.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:43 smithi106 bash[31333]: debug 2024-02-13T00:54:43.332+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:17.940485+0000 front 2024-02-13T00:54:17.940421+0000 (oldest deadline 2024-02-13T00:54:40.240267+0000) 2024-02-13T00:54:43.756 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:43 smithi106 bash[26571]: debug 2024-02-13T00:54:43.516+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:53:57.445252+0000 front 2024-02-13T00:53:57.445525+0000 (oldest deadline 2024-02-13T00:54:22.745475+0000) 2024-02-13T00:54:43.756 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:43 smithi106 bash[26571]: debug 2024-02-13T00:54:43.516+0000 7fc3a2fa8700 -1 osd.5 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.147735+0000 front 2024-02-13T00:54:09.147530+0000 (oldest deadline 2024-02-13T00:54:35.047450+0000) 2024-02-13T00:54:43.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:43 smithi106 bash[36129]: debug 2024-02-13T00:54:43.568+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:43.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:43 smithi106 bash[36129]: debug 2024-02-13T00:54:43.568+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:43.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:43 smithi106 bash[36129]: debug 2024-02-13T00:54:43.568+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:15.434578+0000 front 2024-02-13T00:54:15.434660+0000 (oldest deadline 2024-02-13T00:54:39.534463+0000) 2024-02-13T00:54:44.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:43 smithi080 bash[48089]: level=error ts=2024-02-13T00:54:43.599Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:54:44.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:43 smithi080 bash[48089]: level=warn ts=2024-02-13T00:54:43.601Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:54:44.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:43 smithi080 bash[48089]: level=warn ts=2024-02-13T00:54:43.602Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:54:44.505 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:44 smithi106 bash[31333]: debug 2024-02-13T00:54:44.312+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:44.506 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:44 smithi106 bash[31333]: debug 2024-02-13T00:54:44.312+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:07.438970+0000 front 2024-02-13T00:54:07.438994+0000 (oldest deadline 2024-02-13T00:54:33.338473+0000) 2024-02-13T00:54:44.506 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:44 smithi106 bash[31333]: debug 2024-02-13T00:54:44.312+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:17.940485+0000 front 2024-02-13T00:54:17.940421+0000 (oldest deadline 2024-02-13T00:54:40.240267+0000) 2024-02-13T00:54:44.846 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:44 smithi106 bash[36129]: debug 2024-02-13T00:54:44.576+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:44.846 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:44 smithi106 bash[36129]: debug 2024-02-13T00:54:44.576+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:44.846 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:44 smithi106 bash[36129]: debug 2024-02-13T00:54:44.576+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:15.434578+0000 front 2024-02-13T00:54:15.434660+0000 (oldest deadline 2024-02-13T00:54:39.534463+0000) 2024-02-13T00:54:44.846 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:44 smithi106 bash[45137]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd-5 2024-02-13T00:54:45.255 INFO:journalctl@ceph.osd.5.smithi106.stdout:Feb 13 00:54:44 smithi106 bash[45201]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd-5 2024-02-13T00:54:45.755 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:45 smithi106 bash[31333]: debug 2024-02-13T00:54:45.332+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:45.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:45 smithi106 bash[31333]: debug 2024-02-13T00:54:45.332+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:07.438970+0000 front 2024-02-13T00:54:07.438994+0000 (oldest deadline 2024-02-13T00:54:33.338473+0000) 2024-02-13T00:54:45.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:45 smithi106 bash[31333]: debug 2024-02-13T00:54:45.332+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:17.940485+0000 front 2024-02-13T00:54:17.940421+0000 (oldest deadline 2024-02-13T00:54:40.240267+0000) 2024-02-13T00:54:45.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:45 smithi106 bash[36129]: debug 2024-02-13T00:54:45.540+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:45.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:45 smithi106 bash[36129]: debug 2024-02-13T00:54:45.540+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:45.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:45 smithi106 bash[36129]: debug 2024-02-13T00:54:45.540+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:15.434578+0000 front 2024-02-13T00:54:15.434660+0000 (oldest deadline 2024-02-13T00:54:39.534463+0000) 2024-02-13T00:54:45.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:45 smithi106 bash[36129]: debug 2024-02-13T00:54:45.540+0000 7f93e0f01700 -1 osd.7 743 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24433.0:1446 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected e743) 2024-02-13T00:54:46.593 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:46 smithi106 bash[31333]: debug 2024-02-13T00:54:46.372+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:46.593 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:46 smithi106 bash[31333]: debug 2024-02-13T00:54:46.372+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:07.438970+0000 front 2024-02-13T00:54:07.438994+0000 (oldest deadline 2024-02-13T00:54:33.338473+0000) 2024-02-13T00:54:46.593 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:46 smithi106 bash[31333]: debug 2024-02-13T00:54:46.372+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:17.940485+0000 front 2024-02-13T00:54:17.940421+0000 (oldest deadline 2024-02-13T00:54:40.240267+0000) 2024-02-13T00:54:46.755 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:46 smithi106 bash[36129]: debug 2024-02-13T00:54:46.588+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:46.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:46 smithi106 bash[36129]: debug 2024-02-13T00:54:46.588+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:46.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:46 smithi106 bash[36129]: debug 2024-02-13T00:54:46.588+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:15.434578+0000 front 2024-02-13T00:54:15.434660+0000 (oldest deadline 2024-02-13T00:54:39.534463+0000) 2024-02-13T00:54:46.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:46 smithi106 bash[36129]: debug 2024-02-13T00:54:46.588+0000 7f93e0f01700 -1 osd.7 743 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24433.0:1446 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected e743) 2024-02-13T00:54:46.957 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.5.service' 2024-02-13T00:54:46.986 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T00:54:46.986 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-13T00:54:46.987 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-02-13T00:54:46.987 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.6 2024-02-13T00:54:47.217 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:47 smithi106 systemd[1]: Stopping Ceph osd.6 for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:54:47.217 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:47 smithi106 bash[45317]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd.6 2024-02-13T00:54:47.506 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:47 smithi106 bash[31333]: debug 2024-02-13T00:54:47.212+0000 7f2547d83700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-13T00:54:47.506 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:47 smithi106 bash[31333]: debug 2024-02-13T00:54:47.212+0000 7f2547d83700 -1 osd.6 743 *** Got signal Terminated *** 2024-02-13T00:54:47.506 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:47 smithi106 bash[31333]: debug 2024-02-13T00:54:47.212+0000 7f2547d83700 -1 osd.6 743 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-13T00:54:47.506 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:47 smithi106 bash[31333]: debug 2024-02-13T00:54:47.412+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:47.506 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:47 smithi106 bash[31333]: debug 2024-02-13T00:54:47.412+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:07.438970+0000 front 2024-02-13T00:54:07.438994+0000 (oldest deadline 2024-02-13T00:54:33.338473+0000) 2024-02-13T00:54:47.506 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:47 smithi106 bash[31333]: debug 2024-02-13T00:54:47.412+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:17.940485+0000 front 2024-02-13T00:54:17.940421+0000 (oldest deadline 2024-02-13T00:54:40.240267+0000) 2024-02-13T00:54:48.006 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:47 smithi106 bash[36129]: debug 2024-02-13T00:54:47.548+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:48.006 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:47 smithi106 bash[36129]: debug 2024-02-13T00:54:47.548+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:48.006 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:47 smithi106 bash[36129]: debug 2024-02-13T00:54:47.548+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:15.434578+0000 front 2024-02-13T00:54:15.434660+0000 (oldest deadline 2024-02-13T00:54:39.534463+0000) 2024-02-13T00:54:48.006 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:47 smithi106 bash[36129]: debug 2024-02-13T00:54:47.548+0000 7f93e0f01700 -1 osd.7 743 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24433.0:1446 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected e743) 2024-02-13T00:54:48.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:48 smithi106 bash[31333]: debug 2024-02-13T00:54:48.440+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:48.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:48 smithi106 bash[31333]: debug 2024-02-13T00:54:48.440+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:07.438970+0000 front 2024-02-13T00:54:07.438994+0000 (oldest deadline 2024-02-13T00:54:33.338473+0000) 2024-02-13T00:54:48.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:48 smithi106 bash[31333]: debug 2024-02-13T00:54:48.440+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:17.940485+0000 front 2024-02-13T00:54:17.940421+0000 (oldest deadline 2024-02-13T00:54:40.240267+0000) 2024-02-13T00:54:48.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:48 smithi106 bash[36129]: debug 2024-02-13T00:54:48.532+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:48.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:48 smithi106 bash[36129]: debug 2024-02-13T00:54:48.532+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:48.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:48 smithi106 bash[36129]: debug 2024-02-13T00:54:48.532+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:15.434578+0000 front 2024-02-13T00:54:15.434660+0000 (oldest deadline 2024-02-13T00:54:39.534463+0000) 2024-02-13T00:54:48.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:48 smithi106 bash[36129]: debug 2024-02-13T00:54:48.532+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6830 osd.3 since back 2024-02-13T00:54:26.437305+0000 front 2024-02-13T00:54:26.437348+0000 (oldest deadline 2024-02-13T00:54:48.137184+0000) 2024-02-13T00:54:48.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:48 smithi106 bash[36129]: debug 2024-02-13T00:54:48.532+0000 7f93e0f01700 -1 osd.7 743 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24433.0:1446 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected e743) 2024-02-13T00:54:49.755 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:49 smithi106 bash[31333]: debug 2024-02-13T00:54:49.452+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:49.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:49 smithi106 bash[31333]: debug 2024-02-13T00:54:49.452+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:07.438970+0000 front 2024-02-13T00:54:07.438994+0000 (oldest deadline 2024-02-13T00:54:33.338473+0000) 2024-02-13T00:54:49.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:49 smithi106 bash[31333]: debug 2024-02-13T00:54:49.452+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:17.940485+0000 front 2024-02-13T00:54:17.940421+0000 (oldest deadline 2024-02-13T00:54:40.240267+0000) 2024-02-13T00:54:49.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:49 smithi106 bash[36129]: debug 2024-02-13T00:54:49.536+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:49.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:49 smithi106 bash[36129]: debug 2024-02-13T00:54:49.536+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:49.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:49 smithi106 bash[36129]: debug 2024-02-13T00:54:49.536+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:15.434578+0000 front 2024-02-13T00:54:15.434660+0000 (oldest deadline 2024-02-13T00:54:39.534463+0000) 2024-02-13T00:54:49.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:49 smithi106 bash[36129]: debug 2024-02-13T00:54:49.536+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6830 osd.3 since back 2024-02-13T00:54:26.437305+0000 front 2024-02-13T00:54:26.437348+0000 (oldest deadline 2024-02-13T00:54:48.137184+0000) 2024-02-13T00:54:49.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:49 smithi106 bash[36129]: debug 2024-02-13T00:54:49.536+0000 7f93e0f01700 -1 osd.7 743 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24433.0:1446 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected e743) 2024-02-13T00:54:50.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:50 smithi080 bash[48089]: level=error ts=2024-02-13T00:54:50.148Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:54:50.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:50 smithi080 bash[48089]: level=warn ts=2024-02-13T00:54:50.149Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:54:50.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:50 smithi080 bash[48089]: level=warn ts=2024-02-13T00:54:50.150Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:54:50.755 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:50 smithi106 bash[31333]: debug 2024-02-13T00:54:50.428+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:50.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:50 smithi106 bash[31333]: debug 2024-02-13T00:54:50.428+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:07.438970+0000 front 2024-02-13T00:54:07.438994+0000 (oldest deadline 2024-02-13T00:54:33.338473+0000) 2024-02-13T00:54:50.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:50 smithi106 bash[31333]: debug 2024-02-13T00:54:50.428+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:17.940485+0000 front 2024-02-13T00:54:17.940421+0000 (oldest deadline 2024-02-13T00:54:40.240267+0000) 2024-02-13T00:54:50.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:50 smithi106 bash[36129]: debug 2024-02-13T00:54:50.488+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:50.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:50 smithi106 bash[36129]: debug 2024-02-13T00:54:50.488+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:50.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:50 smithi106 bash[36129]: debug 2024-02-13T00:54:50.488+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:15.434578+0000 front 2024-02-13T00:54:15.434660+0000 (oldest deadline 2024-02-13T00:54:39.534463+0000) 2024-02-13T00:54:50.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:50 smithi106 bash[36129]: debug 2024-02-13T00:54:50.488+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6830 osd.3 since back 2024-02-13T00:54:26.437305+0000 front 2024-02-13T00:54:26.437348+0000 (oldest deadline 2024-02-13T00:54:48.137184+0000) 2024-02-13T00:54:50.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:50 smithi106 bash[36129]: debug 2024-02-13T00:54:50.488+0000 7f93e0f01700 -1 osd.7 743 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24433.0:1446 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected e743) 2024-02-13T00:54:51.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:51 smithi106 bash[31333]: debug 2024-02-13T00:54:51.424+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:01.037687+0000 front 2024-02-13T00:54:01.037482+0000 (oldest deadline 2024-02-13T00:54:26.337406+0000) 2024-02-13T00:54:51.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:51 smithi106 bash[31333]: debug 2024-02-13T00:54:51.424+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:07.438970+0000 front 2024-02-13T00:54:07.438994+0000 (oldest deadline 2024-02-13T00:54:33.338473+0000) 2024-02-13T00:54:51.756 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:51 smithi106 bash[31333]: debug 2024-02-13T00:54:51.424+0000 7f2540cf8700 -1 osd.6 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:17.940485+0000 front 2024-02-13T00:54:17.940421+0000 (oldest deadline 2024-02-13T00:54:40.240267+0000) 2024-02-13T00:54:51.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:51 smithi106 bash[36129]: debug 2024-02-13T00:54:51.532+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:51.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:51 smithi106 bash[36129]: debug 2024-02-13T00:54:51.532+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:51.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:51 smithi106 bash[36129]: debug 2024-02-13T00:54:51.532+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:15.434578+0000 front 2024-02-13T00:54:15.434660+0000 (oldest deadline 2024-02-13T00:54:39.534463+0000) 2024-02-13T00:54:51.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:51 smithi106 bash[36129]: debug 2024-02-13T00:54:51.532+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6830 osd.3 since back 2024-02-13T00:54:26.437305+0000 front 2024-02-13T00:54:26.437348+0000 (oldest deadline 2024-02-13T00:54:48.137184+0000) 2024-02-13T00:54:51.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:51 smithi106 bash[36129]: debug 2024-02-13T00:54:51.532+0000 7f93e0f01700 -1 osd.7 743 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24433.0:1446 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected e743) 2024-02-13T00:54:52.755 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:52 smithi106 bash[36129]: debug 2024-02-13T00:54:52.532+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:52.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:52 smithi106 bash[36129]: debug 2024-02-13T00:54:52.532+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:52.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:52 smithi106 bash[36129]: debug 2024-02-13T00:54:52.532+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:15.434578+0000 front 2024-02-13T00:54:15.434660+0000 (oldest deadline 2024-02-13T00:54:39.534463+0000) 2024-02-13T00:54:52.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:52 smithi106 bash[36129]: debug 2024-02-13T00:54:52.532+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6830 osd.3 since back 2024-02-13T00:54:26.437305+0000 front 2024-02-13T00:54:26.437348+0000 (oldest deadline 2024-02-13T00:54:48.137184+0000) 2024-02-13T00:54:52.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:52 smithi106 bash[36129]: debug 2024-02-13T00:54:52.532+0000 7f93e0f01700 -1 osd.7 743 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24433.0:1446 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected e743) 2024-02-13T00:54:53.208 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:52 smithi106 bash[45352]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd-6 2024-02-13T00:54:53.208 INFO:journalctl@ceph.osd.6.smithi106.stdout:Feb 13 00:54:53 smithi106 bash[45418]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd-6 2024-02-13T00:54:53.772 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:53 smithi106 bash[36129]: debug 2024-02-13T00:54:53.492+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:53.772 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:53 smithi106 bash[36129]: debug 2024-02-13T00:54:53.492+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:53.772 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:53 smithi106 bash[36129]: debug 2024-02-13T00:54:53.492+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:15.434578+0000 front 2024-02-13T00:54:15.434660+0000 (oldest deadline 2024-02-13T00:54:39.534463+0000) 2024-02-13T00:54:53.772 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:53 smithi106 bash[36129]: debug 2024-02-13T00:54:53.492+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6830 osd.3 since back 2024-02-13T00:54:26.437305+0000 front 2024-02-13T00:54:26.437348+0000 (oldest deadline 2024-02-13T00:54:48.137184+0000) 2024-02-13T00:54:53.772 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:53 smithi106 bash[36129]: debug 2024-02-13T00:54:53.492+0000 7f93e0f01700 -1 osd.7 743 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24433.0:1446 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected e743) 2024-02-13T00:54:54.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:53 smithi080 bash[48089]: level=error ts=2024-02-13T00:54:53.601Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:54:54.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:53 smithi080 bash[48089]: level=warn ts=2024-02-13T00:54:53.602Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:54:54.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:54:53 smithi080 bash[48089]: level=warn ts=2024-02-13T00:54:53.603Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:54:54.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:54 smithi106 bash[36129]: debug 2024-02-13T00:54:54.484+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:54.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:54 smithi106 bash[36129]: debug 2024-02-13T00:54:54.484+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:54.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:54 smithi106 bash[36129]: debug 2024-02-13T00:54:54.484+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:15.434578+0000 front 2024-02-13T00:54:15.434660+0000 (oldest deadline 2024-02-13T00:54:39.534463+0000) 2024-02-13T00:54:54.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:54 smithi106 bash[36129]: debug 2024-02-13T00:54:54.484+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6830 osd.3 since back 2024-02-13T00:54:26.437305+0000 front 2024-02-13T00:54:26.437348+0000 (oldest deadline 2024-02-13T00:54:48.137184+0000) 2024-02-13T00:54:54.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:54 smithi106 bash[36129]: debug 2024-02-13T00:54:54.488+0000 7f93e0f01700 -1 osd.7 743 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24433.0:1446 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected e743) 2024-02-13T00:54:55.156 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.6.service' 2024-02-13T00:54:55.183 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T00:54:55.184 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-02-13T00:54:55.184 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-02-13T00:54:55.184 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.7 2024-02-13T00:54:55.425 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:55 smithi106 systemd[1]: Stopping Ceph osd.7 for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:54:55.425 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:55 smithi106 bash[45534]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd.7 2024-02-13T00:54:55.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:55 smithi106 bash[36129]: debug 2024-02-13T00:54:55.420+0000 7f93e778b700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-13T00:54:55.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:55 smithi106 bash[36129]: debug 2024-02-13T00:54:55.420+0000 7f93e778b700 -1 osd.7 743 *** Got signal Terminated *** 2024-02-13T00:54:55.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:55 smithi106 bash[36129]: debug 2024-02-13T00:54:55.420+0000 7f93e778b700 -1 osd.7 743 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-13T00:54:55.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:55 smithi106 bash[36129]: debug 2024-02-13T00:54:55.480+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:55.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:55 smithi106 bash[36129]: debug 2024-02-13T00:54:55.480+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:55.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:55 smithi106 bash[36129]: debug 2024-02-13T00:54:55.480+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:15.434578+0000 front 2024-02-13T00:54:15.434660+0000 (oldest deadline 2024-02-13T00:54:39.534463+0000) 2024-02-13T00:54:55.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:55 smithi106 bash[36129]: debug 2024-02-13T00:54:55.480+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6830 osd.3 since back 2024-02-13T00:54:26.437305+0000 front 2024-02-13T00:54:26.437348+0000 (oldest deadline 2024-02-13T00:54:48.137184+0000) 2024-02-13T00:54:55.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:55 smithi106 bash[36129]: debug 2024-02-13T00:54:55.480+0000 7f93e0f01700 -1 osd.7 743 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24433.0:1446 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected e743) 2024-02-13T00:54:56.755 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:56 smithi106 bash[36129]: debug 2024-02-13T00:54:56.492+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:56.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:56 smithi106 bash[36129]: debug 2024-02-13T00:54:56.492+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:56.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:56 smithi106 bash[36129]: debug 2024-02-13T00:54:56.492+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:15.434578+0000 front 2024-02-13T00:54:15.434660+0000 (oldest deadline 2024-02-13T00:54:39.534463+0000) 2024-02-13T00:54:56.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:56 smithi106 bash[36129]: debug 2024-02-13T00:54:56.492+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6830 osd.3 since back 2024-02-13T00:54:26.437305+0000 front 2024-02-13T00:54:26.437348+0000 (oldest deadline 2024-02-13T00:54:48.137184+0000) 2024-02-13T00:54:56.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:56 smithi106 bash[36129]: debug 2024-02-13T00:54:56.492+0000 7f93e0f01700 -1 osd.7 743 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24433.0:1446 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected e743) 2024-02-13T00:54:57.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:57 smithi106 bash[36129]: debug 2024-02-13T00:54:57.476+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:57.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:57 smithi106 bash[36129]: debug 2024-02-13T00:54:57.476+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:57.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:57 smithi106 bash[36129]: debug 2024-02-13T00:54:57.476+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:15.434578+0000 front 2024-02-13T00:54:15.434660+0000 (oldest deadline 2024-02-13T00:54:39.534463+0000) 2024-02-13T00:54:57.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:57 smithi106 bash[36129]: debug 2024-02-13T00:54:57.476+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6830 osd.3 since back 2024-02-13T00:54:26.437305+0000 front 2024-02-13T00:54:26.437348+0000 (oldest deadline 2024-02-13T00:54:48.137184+0000) 2024-02-13T00:54:57.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:57 smithi106 bash[36129]: debug 2024-02-13T00:54:57.476+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.106:6804 osd.4 since back 2024-02-13T00:54:32.139039+0000 front 2024-02-13T00:54:32.139188+0000 (oldest deadline 2024-02-13T00:54:56.838927+0000) 2024-02-13T00:54:57.756 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:57 smithi106 bash[36129]: debug 2024-02-13T00:54:57.476+0000 7f93e0f01700 -1 osd.7 743 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24433.0:1446 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected e743) 2024-02-13T00:54:59.005 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:58 smithi106 bash[36129]: debug 2024-02-13T00:54:58.512+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:54:59.006 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:58 smithi106 bash[36129]: debug 2024-02-13T00:54:58.512+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:54:59.006 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:58 smithi106 bash[36129]: debug 2024-02-13T00:54:58.512+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:15.434578+0000 front 2024-02-13T00:54:15.434660+0000 (oldest deadline 2024-02-13T00:54:39.534463+0000) 2024-02-13T00:54:59.006 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:58 smithi106 bash[36129]: debug 2024-02-13T00:54:58.512+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6830 osd.3 since back 2024-02-13T00:54:26.437305+0000 front 2024-02-13T00:54:26.437348+0000 (oldest deadline 2024-02-13T00:54:48.137184+0000) 2024-02-13T00:54:59.006 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:58 smithi106 bash[36129]: debug 2024-02-13T00:54:58.512+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.106:6804 osd.4 since back 2024-02-13T00:54:32.139039+0000 front 2024-02-13T00:54:32.139188+0000 (oldest deadline 2024-02-13T00:54:56.838927+0000) 2024-02-13T00:54:59.006 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:58 smithi106 bash[36129]: debug 2024-02-13T00:54:58.512+0000 7f93e0f01700 -1 osd.7 743 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24433.0:1446 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected e743) 2024-02-13T00:55:00.006 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:59 smithi106 bash[36129]: debug 2024-02-13T00:54:59.500+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6806 osd.0 since back 2024-02-13T00:54:00.028851+0000 front 2024-02-13T00:54:00.028984+0000 (oldest deadline 2024-02-13T00:54:23.528649+0000) 2024-02-13T00:55:00.006 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:59 smithi106 bash[36129]: debug 2024-02-13T00:54:59.500+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6814 osd.1 since back 2024-02-13T00:54:09.132675+0000 front 2024-02-13T00:54:09.132618+0000 (oldest deadline 2024-02-13T00:54:33.232649+0000) 2024-02-13T00:55:00.006 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:59 smithi106 bash[36129]: debug 2024-02-13T00:54:59.500+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6822 osd.2 since back 2024-02-13T00:54:15.434578+0000 front 2024-02-13T00:54:15.434660+0000 (oldest deadline 2024-02-13T00:54:39.534463+0000) 2024-02-13T00:55:00.006 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:59 smithi106 bash[36129]: debug 2024-02-13T00:54:59.500+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.80:6830 osd.3 since back 2024-02-13T00:54:26.437305+0000 front 2024-02-13T00:54:26.437348+0000 (oldest deadline 2024-02-13T00:54:48.137184+0000) 2024-02-13T00:55:00.006 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:59 smithi106 bash[36129]: debug 2024-02-13T00:54:59.500+0000 7f93e0f01700 -1 osd.7 743 heartbeat_check: no reply from 172.21.15.106:6804 osd.4 since back 2024-02-13T00:54:32.139039+0000 front 2024-02-13T00:54:32.139188+0000 (oldest deadline 2024-02-13T00:54:56.838927+0000) 2024-02-13T00:55:00.006 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:54:59 smithi106 bash[36129]: debug 2024-02-13T00:54:59.500+0000 7f93e0f01700 -1 osd.7 743 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24433.0:1446 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected e743) 2024-02-13T00:55:00.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:00 smithi080 bash[48089]: level=error ts=2024-02-13T00:55:00.148Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:55:00.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:00 smithi080 bash[48089]: level=warn ts=2024-02-13T00:55:00.149Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:55:00.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:00 smithi080 bash[48089]: level=warn ts=2024-02-13T00:55:00.150Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:55:01.348 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:55:01 smithi106 bash[45570]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd-7 2024-02-13T00:55:01.348 INFO:journalctl@ceph.osd.7.smithi106.stdout:Feb 13 00:55:01 smithi106 bash[45634]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-osd-7 2024-02-13T00:55:03.302 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@osd.7.service' 2024-02-13T00:55:03.335 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T00:55:03.335 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-02-13T00:55:03.335 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopping rgw.foo.a... 2024-02-13T00:55:03.335 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@rgw.foo.a 2024-02-13T00:55:03.604 INFO:journalctl@ceph.rgw.foo.a.smithi080.stdout:Feb 13 00:55:03 smithi080 systemd[1]: Stopping Ceph rgw.foo.a for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:55:03.604 INFO:journalctl@ceph.rgw.foo.a.smithi080.stdout:Feb 13 00:55:03 smithi080 bash[123028]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-rgw.foo.a 2024-02-13T00:55:03.605 INFO:journalctl@ceph.rgw.foo.a.smithi080.stdout:Feb 13 00:55:03 smithi080 bash[44149]: debug 2024-02-13T00:55:03.531+0000 7f670c521700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/radosgw -n client.rgw.foo.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-13T00:55:03.605 INFO:journalctl@ceph.rgw.foo.a.smithi080.stdout:Feb 13 00:55:03 smithi080 bash[44149]: debug 2024-02-13T00:55:03.531+0000 7f67235eb880 -1 shutting down 2024-02-13T00:55:04.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:03 smithi080 bash[48089]: level=error ts=2024-02-13T00:55:03.601Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=4 err="ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:55:04.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:03 smithi080 bash[48089]: level=warn ts=2024-02-13T00:55:03.602Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:55:04.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:03 smithi080 bash[48089]: level=warn ts=2024-02-13T00:55:03.603Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:55:10.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:10 smithi080 bash[48089]: level=error ts=2024-02-13T00:55:10.149Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:55:10.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:10 smithi080 bash[48089]: level=warn ts=2024-02-13T00:55:10.150Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:55:10.508 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:10 smithi080 bash[48089]: level=warn ts=2024-02-13T00:55:10.151Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:55:12.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:11 smithi080 bash[48089]: level=warn ts=2024-02-13T00:55:11.627Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:55:12.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:11 smithi080 bash[48089]: level=warn ts=2024-02-13T00:55:11.628Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:55:13.944 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:13 smithi080 bash[48089]: level=error ts=2024-02-13T00:55:13.602Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=4 err="ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:55:13.944 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:13 smithi080 bash[48089]: level=warn ts=2024-02-13T00:55:13.603Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:55:13.944 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:13 smithi080 bash[48089]: level=warn ts=2024-02-13T00:55:13.604Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:55:14.392 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@rgw.foo.a.service' 2024-02-13T00:55:14.419 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T00:55:14.420 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopped rgw.foo.a 2024-02-13T00:55:14.420 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-02-13T00:55:14.420 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@prometheus.a 2024-02-13T00:55:14.686 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:55:14 smithi106 systemd[1]: Stopping Ceph prometheus.a for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:55:14.686 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:55:14 smithi106 bash[45753]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-prometheus.a 2024-02-13T00:55:14.686 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:55:14 smithi106 bash[42447]: ts=2024-02-13T00:55:14.618Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-02-13T00:55:14.687 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:55:14 smithi106 bash[42447]: ts=2024-02-13T00:55:14.618Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-02-13T00:55:14.687 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:55:14 smithi106 bash[42447]: ts=2024-02-13T00:55:14.618Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-02-13T00:55:14.687 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:55:14 smithi106 bash[42447]: ts=2024-02-13T00:55:14.618Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-02-13T00:55:14.687 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:55:14 smithi106 bash[42447]: ts=2024-02-13T00:55:14.618Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-02-13T00:55:14.687 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:55:14 smithi106 bash[42447]: ts=2024-02-13T00:55:14.618Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-02-13T00:55:14.687 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:55:14 smithi106 bash[42447]: ts=2024-02-13T00:55:14.618Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-02-13T00:55:14.687 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:55:14 smithi106 bash[42447]: ts=2024-02-13T00:55:14.618Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-02-13T00:55:14.687 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:55:14 smithi106 bash[42447]: ts=2024-02-13T00:55:14.618Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-02-13T00:55:14.687 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:55:14 smithi106 bash[42447]: ts=2024-02-13T00:55:14.622Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-02-13T00:55:14.687 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:55:14 smithi106 bash[42447]: ts=2024-02-13T00:55:14.622Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-02-13T00:55:14.687 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:55:14 smithi106 bash[42447]: ts=2024-02-13T00:55:14.622Z caller=main.go:1066 level=info msg="See you next time!" 2024-02-13T00:55:15.444 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@prometheus.a.service' 2024-02-13T00:55:15.452 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:55:15 smithi106 bash[45786]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-prometheus-a 2024-02-13T00:55:15.452 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:55:15 smithi106 bash[45846]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-prometheus-a 2024-02-13T00:55:15.452 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:55:15 smithi106 systemd[1]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@prometheus.a.service: Succeeded. 2024-02-13T00:55:15.452 INFO:journalctl@ceph.prometheus.a.smithi106.stdout:Feb 13 00:55:15 smithi106 systemd[1]: Stopped Ceph prometheus.a for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:55:15.468 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T00:55:15.469 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-02-13T00:55:15.469 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm rm-cluster --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 --force --keep-logs 2024-02-13T00:55:20.470 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:20 smithi080 bash[48089]: level=error ts=2024-02-13T00:55:20.150Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:55:20.470 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:20 smithi080 bash[48089]: level=warn ts=2024-02-13T00:55:20.151Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:55:20.470 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:20 smithi080 bash[48089]: level=warn ts=2024-02-13T00:55:20.152Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:55:21.641 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:21 smithi080 bash[48089]: level=error ts=2024-02-13T00:55:21.627Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=2 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:55:21.641 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:21 smithi080 bash[48089]: level=warn ts=2024-02-13T00:55:21.627Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-13T00:55:21.641 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:21 smithi080 bash[48089]: level=warn ts=2024-02-13T00:55:21.629Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi106.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.106:8443: connect: connection refused" 2024-02-13T00:55:22.482 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:55:22 smithi080 systemd[1]: Stopping Ceph node-exporter.a for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:55:22.483 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:55:22 smithi080 bash[123456]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-node-exporter.a 2024-02-13T00:55:23.258 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:55:22 smithi080 bash[123493]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-node-exporter-a 2024-02-13T00:55:23.258 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:55:23 smithi080 systemd[1]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-02-13T00:55:23.258 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:55:23 smithi080 bash[123554]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-node-exporter-a 2024-02-13T00:55:23.258 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:55:23 smithi080 systemd[1]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-02-13T00:55:23.258 INFO:journalctl@ceph.node-exporter.a.smithi080.stdout:Feb 13 00:55:23 smithi080 systemd[1]: Stopped Ceph node-exporter.a for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:55:23.682 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:23 smithi080 systemd[1]: Stopping Ceph alertmanager.a for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:55:23.682 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:23 smithi080 bash[123591]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-alertmanager.a 2024-02-13T00:55:23.682 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:23 smithi080 bash[48089]: level=info ts=2024-02-13T00:55:23.452Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-02-13T00:55:24.008 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:23 smithi080 bash[123628]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-alertmanager-a 2024-02-13T00:55:24.369 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:24 smithi080 bash[123692]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-alertmanager-a 2024-02-13T00:55:24.369 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:24 smithi080 systemd[1]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@alertmanager.a.service: Succeeded. 2024-02-13T00:55:24.369 INFO:journalctl@ceph.alertmanager.a.smithi080.stdout:Feb 13 00:55:24 smithi080 systemd[1]: Stopped Ceph alertmanager.a for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:55:24.871 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm rm-cluster --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 --force --keep-logs 2024-02-13T00:55:31.209 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:55:31 smithi106 systemd[1]: Stopping Ceph iscsi.iscsi.a for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:55:31.209 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:55:31 smithi106 bash[46057]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-iscsi.iscsi.a 2024-02-13T00:55:31.505 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:55:31 smithi106 bash[39366]: debug Shutdown received 2024-02-13T00:55:42.256 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:55:41 smithi106 bash[46092]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-iscsi-iscsi-a 2024-02-13T00:55:42.256 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:55:42 smithi106 systemd[1]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@iscsi.iscsi.a.service: Main process exited, code=exited, status=137/n/a 2024-02-13T00:55:42.256 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:55:42 smithi106 bash[46157]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-iscsi-iscsi-a 2024-02-13T00:55:43.007 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:55:42 smithi106 bash[46167]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-iscsi-iscsi-a-tcmu 2024-02-13T00:55:43.008 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:55:42 smithi106 systemd[1]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-02-13T00:55:43.008 INFO:journalctl@ceph.iscsi.iscsi.a.smithi106.stdout:Feb 13 00:55:42 smithi106 systemd[1]: Stopped Ceph iscsi.iscsi.a for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:55:43.207 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:55:43 smithi106 systemd[1]: Stopping Ceph node-exporter.b for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:55:43.208 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:55:43 smithi106 bash[46234]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-node-exporter.b 2024-02-13T00:55:44.006 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:55:43 smithi106 bash[46268]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-node-exporter-b 2024-02-13T00:55:44.006 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:55:43 smithi106 systemd[1]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-02-13T00:55:44.006 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:55:43 smithi106 bash[46331]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-node-exporter-b 2024-02-13T00:55:44.006 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:55:43 smithi106 systemd[1]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-02-13T00:55:44.006 INFO:journalctl@ceph.node-exporter.b.smithi106.stdout:Feb 13 00:55:43 smithi106 systemd[1]: Stopped Ceph node-exporter.b for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:55:44.495 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:55:44 smithi106 systemd[1]: Stopping Ceph grafana.a for a5ae7724-ca05-11ee-95b9-87774f69a715... 2024-02-13T00:55:44.495 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:55:44 smithi106 bash[46393]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-grafana.a 2024-02-13T00:55:44.755 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:55:44 smithi106 bash[41659]: t=2024-02-13T00:55:44+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2024-02-13T00:55:45.256 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:55:45 smithi106 bash[46427]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-grafana-a 2024-02-13T00:55:45.256 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:55:45 smithi106 bash[46491]: Error response from daemon: No such container: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715-grafana-a 2024-02-13T00:55:45.256 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:55:45 smithi106 systemd[1]: ceph-a5ae7724-ca05-11ee-95b9-87774f69a715@grafana.a.service: Succeeded. 2024-02-13T00:55:45.256 INFO:journalctl@ceph.grafana.a.smithi106.stdout:Feb 13 00:55:45 smithi106 systemd[1]: Stopped Ceph grafana.a for a5ae7724-ca05-11ee-95b9-87774f69a715. 2024-02-13T00:55:45.913 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-13T00:55:45.930 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-13T00:55:45.944 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-13T00:55:45.946 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/crash to /home/teuthworker/archive/lflores-2024-02-12_21:56:27-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7557134/remote/ubuntu@smithi080.front.sepia.ceph.com/crash 2024-02-13T00:55:45.947 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/crash -- . 2024-02-13T00:55:45.985 INFO:teuthology.orchestra.run.smithi080.stderr:tar: /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/crash: Cannot open: No such file or directory 2024-02-13T00:55:45.985 INFO:teuthology.orchestra.run.smithi080.stderr:tar: Error is not recoverable: exiting now 2024-02-13T00:55:45.987 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/crash to /home/teuthworker/archive/lflores-2024-02-12_21:56:27-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7557134/remote/ubuntu@smithi106.front.sepia.ceph.com/crash 2024-02-13T00:55:45.988 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/crash -- . 2024-02-13T00:55:46.005 INFO:teuthology.orchestra.run.smithi106.stderr:tar: /var/lib/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/crash: Cannot open: No such file or directory 2024-02-13T00:55:46.006 INFO:teuthology.orchestra.run.smithi106.stderr:tar: Error is not recoverable: exiting now 2024-02-13T00:55:46.006 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-13T00:55:46.007 DEBUG:teuthology.orchestra.run.smithi080:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(MON_DOWN\)' | egrep -v 'missing hit_sets' | egrep -v 'do not have an application enabled' | egrep -v 'application not enabled on pool' | egrep -v 'mons down' | head -n 1 2024-02-13T00:55:46.049 INFO:teuthology.orchestra.run.smithi080.stdout:2024-02-13T00:37:54.257551+0000 mon.a (mon.0) 861 : cluster [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-02-13T00:55:46.049 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-02-13T00:55:46.050 DEBUG:teuthology.orchestra.run.smithi080:> sudo egrep '\[SEC\]' /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(MON_DOWN\)' | egrep -v 'missing hit_sets' | egrep -v 'do not have an application enabled' | egrep -v 'application not enabled on pool' | egrep -v 'mons down' | head -n 1 2024-02-13T00:55:46.110 DEBUG:teuthology.orchestra.run.smithi080:> sudo egrep '\[ERR\]' /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(MON_DOWN\)' | egrep -v 'missing hit_sets' | egrep -v 'do not have an application enabled' | egrep -v 'application not enabled on pool' | egrep -v 'mons down' | head -n 1 2024-02-13T00:55:46.170 DEBUG:teuthology.orchestra.run.smithi080:> sudo egrep '\[WRN\]' /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(MON_DOWN\)' | egrep -v 'missing hit_sets' | egrep -v 'do not have an application enabled' | egrep -v 'application not enabled on pool' | egrep -v 'mons down' | head -n 1 2024-02-13T00:55:46.229 INFO:teuthology.orchestra.run.smithi080.stdout:2024-02-13T00:37:54.257551+0000 mon.a (mon.0) 861 : cluster [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-02-13T00:55:46.229 INFO:tasks.cephadm:Compressing logs... 2024-02-13T00:55:46.230 DEBUG:teuthology.orchestra.run.smithi080:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-13T00:55:46.275 DEBUG:teuthology.orchestra.run.smithi106:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-13T00:55:46.284 INFO:teuthology.orchestra.run.smithi080.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-02-13T00:55:46.291 INFO:teuthology.orchestra.run.smithi106.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-02-13T00:55:46.299 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-13T00:55:46.299 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-mon.b.log 2024-02-13T00:55:46.300 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.5.log 2024-02-13T00:55:46.300 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-mgr.x.log 2024-02-13T00:55:46.300 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-mon.b.log: /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph.audit.log 2024-02-13T00:55:46.301 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-13T00:55:46.301 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-mon.a.log 2024-02-13T00:55:46.301 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.6.log 2024-02-13T00:55:46.302 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-client.rgw.foo.a.log 2024-02-13T00:55:46.303 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-mgr.y.log 2024-02-13T00:55:46.304 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/tcmu-runner.log 2024-02-13T00:55:46.304 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph.log 2024-02-13T00:55:46.304 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.6.log: /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/tcmu-runner.log: 67.5%gzip -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/tcmu-runner.log.gz-5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph.cephadm.log 2024-02-13T00:55:46.304 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-02-13T00:55:46.304 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.4.log 2024-02-13T00:55:46.306 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph.cephadm.log: /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph.log: 81.5% -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph.cephadm.log.gz 2024-02-13T00:55:46.306 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-volume.log 2024-02-13T00:55:46.306 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-mon.a.log: /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-client.rgw.foo.a.log: gzip -5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-mon.c.log 2024-02-13T00:55:46.306 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph.audit.log 2024-02-13T00:55:46.306 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.1.log 2024-02-13T00:55:46.306 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph.log 2024-02-13T00:55:46.306 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.1.log: /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph.cephadm.log 2024-02-13T00:55:46.313 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.4.log: 87.7% -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph.log.gz 2024-02-13T00:55:46.313 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.7.log 2024-02-13T00:55:46.313 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-13T00:55:46.314 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph.log: gzip -5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.0.log 2024-02-13T00:55:46.315 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph.cephadm.log: 89.0% -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph.cephadm.log.gz 2024-02-13T00:55:46.316 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-volume.log: /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.7.log: 92.4% -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-mgr.x.log.gz 2024-02-13T00:55:46.317 INFO:teuthology.orchestra.run.smithi106.stderr: 92.2% -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph.audit.log.gz 2024-02-13T00:55:46.318 INFO:teuthology.orchestra.run.smithi080.stderr: 93.1% -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph.log.gz 2024-02-13T00:55:46.319 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.3.log 2024-02-13T00:55:46.322 INFO:teuthology.orchestra.run.smithi106.stderr: 91.3% -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-volume.log.gz 2024-02-13T00:55:46.323 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.0.log: 91.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-13T00:55:46.324 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-volume.log 2024-02-13T00:55:46.328 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.3.log: 95.2% -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph.audit.log.gz 2024-02-13T00:55:46.329 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.2.log 2024-02-13T00:55:46.339 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-volume.log: 91.4% -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-volume.log.gz 2024-02-13T00:55:46.355 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.2.log: 93.8% -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-client.rgw.foo.a.log.gz 2024-02-13T00:55:46.759 INFO:teuthology.orchestra.run.smithi080.stderr: 91.1% -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-mgr.y.log.gz 2024-02-13T00:55:47.193 INFO:teuthology.orchestra.run.smithi106.stderr: 93.0% -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-mon.b.log.gz 2024-02-13T00:55:47.594 INFO:teuthology.orchestra.run.smithi080.stderr: 92.6% -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-mon.c.log.gz 2024-02-13T00:55:48.380 INFO:teuthology.orchestra.run.smithi080.stderr: 92.0% -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-mon.a.log.gz 2024-02-13T00:55:50.995 INFO:teuthology.orchestra.run.smithi106.stderr: 94.0% -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.6.log.gz 2024-02-13T00:55:51.181 INFO:teuthology.orchestra.run.smithi080.stderr: 94.0% -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.2.log.gz 2024-02-13T00:55:51.185 INFO:teuthology.orchestra.run.smithi080.stderr: 94.1% -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.1.log.gz 2024-02-13T00:55:51.201 INFO:teuthology.orchestra.run.smithi106.stderr: 94.0% -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.5.log.gz 2024-02-13T00:55:51.269 INFO:teuthology.orchestra.run.smithi106.stderr: 94.0% -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.7.log.gz 2024-02-13T00:55:51.815 INFO:teuthology.orchestra.run.smithi106.stderr: 94.2% -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.4.log.gz 2024-02-13T00:55:51.816 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-02-13T00:55:51.817 INFO:teuthology.orchestra.run.smithi106.stderr:real 0m5.536s 2024-02-13T00:55:51.817 INFO:teuthology.orchestra.run.smithi106.stderr:user 0m20.225s 2024-02-13T00:55:51.817 INFO:teuthology.orchestra.run.smithi106.stderr:sys 0m0.813s 2024-02-13T00:55:51.842 INFO:teuthology.orchestra.run.smithi080.stderr: 94.1% -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.0.log.gz 2024-02-13T00:55:52.141 INFO:teuthology.orchestra.run.smithi080.stderr: 94.1% -- replaced with /var/log/ceph/a5ae7724-ca05-11ee-95b9-87774f69a715/ceph-osd.3.log.gz 2024-02-13T00:55:52.143 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-13T00:55:52.143 INFO:teuthology.orchestra.run.smithi080.stderr:real 0m5.867s 2024-02-13T00:55:52.143 INFO:teuthology.orchestra.run.smithi080.stderr:user 0m24.042s 2024-02-13T00:55:52.143 INFO:teuthology.orchestra.run.smithi080.stderr:sys 0m0.979s 2024-02-13T00:55:52.143 INFO:tasks.cephadm:Archiving logs... 2024-02-13T00:55:52.143 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/log/ceph to /home/teuthworker/archive/lflores-2024-02-12_21:56:27-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7557134/remote/ubuntu@smithi080.front.sepia.ceph.com/log 2024-02-13T00:55:52.145 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-13T00:55:55.525 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/log/ceph to /home/teuthworker/archive/lflores-2024-02-12_21:56:27-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7557134/remote/ubuntu@smithi106.front.sepia.ceph.com/log 2024-02-13T00:55:55.526 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-13T00:55:58.455 INFO:tasks.cephadm:Removing cluster... 2024-02-13T00:55:58.455 DEBUG:teuthology.orchestra.run.smithi080:> sudo cephadm rm-cluster --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 --force 2024-02-13T00:56:00.033 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm rm-cluster --fsid a5ae7724-ca05-11ee-95b9-87774f69a715 --force 2024-02-13T00:56:01.641 INFO:tasks.cephadm:Teardown complete 2024-02-13T00:56:01.642 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-13T00:56:01.652 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-13T00:56:01.652 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-13T00:56:01.655 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-13T00:56:01.715 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-13T00:56:01.724 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-13T00:56:01.725 DEBUG:teuthology.orchestra.run.smithi080:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-13T00:56:01.727 DEBUG:teuthology.orchestra.run.smithi106:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-13T00:56:01.744 INFO:teuthology.orchestra.run.smithi080.stdout: remote refid st t when poll reach delay offset jitter 2024-02-13T00:56:01.744 INFO:teuthology.orchestra.run.smithi080.stdout:============================================================================== 2024-02-13T00:56:01.744 INFO:teuthology.orchestra.run.smithi080.stdout:*hv01.front.sepi 44.4.53.2 2 u 40 128 377 0.073 -0.548 0.134 2024-02-13T00:56:01.744 INFO:teuthology.orchestra.run.smithi080.stdout:+hv02.front.sepi 63.231.80.2 3 u 107 128 377 0.095 1.003 0.079 2024-02-13T00:56:01.745 INFO:teuthology.orchestra.run.smithi080.stdout:+hv03.front.sepi 74.6.168.72 3 u 110 128 377 0.095 -1.189 0.385 2024-02-13T00:56:01.745 INFO:teuthology.orchestra.run.smithi080.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2024-02-13T00:56:01.746 INFO:teuthology.orchestra.run.smithi106.stdout: remote refid st t when poll reach delay offset jitter 2024-02-13T00:56:01.746 INFO:teuthology.orchestra.run.smithi106.stdout:============================================================================== 2024-02-13T00:56:01.746 INFO:teuthology.orchestra.run.smithi106.stdout:*hv01.front.sepi 44.4.53.2 2 u 37 128 377 0.096 -1.023 0.090 2024-02-13T00:56:01.747 INFO:teuthology.orchestra.run.smithi106.stdout:+hv02.front.sepi 63.231.80.2 3 u 30 128 377 0.095 0.474 0.122 2024-02-13T00:56:01.747 INFO:teuthology.orchestra.run.smithi106.stdout:+hv03.front.sepi 74.6.168.72 3 u 43 128 377 0.087 -1.771 0.598 2024-02-13T00:56:01.747 INFO:teuthology.orchestra.run.smithi106.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2024-02-13T00:56:01.747 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-13T00:56:01.756 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-13T00:56:01.756 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-13T00:56:01.765 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-13T00:56:01.775 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-13T00:56:01.783 INFO:teuthology.task.internal:Duration was 2606.315932 seconds 2024-02-13T00:56:01.783 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-13T00:56:01.791 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-13T00:56:01.792 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-13T00:56:01.794 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-13T00:56:01.844 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-13T00:56:01.845 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi080.front.sepia.ceph.com 2024-02-13T00:56:01.845 DEBUG:teuthology.orchestra.run.smithi080:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-13T00:56:01.858 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi106.front.sepia.ceph.com 2024-02-13T00:56:01.859 DEBUG:teuthology.orchestra.run.smithi106:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-13T00:56:01.873 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-13T00:56:01.873 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-13T00:56:01.904 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-13T00:56:01.977 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-13T00:56:01.978 DEBUG:teuthology.orchestra.run.smithi080:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-13T00:56:01.980 DEBUG:teuthology.orchestra.run.smithi106:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-13T00:56:02.150 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-13T00:56:02.162 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-13T00:56:02.162 DEBUG:teuthology.orchestra.run.smithi080:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-13T00:56:02.179 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-13T00:56:02.195 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-13T00:56:02.205 DEBUG:teuthology.orchestra.run.smithi080:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-13T00:56:02.224 DEBUG:teuthology.orchestra.run.smithi106:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-13T00:56:02.235 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = core 2024-02-13T00:56:02.253 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = core 2024-02-13T00:56:02.285 DEBUG:teuthology.orchestra.run.smithi080:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-13T00:56:02.299 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-13T00:56:02.300 DEBUG:teuthology.orchestra.run.smithi106:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-13T00:56:02.336 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-13T00:56:02.337 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-13T00:56:02.347 INFO:teuthology.task.internal:Transferring archived files... 2024-02-13T00:56:02.348 DEBUG:teuthology.misc:Transferring archived files from smithi080:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/lflores-2024-02-12_21:56:27-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7557134/remote/smithi080 2024-02-13T00:56:02.349 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-13T00:56:02.384 DEBUG:teuthology.misc:Transferring archived files from smithi106:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/lflores-2024-02-12_21:56:27-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7557134/remote/smithi106 2024-02-13T00:56:02.385 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-13T00:56:02.417 INFO:teuthology.task.internal:Removing archive directory... 2024-02-13T00:56:02.417 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-13T00:56:02.420 DEBUG:teuthology.orchestra.run.smithi106:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-13T00:56:02.466 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-13T00:56:02.478 INFO:teuthology.task.internal:Not uploading archives. 2024-02-13T00:56:02.478 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-13T00:56:02.487 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-13T00:56:02.488 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-13T00:56:02.490 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-13T00:56:02.496 INFO:teuthology.orchestra.run.smithi080.stdout: 1048601 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 00:56 /home/ubuntu/cephtest 2024-02-13T00:56:02.514 INFO:teuthology.orchestra.run.smithi106.stdout: 1048602 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 00:56 /home/ubuntu/cephtest 2024-02-13T00:56:02.516 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-13T00:56:02.527 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-13T00:56:02.546 INFO:teuthology.nuke:Checking targets against current locks 2024-02-13T00:56:02.571 DEBUG:teuthology.nuke:shortname: smithi080 2024-02-13T00:56:02.571 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-13T00:56:02.594 DEBUG:teuthology.nuke:shortname: smithi106 2024-02-13T00:56:02.594 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-13T00:56:02.597 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-02-12_21:56:27-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7557134', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-13 00:03:30.530224', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2024-02-13T00:56:02.618 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-02-12_21:56:27-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7557134', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-13 00:03:30.531748', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2024-02-13T00:56:02.644 INFO:teuthology.orchestra.console.smithi080:Power off 2024-02-13T00:56:02.645 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-13T00:56:02.667 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off 2024-02-13T00:56:02.667 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-13T00:56:02.682 INFO:teuthology.orchestra.console.smithi106:Power off 2024-02-13T00:56:02.682 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-13T00:56:02.691 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-02-13T00:56:02.704 DEBUG:teuthology.orchestra.console.smithi106:power off output: Chassis Power Control: Down/Off 2024-02-13T00:56:02.704 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-13T00:56:02.726 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-02-13T00:56:06.692 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-13T00:56:06.727 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-13T00:56:06.802 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-02-13T00:56:06.838 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-02-13T00:56:10.804 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-13T00:56:10.839 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-13T00:56:10.914 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-02-13T00:56:10.948 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-02-13T00:56:11.016 INFO:teuthology.orchestra.console.smithi080:Power off completed 2024-02-13T00:56:14.953 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-13T00:56:15.061 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2024-02-13T00:56:15.162 INFO:teuthology.orchestra.console.smithi106:Power off completed 2024-02-13T00:56:15.266 INFO:teuthology.run:Summary data: description: rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} duration: 2606.3159317970276 failure_reason: '"2024-02-13T00:37:54.257551+0000 mon.a (mon.0) 861 : cluster [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log' flavor: default owner: scheduled_lflores@teuthology success: false 2024-02-13T00:56:15.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-13T00:56:15.355 INFO:teuthology.run:FAIL